06 December 2011

6th sense

from the official website :-
'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.
The SixthSense [prototype] comprises a pocket projector, a mirror and a camera contained in a pendant like, wearable device.
The projector projects visuals enabling any physical surfaces, walls and objects around us to be used as interfaces/screens ;
while the camera recognizes and tracks users' hand gestures and objects using computer-vision techniques.
The software program in the computing device in user's pocket  processes the video stream data that is  captured by the camera and tracks the locations of the colored markers at the tips of the user’s fingers.
The movements and arrangements of these markers are interpreted into gestures that act as interaction instructions for the projected application interfaces.
SixthSense supports multi-touch and multi-user interaction.

The current prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system. a few examples are ,The map application , The drawing application

 SixthSense also recognizes user’s freehand gestures (postures). For example, the SixthSense system implements a gestural camera that takes photos of the scene the user is looking at by detecting the ‘framing’ gesture.
The user can stop by any surface or wall and flick through the photos he/she has taken.
 SixthSense also lets the user draw icons or symbols in the air using the movement of the index finger and recognizes those symbols as interaction instructions. For example, drawing a magnifying glass symbol takes the user to the map application
 The SixthSense system also augments physical objects the user is interacting with by projecting more information about these objects projected on them. For example, a newspaper can show live video news or dynamic information can be provided on a regular piece of paper. The gesture of drawing a circle on the user’s wrist projects an analog watch.

as per the official website , The current prototype system costs approximate $350 to build. Instructions on how to make your own prototype device can be found here

the maker , also an indian, is pranav mistry he has made this really nice gadget on windows platform in C/C++
the instructions to make your own , do not yet, have the software but let us wait for it :D
this really makes me think of what is possible in the future where we can interact with our friends not in a screen but on a real-sized wall projection! all in all a great projects there are a few remakes done by aspiring people but none of those that i saw were seriously comparabe to the original
here's a vid.

enjoy the vid and  Happy Geeking  :D