We humans,interact with the world using our five senses.But as the name suggests this technology brings forward an additional sixth sense.A sixth sense is an ESP(Extra Sensory Perception) that aims at a more developed future with both the physical and digital world connected without the help of hardware devices.We came a step nearer to this goal of the sixth sense by the introduction of sixth sense technology.

The sixth sense technology employs a sixth sense which is in reality a wearable pendent like device.This device is actually a mini projector coupled with a camera and a cell phone ,designed for obeying hand gestures.Using simple hand gestures,touch screens can be obtained from any surface for various applications.

The origin of sixth sense technology can be  traced back to Steve Mann who implemented a wearable computer in the form of neck-projector coupled with a camera system in 1990.In later years,following his footsteps,Pranav Mistry ,a young research scientist at MIT came up with new applications of this technology.Thus ,the sixth sense technology was developed at Media labs in MIT and was coined as Wear Ur World(WUW).

The device has various applications such as the drawing application in which movement of the index finger is recognized and the user can draw on any surface.The other applications include mapping,reading newspaper,checking time by drawing a wrist watch etc.Other than being portable,this device also serves as a computer and saves time spent on searching information.


The hardware components are coupled in a pendant like mobile wearable device.

  • Camera
  • Projector
  • Mirror
  • Mobile Component
  • Color Markers

Camera:If there is any object in view,then the object is recognized by the webcam and using computer-vision based techniques the users gestures are tracked and it sends the data to the smartphone.


Projector:The projetor projects the visual information on any surface, including the object itself or your hand. The project itself contains a battery inside,with 3 hours of battery life. The projector showcases the  information enabling surfaces, walls and physical objects around us to be used as interfaces



Mirror:The downward-facing projector projects the output image on to the mirror

And the  mirror reflects this image on to the desired surface.



Mobile Component:The  mobile devices like the smartphone are used to handle connection to the internet.Using mobile internet data and voice can be communicated  across the world either by transmitting or by receiving it.Similarly video data can  also be processed by a web enabled  smartphone.



Colour Markers:The software program processes the video stream data captured by the camera and tracks the locations of the colored markers at the tip of the user’s fingers. The movements and arrangements of these markers are then interpreted into gestures.



The object in view in captured by the camera and sends it to webcam for processing.With the help of the markers,the gestures are identified. The software program analyses the video data caught by the camera and also tracks down

the locations of the coloured markers by utilising single computer vision techniques.

The software recognizes 3 kinds of gestures:

  • Multitouch gestures
  • Freehand gestures
  • Iconic gestures

Then the processed information is  projected by the projector onto the mirror which inturn reflects it on the desired surface.





  • The drawing application lets user draw on any surface by observing the movement of index finger


  • SixthSense also lets the user draw icons or symbols in the air using the movement of the index finger and recognizes those symbols as interaction instructions. For example, drawing a magnifying glass symbol takes the user to the map application or drawing an ‘@’ symbol lets the user check his mail.
  • Mapping can also be done anywhere with the features of zooming in or zooming out.


  •  Some of the more practical uses are reading a newspaper.


  •  The device can also tell us arrival, departure or delay time of our air plane on our tickets.


  •  In the case of more information needed , pick any page and the device gives additional information on the text, comments and lot more add on features and also helps us to view the rating and to add more.
  •  To know the time, all one has to do is to just gesture drawing circle on the wrist and there appears a wrist watch.


  • Call can be made by typing the numbers on the hand. It display the keypad of the phone over your palm and the keys appears on the four finger… Use your another hand’s finger to press the keys.



Sixth sense technology  is thus one of  the  best technologies ever found.It leads the way for a more developed tomorrow with no bridge between the physical and digital world.Being a variant of artificial intelligence,this technology relates itself to numerous other technologies like Augmented reality,Gesture Recognition,Radio Frequency Identification,Sixth Sense washing machine etc.