Apple was just granted a patent by the US Patent and Trademark Office (via Patently Apple) detailing 3D display & imaging technologies that could potentially lead to advanced Kinect-like navigation through performing gestures or manipulating holographic images within a virtual 3D space.
Essentially, this would allow you to perform hand gestures within a virtual space while your hands are displayed on a screen, allowing for precise manipulation of on-screen elements.
The patent’s inventor also notes that these imaging technologies could be used for presence detection, head tracking, and auxiliary display capabilities as well. We can’t help think of Kinect-like gaming for a potential future Apple TV, although the extent of the gestures and tech described in the patent goes well beyond current implementations.
As Patently Apple notes, the “virtual elements have no real physical embodiment” but could potentially take advantage of holographic technology that the same inventor outlined in a previous Apple patent. The application could also include audio feedback. For example a clicking sound when pressing a button within the virtual space would provide confirmation of the action.
Patently Apple explains:
The best 4K & 5K displays for Mac
“a user would place his or her left hand 120 and/or right hand 122 into the imaging volume or space. The hands would then be detected by the scanning beam. A left hand image 124 and a right hand image 126, respectively, would then be projected by the projection beam onto the display area to provide immediate feedback to the user concerning the relationship between the user’s hands and the various virtual objects within the imaging volume or space. Thus, as depicted, the user could grasp one of the knob images with the left hand by moving the left hand until the left hand image indicates that the selected virtual knob (not shown) represented by the corresponding knob image has been engaged. The knob could then be grasped and manipulated such as by rotating the knob.”
One can only imagine the implications this could have on games and business apps running on a future Apple TV. However, it appears the tech could be used as a global navigation method rather than geared towards a specific application. The patent even touches on potential uses for mobile devices such as an “interactive virtual keyboard” that would detect “finger locations and moves”.