Skip the navigation

'Minority Report'-style goggles enable interaction with floating display

Heads-up display can be used with any number of computer devices

October 23, 2013 04:38 PM ET

Computerworld - A Taiwan-based nonprofit R&D organization announced Wednesday a virtual display that allows users to control virtual keyboards and touchscreens that float out in front of users.

The Industrial Technology Research Institute (ITRI) said its new technology uses special glasses and DDDR (defined distance with defined range) camera technology to allow users to see and interact with virtual data, images and devices with finger strokes.

The heads-up display technology resembles the sci-fi technology displayed in the movie Minority Report, starring Tom Cruise.

The new i-Air Touch technology is being developed for an array of devices, including PCs and laptops, wearable computers and mobile devices, that allows a user's hand to be free of any physical device such as a touchpad or keyboard for touch input.

i-Air Touch
i-Air Touch glasses allow virtual interaction with computer screens.

i-Air Touch's see-through capability enables a user wearing a pair of special eyeglasses to see and interact with a virtual input device, such as a touchscreen or mouse that appears to be floating in the air, while still being able to see and interact with the real world.

"i-Air Touch creates new possibilities for wearable and mobile computing by freeing users from the distraction of locating and touching keys on a physical input device for hands-free computing and improving security over voice commands," Golden Tiao, deputy general director of ITRI's Electronics and Optoelectronics Research Laboratories, said in a statement.

ITRI plans to license the patented technology to manufacturers. The company sees the heads-up display technology being used in not only consumer arenas, but also for medical applications such as endoscopic surgery and any industrial applications that benefit from hands-free input.

The DDDR camera is the key functional component of i-Air Touch, ITRI said. The camera discerns the virtual images for interaction, but it conserves battery power, which is a major issue facing manufacturers of many wearable computers, the company stated.

How it works

The camera uses a phase- and color-coded lens to discern an object at a predetermined distance of 11 inches to 12.5 inches away from the eyeglasses. The camera detects and activates only in the presence of a fingertip within that input range. The virtual images shut off if a user's fingertip isn't present, allowing a clear field of view.

The DDDR camera essentially captures the image of a user's fingertip out in front of it and splits the image into green and red color codes to provide segmentation in image processing, while phase coding provides distance and depth perception of the fingertip.

i-Air Touch
i-Air Touch allows multiple screen/keyboard interaction.

The DDDR camera lens focuses the green light component at 11 inches and the red at 12.5-inches. The combined green and red components resolve to the strongest image signal at the midpoint between the two light components (about 11 13/16-in). The camera then captures the image signal at that midpoint as "input."

Because the camera does not register signals outside of the 11-in.-to-12.5-in. virtual target plane, it consumes no power other than when a fingertip is present.

Additionally, by detecting when a user's fingertip is in input range, the camera ensures that the user is intentionally trying to air-touch the virtual input device and that the camera does not mistake other user movements for input.

"A successful virtual touch triggers i-Air Touch to send a signal to the host device (a computer, laptop, smartphone, etc.) signifying that a key has been pressed or a touchscreen function has been touched," ITRI stated in a news release.

While the glasses cannot take photos, like Google Glass, they can be used with cameras in others kinds of wearable computers, the company said.

i-Air Touch technology is a real-world implementation of having a fictitious computer touch screen floating in the air. Similar to what has been seen in movies, such as Minority Report, i-Air Touch works as a virtual keyboard or touch screen for a computer or other interactive devices like a smartphone.

This article, 'Minority Report'-style goggles enable interaction with floating keyboards, was originally published at Computerworld.com.

covers storage, disaster recovery and business continuity, financial services infrastructure and health care IT for Computerworld. Follow Lucas on Twitter at Twitter @lucasmearian or subscribe to Lucas's RSS feed Mearian RSS. His e-mail address is lmearian@computerworld.com.

See more by Lucas Mearian on Computerworld.com.

Read more about Emerging Technologies in Computerworld's Emerging Technologies Topic Center.



Our Commenting Policies
Internet of Things: Get the latest!
Internet of Things

Our new bimonthly Internet of Things newsletter helps you keep pace with the rapidly evolving technologies, trends and developments related to the IoT. Subscribe now and stay up to date!