User Interfaces: See me, hear me...
New computer interfaces may respond to gestures and speech.
Computerworld - Computers of the future may perform tasks based on what you say to them, how you gesture or even where you look. But that doesn't mean your keyboard and mouse are going away anytime soon.
"There's never a need to throw away something that works," says Joseph Olive, a director at the multimedia communications research laboratory at Lucent Technologies Inc.'s Bell Labs.
Researchers working on new generations of interfaces are taking a pragmatic approach to how we'll interact with machines, adding support for text, speech, gaze, gesture and more, depending on circumstances and what seems to make sense.
Ideally, tomorrow's computers will be better at anticipating what users want, without needing typed commands. This will involve "context-aware" interfaces, according to Ted Selker, head of the context-aware computing research group at MIT's Media Lab. That might mean a Web application will be able to sense both your mouse and eye movements to determine whether you've visited a site before and what items most interest youand then dynamically generate a page based on those interests.
By 2006, Selker says, "the computer will know more about why you're doing what you're doing and what it can do to help you."
Say What?
Speech-recognition software is already making inroads in telephone-based customer service applications. Today's systems are often limited to narrow uses, such as saying the name of a company to get a stock quote. Work on broader-based systems is under way, though.
"What we're vigorously researching . . . is to let you speak much more freely," Olive says. Murray Hill, N.J.-based Lucent recently tested a prototype of an automated phone operator at a financial institution. Callers could say things like "I lost my checkbook" instead of wading through menu options.
The test involved routing callers to one of about 40 departments. About 8% of the calls had to be switched to a human receptionist because requests weren't specific enough. Among calls handled by the computer, the accuracy rate was 96%, Olive said.
Speech-recognition experts believe the technology will be increasingly used in mobile applications. After all, says Mike Phillips, chief technology officer at SpeechWorks International Inc. in Boston, it's tough to design an easy- to-use knob interface for a car MP3 player that's got a few thousand songs stored in it.
Other potential uses include more sophisticated hands-free dialing as well as climate control systems.
Speech recognition should also make it easier to use a small device to access data stored on a larger one. "Basically, anything that's on your desktop will be available to you by voice," Olive predicts.



- Excel 2010 Cheat Sheet
- Register for this Computerworld Insider Cheat Sheet and gain access to hundreds of premium content articles, guides, product reviews and more.
- VMware View Optimization Guide for Windows 7
- This document provides guidelines for configuring a standard Windows 7 image to be used within a VMware View™ environment, providing administrators with the...
- Watson - A System Designed for Answers. The future of workload optimized systems design
- Watson is a workload optimized system designed for complex analytics, made possible by integrating massively parallel POWER7 processors and DeepQA technology. Read the...
- Overcome Top 7 Admin Challenges of Active Directory
- As Active Directory's role in the enterprise has drastically increased, so has the need to secure the data. Gain insight on creating repeatable,...
- Insiders Can Ruin Your Company. Take Action.
- Did you know that 80 percent of threats to an organization come from the inside? The threat from insiders is often overlooked in...
- Top Solutions and Tools to Prevent Devastating Malware
- Custom malware frequently goes undetected. According to Forrester Research, the best way to reduce risk of breach is to deploy file integrity monitoring... All Operating Systems White Papers
- Optimizing Networks for the Cloud
- Join guest speaker, Rohit Mehra, IDC Director of Enterprise Communications Infrastructure, to explore current trends, discuss best practices for optimizing Data Center and...
- Apps QuickStart Series Part 2: Designing and Deploying SQL Server on VMware vSphere
- Download this webcast to learn about the design considerations for virtualizing SQL workloads, performance and scalability information and high-availability options, as well as...
- Apps QuickStart Series Part 1: Designing and Deploying Exchange 2010 on VMware vSphere
- Download this webcast to learn the virtual hardware design considerations for Exchange 2010, deployment using the building block approach, options for high-availability and...
- Customer Spotlight: How IPC The Hospitalist Company Implemented Oracle on VMware
- Have you been looking to hear about customer's experiences with the new VMware vCenter Site Recovery Manager product? View this webcast to learn...
- Virtualize Business-Critical Applications with Confidence
- Virtualizing business-critical applications has become a key focus for organizations as they move along their virtualization journey. With the launch of VMware vSphere®... All Operating Systems Webcasts