Skip the navigation

User Interfaces: See me, hear me...

New computer interfaces may respond to gestures and speech.

By Sharon Machlis
August 26, 2002 12:00 PM ET

Computerworld - Computers of the future may perform tasks based on what you say to them, how you gesture or even where you look. But that doesn't mean your keyboard and mouse are going away anytime soon.


"There's never a need to throw away something that works," says Joseph Olive, a director at the multimedia communications research laboratory at Lucent Technologies Inc.'s Bell Labs.


Researchers working on new generations of interfaces are taking a pragmatic approach to how we'll interact with machines, adding support for text, speech, gaze, gesture and more, depending on circumstances and what seems to make sense.


Ideally, tomorrow's computers will be better at anticipating what users want, without needing typed commands. This will involve "context-aware" interfaces, according to Ted Selker, head of the context-aware computing research group at MIT's Media Lab. That might mean a Web application will be able to sense both your mouse and eye movements to determine whether you've visited a site before and what items most interest you—and then dynamically generate a page based on those interests.


By 2006, Selker says, "the computer will know more about why you're doing what you're doing and what it can do to help you."


Say What?


Speech-recognition software is already making inroads in telephone-based customer service applications. Today's systems are often limited to narrow uses, such as saying the name of a company to get a stock quote. Work on broader-based systems is under way, though.


"What we're vigorously researching . . . is to let you speak much more freely," Olive says. Murray Hill, N.J.-based Lucent recently tested a prototype of an automated phone operator at a financial institution. Callers could say things like "I lost my checkbook" instead of wading through menu options.


The test involved routing callers to one of about 40 departments. About 8% of the calls had to be switched to a human receptionist because requests weren't specific enough. Among calls handled by the computer, the accuracy rate was 96%, Olive said.


Speech-recognition experts believe the technology will be increasingly used in mobile applications. After all, says Mike Phillips, chief technology officer at SpeechWorks International Inc. in Boston, it's tough to design an easy- to-use knob interface for a car MP3 player that's got a few thousand songs stored in it.


Other potential uses include more sophisticated hands-free dialing as well as climate control systems.


Speech recognition should also make it easier to use a small device to access data stored on a larger one. "Basically, anything that's on your desktop will be available to you by voice," Olive predicts.



Additional Resources
Forrester Consulting - Optimizing Users and Applications in a Mobile World
WHITE PAPER
Solving application issues over the WAN requires careful consideration. Based on their independent research, Forrester Consulting offers recommendations on how to tackle application performance issues, insufficient bandwidth and the inability to quickly restore users in a disaster.

Read now.

Security KnowledgeVault
WHITE PAPER
Security is not an option. This KnowledgeVault Series offers professional advice how to be proactive in the fight against cybercrimes and multi-layered security threats; how to adopt a holistic approach to protecting and managing data; and how to hire a qualified security assessor. Make security your Number 1 priority.

Read now.

Cut Communications Costs Once and for All
WHITE PAPER
New IP-based communications systems are being deployed by small and midsized businesses at a rapid rate. Learn how these organizations are enabling faster responsiveness, creating better customer experiences, speeding office or mobile interactions, and dramatically reducing existing communications costs.

Read now.

Operating Systems White Papers
VMware View Optimization Guide for Windows 7
This document provides guidelines for configuring a standard Windows 7 image to be used within a VMware View™ environment, providing administrators with the...
Watson - A System Designed for Answers. The future of workload optimized systems design
Watson is a workload optimized system designed for complex analytics, made possible by integrating massively parallel POWER7 processors and DeepQA technology. Read the...
Overcome Top 7 Admin Challenges of Active Directory
As Active Directory's role in the enterprise has drastically increased, so has the need to secure the data. Gain insight on creating repeatable,...
Insiders Can Ruin Your Company. Take Action.
Did you know that 80 percent of threats to an organization come from the inside? The threat from insiders is often overlooked in...
Top Solutions and Tools to Prevent Devastating Malware
Custom malware frequently goes undetected. According to Forrester Research, the best way to reduce risk of breach is to deploy file integrity monitoring...
All Operating Systems White Papers
Operating Systems Webcasts
Optimizing Networks for the Cloud
Join guest speaker, Rohit Mehra, IDC Director of Enterprise Communications Infrastructure, to explore current trends, discuss best practices for optimizing Data Center and...
Apps QuickStart Series Part 2: Designing and Deploying SQL Server on VMware vSphere
Download this webcast to learn about the design considerations for virtualizing SQL workloads, performance and scalability information and high-availability options, as well as...
Apps QuickStart Series Part 1: Designing and Deploying Exchange 2010 on VMware vSphere
Download this webcast to learn the virtual hardware design considerations for Exchange 2010, deployment using the building block approach, options for high-availability and...
Customer Spotlight: How IPC The Hospitalist Company Implemented Oracle on VMware
Have you been looking to hear about customer's experiences with the new VMware vCenter Site Recovery Manager product? View this webcast to learn...
Virtualize Business-Critical Applications with Confidence
Virtualizing business-critical applications has become a key focus for organizations as they move along their virtualization journey. With the launch of VMware vSphere®...
All Operating Systems Webcasts
Newsletter Sign-Up

Receive the latest news test, reviews and trends on your favorite technology topics

Choose a newsletter
  1. View all newsletters | Privacy Policy
IT Jobs