Receive the latest technology news and information.

	Computerworld Daily News (First Look and Wrap-Up)
	Computerworld Blogs Newsletter
	The Weekly Top 10
	Cloud Computing

View all newsletters

E-mail Address:

Industry:

Job Title:

Company Size:

Country:

State:

I would like to receive offers via e-mail from Computerworld partners.

2006 Computerworld Horizon Awards

2006 Horizon Awards Winner: IBM Almaden Research Center's Business Insights Workbench

Next-generation tool adds analytics and insight to its search of structured and unstructured data.

Gary Anthes Today’s Top Stories

or Other Software Stories

August 21, 2006

Eight years ago, there were plenty of tools to search and analyze structured data, and even a few to go after unstructured information such as free-form text. But the two kinds of tools were not integrated, according to Jeffrey Kreulen, senior manager of service-oriented technologies at IBM's Almaden Research Center in San Jose. And the most sophisticated analytic tools used esoteric mathematical techniques that pretty much kept them out of the hands of nontechnical users.

The IBM lab is now into the third generation of tools to address those limitations. In 1998, it developed a prototype called eClassifier, basically a collection of algorithms for mining call center data. It was used internally at IBM to answer questions such as, "What are my top 10 problems?"

IBM Almaden
Research Center
www.research.ibm.com/biw

PRODUCT: Business Insights Workbench

KEY DEVELOPER: Jeffrey Kreulen

The idea, says Kreulen by way of example, was that if 10% of all calls dealt with password-reset issues, 10% of calls might be eliminated by automating the password-reset task.

But eClassifier was limited in both usefulness and usability, and it was replaced by a second-generation tool called BIKM, for business intelligence/ knowledge management. The tool was designed to find a way to go after both structured and unstructured information simultaneously. The BI part focused on transactional kinds of data, such as financial records, while the KM part dealt with the kinds of unstructured text that can run into the petabytes at many companies, Kreulen says. But BIKM was primarily about search and retrieval. "The next phase is what BIW is about," Kreulen says of the Horizon-award-winning Business Insights Workbench. "It's about how to do analytics on top of that; how to create actionable insights for your business that search just can't do."

These insights are enabled by human expertise built into BIW in the form of taxonomies — natural classifications of data that emerge from clustering algorithms. A user might start with his own taxonomies, such as what he believes are the top 10 reasons for customer calls, but then BIW can refine and improve those by a process called machine learning. More powerful machine learning techniques are a focus of research today at Almaden, Kreulen says.

Business Insights Workbench combines the search and retrieval capabilities of typical business intelligence and knowledge management tools with analytics, powered by human expertise and

The other major improvement in this third-generation tool is that it is more accessible to lay users, Kreulen says. "We are striving for a broader audience; we don't want our users to have to be Ph.Ds," he says.

"A great deal of information is lost because it is buried in unstructured data that is difficult to mine," says Joe Drouin, CIO at TRW Automotive Holdings Corp. in Livonia, Mich., and one of this year's Horizon judges. "Finding those critical nuggets of information and presenting them in a way to enable better decision-making is a daunting task."

"IBM's concept for pulling this all together and offering a set of integrated tools, on top of a framework for aggregating and consolidating structured and unstructured data from a wide variety of sources, holds a great deal of promise," Drouin adds.

BIW isn't a product but is part of the tool kit that IBM carries on consulting engagements. It is being used in call centers, where service representatives enter structured information as coded values, as well as unstructured, free-form text such as comments and problem descriptions. "Often, the unstructured information is a lot more valuable than the structured information," Kreulen observes.

A more futuristic application of BIW would be to mine and analyze e-mail messages, either those of employees or customers, in support of risk assessment and compliance functions, Kreulen says.

See the complete Computerworld Horizon Awards special report.

Print this Story

Send Us Feedback

E-mail this Story

Digg this Story

Slashdot this Story

Report Contents

Featured Articles

	Google's Chrome OS hits BitTorrent
	New attack fells Internet Explorer
	iPhone owners demand to see Apple source code
	More top stories...

	Free Web apps to help organize your holidays
	Global warming research exposed after hack
	Some Nook e-readers won't make it for the holidays

See your link here

Windows 7 tricks: 20 top tips and tweaks

Getting to know Windows 7? Don't stop now: From speeding up taskbar thumbnails to reining in UAC, here are 20 ways to make Windows 7 act the way you want.

Review: Taking the Droid on the road

Is Motorola's new Droid good enough to vanquish iPhone envy? To find out, we took it on a 3-day trip.

Opinion: Linux desktop turns 10; world yawns

Sure, you could always use Linux as a desktop OS, but Corel Linux 1.0 was the first distro designed for ordinary users. It's been a long, strange trip since then.