2006 Horizon Awards Winner: IBM Almaden Research Center's Business Insights Workbench

Gary Anthes   Today’s Top Stories   or  Other Software Stories  

Four Ways to Improve Your TSM Environment with a SEPATON VTL Data Protection is not an Insurance Policy - You Cannot Buy-back Lost Data. Showcase ISV Products with BIRT Oracle Accelerate - Not Just Smart but Timely Why BI is Ripe - Now! - For Businesses of Any Size How Midsize Businesses Are Using ERP To Gain Competitive Advantage in a Tough Economy Computerworld Technology Briefing: More than Business Value Computerworld Briefing: Staffing for Intelligence 8 Questions To Ask About Your Intrusion-Security Solution Sign up to receive Software Resource Alerts

August 21, 2006

Eight years ago, there were plenty of tools to search and analyze structured data, and even a few to go after unstructured information such as free-form text. But the two kinds of tools were not integrated, according to Jeffrey Kreulen, senior manager of service-oriented technologies at IBM's Almaden Research Center in San Jose. And the most sophisticated analytic tools used esoteric mathematical techniques that pretty much kept them out of the hands of nontechnical users.

The IBM lab is now into the third generation of tools to address those limitations. In 1998, it developed a prototype called eClassifier, basically a collection of algorithms for mining call center data. It was used internally at IBM to answer questions such as, "What are my top 10 problems?"

The idea, says Kreulen by way of example, was that if 10% of all calls dealt with password-reset issues, 10% of calls might be eliminated by automating the password-reset task.

But eClassifier was limited in both usefulness and usability, and it was replaced by a second-generation tool called BIKM, for business intelligence/ knowledge management. The tool was designed to find a way to go after both structured and unstructured information simultaneously. The BI part focused on transactional kinds of data, such as financial records, while the KM part dealt with the kinds of unstructured text that can run into the petabytes at many companies, Kreulen says. But BIKM was primarily about search and retrieval. "The next phase is what BIW is about," Kreulen says of the Horizon-award-winning Business Insights Workbench. "It's about how to do analytics on top of that; how to create actionable insights for your business that search just can't do."

These insights are enabled by human expertise built into BIW in the form of taxonomies — natural classifications of data that emerge from clustering algorithms. A user might start with his own taxonomies, such as what he believes are the top 10 reasons for customer calls, but then BIW can refine and improve those by a proc­ess called machine learning. More powerful machine learning techniques are a focus of research today at Almaden, Kreulen says.

"A great deal of information is lost because it is buried in unstructured data that is difficult to mine," says Joe Drouin, CIO at TRW Automotive Holdings Corp. in Livonia, Mich., and one of this year's Horizon judges. "Finding those critical nuggets of information and presenting them in a way to enable better decision-making is a daunting task."

"IBM's concept for pulling this all together and offering a set of integrated tools, on top of a framework for aggregating and consolidating structured and unstructured data from a wide variety of sources, holds a great deal of promise," Drouin adds.

BIW isn't a product but is part of the tool kit that IBM carries on consulting engagements. It is being used in call centers, where service representatives enter structured information as coded values, as well as unstructured, free-form text such as comments and problem descriptions. "Often, the unstructured information is a lot more valuable than the structured information," Kreulen observes.

A more futuristic application of BIW would be to mine and analyze e-mail messages, either those of employees or customers, in support of risk assessment and compliance functions, Kreulen says.

See the complete Computerworld Horizon Awards special report.

Print this Story

Send Us Feedback

E-mail this Story

Digg this Story

Slashdot this Story

Attacks likely against Windows, PowerPoint, researchers say Chinese artist-dissident lauds Google plan to stop censoring Judge dismisses Windows anti-piracy software lawsuit More top stories...

Google Buzz takes the fight to Facebook, Twitter Micron acquires flash memory maker Numonyx New Russian botnet tries to kill rival

See your link here

Editors' Picks Top 10 Super Bowl tech ads Watch the most compelling Super Bowl ads of years past from the likes of Intel, Iomega, EDS, Apple and Xerox, then vote for your favorite in our reader poll. Is NAND flash about to hit a dead end? As the technology used to create NAND flash memory continues to shrink, bit error rates and reliability issues are increasing, forcing solid-state memory makers to look for alternatives. IT careers: How to cope with an unsupportive boss You're ready to advance, but your manager is asleep at the switch. Here's how to get ahead without a boost from your boss. 4 free video editors bring out your inner filmmaker These applications can help you turn your raw video into a snazzy presentation. IT Jobs See All Jobs Post a job for $295 Go Jobs by SimplyHired hot topics Windows 7 Get the latest news, reviews and more about Microsoft's newest desktop operating system. Apple E-book readers Google iPhone Mac A to Z Microsoft » See more hot topics special report topics View the top-rated IT workplaces. General Mills, Genentech, San Diego Gas & Electric, University of Pennsylvania and Monsanto top the list. More Special Reports 2008 Best Places to Work in IT 2007 Best Places to Work in IT 2009 Salary Survey 2008 Salary Survey 2007 Salary Survey 2010 Premier 100 IT Leaders 2009 Premier 100 IT Leaders 2008 Premier 100 IT Leaders 2008 IT Forecast 2007 IT Forecast 40 Years of Computerworld Top Green-IT 2009 Top Green-IT 2008 The FAQs About Going Green IT Schools to Watch iPhone: One Year Later Global Mobile Your Next Data Center Management: Reinventing IT Stop Data Leaks Web 2.0 Security Surviving Disasters Managing Storage Virtualization The Lean Storage Machine Storage on Trial Can Web 2.0 Save BI? Bypass These BI Potholes All Zones The SAS Zone Software Resource Center Mobile Security Disaster Recovery & Cost Savings Strategic Content Management Business Analytics Zone

• Attacks likely against Windows, PowerPoint, researchers say
• Google Buzz takes the fight to Facebook, Twitter
• Chinese artist-dissident lauds Google plan to stop censoring
• More top stories 

Strategic Content Management Learn how the right Enterprise Content Management (ECM) solution can start saving you money within a week and pay for itself in as little as three months. These case studies and white papers provide practical information on how to go from theory to reality - to help you put together a plan that will achieve your content management and process automation goals. Enter the Strategic Content Management Zone now

Best Places to Work in IT Where can you earn top dollar, get the best benefits, the latest IT and more? Find out in our 14th annual survey.