IBM: Watson could boost confidence of financial industry
IDG News Service - The software that helped IBM's Watson computer reign victorious on the Jeopardy game show in February could also help the financial industry assess risk more effectively, a pair of IBM executives stated on Monday at a high-performance computing conference.
"The financial community is always interested in reducing risk and being more assured of their decisions. The analytics behind Watson can help with some of that," said Jean Staten, IBM's director of cross-company Linux usage, in an interview with IDG.
Watson's ability to judge the confidence of an answer it provides to a user query could help further speed split-second decision-making process in the financial community, the two noted.
In each episode, after host Alex Trebek asked the contestants a question, Watson's best three answers would be posted on the bottom of the screen, along with a self-assessed confidence rating -- ranging from 0% to 100% -- how likely each answer was correct. The greater the confidence level, the more likely the given answer would actually be correct, according to the machine.
That ability to rank the probable validity of computer-generated answers could be valuable to the financial community, Staten noted. Using an organization's internally collected data, such a feature would also allow hedge fund managers, for instance, to quickly make more informed decisions about investments to make, or to avoid.
The Watson system, when asked a question, will seek to find as many probable answers for that question as it can, explained Epstein. Each answer it produces will contain a confidence level, or an assessment of whether the answer is the correct one, based on analysis of the source of the data, the structure of the question, and other factors.
This approach is "representative of really of what we do in everyday life. When we make decision, we have level of confidence of these decisions," Staten said, adding that we rarely know with absolute certainty whether our answer to some question is the correct one.
In Jeopardy, Watson would submit an answer if it had a confidence rating of around 80% or higher. Within organizations, the threshold of what constitutes a correct or a reliable answer could be calculated by using a set of training data, Staten said.
The Watson system used a variety of open source technologies to help generate answers, each with its own set of algorithms for deriving answers. The Apache Hadoop data processing framework was used for preprocessing the vast amounts of unstructured data that IBM had collected for the challenge. The Apache UIMA (Unstructured Information Management Architecture) provided the framework for deploying search engines, such as Apache Lucene and the Indri inference engine, that would figure out the best answers from a variety of perspectives.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- The Benefits of IBM: The Savings of Open Source Download Now
- Is Your Big Data Solution Production-Ready? Read "Is Your Big Data Solution Production-Ready?" now, and discover best practices and actionable steps to implementing a production-ready big data solution.
- Pay-as-you-Grow Data Protection: IBM Tivoli's Full-featured Data Protection Suite for Small to Medium Businesses IBM Tivoli Storage Manager Suite for Unified Recovery gives small and medium businesses the opportunity to start out with only the individual solutions...
- Streamline Data Protection with IBM Tivoli Storage Manager Operations Center IBM Tivoli Storage Manager (TSM) has been an industry-standard data protection solution for two decades. But, where most competitors focus exclusively on Backup...
- Webinar: Building a Big Data solution that's production-ready Big data solutions are no longer just a nice-to-have.
- Meg Whitman presents Unlocking IT with Big Data During this Web Event you will hear Meg Whitman, President and CEO, HP discuss HAVEn - the #1 Big Data platform, as well... All Open Source White Papers | Webcasts