IBM releases unstructured data framework code as open-source
The company hopes to spur wider compatibility for complex text analytics apps
Computerworld - IBM today released the source code for its Unstructured Information Management Architecture (UIMA) to encourage independent software vendors (ISV) to use the framework for the creation of complex, enterprise-ready text analytics applications on a standards-based platform.
In an announcement today, IBM said the UIMA code is now available as an open-source development project on SourceForge.net.
While traditional content and knowledge management applications today allow users to search for terms, they don't allow searches for concepts or relationships between words in documents, Web sites or other text, said Marc Andrews, a spokesman for content discovery strategy and business development at IBM. Complex text analytics applications from various vendors do provide that kind of analysis, but plugging them into existing search applications can be difficult because of code compatibility issues, he said.
The idea behind UIMA is to have a standards-based platform developers can use to create specialized text analysis applications, which can then be tied in by users with the search applications of their choice. UIMA defines a common, standard interface that enables text analytics components from multiple vendors to work together.
"Customers [have] had to do the integrations themselves because there are no interfaces" between proprietary text analysis applications and search products, Andrews said. "They've had to custom-tie them together," which is often difficult and costly. "UIMA enables them to tie these things together more easily, providing plug-and-play in a common language."
Last August, IBM announced that more than 15 ISVs, including SAS Institute Inc., Cognos Inc., ClearForest Corp. and Attensity Corp., had pledged to support UIMA in their text analytics and search products (see "IBM releases open analytics interface"). IBM also introduced its own offering, IBM WebSphere Information Integrator OmniFind Edition, which is based on UIMA.
Text analytics can comb through documents, comment and note fields, problem reports, e-mail, Web sites and other text-based information sources, according to IBM, which worked on the development of UIMA for more than four years.
Several medical institutions are using UIMA to help organize huge amounts of unstructured data that could be useful in medical research, according to IBM.
The Mayo Clinic is using it to help extract and collect data from some 20 million clinical notes in medical records that will be used for research and to improve patient treatments. The Memorial Sloan-Kettering Cancer Center is extracting data on cancer treatments from its records to search for new cancer treatments.
In addition, the International Federation of Pharmaceutical Manufacturers and Associations, a worldwide industry body that represents pharmaceutical companies, recently deployed a portal of clinical trial information that uses the UIMA frameworkwith IBM's OmniFind application to identify medical terms and concepts. That allows doctors, pharmacists, researchers and others to search by disease area or medicine names. The tool even recognizes synonyms across multiple languages. The portal will be used to bring together content from a number of existing clinical trial registries and databases, allowing doctors and patients to review summarized results and find trials they can join, according to IBM.
Read more about App Development in Computerworld's App Development Topic Center.
- Path Selection Infographic Path Selection Infographic
- Hyperconvergence Infographic A wide range of observers agree that data centers are now entering an era of "hyperconvergence" that will raise network traffic levels faster...
- Preparing Your Infrastructure for the Hyperconvergence Era From cloud computing and virtualization to mobility and unified communications, an array of innovative technologies is transforming today's data centers.
- Increase IT Performance from the Enterprise to the Cloud with WAN Optimization Massive consolidation and data mobility, enabled by virtualization, have radically altered how we build servers, design applications, and deploy storage for the emerging...
- Live Webcast
Transforming Finance, Procurement and Supply Chain Effectiveness with Cross-Functional Analytics
Date: May 6th, 2014
Time: 1 PM EDT
Attend this Webcast to find out how Oracle's packaged analytic applications enable line-of-business managers to examine all...
- Video Stream Quality Impacts Viewer Behavior This scientific white paper, using statistical data from Amakai's streaming network, analyzes how changes in video quality cause changes in viewer behavior.
- Service-Enabling CICS Applications: Best Practices This informative webcast provides an informed, thorough look into CICS service-enablement options and how they can affect your environment. You'll learn how to... All Applications White Papers | Webcasts