Hadoop finds niche alongside conventional database systems
Computerworld - The growing need for companies to manage surging volumes of structured and unstructured data is continuing to propel enterprise use of open-source Apache Hadoop software.
But instead of replacing existing technologies, Hadoop appears to be working alongside conventional relational database management systems (RDBMS), according to a Ventana Research report released late last month.
Hadoop is designed to help companies manage and process petabytes of data. The technology's appeal lies in its ability to break up very large data sets into smaller data blocks that are then distributed across a cluster of commodity hardware for faster processing.
Early adopters, including Facebook, Amazon, eBay and Yahoo, use Hadoop to analyze petabytes of unstructured data that conventional RDBMS setups couldn't handle easily. Ventana's report, based on a survey of more than 160 companies, shows that a growing number of businesses have begun putting Hadoop to use for similar purposes.
The survey found that most of those companies are using Hadoop to collect and analyze huge volumes of unstructured and machine-generated information, such as log and event data, search-engine results and content from social media sites, said David Menninger, author of the Ventana report.
"In two-thirds of the cases, we found that people are using Hadoop for advanced analytics and for types of analysis that they were not doing before," he said.
The technology is much less likely to be used for analyzing conventional structured data such as transaction data, customer information and call records, where traditional RDBMS tools still appear to have an edge, Menninger said.
Despite Hadoop's early promise, the study said, enterprises that use it still face challenges related to issues such as security, clustering and a shortage of people with Hadoop skills.
This version of this story was originally published in Computerworld's print edition. It was adapted from an article that appeared earlier on Computerworld.com.
Read more about Applications in Computerworld's Applications Topic Center.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- What Datapipe customers need to know about the new PCI DSS 3.0 compliance standard This handy quick reference outlines what PCI DSS 3.0 is, who needs to be compliant and how Alert Logic solutions address the new...
- The 12 PCI DSS 3.0 requirements addressed by Peer 1 Hosting This handy quick reference outlines the 12 PCI DSS 3.0 requirements, who needs to be compliant and how Alert Logic solutions address the...
- Defense Throughout the Vulnerability Life Cycle This whitepaper provides insight into how to leverage threat and log management technologies to protect your IT assets throughout their vulnerability life cycle.
- The Critical Role of Support in Your Enterprise Mobility Management Strategy Most business leaders underestimate the importance of tech support when they choose an EMM solution. Here's what to put on your checklist.
- Live Webcast Best Practices for the Hyperconverged Enterprise Network To the Age of Constant Connectivity and Information overload
- Live Webcast Unmasking the Differences between Consumer and Enterprise File Sync & Share The consumerization of IT combined with the rapid pace of the modern mobile workplace is forcing enterprise IT teams to evaluate file sync...
- Live Webcast Government Agency Webifies Outdated COBOL Applications Let this CTO tell you how his agency converted 1980s-era green screens into an e-filing portal for the 100,000 cases handled each year...
- The New Way to Work Knowledge Vault This Knowledge Vault focuses on how, in today's increasingly virtual world, it's more important than ever to engage deeply with employees, suppliers, partners,...
- Getting Ready for BlackBerry Enterprise Service 10.2 Find out how BlackBerry® Enterprise Service 10 helps organizations address the full spectrum of EMM challenges, while balancing the needs of both the... All Applications White Papers | Webcasts