Defining 'big data' depends on who's doing the defining
Big data is an IT buzzword nowadays, but what does it really mean? When does data become big?
Network World - Big data is an IT buzzword nowadays, but what does it really mean? When does data become big?
At a recent Big Data and High Performance Computing Summit in Boston hosted by Amazon Web Services (AWS), data scientist John Rauser mentioned a simple definition: Any amount of data that's too big to be handled by one computer.
Some says that's too simplistic. Others say it's spot on.
CLOUD TRENDS: New bare metal cloud offerings emergingA
"Big data has to be one of the most hyped technologies since, well the last most hyped technology, and when that happens, definition become muddled," says Jeffrey Breen of Atmosphere Research Group.
The lack of a standard definition points to the immaturity of the market, says Dan Vesset, IDC program vice president of the business analytics division of the research firm. But, he isn't quite buying the definition floated by AWS. "I'd like to see something that actually talks about data instead of the infrastructure needed to process it," he says.
Others agree with the AWS definition.
"It may not be all inclusive, but I think for the most part that's right," says Jeff Kelly, a big data analytics analyst at the Wikibon project. Part of the idea of big data is that it's so big that analyzing it needs to be spread across multiple workloads, hence AWS's definition. "When you're hitting the limits of your technology, that's when data gets big," Kelly says.
One of the most common definitions of big data uses three terms, all of which happen to start with the letter V: volume, velocity and variety. Many analyst firms, such as IDC and companies, such as IBM, seem to coalesce around this definition. Volume would mean the massive amount of data generated and collected by organizations; velocity, refers to the speed at which the data must be analyzed; and variety means the vast array of different types of data that is collected, from text, to audio, video, web logs and more.
But some are skeptical of that definition, too. Breen has a fourth "v" to add to the definition: vendor.
Companies such as AWS and IBM tailor definitions to support their products, Breen says. AWS, for example, offers a variety of big data analytic tools, such as Elastic Map Reduce, which is a cloud-based big data processing feature.
"The cloud provides instant scalability and elasticity and lets you focus on analytics instead of infrastructure," Amazon spokesperson Tera Randall wrote in an e-mail. "It enhances your ability and capability to ask interesting questions about your data and get rapid, meaningful answers." Randall says Rauser's big data definition is not an official AWS definition of the term, but was being used to describe the challenges facing business management of big data.
- Silicon Valley's 19 Coolest Places to Work
- Is Windows 8 Development Worth the Trouble?
- 8 Books Every IT Leader Should Read This Year
- 10 Hot Hadoop Startups to Watch
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- Going Paperless? Here's What You Need to Think About As makers of some of the world's most popular PDF solutions, we often consult with businesses & governmental agencies that have the goal...
- The Big Data Opportunity for HR and Finance If CEOs, CFOs, CIOs, and CHROs want to drive their businesses forward, they will need to quickly recognize the enormous value of big...
- The New Business Case for Video Conferencing: 7 Real-World Benefits Beyond Cost-Savings This whitepaper provides insight into the value of video conferencing in today's business environment, and how organizations are using visual collaboration to find...
- The Value of IBM InfoSphere BigInsights The IBM® InfoSphere® BigInsights™ software platform helps firms discover and analyze business insights hidden in large volumes of a diverse range of data....
Transforming Finance, Procurement and Supply Chain Effectiveness with Cross-Functional Analytics
Date: May 6th, 2014
Time: 1 PM EDT
Attend this Webcast to find out how Oracle's packaged analytic applications enable line-of-business managers to examine all...
- Unified Communications 101 What's the best way to implement a unified communications solution for your organization? Join independent networking expert, Ed Tittel, as he weighs the... All Business Intelligence/Analytics White Papers | Webcasts