Big Data Watch

Google focused on big data, real-time analysis in the cloud

The next year should see new services, tools to manage big pipelines

Big Data Watch

Show More

When it comes to big data, many enterprises are getting slammed with big problems. That's why Google will focus on helping those large companies over the next year.

Greg DeMichillie, director of product management for Google's cloud team, said the announcement of Cloud Dataflow during the Google I/O keynote on Wednesday is just the beginning of its big data push.

"Data flow is the first of what we're doing to help people make sense of the data that they have," DeMichillie told Computerworld. "They need to focus on their business problems, not managing the infrastructure... Dataflow begins that and we'll continue that."

On Wednesday, the company unveiled Google Cloud Dataflow, a managed data processing service designed to create data pipelines that "ingest, transform and analyze data in both batch and streaming modes."

The service, according to DeMichillie, is the first step in helping companies handle massive amounts of data.

Enterprises have been managing huge amounts of data for years. Now companies have to factor in data from more devices, along with more information, which requires complex, and at least near real-time analytics.

Over the next year, Google will be focused on releasing cloud tools and services that will ease development tasks, while also helping companies monitor their operations, DeMichillie said.

"How do you stay on top of what's happening?" he asked. "The answer is monitoring and alerting. You get automatic intelligent defaults, dashboards and alerts. We're just at the beginning of what can be done there."

While DeMichillie wouldn't provide any specific projects in the works, he said Google will release more services and tools specific to big data and analytics.

"I think it's huge," DeMichillie said. "Enterprises have reams of data, whether it's business data about transactions or web log data or data about how customers are engaging through mobile apps. What they struggle with is, how do I make business value out of that?"

When companies take on big data projects, the IT department ss often left to struggle with cleaning and filtering the data. It takes an immense amount of work to get to the point where the business value is found in the data.

"At Google, we went through that 15 years ago, and we developed a lot of technologies to help us make sense of that," DeMichillie said. "We have only started to tap the services we can expose to customers that we built here at Google."

With big data analysis, timing is everything. DeMichillie noted that many companies get weekly or monthly data analysis reports on topics like sales numbers.

What they really need is that analysis in real time, or at least near real time, he said.

"Knowing there was a trend isn't helpful if you find out a week later," he added. "You have to know about it when it's happening so you can act on it. What if there's Twitter activity that correlates to your business right now? That requires near real-time understanding, and that's just not happening right now."

Patrick Moorhead, an analyst with Moor Insights & Strategy, said Google is on the right track with its focus on big data.

"Real-time analysis of big data can cost enterprises tens of millions of dollars in hardware and software," he added. "For enterprises that don't have the skills to set up and operate their own big data and real-time analytics operation, this will save a lot of time, money and headaches."

DeMichillie also noted that Google will continue to work to push prices down in the cloud, continuing what some have called a price war with cloud-rival Amazon.

"When we announced our price reductions, it was the beginning of a process," he said. "We have said what we did in March is not a one-time event... Of course it's a competitive market and, of course, there are big players and you have to be cost competitive."

Sharon Gaudin covers the Internet and Web 2.0, emerging technologies, and desktop and laptop chips for Computerworld. Follow Sharon on Twitter at @sgaudin, on Google+ or subscribe to Sharon's RSS feed. Her email address is

See more by Sharon Gaudin on

Read more about big data in Computerworld's Big Data Topic Center.

Copyright © 2014 IDG Communications, Inc.

Bing’s AI chatbot came to work for me. I had to fire it.
Shop Tech Products at Amazon