'Big data' prep: 5 things IT should do now

With big data being hyped as the next big strategic initiative for business, it's time for IT to lay the groundwork.

1 2 3 4 Page 4
Page 4 of 4

"The warehouses of the past have been focused on determining what kind of data repository you have and where you have it. The new mindset is that data warehouses will be a combination of new and existing repositories plus data processing and delivery services," Beyer explains.

Bone up on the technology

The big-data world comes with a big list of new acronyms and technologies that have likely never graced a CIO's radar screen.

Open-source technology is getting most of the attention with technologies like Hadoop, MapReduce, and NoSQL taking credit for helping Web-based giants like Google and Facebook churn through their reservoirs of big data. Many of these technologies, while starting to be offered in more commercial forms, are still fairly immature and require people with very specific skills sets.

Beyond the new open-source options, IT groups will also have to ensure they are up to speed on other technologies important to the big-data world, such as in-database analytics, columnar databases and data warehouse appliances.

IT managers and their staffs need to dive in and at least familiarize themselves with these new tools in order to be properly situated to make big-data decisions going forward.

Prepare to hire or retrain staff

Whether it's a Hadoop expert or a data scientist, most IT organizations are sorely lacking the right talent to take the next steps with big data. The analytic skill sets are perhaps the most crucial, and they represent the area where the gap is currently largest.

McKinsey projects that in the U.S. alone, there will be a need by 2018 for between 140,000 and 190,000 additional experts in statistical methods and data-analysis technologies, including the widely hyped emerging role of "data scientist."

In addition, McKinsey anticipates the need for another 1.5 million data-literate managers, on either the business or tech side of the house, who have formal training in predictive analytics and statistics.

Under the IT department's jurisdiction, traditional data warehouse and BI professionals will require some retraining.

And in addition to traditional skills in information management, governance and database structure, the new big-data professionals need an understanding of semantics and mathematical disciplines -- not to mention expertise in the new predictive analytics tools and data management platforms that comprise big data.

"The people who built the databases of the past are not necessarily the people who will be building the databases of the future," says Catalina's Williams. "Don't underestimate the complexity in trying to produce something like this."

For some companies, especially those in less populated areas, staffing will likely complicate the challenge. "[Big data] definitely requires a different mindset and skills in a host of areas," says Rick Cowan, CIO at True Textiles, in Guilford, Maine, a contract manufacturer of interior fabrics for the commercial market.

"As a medium-sized business, it's been a challenge to be able to get staff and keep them up to speed with the ever-changing environment." To address the need, Cowan has begun formally retraining programmers and database analysts to come up to speed on advanced analytics.

IT department heads will have to do some transforming of their own to excel in this brave new world. While the best tech leaders of the past have been partly information librarian and partly infrastructure engineer, the IT managers of the future will be a combination of data scientist and business process engineer, says Gartner's Beyer.

"CIOs have been used to managing infrastructure based on a given instruction set from the business, as opposed to a CIO that is able to identify the opportunity and therefore push towards innovative use of information," he explains. "That's the transformation that needs to happen."

Stackpole, a frequent Computerworld contributor, has reported on business and technology for more than 20 years.

Copyright © 2011 IDG Communications, Inc.

1 2 3 4 Page 4
Page 4 of 4
7 inconvenient truths about the hybrid work trend
Shop Tech Products at Amazon