Big data worker shortage demands job candidates with diverse backgrounds
Companies urgently seek people with IT, math and business backgrounds
IDG News Service - A career path that began with studying infectious diseases and led to analyzing terabytes of game data may seem a circuitous route. For Brendan Burke, though, the applied math skills he picked up as an undergraduate biology and political science major, the programming skills he added as a bioengineering graduate student, and his use of the two as a research scientist led to a job in the booming IT field of data science.
"A lot of the skill set I developed very specifically for biology could be applied in very commercially viable ways," says Burke, who earned both of his degrees from Stanford University and worked at the California school as a scientist. As head of player science at Playnomics, a Silicon Valley company that uses game data to develop player analytics, the math and computer science skills he used to determine how many touch points a virus requires to spread across a population now help him understand how people interact with games. "Something in data science gets your creative juices flowing when you see something that you built for an entirely different purpose can be used in all of these other ways," he says.
Data science also excites companies that want to use the data they've amassed to make strategic decisions that will benefit the bottom line.
A range of industries are using data to guide business decisions and bring in revenue, says Laura Kelley, a vice president at technology staffing firm Modis. "Companies are using this information to launch products and services. Whether it's what customers are buying, what products or services get the better ROI, [data] comes into strategic decisions."
Businesses, though, are struggling to find employees to handle big data, the term assigned to gathering and analyzing massive quantities of information. This field is relatively new to enterprise IT and although many companies are exploring data science programs, the necessary talent is still maturing, say technology and staffing executives.
Related: Big data, big jobs?
This places people with applicable skills in demand now and in the future, say hiring experts. The U.S. faces a substantial shortage of workers with data science skills, according to a much-talked about report published last year by consulting firm McKinsey and Company. The report predicted that by 2018 the country will lack 1.5 million analysts who can make strategic decisions using big data and between 140,000 to 190,000 workers with the proper data-processing technology skills.
"There [will be] more career opportunities in the future for this type of strategic analysis," says Kelley, who has seen the business intelligence analyst job change into a data scientist position in the last 18 months. "We've always used information but not to this level. With the amount of data companies are capturing on everything and everybody it's just amazing what can be done with that."
Colleges have realized the need to train people for those careers and are developing degree and certification programs targeting undergraduate and graduate students as well as IT professionals. To address immediate data-science staffing needs, which include technical and business roles, companies have adopted assorted tactics.
To handle the more than 100TB of data processed each week by BrightEdge, a San Mateo, California, startup that helps companies manage their search engine rankings, CEO and founder Jim Yu wants data workers who grasp the entire scope of big data processing.
People know how to query databases, but there is "an extra layer of understanding" when handling large data sets, which at BrightEdge includes tracking data on more than 150 billion URLs. Experience working with traditional SQL relational databases helps, but big data's scale requires a different processing mindset, he said.
- 2014 IT Workplace Trends and Salary Guide Staying competitive in the IT market can be challenging. This guide provides you with insight into variety of IT workplace trends including, U.S....
- Agility & Scalability for Oracle EBS R12 and RAC on VMware vSphere 5 This white paper outlines extensive performance and scalability testing of Oracle EBS applications on a Vblock™ Systems with vSphere 5.
- Oracle and VCE: The Next Step in Integrated Computing Platforms In this ESG Lab review you will learn how a VCE system driven by Oracle, delivers the perfect blend of high performance and...
- Migrate Oracle Apps from RISC/UNIX to Virtualized x86 Ready to move Oracle to a virtualized environment? This brief explains how true converged infrastructure can help you migrate from a RISC/UNIX environment...
- Keep Servers Up and Running and Attackers in the Dark An SSL/TLS handshake requires at least 10 times more processing power on a server than on the client. SSL renegotiation attacks can readily...
- On Demand: Mastering the Art of Mobile Content Management Mobile device usage in the enterprise has skyrocketed, and it continues to escalate. IT must answer to users who demand access to their... All IT Careers White Papers | Webcasts
Our 28th annual survey results show which IT skills are in high demand and which are cooling off. Also, see how your salary stacks up to peers' with our Smart Salary Tool.