How universities and big business are partnering up to solve big data problems and plug the data science skills gap


With the rise of big data and the lack of data scientists in the market, businesses are reaching out to academia more and more to help solve some of their thorniest technical problems.

In theory, it is a match made in heaven. Academics want interesting problems to solve and businesses have plenty of them when it comes to making use of their new-found reams of big data. In a world where data scientists are the scarcest of resources, partnerships between universities and businesses are helping to plug the data science skills gap.

Alice Jacques, senior data scientist, consumer insight at Channel 4 summed it up during her talk at the DataIQ conference in London last month. "Businesses have data and real problems, academics have experts and teaching capacity," she explained.

Read next: How to get a job as a data scientist: What qualifications and skills you need and what employers expect

The benefits for both sides are clear to see: industry gets cheap access to data science talent and universities can tout industry experience to attract students, boost funding and help with their rankings.

Professor Patrick Wolfe from University College London (UCL) told Computerworld UK that he sees universities moving away from the "old-fashioned ivory tower model" as they look to engage with society more.

Wolfe believes that by linking arms with big business, universities have an opportunity to "apply new ideas immediately".

"If I wanted to work on a network 30 years ago there wouldn't have been much data to work on," he added. "What has happened now is there is a natural bridge."

Channel 4

Jacques from Channel 4 said the media company worked with two UCL PhD and four master's students on a soon-to-be released Netflix-style recommendation engine for its on-demand service All4.

Jacques told Computerworld UK that the current batch of PhD students "are doing their PhDs in recommendation systems and computational statistics, stochastic modelling and time series," which are all skills that have helped Channel 4 develop its recommendation system.

"We have six mini-experts that understand a single problem very well," she said.

Read next: The 16 best data scientists to follow on Twitter: from top influencers to industry experts

Jacques urged data scientists to get out to academic conferences more. "They scare you and remind you that academics didn't stop when you left [university]," she said. "They expose you to new ideas, which you can try to fit into your business problems. It is speed dating for data science ideas."

Poaching talent

This trend goes further than collaboration and into outright talent poaching.

"The other side is a trend of academic researchers in areas like computer science sometimes being poached away to industry," Wolfe said. "If you are excited about running algorithms at large scale you can't really do that sitting behind a university desk."

According to Wolfe, industry experience simply makes his students "more immediately marketable", but that demand for data science skills will continue to outstrip supply because "universities work on a slightly slower scale" than industry.

On the other hand, universities use these relationships as a way to attract master's students. For example, the data science school at City University of London states: "When it comes to the big data and data science area, we have established relationships with organisations including the BBC, Microsoft and The British Library so you can be confident that with City, your access to professional experience is unparalleled."

The University of Lancaster's data science institute website lists nearly 40 industry partners that students can access. The website looks to attract new partners by promising "access [to] skills in data mining, programming, statistical modelling, statistical inference" and the ability to "gain an early view of talented data science professionals".


It certainly looks like closer relations between academia and business can bring huge benefits for universities in terms of funding future research and for students looking to boost their job prospects.

The only concern will be if the relationship gets too cosy and academics lose their all-important scope to come at problems in a broader sense than simply solving a business problem.


Copyright © 2016 IDG Communications, Inc.

8 simple ways to clean data with Excel
Shop Tech Products at Amazon