IDG News Service - What if a U.S. president called for a bunch of government data to be released, but the raw numbers were difficult to make sense of?
A handful of companies and an open-source development project are trying to make sure that isn't happening as U.S. President Barack Obama pushes for open government in the early days of his administration.
The business models differ, but some companies are using the raw data released on Data.gov and elsewhere to demonstrate the power of their data-publishing and number-crunching services.
The release of all this data is a good move, but much of it is in a raw format, making it difficult to present it in a way that people can understand, said Kevin Merritt, CEO and founder of Socrata, a two-year-old company focused on helping government agencies and other users of the data reorganize and republish it on the Web.
Socrata calls its service of reorganizing the data into easy-to-read, interactive charts and graphs "social data discovery."
"The data is valuable, but the social data is valuable as well," said Merritt, a former Microsoft executive. "It's one thing to put the data online, but it's another thing to actually get some civic feedback loop."
On Data.gov alone, there were nearly 400 raw data sets available as of Wednesday morning.
There's a database of people, reported by country and region, granted asylum in the U.S. between 1998 and 2008; there's data on toxic chemicals released in Guam in 2005; there's a database of tornadoes, large hail and damaging wind reports from 1950 to 2006; there's data on the geochemistry of water samples in the U.S.; and there's a database of copper smelters around the world.
There's also data about patent applications, workplace fatalities, federal IT spending and migratory bird flyways. There are an additional 109,000 geographical data sets.
Vivek Kundra, federal CIO, was asked at a recent U.S. Federal Communications Commission forum about the Obama administration's philosophy on releasing data. "We don't really know which data feeds are going to lead to better analysis," he said. "What we are doing is, we're trying to release as much data as possible. As a result of that, we're finding a lot of innovation happening out there."
As the data is released, many U.S. residents are spotting trends that government workers hadn't seen before, he added. For example, based on data on which airline flights are typically late, fliers are starting to avoid flights from some airlines at certain times of the day, he said.
Socrata aims its products at government agencies, as well as journalists, researchers and other people wanting to make sense of the raw data. It offers a handful of products, including a free entry-level offering that allows anyone to host data on Socrata.com and a hosted, branded data site for large organizations. Socrata can help government agencies cut costs for storing and delivering data, Merritt said.
This state transportation department uses computer science students from a local university as programming interns, and everyone is happy with the arrangement -- until one intern learns how to bring down the mainframe.
- IT Certification Study Tips
- Register for this Computerworld Insider Study Tip guide and gain access to hundreds of premium content articles, cheat sheets, product reviews and more.
- Changing the Way Government Works: Four Technology Trends that Drive Down Costs and Increase Productivity
- This paper discusses four technology-based approaches to improving processes and increasing
productivity while driving down department and agency costs.
- Path Selection Infographic
- Path Selection Infographic
- Hyperconvergence Infographic
- A wide range of observers agree that data centers are now entering an era of "hyperconvergence" that will raise network traffic levels faster...
- Preparing Your Infrastructure for the Hyperconvergence Era
- From cloud computing and virtualization to mobility and unified communications, an array of innovative technologies is transforming today's data centers.
- How WAN Optimization Helps Enterprises Reduce Costs
- If you wanted to break down innovation into a tidy equation, it might go something like this: Technology + Connectivity = Productivity. Productivity... All Government IT White Papers
- Cloud Knowledge Vault Learn how your organization can benefit from the scalability, flexibility, and performance that the cloud offers through the short videos and other resources...
- LIVE EVENT: 5/7, The End of Data Protection As We Know It. Introducing a Next Generation Data Protection Architecture. Traditional backup is going away, but where does this leave end-users?
- On-demand webinar: "Mobility Mayhem: Balancing BYOD with Enterprise Security" Check out this on-demand webinar to hear Sophos senior security expert John Shier deep dive into how BYOD impacts your enterprise security strategy...
- Mobile Security: Containerizing Enterprise Data In this on-demand webinar, Fixmo's Lee Cocking, VP of corporate strategy, explains why Apple-ization trends like mobility and "bring-your-own-device" (BYOD) are driving the...
- Endpoint Data Management: Protecting the Perimeter of the Internet of Things Not surprisingly, "Internet of Things" (IoT) and Big Data present new challenges AND opportunities for enterprise IT. Teams need to harness, secure and...
- All Government IT Webcasts