IDG News Service - What if a U.S. president called for a bunch of government data to be released, but the raw numbers were difficult to make sense of?
A handful of companies and an open-source development project are trying to make sure that isn't happening as U.S. President Barack Obama pushes for open government in the early days of his administration.
The business models differ, but some companies are using the raw data released on Data.gov and elsewhere to demonstrate the power of their data-publishing and number-crunching services.
The release of all this data is a good move, but much of it is in a raw format, making it difficult to present it in a way that people can understand, said Kevin Merritt, CEO and founder of Socrata, a two-year-old company focused on helping government agencies and other users of the data reorganize and republish it on the Web.
Socrata calls its service of reorganizing the data into easy-to-read, interactive charts and graphs "social data discovery."
"The data is valuable, but the social data is valuable as well," said Merritt, a former Microsoft executive. "It's one thing to put the data online, but it's another thing to actually get some civic feedback loop."
On Data.gov alone, there were nearly 400 raw data sets available as of Wednesday morning.
There's a database of people, reported by country and region, granted asylum in the U.S. between 1998 and 2008; there's data on toxic chemicals released in Guam in 2005; there's a database of tornadoes, large hail and damaging wind reports from 1950 to 2006; there's data on the geochemistry of water samples in the U.S.; and there's a database of copper smelters around the world.
There's also data about patent applications, workplace fatalities, federal IT spending and migratory bird flyways. There are an additional 109,000 geographical data sets.
Vivek Kundra, federal CIO, was asked at a recent U.S. Federal Communications Commission forum about the Obama administration's philosophy on releasing data. "We don't really know which data feeds are going to lead to better analysis," he said. "What we are doing is, we're trying to release as much data as possible. As a result of that, we're finding a lot of innovation happening out there."
As the data is released, many U.S. residents are spotting trends that government workers hadn't seen before, he added. For example, based on data on which airline flights are typically late, fliers are starting to avoid flights from some airlines at certain times of the day, he said.
Socrata aims its products at government agencies, as well as journalists, researchers and other people wanting to make sense of the raw data. It offers a handful of products, including a free entry-level offering that allows anyone to host data on Socrata.com and a hosted, branded data site for large organizations. Socrata can help government agencies cut costs for storing and delivering data, Merritt said.
This pilot fish is a contractor at a military base, working on some very cool fire-control systems for tanks. But when he spots something obviously wrong during a live-fire test, he can't get the firing-range commander's attention.
- IT Certification Study Tips
- Register for this Computerworld Insider Study Tip guide and gain access to hundreds of premium content articles, cheat sheets, product reviews and more.
- Reduce federal infrastructure risk with compliance management and situational awareness
- IBM continuous monitoring and management solutions deliver real-time situational awareness to help federal agencies understand vulnerabilities, and protect the infrastructure.
- Improving IT Efficiencies: Four Advantages of Multi-Tenant Data Centers
- Increasing demands on IT are forcing organizations to rethink their data center options. For many organizations, that means turning to the flexibility afforded...
- Accelerating Cloud Deployment and Operations with Managed Services
- Companies that do not have sufficient in-house expertise to either deploy or maintain an IaaS cloud should turn to Managed Service Providers .
- Rethinking IT Operations in the Cloud
- This paper breaks down the challenges that often prevent the cloud from delivering the fast, flexible and affordable infrastructure companies seek - and...
- Gartner Magic Quadrant for Cloud-Enabled Managed Hosting, North America
- Cloud-enabled managed hosting brings cloudlike consumption and provisioning attributes to the traditional managed hosting market All Government IT White Papers
- NSS Labs & Cisco Present: Evaluating Leading Breach Detection Systems Today's constantly evolving advanced malware and APTs can evade point-in-time defenses to penetrate networks. Security professionals must evolve their strategy in lockstep to...
- Will the Real Endpoint Threat Detection and Response Please Stand Up? This webinar explores new technologies & process for protecting endpoints from advanced attackers as well as the innovations that are pushing the envelope...
- What should I look for in a Next Generation Firewall? SANS Provides Guidance With so many vendors claiming to have a Next Generation Firewall (NGFW), it can be difficult to tell what makes each one different....
- Why Are Customers Really Deploying an NGFW? It seems every IT Security expert is talking about the NGFW, but what are people really doing? This webcast covers 5 real-world customer...
- Charting Your Analytical Future - "Making predictive analytics part of your business processes" Webinar This session will show how predictive analytics can be used throughout the organization by anyone looking for answers and how organizations can make...
- All Government IT Webcasts