Hadoop analysis now tackling IoT to improve transit
A new consultancy crunches data from different sources for insights into agencies' operations
IDG News Service - For the Internet of Things, collecting data is only half the battle, and public transit agencies know that as well as anyone.
Operators of bus, train and trolley systems collect a wide range of data types from ticket machines, fare validation devices, GPS (Global Positioning System) and other sources, but typically that data stays in silos, according to Wade Rosado, director of analytics for Urban Insights, a consultancy launched on Monday to help make use of transit data.
Urban Insights is using a cloud-based Apache Hadoop system to crunch numbers from transit agencies that want to glean new insights about their operations. The company, a wholly owned subsidiary of transit technology vendor Cubic Transportation Systems, can provide both periodic consulting services, such as producing annual reviews, and ongoing measurements as frequently as every day, Rosado said.
Transit is a classic example of the kind of business that may be transformed by IoT. It has a lot of moving parts, serves constantly changing rider needs and faces demands for efficiency. Transit also is built around specialized infrastructure that stays in place for years or even decades, something it holds in common with power transmission, logistics and other IoT hotspots.
There's a lot of useful data generated in a transit system's day, Rosado said. Buses may check in with a GPS location every 30 seconds, sensors on doors can count how many riders get on and off, and payment systems know about ticket purchases and validations.
"They do absolutely collect this data, and they use it within the constraints of the system that was designed to report on it, but where the weakness exists is in integrating those data sources to paint a more complete picture of what's actually happening," Rosado said.
For example, Urban Insights is helping the San Diego Municipal Transportation System (MTS) to figure out whether its routes and schedules match most riders' needs. Existing systems collected data about individual trips on buses or trolleys, so Urban Insights combined data from five separate sources to understand riders' overall journeys, including transfers, and whether service was aligned with real demand, he said.
Urban Insights creates custom data models, takes in raw data from customers' systems and reformats it, and then integrates it with data from other sources. "Hadoop lends itself very well to that, because it's able to do complex operations on very large data sets," Rosado said.
Urban Insights, based in Washington, D.C., is running its service on a combination of its own servers and virtual private cloud resources through services like Microsoft Azure, Rosado said. That lets the consultancy burst to greater capacity when needed, he said.
This pilot fish is a contractor at a military base, working on some very cool fire-control systems for tanks. But when he spots something obviously wrong during a live-fire test, he can't get the firing-range commander's attention.
- IT Certification Study Tips
- Register for this Computerworld Insider Study Tip guide and gain access to hundreds of premium content articles, cheat sheets, product reviews and more.
- Reduce federal infrastructure risk with compliance management and situational awareness
- IBM continuous monitoring and management solutions deliver real-time situational awareness to help federal agencies understand vulnerabilities, and protect the infrastructure.
- Software Asset Management: Ensuring Today's Assets
- Today's trends like BYOD and SaaS are new and exciting in terms of how they will help make our jobs more productive but...
- Trends Shaping Software Management: 2014
- Most IT executives recognize the relationship between mobile computing and worker productivity, and have long issued notebook computers and other mobile devices to...
- Software Asset Management: Pay Attention or Pay Up
- There is a wide range of options for managing software assets, from in-house solutions to the cloud to managed services providers. Read this...
- Are You Prepared for a Software Audit?
- Just the word "audit" is enough to make anyone shiver, and when it comes to a software audit, the reaction is no different.... All Government IT White Papers
- IBM FlashSystem V840: Leveraging Software-Defined Flash to Drive Your Business With end-to-end, tightly integrated functionality and super-fast flash technology, products like IBM FlashSystem V840 Enterprise Performance Solution empower businesses to leverage the efficiency...
- Leveraging Flash Storage to Accelerate Oracle Real Application Clusters Join this webinar to understand the latest solid-state storage trends, the specific applications driving solid-state storage deployments and the benefits of deploying the...
- Top 4 Digital Signage Fails Join RMG Networks for a look at four of the most common reasons digital signage fails in corporate businesses. Learn about strategies to...
- It's not too late...Get Your Mobile Questions Answered Live! How can IT provide seamless and secure mobile communications and collaboration for all? Join this live Webcast as IDG asks an expert panel...
- Why do you need an enterprise mobile platform? Today companies must offer great apps that run on a range of devices, and connect to an exploding set of backend data. Appcelerator...
- All Government IT Webcasts