Been audited lately? Blame the IRS's massive, superfast data warehouse
Naturally, the system has its limits. It doesn't assist IRS agents in the process of actually conducting audits. And it isn't the system that returns information to individuals or corporations seeking answers about particular returns.
"We aren't open to the public. And we don't manage any transactional data stores. The way we deliver value is behind the scenes," he said.
Putting it together
Like any large federal agency or corporation, the IRS stores data from many sources -- including legacy mainframe databases, Oracle databases and flat files. Linking them to do any sort of business intelligence work a decade ago was a "nightmare," Butler said.
For the CDW, Butler's research group chose 10 years ago to adopt Sybase Inc.'s then-new IQ Analytics Server. Unlike most horizontally minded databases, IQ stores data in column-based tables, which can be slow for writing data but quick at reading it -- making it perfect for applications such as data warehousing.
"We were met with a lot of skepticism," Butler recalled. "'Why don't you go with IBM or Informix?' people asked me. It looked a little risky, too, since Sybase IQ wasn't part of the approved enterprise architecture. Eventually, I was told that we could use IQ for research, but we were going to keep on mostly using Oracle and IBM DB2."
Actually, the research division also uses Microsoft Corp.'s SQL Server to store all of the metadata for the data warehouse and the rest of the agency. Managing and cleaning all of that metadata -- 10,000 labels for 150 databases -- is a huge task in itself, Butler said.
Better hardware, improvements to IQ and, most of all, faster and cheaper storage have combined to boost the CDW's performance.
"When we started, it took us six to eight weeks to load one year's worth [15 to 20TB] of tax returns. It takes four hours today," Butler said.
Today, only about 500 researchers -- mostly from the IRS, some from the U.S. Department of the Treasury -- are allowed direct access to the CDW, using Hyperion Solutions Corp. business-intelligence query tools.
But Butler's team is starting to build analysis services that would calculate and publish summary and trend statistics to wikis, blogs and SharePoint sites inside the IRS. That would make it easier for the IRS to fulfill data requests from federal agencies.
The ultimate goal is to make the information available to the public, similar to how the U.S. Census Bureau publishes copious demographic data to its Web site. That, Butler says, would be "the pot of gold at the end of the rainbow."
Read more about Business Intelligence/Analytics in Computerworld's Business Intelligence/Analytics Topic Center.
- Seattle Children's Accelerates Citrix Login Times by 500% with Cross-Tier Insight Seattle Children's is a leading research hospital with a large and growing Citrix XenDesktop deployment. With ExtraHop, the IT team at Seattle Children's...
- McKesson Makes Application Hosting for Hospitals Faster, More Efficient With ExtraHop, McKesson identified the root cause of slow Citrix XenApp application launches and adopted a more intelligent, proactive IT operations model that...
- A Non-Geek's Big Data Playbook A visual playbook for the non-geek yet technically savvy business professional who is still trying to understand how big data impacts the enterprise...
- Reducing Expenses Starts with the Programming Skills of Operations Groups Reducing expenses can start with the programming skills of operations groups. Read this article to learn how to improve the bottom line, and...
- Charting Your Analytical Future - "Making predictive analytics part of your business processes" Webinar This session will show how predictive analytics can be used throughout the organization by anyone looking for answers and how organizations can make...
- Capturing Data in Motion: Delivering Real-Time Insight from Data Streams This webcast will help organizations of all types and sizes learn about a technology and business strategy for tapping into the wealth of... All Business Intelligence/Analytics White Papers | Webcasts
Our new bimonthly Internet of Things newsletter helps you keep pace with the rapidly evolving technologies, trends and developments related to the IoT. Subscribe now and stay up to date!