Ads by TechWords

See your link here
Receive the latest technology news and information.
Computerworld Daily News (First Look and Wrap-Up)
Computerworld Blogs Newsletter
The Weekly Top 10
Cloud Computing
View all newsletters




Privacy Policy
 
Business Intelligence: The Future of BI

Four Steps to Get Your Data in Shape

Andrew Manby, Ascential Software   Today’s Top Stories   or  Other Business Intelligence Stories  
 

Sign up to receive Business Intelligence Resource Alerts

sign-up

June 21, 2004 (Computerworld) -- As the economy improves, many companies are looking to business intelligence and corporate performance metrics to help improve productivity and cut costs across the enterprise. But what CIOs are learning is that the success of any BI implementation hinges on the accuracy, reliability and timeliness of the corporate data feeding the system.

For example, The Scotts Co., a world leader in do-it-yourself lawn and garden consumer products in Marysville, Ohio, selected BI tools from SAP AG to gain better visibility into its business ecosystem -- from suppliers through to distributors and retailers. But before getting started, the company applied data integration tools to prepare and load corporate data into the SAP system. The result: Scotts gained greater visibility into the requirements of its retailers, allowing the company to slash inventory by 30% and boost cash flow by $100 million.

Before information can be analyzed, relevant corporate data must be refined into actionable information using a technique called data integration. When applied to BI, data integration provides the necessary infrastructure to ensure that information is accessible, reliable, complete and consistent. Here are four steps to follow in preparing data for a BI system:

Step 1. Plan ahead and verify your assumptions about the data. Assume nothing about the state of your data when you begin a project. During the business requirements phase of a project, it's imperative to determine the true state of the data from all of the contributing sources within your enterprise. Specifically, assess (profile) the data in terms of availability, consistency and the validity of embedded business rules. This process should be automated and use as much data as is statistically important to you (whether that's 10%, 20% or 100%).

Profiling your data provides an immediate payback by quickly defining what format manipulations and standards are needed to ensure downstream accuracy and reliability. Failing to take this step can extend your project by 30% or more.

Step 2. Standardize, match and enrich the data. Now that you've identified any inconsistencies in your data, it's essential to correct the data; that is, standardize the names, addresses, product codes, birth dates, Social Security numbers and locations into consistent and reliable formats. There's about a 40% chance your data will require some level of enrichment to complete missing or inaccurate values. This may mean merging external information sources from Acxiom or Dun & Bradstreet with your own data. And because many firms store their customer data in 10 or more systems, it may be necessary to remove duplicate information. This process should use statistically proven matching techniques to ensure the best possible consistency and the ability to standardize any sort of data, not just customer information.

Step 3. Transform and deliver your data to order. To populate your BI system, you'll need to pack up and move your data from its source to the target data warehouse in a reliable and timely manner. This step requires the ability to extract, transform and load data from your myriad hardware platforms where it resides and deliver it to the consolidated data warehouse or data mart that feeds your BI systems. This can be one of the most time-consuming steps in the process, so you may want to investigate the benefits of parallel processing systems. These systems can save you time by extending the data movement process across all available CPUs. Alternatively, if you need immediate visibility as soon as a customer places an order, then you may be able to "trickle feed" the information instead of taking a bulk approach.

Step 4. Make sure the business can trust the data. The last step is to ensure that you can trust your data -- this means giving end users the ability to track and understand data composition and continuously monitor data quality. After delivering the data to the target system, you'll need to ensure that the business users have access to the source, definition and history of that data, as well as an understanding of how that data relates to other information throughout the enterprise. Business-friendly explanations of the definition, origin and relationship of data -- presented through a browser -- can remove ambiguity, lessen the IT support burden and help end users make better decisions.

Periodic data audits will also help ensure the continued reliability of your data. Data audits provide management with graphical assessments of data quality, based on business rules, and allow you to recognize anomalies as they develop and rectify them immediately.

In essence, the first key to BI success is to make sure you have a data integration system that can handle the full range of functions -- profiling, data quality, transformation and delivery -- and integrates easily with existing systems.

Andrew Manby is director of platform product marketing at Ascential Software Corp. in Westboro, Mass. He can be contacted at andrew.manby@ascential.com.

Special Report

The Future of BI
Stories in this report:



Print this Story Send Us Feedback E-mail this Story Digg! Digg this Story Slashdot this Story

Special Reports

IE9 to tap hardware to boost performance
New attack fells Internet Explorer
The 5 best and worst features of Google Chrome OS
More top stories...
Free Web apps to help organize your holidays
Google's Chrome OS hits BitTorrent
Global warming research exposed after hack


Ads by TechWords

See your link here


Getting to know Windows 7? Don't stop now: From speeding up taskbar thumbnails to reining in UAC, here are 20 ways to make Windows 7 act the way you want.
Is Motorola's new Droid good enough to vanquish iPhone envy? To find out, we took it on a 3-day trip.
Sure, you could always use Linux as a desktop OS, but Corel Linux 1.0 was the first distro designed for ordinary users. It's been a long, strange trip since then.
New touch-screen laptops from Fujitsu, HP and Lenovo take advantage of Microsoft Windows 7's touch-friendly infrastructure.
Get the latest news, reviews and more about Microsoft's newest desktop operating system.
General Mills, Genentech, San Diego Gas & Electric, University of Pennsylvania and Monsanto top the list.
All Zones
The SAS Zone
Software Resource Center
Mobile Security
Disaster Recovery & Cost Savings
Strategic Content Management
Business Analytics Zone

SAS Information Management Kit

SAS is the leader in business intelligence and analytical software and services. Only SAS offers leading data integration, storage, analytics and business intelligence applications within a comprehensive enterprise intelligence platform. SAS gives 97 of the top 100 companies in the 2007 Fortune 500 THE POWER TO KNOW®.

Webcast: The Information Management Roadmap
Imagine high-quality data, cleansed, analyzed and delivered throughout your organization. Join Computerworld, IT visionary Thornton May and a panel of experts to learn how SAS® can help you make it happen.

View this webcast 
Research Report: Information Management Initiatives at Midsize and Large Organizations
See the top-line results of this Computerworld sponsored survey to see how IT and business leaders are handling information management implementation.

Download this report 
White Paper: Information Management: Better Information for Winning Decisions.
This white paper explains how the SAS Information Evolution Model aids companies in assessing how they use this information to make strategic decisions and drive business.

Download this white paper