Bart Perkins: Benchmarking is great, when it's not a waste
for some companies benchmarking can be more expensive than it is worth
Computerworld - We all know the arguments for benchmarking: It lets you compare your costs and service levels against those of similar organizations. It helps you focus your resources on improving any processes that have higher costs or lower service levels than industry norms. It can provide a solid foundation for comprehensive improvement plans.
Here's an argument against benchmarking: It can waste money.
True apples-to-apples comparisons don't come easily. You have to dig around to find out, for example, which accounting rules are used. Does a programmer's hourly cost include bonus and benefits? How about facility, technology and administrative support costs? You also have to make sure you understand how the various organizations in your benchmarking cohort calculate things like application response time, network availability and the percentage of incidents resolved on the first call. Accounting for all of those differences takes a lot of effort and many hours of work -- in other words, a lot of money.
Is benchmarking likely to be a waste of money? The answer could very well be yes if these factors come into play:
Weak IT management processes. It takes several years to fully implement ITIL or to achieve significant improvement from a PMP program, and any benchmarking data gathered will be unfavorable (and likely inaccurate) until the new processes are fully adopted. Premature benchmarking merely indicates the size of the improvement opportunity. While this may motivate some organizations, the same information can be gathered more quickly by consulting someone who's an expert in ITIL, PMP, Cobit or other control process.
Poor IT accounting and weak metrics. When internal processes are weak, data collection becomes quite complex. The benchmarking team needs to make assumptions about data allocation and must combine data from multiple sources. While this may be sufficient for planning purposes (which only need to be directionally correct), true benchmarking implies a high degree of precision. Even minor allocation errors make the analysis less precise and allow skeptics and critics to challenge the data and associated conclusions.
Executives who aren't yet committed to change. Benchmarks help organizations determine how to change, but not why. IT leaders frequently base decisions on logic and rigorous analysis and will understand the need for process changes merely from benchmark results. But many executives want compelling arguments in addition to data; they want passion, energy and inspiration. With such executives, benchmarking is insufficient, and perhaps even irrelevant.
A need for radical restructuring. Benchmarking only identifies opportunities to make incremental improvements to existing processes. When you need to rethink your mission, redesign the organizational structure, increase customer engagement or alter the way you deliver products and services, benchmarking is a total waste. It will have value only after you resolve the bigger issues.
Benchmarking requires a stable context, a significant investment of resources and periodic refreshes. Use them wisely. It's a diagnostic tool, not a replacement for sound business decisions. And certainly not a magic potion. Don't even think about benchmarking if you don't know how to use the results.
More by Bart Perkins
- Bart Perkins: Pester no more: How to handle the FCC's new rules on robocalls
- Bart Perkins: 3D printing is IT's next big challenge
- Bart Perkins: Benchmarking is great, when it's not a waste
- Bart Perkins: Global standards, meet local constraints
- Bart Perkins: Congratulations on your new supplier. Got a good prenup?
- Bart Perkins: Can't buy you love
- Bart Perkins: Jousting for jobs
- Bart Perkins: Unresponsive suppliers might just not be that into you
- Bart Perkins: Avoiding IT audit nightmares
- Bart Perkins: Beware of self-destructing messaging in the enterprise
Read more about Management in Computerworld's Management Topic Center.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- Future Focus: What's Coming in Enterprise Mobility Management (EMM) Find out why Enterprise Mobility Management (EMM) solutions that are truly future-ready must be designed to enable Machine-to-Machine (M2M) capabilities and much more.
- The CIO's Guide to Enterprise Mobility Management (EMM) This guide will help those making an EMM platform decision make the best choice for their organization.
- Yankee Group: BlackBerry Results Refute Rumors of its Demise Yankee Group: BlackBerry® is stronger than the press makes it out to be.
- Your New EMM Platform: How to Streamline the Migration Smartphone migration can be resource-intensive and challenging. Find out how outsourcing the process can save significant time and money.
- Live Webcast Increasing the Value of Your Reports and Dashboards Learn how incorporating other analytical capabilities such as predictive modeling and visualization can increase the value of your reports and dashboards by providing...
- Testimonial: Cystic Fibrosis Trust Peter Hawkins, the Head of IT for Cystic Fibrosis Trust, discusses the role CommVault's Simpana software platform plays in improving the company's information...
- Increasing the Value of Your Reports and Dashboards Learn how incorporating other analytical capabilities such as predictive modeling and visualization can increase the value of your reports and dashboards by providing... All Management White Papers | Webcasts