Where ROI Models Fail
Computerworld - Now that cost is king, more IT executives are relying on standard accounting methodologies such as net present value (NPV) and internal rate of return (IRR) to cost-justify IT investments to top brass. Sometimes they're using the models because the rest of the company is doing it.
IT leaders "should adopt what the business adopts, and that's fine if that's how the organization wants to view the numbers," says Audrey Apfel, an analyst at Gartner Inc. in Stamford, Conn.
Problem is, say Apfel and other pundits, return-on-investment models are usually incomplete and don't reveal as much as they should about intangibles such as an investment's impact on employee productivity, sales or customer satisfaction.
"ROI models fail because they become overly complex," adds Stephen Andriole, an MIS professor at Villanova University in Villanova, Pa., and a senior consultant for the Cutter Consortium in Arlington, Mass.

![]()
GM CTO Tony Scott ![]()
That's why Andriole leans toward the use of more simplified ROI techniques, such as payback.
"At Cigna, we had all these complicated ways of collecting the data, with five people collecting data. And I said, 'Whoa, wouldn't it be more effective to have three of those people actually working on the project and just two people collecting the data?' "
Capturing Soft Gains
ROI models also aren't well suited to capturing soft benefits, such as customer satisfaction or employee productivity gains.
"If you reach a customer on the second ring instead of the third ring, how do you capture that? Are they more profitable? Are they happier? The human factor of computer-assisted work is neglected by the ROI model," asserts John Jordan, a principal at Cap Gemini Ernst & Young in Cambridge, Mass.
Further, ROI calculations typically fail to include the complexity costs associated with adding a new application -- such as additional hardware, storage or WAN/LAN equipment, and support personnel -- to an IT infrastructure, says Jordan. That's one reason he advocates asking another question: What's the cost of doing nothing vs. the cost of making an IT investment?
Jordan paints the following scenario: An IT manager is faced with buying five Unix servers in order to add new services to his company's Web site. The consideration isn't "just the hardware that you buy but the business capability you achieve in three weeks instead of three months," he explains. "That kind of thinking is hard to put a dollar value on."
The problem with relying solely upon financial techniques such as NPV or IRR "is that they don't necessarily capture all of the business benefits of an IT investment, nor do they help to evaluate all of the options that are open to you," says Chip Gliedman, an analyst at Giga Information Group Inc. Giga recommends that CIOs use options models, decision trees and other tools "to try to quantify and communicate the value of those options and the value of that flexibility."
Take a company that's about to install a new application that requires a two-processor server. You have two options, says Gliedman: "You can buy a two-processor server or a 16-processor cabinet and put two processors in it. The first option has higher immediate returns, but the second gives you the option to put additional processors in as they're needed."
A Computerworld.com survey indicates that it's common to try to calculate ROI for IT projects. Most of the 113 IT managers responding to last month's survey said their IT organizations do some sort of ROI calculation for major projects; only 6% said they do no ROI calculations at all.
But about half (48%) of the respondents agreed with the statement that "sometimes ROI calculations are a good idea, and sometimes they're not". Many IT organizations go to the trouble of doing the ROI math only for really expensive projects.
Sometimes, financial justifications have to be tossed aside when an IT investment simply makes good business sense, some IT executives say.
As General Motors Corp. Chief Technology Officer Tony Scott put it: "We have some areas where we use metrics to measure [business returns]. But in some instances, we have to go on faith."
- Do the Math! An ROI Guide
- ROI Diligence Yields Rewards
- ROI Guide: Payback Period
- ROI Guide: Net Present Value
- ROI Guide: Internal Rate of Return
- ROI Guide: Balanced Scorecard
- ROI Guide: Economic Value Added
- ROI Guide: The Consultants' Offerings
- Where ROI Models Fail
- Forget ROI
- The Almanac: ROI
- The Next Chapter: ROI
- The New ROI
- Maximize ROI With a Project Office
- Stop the ROI Chaos!
Read more about ROI in Computerworld's ROI Topic Center.



- Excel 2010 Cheat Sheet
- Register for this Computerworld Insider Cheat Sheet and gain access to hundreds of premium content articles, guides, product reviews and more.
- Streamline Compliance and Increase ROI
- Streamline, simplify, and automate compliance related activities; especially those that impact multiple business units. This white paper from NetIQ, outlines solutions that will...
- Overcome Top 7 Admin Challenges of Active Directory
- As Active Directory's role in the enterprise has drastically increased, so has the need to secure the data. Gain insight on creating repeatable,...
- Insiders Can Ruin Your Company. Take Action.
- Did you know that 80 percent of threats to an organization come from the inside? The threat from insiders is often overlooked in...
- Top Solutions and Tools to Prevent Devastating Malware
- Custom malware frequently goes undetected. According to Forrester Research, the best way to reduce risk of breach is to deploy file integrity monitoring...
- X-Ray of the PCI Process-4 Proactive Steps
- This white paper from Forrester Research Inc., helps break PCI into understandable components. Security and risk professionals will gain knowledge and insight into... All ROI White Papers
- Optimizing Networks for the Cloud
- Join guest speaker, Rohit Mehra, IDC Director of Enterprise Communications Infrastructure, to explore current trends, discuss best practices for optimizing Data Center and...
- Apps QuickStart Series Part 2: Designing and Deploying SQL Server on VMware vSphere
- Download this webcast to learn about the design considerations for virtualizing SQL workloads, performance and scalability information and high-availability options, as well as...
- Apps QuickStart Series Part 1: Designing and Deploying Exchange 2010 on VMware vSphere
- Download this webcast to learn the virtual hardware design considerations for Exchange 2010, deployment using the building block approach, options for high-availability and...
- Customer Spotlight: How IPC The Hospitalist Company Implemented Oracle on VMware
- Have you been looking to hear about customer's experiences with the new VMware vCenter Site Recovery Manager product? View this webcast to learn...
- Virtualize Business-Critical Applications with Confidence
- Virtualizing business-critical applications has become a key focus for organizations as they move along their virtualization journey. With the launch of VMware vSphere®... All ROI Webcasts