Skip the navigation

Where ROI Models Fail

By Thomas Hoffman
February 17, 2003 12:00 PM ET

Computerworld - Now that cost is king, more IT executives are relying on standard accounting methodologies such as net present value (NPV) and internal rate of return (IRR) to cost-justify IT investments to top brass. Sometimes they're using the models because the rest of the company is doing it.
IT leaders "should adopt what the business adopts, and that's fine if that's how the organization wants to view the numbers," says Audrey Apfel, an analyst at Gartner Inc. in Stamford, Conn.
Problem is, say Apfel and other pundits, return-on-investment models are usually incomplete and don't reveal as much as they should about intangibles such as an investment's impact on employee productivity, sales or customer satisfaction.
"ROI models fail because they become overly complex," adds Stephen Andriole, an MIS professor at Villanova University in Villanova, Pa., and a senior consultant for the Cutter Consortium in Arlington, Mass.

GM CTO Tony Scott
GM CTO Tony Scott
Andriole, who has held senior IT positions at Cigna Corp. and Safeguard Scientifics Inc., says that there are roughly 15 financial calculations that CIOs can use to tally ROI, "and that's part of the problem -- the more complicated the method, the more you have to feed the method rather than working the project."
That's why Andriole leans toward the use of more simplified ROI techniques, such as payback.
"At Cigna, we had all these complicated ways of collecting the data, with five people collecting data. And I said, 'Whoa, wouldn't it be more effective to have three of those people actually working on the project and just two people collecting the data?' "
Capturing Soft Gains
ROI models also aren't well suited to capturing soft benefits, such as customer satisfaction or employee productivity gains.
"If you reach a customer on the second ring instead of the third ring, how do you capture that? Are they more profitable? Are they happier? The human factor of computer-assisted work is neglected by the ROI model," asserts John Jordan, a principal at Cap Gemini Ernst & Young in Cambridge, Mass.
Further, ROI calculations typically fail to include the complexity costs associated with adding a new application -- such as additional hardware, storage or WAN/LAN equipment, and support personnel -- to an IT infrastructure, says Jordan. That's one reason he advocates asking another question: What's the cost of doing nothing vs. the cost of making an IT investment?
Jordan paints the following scenario: An IT manager is faced with buying five Unix servers in order to add new services to his company's Web site. The consideration isn't "just the hardware that you buy but the business capability you achieve in three weeks instead of three months," he explains. "That kind of thinking is hard to put a dollar value on."
The problem with relying solely upon financial techniques such as NPV or IRR "is that they don't necessarily capture all of the business benefits of an IT investment, nor do they help to evaluate all of the options that are open to you," says Chip Gliedman, an analyst at Giga Information Group Inc. Giga recommends that CIOs use options models, decision trees and other tools "to try to quantify and communicate the value of those options and the value of that flexibility."
Take a company that's about to install a new application that requires a two-processor server. You have two options, says Gliedman: "You can buy a two-processor server or a 16-processor cabinet and put two processors in it. The first option has higher immediate returns, but the second gives you the option to put additional processors in as they're needed."
A Computerworld.com survey indicates that it's common to try to calculate ROI for IT projects. Most of the 113 IT managers responding to last month's survey said their IT organizations do some sort of ROI calculation for major projects; only 6% said they do no ROI calculations at all.
But about half (48%) of the respondents agreed with the statement that "sometimes ROI calculations are a good idea, and sometimes they're not". Many IT organizations go to the trouble of doing the ROI math only for really expensive projects.
Sometimes, financial justifications have to be tossed aside when an IT investment simply makes good business sense, some IT executives say.
As General Motors Corp. Chief Technology Officer Tony Scott put it: "We have some areas where we use metrics to measure [business returns]. But in some instances, we have to go on faith."

Read more about ROI in Computerworld's ROI Topic Center.



Additional Resources
Forrester Consulting - Optimizing Users and Applications in a Mobile World
WHITE PAPER
Solving application issues over the WAN requires careful consideration. Based on their independent research, Forrester Consulting offers recommendations on how to tackle application performance issues, insufficient bandwidth and the inability to quickly restore users in a disaster.

Read now.

Security KnowledgeVault
WHITE PAPER
Security is not an option. This KnowledgeVault Series offers professional advice how to be proactive in the fight against cybercrimes and multi-layered security threats; how to adopt a holistic approach to protecting and managing data; and how to hire a qualified security assessor. Make security your Number 1 priority.

Read now.

Cut Communications Costs Once and for All
WHITE PAPER
New IP-based communications systems are being deployed by small and midsized businesses at a rapid rate. Learn how these organizations are enabling faster responsiveness, creating better customer experiences, speeding office or mobile interactions, and dramatically reducing existing communications costs.

Read now.

ROI White Papers
Streamline Compliance and Increase ROI
Streamline, simplify, and automate compliance related activities; especially those that impact multiple business units. This white paper from NetIQ, outlines solutions that will...
Overcome Top 7 Admin Challenges of Active Directory
As Active Directory's role in the enterprise has drastically increased, so has the need to secure the data. Gain insight on creating repeatable,...
Insiders Can Ruin Your Company. Take Action.
Did you know that 80 percent of threats to an organization come from the inside? The threat from insiders is often overlooked in...
Top Solutions and Tools to Prevent Devastating Malware
Custom malware frequently goes undetected. According to Forrester Research, the best way to reduce risk of breach is to deploy file integrity monitoring...
X-Ray of the PCI Process-4 Proactive Steps
This white paper from Forrester Research Inc., helps break PCI into understandable components. Security and risk professionals will gain knowledge and insight into...
All ROI White Papers
ROI Webcasts
Optimizing Networks for the Cloud
Join guest speaker, Rohit Mehra, IDC Director of Enterprise Communications Infrastructure, to explore current trends, discuss best practices for optimizing Data Center and...
Apps QuickStart Series Part 2: Designing and Deploying SQL Server on VMware vSphere
Download this webcast to learn about the design considerations for virtualizing SQL workloads, performance and scalability information and high-availability options, as well as...
Apps QuickStart Series Part 1: Designing and Deploying Exchange 2010 on VMware vSphere
Download this webcast to learn the virtual hardware design considerations for Exchange 2010, deployment using the building block approach, options for high-availability and...
Customer Spotlight: How IPC The Hospitalist Company Implemented Oracle on VMware
Have you been looking to hear about customer's experiences with the new VMware vCenter Site Recovery Manager product? View this webcast to learn...
Virtualize Business-Critical Applications with Confidence
Virtualizing business-critical applications has become a key focus for organizations as they move along their virtualization journey. With the launch of VMware vSphere®...
All ROI Webcasts
Newsletter Sign-Up

Receive the latest news test, reviews and trends on your favorite technology topics

Choose a newsletter
  1. View all newsletters | Privacy Policy
IT Jobs