Subscribe to our e-mail newsletters
For more info on a specific newsletter, click the title. Details will be displayed in a new window.
ROI (Return on Investment)
IT Management
Computerworld Daily News (First Look and Wrap-Up)
Computerworld Blogs Newsletter
The Weekly Top 10
More E-Mail Newsletters 
Computerworld 2007Subscribe to Computerworld
40 years of the most authoritative source of news and information for IT leaders.

Study: Buggy software costs users, vendors nearly $60B annually

Patrick Thibodeau   Today’s Top Stories    or  Other ROI Stories  
 

Sign up to receive Security Resource Alerts

June 25, 2002 (Computerworld) -- WASHINGTON -- Software bugs are costing the U.S. economy an estimated $59.5 billion each year, with more than half of the cost borne by end users and the remainder by developers and vendors, according to a new federal study.
Improvements in testing could reduce this cost by about a third, or $22.5 billion, but it won't eliminate all software errors, the study said. Of the total $59.5 billion cost, users incurred 64% of the cost and developers 36%.
The findings were released yesterday in a 309-page study (download PDF) conducted by the National Institute of Standards and Technology (NIST), a federal agency that conducts extensive research on technology issues.
There are very few markets where "buyers are willing to accept products that they know are going to malfunction," said Gregory Tassey, the NIST senior economist who headed the study. "But software is at the extreme end in terms of errors or bugs that are in the typical product when it is sold."
A product of 18 months of research that included extensive feedback from end users, the study examined the impact of buggy software in several major industries -- automotive, aerospace and financial services -- and then extrapolated the results for the U.S. economy. The study was conducted for NIST by the nonprofit Research Triangle Institute in Research Triangle Park, N.C.
For instance, one case study in the automotive and aerospace industries involved interviews with 10 software developers and 179 users of computer-aided design, manufacturing and engineering systems and product data management software. That study found that users of these software design tools spent significant resources responding to software errors. Approximately 60% of those surveyed said they had experienced "significant software errors" in the previous year. The total cost in these sectors from inadequate software testing was estimated to be $1.8 billion.
Similar results were found in the financial services sector. In the case study of that sector, four software developers and 98 software users were interviewed. According to the study, developers agreed that an improved testing system was needed that could track a bug back to the point where it was introduced and show how it influenced the rest of the production process. The ideal testing infrastructure could remedy problems in real time rather than requiring developers to wait for the product to be fully assembled, the report said.
The total cost on financial services from inadequate software testing was estimated at $3.3 billion, the report said.
"No one thinks you can get all the errors out of software," said Tassey. Vendors are under pressure to get products to market quickly, and there are diminishing returns on testing: The more effort you put into it, the fewer the bugs that are found. "However, the general consensus seems to be [that] the current state of the art with respect to testing is poor and can be sufficiently improved," he said.
The study didn't propose specific actions for improving testing but called for the development of testing standards, noting that today's testing tools "are still fairly primitive."
The study also said that standardized testing tools, scripts, reference data and metrics, among other things, "that have undergone a rigorous certification process would have a large impact on the inadequacies" now found.




Print this Story Send Us Feedback E-mail this Story Digg! Digg this Story Slashdot this Story
"Are you the uber-geek at your job who holds all the pieces of the network and security together? If so,..." Read more...
"Today, CIO means being more than a competent manager of IT. It should mean Lord of Process, and we should..." Read more...
Read more Management posts or See all Blogs
Update: Microsoft to appeal $1.3B EU fine
XP SP3 cripples some PCs with endless reboots
Windows Vista more secure than XP, says security company
More top stories...
Microsoft grows DAISY for blind computer users while Adobe wilts
Sun's JavaOne show re-dubbed 'VomitOne' after stomach bug hits
Leopard at six months: Does it live up to the early hype?
Ubuntu 8.04 is a popular Linux distribution that offers some updated features along with its usual easy-to-use interface and solid support.
Forget "Format c:" or any of those silly software programs that promise to remove data from hard drives. Get physical — really physical.
Was it the receptionist, the salesman or the building manager? Here's how to find and stop the leaks.
Now you can get cell phones customized with services specific to your religion. Columnist Mike Elgan picks the three best devices.
Reviews, analyses, how-tos, visual tours, hot issues and predictions about Microsoft's new OS.
Four years from now, the IT field will be a vastly different place. Will you be ready?
All Zones
Application Performance Zone
Enterprise-Class Security Zone
Enterprise Solutions Zone
The File Data Management Zone
Grid Computing on Windows Zone
Security Management Zone
ITIL Best Practices Zone
The SAS Zone
Storage Virtualization Zone
The Data Center Management Zone

Ads by TechWords

See your link here
Does collaboration drive business success?
Get this white paper now!
(Source: Microsoft Office Live Meeting) Collaboration occurs at the intersection of an enterprise's technology and culture. Discover how these two critical factors affect the quality of collaboration in Meetings Around the World: The Impact of Collaboration on Business Performance. You'll learn why enterprises need to work collaboratively - and examine how collaboration impacts business success.
Download this white paper go
HP's Virtualization: HP's Remote Client Solutions Webinar
HP's Virtualization: HP's Remote Client Solutions Webinar
View this webcast!
Go to the webcast 
Computerworld Report : Smart Storage
Download this Computerworld report, free for a limited time, compliments of HP.
(Source: Computerworld) Faced with growing demands, immature tools and a confusing array of technologies, IT decision-makers have to make some strategic choices. Learn how to avoid the pitfalls in this Computerworld report, a $49.95 value, available free for a limited time, compliments of HP.
Download this executive briefing download
White Papers
Read up on the latest ideas and technologies from companies that sell hardware, software and services.
New Fujitsu High-End Itanium Windows- and Linux-Based PRIMEQUEST Servers Offer the Utmost in High Availability
New Fujitsu High-End Itanium-Based PRIMEQUEST Servers Offer Industry-Leading System Management for Linux and Windows
Symantec State of the Data Center Report 2007
View more whitepapers 
HP Compaq t5735 Thin Client

Linux-based thin client delivers desktop-like performance supporting a variety of open-source applications, creating a new paradigm in thin client computing. The NEW HP Compaq t5735 Thin Client provides convenient access to server-based solutions, Virtual Desktop Infrastructure (VDI) or to a variety of remote client solutions.

Download this datasheet 
Global Operations Uses HP Thin Clients to Improve Security and TCO

Do you need a secure standardized platform while maintaining a lower cost of ownership company wide and to help make the company more competitive? Read how the CIO of the world's largest manufacturer of polyethylene folding tables, chairs, picnic tables, and residential basketball equipment obtained his IT Goal with HP Thin Clients.

Download this case study 
HP's Virtualization: HP's Remote Client Solutions Webinar

- Hear from IDC analysts on PC Client Virtualization and Alternatives to Client Computing
- Hear how customers solved IT challenges with HP's solution to Virtualization
- Learn about different types of virtualization market analysis from HP's CTO
- Hear from the VP of Netpads, Inc. how HP Thin Client solutions helped solve IT challenges, security concerns and lowered TCO for the emerging hospitality.

View this webcast