The Pros & Cons of CMM

Computerworld - What's in a CMM rating?
Does hiring a CMM Level 5 service provider guarantee that an outsourced software project will come in on time and on budget?
Will a higher CMM rating automatically mean higher costs?
What impact does earning a rating have on software quality?
These are just a few of the questions confronting IT managers charged with contracting out an increasing volume of application development and maintenance work to lower-cost offshore outsourcers.
Developed by the Software Engineering Institute (SEI) at Carnegie Mellon University in Pittsburgh, CMM—short for Capability Maturity Model—is a set of rigorous standards for software development that's based on five levels. Of some 70 companies worldwide that have publicly acknowledged reaching the highest rating of Level 5, about 50 are in India, according to the SEI and Gartner Inc.
Not surprisingly, these Indian outsourcers aggressively tout their CMM rating, marketing themselves as top-notch developers with standardized, repeatable processes in place for delivering the highest quality software. Executing standardized processes also works to keep down costs, enabling Level 5 providers to pass on additional savings to customers, according to Sangita Singh, head of strategic marketing at Wipro Ltd., an Indian outsourcing company with U.S. headquarters in Santa Clara, Calif.
Research confirms that higher CMM levels correlate with fewer software defects (see chart below). But the highest CMM rating doesn't necessarily guarantee the greatest savings for customers. "The data on quality and maturity levels shows there is a definite improvement in costs and [on-time project completion] schedules," says Bill Peterson, program director for software engineering process management at the SEI. "But whether the supplier passes the savings on to the buyer, we don't know. That's more business than anything to do with the logic of costs.
"What we are saying is that as a Level 5, [suppliers] are better and they're able to charge more, not less," Peterson adds.
At the same time, a Level 5 CMM rating comes with no guarantees, and in some cases, it may even be overkill, experts say.
"CMM is a great discipline, and it is a great designation to have," says Bart Perkins, a Computerworld columnist and managing partner at Louisville, Ky.-based Leverage Partners Inc., which helps CIOs manage IT suppliers. "But the reality is that if an outsourcer is at Level 5 and the client is at Level 1 or 2, the client doesn't have the internal discipline to take advantage of the Level 5 provider's standardized routines."
Defining system or project requirements is a prime example. "With CMM, the entire requirements process is very rigidly defined. A Level 5 requirements document is very detailed and explicit and has metrics associated with it," Perkins explains. "But a company at a CMM Level 0 or 1 could have their requirements on the back of an envelope and no metrics. The Level 1 companies are lucky if they write out two pages."
The upshot, says Perkins, is that touting a CMM Level 5 rating to a Level 1 buyer "comes down to touting a feature that's of little value. It's like a car salesman in Alaska touting a car's great air conditioning. It may be great, but you can't take advantage of it."
Yet some companies, such as Farmers Insurance Group in Los Angeles, contract with Level 5 outsourcers exclusively, even though they may be unable to reap all of the benefits of doing so.
"The CIO dictated that we only do business with CMM Level 5 partners. It was a way of distinguishing the best companies from the rest of the pack," explains Alan Stanley, a program manager at Farmers.
"Beyond that, we don't take advantage of CMM. We tend to dictate how we want work done. We allocate work and processes based on what we do here, so I don't think we've really benefited from the CMM Level 5 side," he adds.
Helen Cousins, former CIO at Parsippany, N.J.-based Cendant Corp., says she believes that hiring a Level 5 outsourcer is a way to raise the bar for your own IT organization. "One of the things we gained out of necessity is the ability to more clearly define what we want," says Cousins, who is now CIO at Dex Media Inc. in Denver. "I've also noticed that when people working side by side are with people who are disciplined, it starts rubbing off."
But in a January 2003 report on the subject, Gartner analyst Partha Iyengar cautioned that users should also remember that CMM standards are descriptive rather than prescriptive, meaning that "they describe what must be done, rather than how it must be done." Consequently, a vendor can specify a certain way of executing a process that isn't the best possible implementation of that particular process.
In other words, Iyengar says, "CMM standards certification in no way guarantees that a vendor's internal implementation of these standards is best-in-class in any way."

CMM Checklist 1 2 3 Next » Recommend Digg Twitter ShareThis Email Print Send Feedback Reprints Jump to comments Project Management Additional Resources WHITE PAPER EFD vs. HDD - What You Need to Know Enterprise flash drives provide a new Tier 0 storage layer capable of delivering high I/O performance at a very low latency. Proper use of EFDs in an Oracle environment can deliver increased performance compared to fibre channel drives. Read the recommendations for identification of the best DB components for EFDs. WHITE PAPER Gartner Research Report: Magic Quadrant for Application Delivery Controllers, 2009 The market for products to improve the delivery of application software over networks remains dynamic and innovative. Vendors focused on solving enterprises' most-pressing application problems have become the top players. WHITE PAPER Eight Criteria for Server Load Balancing Server load balancers are a simple yet highly effective means to scale an application environment while ensuring its availability. Today's solutions should also address application performance and security. Read about the top eight criteria you should consider when choosing a server load balancer and how Citrix NetScaler meets those requirements. White Papers & Webcasts Oracle Accelerate - Not Just Smart but Timely Download Now!   Data in Action: Making the Planet Smarter Register Now Why BI is Ripe - Now! - For Businesses of Any Size Download Now!   Hosted Security Services: Why it make budget and security sense in today's economy Watch Now How Midsize Businesses Are Using ERP To Gain Competitive Advantage in a Tough Economy Download Now!   The Workday User Experience Video Watch Workday's Creative Director, Scott Lietzke, discuss the business-centered design philosophy at Workday. Rapid Implementation: The New Age of ERP Download Now!   Business Process Framework Demo Learn about Configurable Business Processes and Calculated Fields. Watch Now! Leveling the Field: Powerful Software Solutions for Midsize Companies Download Now!   Manager Experience Demo Go beyond self-service solutions to perform more effectively. Watch Now. All White Papers | All Webcasts Computerworld Reports Computerworld Technology Briefing: More than Business Value Computerworld Briefing: Staffing for Intelligence 8 Questions To Ask About Your Intrusion-Security Solution All Computerworld Reports Sign up to receive updates on the latest Careers resources IT Jobs See All Jobs Post a job for $295 Go Jobs by SimplyHired   White Papers Oracle Accelerate - Not Just Smart but Timely How Midsize Businesses Are Using ERP To Gain Competitive Advantage in a Tough Economy Leveling the Field: Powerful Software Solutions for Midsize Companies IDC Research Report: The Business Value of Consolidating on Energy-Efficient Servers The Business Case for Virtualization Best Practices for Optimizing Performance and Availability in Virtual Infrastructures Capacity Management in VMWare Virtualized Infrastructures Death to PST Files The Tangled Web: Silent Threats & Invisible Enemies Master Data Management Projects in Practice - An Information Difference Research Study Why BI is Ripe - Now! - For Businesses of Any Size Rapid Implementation: The New Age of ERP Faster, Cheaper and Easier to Maintain HP Technology Guide for Scalable Business Solutions Clipper Group Report: HP Provides Enhanced Options for Data Center Ensuring High Service Levels in Cloud Computing The Top 5 Server Monitoring Battles - and How You Can Win Them A Green Architectural Strategy That Puts IT in the Black Quantifying the Business Value of VMware View Open Source Master Data Management: The Time is Right Sponsored Links To get a better view of your entire data center, you need a better vantage point. Improve your vision with Hitachi IT Operations Analyzer - Free 30 day trial To get a better view of your entire data center, you need a better vantage point. Improve your vision with Hitachi IT Operations Analyzer - Free 30 day trial Stop malware without grinding performance to a halt with SonicWALL Cisco Unified Computing System: New Levels of Integration Diskeeper prevents fragmentation to boost speed and efficiency. Try Free! Discover the Four Trends Driving the Future of Data Centers Microsoft & Novell Interop-Ability Case Study: VTI Technologies Realizing Cost Savings Through Infrastructure Modernization Turn your desk phone and mobile phone into one with Sprint Mobile Integration. Stay informed with custom newsletters from Tech Dispenser Looking to add Unix/Linux functionality to Windows? Next-generation firewalls control applications and prevent threats. Not All QSAs Are Created Equal: What You Should Know Before You Buy The arrival of Serial Attached SCSI (SAS) marks a new era in storage scalability The AMD Virtual Experience Virtual Trade Show Introducing: Project Icebreaker Improve your Modular Cooling System Now with Alcatel-Lucent and Save CA ARCserve r12.5 is More Than Backup! Download Trial Version Today Take the Netezza TwinFin TestDrive! Enterprise search helps employees get more done. Get the facts from Google. Let Progress Software help your business make progress. How Novell & Microsoft interoperability pays off for MoneyGram Now let 1000's access reports themselves with SAP Crystal Reports Server Northwestern Computer Information Systems Program Streamline IT Costs. Boost Performance with WAN Optimization Tolly Performance Report  "Citrix NetScaler with nCore Outperforms F5 BIG-IP" Are you gambling with your data? It is at risk. Find out and protect it. Link to www.trustlto.com ITwhitepapers.com - Access thousands of white papers on 300+ technical topics. Leverage Your Cisco infrastructure for Superior Application Performance Learn about the AMD Virtual Experience Save up to 61% plus Free Cheesecake About Us Advertise Contacts Editorial Calendar Help Desk Jobs at IDG Privacy Policy Reprints Site Map CIO Computerworld CSO DEMO GamePro Games.net IDC IDG IDG Connect IDG Knowledge Hub IDG TechNetwork IDG Ventures IDG.net InfoWorld ITwhitepapers ITworld JavaWorld LinuxWorld Macworld Network World PC World The Industry Standard Copyright © 1994 - 2010 Computerworld Inc. All rights reserved. Reproduction in whole or in part in any form or medium without express written permission of Computerworld Inc. is prohibited. Computerworld and Computerworld.com and the respective logos are trademarks of International Data Group Inc.