Automating the 40 Monkeys
Increasingly, companies are turning to software tools for predeployment application testing.
October 4, 2004 (Computerworld) --
Some call it "the 40 monkeys test." Others prefer the more diplomatic "Friday night pizza party." Whatever the name, it's the traditional method for predeployment software testing: coercing a few dozen employees to come in after hours and beta-test an application to uncover bugs and performance problems before it's rolled out to customers and employees.
Unfortunately, it doesn't always work. "You ask a guy to run a hundred tests, he's eventually going to miss something," says Arthur Povlot, business development manager at Tescom Software Systems Testing Ltd. in London.
It's also virtually unrepeatable. "If 50 people find problems, which I fix and then want to do another test ... well, it just isn't easy to get everyone back again," says Dave Wollin, managing group director of IT at AXA Financial Inc. The New York-based finance and insurance company used Mercury Interactive Corp.'s testing tool before deploying a Web application to field agents.
The desire for repeatability and accuracy is one reason organizations are moving to automate testing, both to uncover bugs and ensure that they meet performance standards.
Melissa Webster, research director at IDC in Framingham, Mass., says worldwide sales of automated testing tools rose by 8.5% in 2003 and are expected to grow at an annual compound rate of 9.3% through 2007. "This sector has recovered faster than the overall IT market," she says.
The increasingly integrated nature of IT systems is another factor pushing companies toward automated testing. Human testers can't always accurately re-create the flow of transactions between applications. That's why Varian Medical Systems Inc., a Palo Alto, Calif.-based maker of medical devices, opted to purchase an automated functional testing tool, SilkTest, from Segue Software Inc. last year.
|
Image Credit: Richard Borge |
"Our applications pass data like treatment and patient information, so there is a real-time flow between them. We could only test the whole system effectively with automation," explains Ashish Katrekar, quality assurance manager at Varian.
Also, manual testing added as much as six months to Varian's development cycle, seriously lengthening the time to market for its products. "Our test suites had grown so big that we couldn't run them quickly. We needed automation to achieve a quicker turnover of products," says Katrekar.
Vendors such as Mercury, Segue Software, Compuware Corp., IBM's Rational unit, RadView Software Ltd. and Empirix Inc. offer products for testing client/server and Web-based applications, as well as mainframe and other legacy systems. Most of these products provide an interface for programming test scripts, as well as a capture-replay tool or visual scripting option for nontechnical users. Also included are reporting tools, and many vendors are starting to offer diagnostics capabilities, as well as monitoring tools for tracking application performance after deployment.
 |
Automating the 40 Monkeys
|
|
|
|
|
|
"There is no doubt that iPhone 2.0.x software is buggier and slower (in contact browsing for instance, not Internet speed)..."
Read more...
"Reseller's team has just installed a new mainframe for this client, and the senior systems tech is justly proud that..."
Read more...
Read more Software posts or See all Blogs
|
Telework can change office dynamics in ways you hadn't anticipated. Proceed cautiously.
Got a painfully slow connection or random dead spots? Our tips will help you get the most out of your wireless network.
Listen up, managers: Employees don't quit the job; they quit you.
Netbooks, ultraportables, mini-notebooks whatever you call them, they've been grabbing headlines. Are they here for the long term or just a flash in the pan?
Reviews, analyses, how-tos, visual tours, hot issues and predictions about Microsoft's new OS.
Four years from now, the IT field will be a vastly different place. Will you be ready?
|
 |
| Computerworld Technology Briefing: An open-source path to optimal virtualization Download this Technology Briefing now! (Source: Novell/IBM/Intel) Virtualization is about a lot more than just lowering total cost of ownership. In fact users that have taken an open source path to virtualization have realized the additional, mission-critical benefit of markedly reduced IT complexity, as well as a more flexible infrastructure that is easier to change to meet shifting, often unpredictable business requirements. Download this executive briefing |
|
| From Laggard to Leader: Transforming the Data Center From Laggard to Leader: Transforming the Data Center Register for this complimentary live webcast today! Go to the webcast |
|
| Windows Vista®: A Cyber Security Shield Get this paper now! (Source: Dell) Windows Vista® incorporates a number of new and enhanced security features that address spyware, security vulnerabilities and end user naivete. Download this white paper |
|
| White Papers Read up on the latest ideas and technologies from companies that sell hardware, software and services. | View more whitepapers |
|
|