Skip the navigation

Automating the 40 Monkeys

Increasingly, companies are turning to software tools for predeployment application testing.

By Sue Hildreth
October 4, 2004 12:00 PM ET

Computerworld - Some call it "the 40 monkeys test." Others prefer the more diplomatic "Friday night pizza party." Whatever the name, it's the traditional method for predeployment software testing: coercing a few dozen employees to come in after hours and beta-test an application to uncover bugs and performance problems before it's rolled out to customers and employees.


Unfortunately, it doesn't always work. "You ask a guy to run a hundred tests, he's eventually going to miss something," says Arthur Povlot, business development manager at Tescom Software Systems Testing Ltd. in London.


It's also virtually unrepeatable. "If 50 people find problems, which I fix and then want to do another test ... well, it just isn't easy to get everyone back again," says Dave Wollin, managing group director of IT at AXA Financial Inc. The New York-based finance and insurance company used Mercury Interactive Corp.'s testing tool before deploying a Web application to field agents.


The desire for repeatability and accuracy is one reason organizations are moving to automate testing, both to uncover bugs and ensure that they meet performance standards.


Melissa Webster, research director at IDC in Framingham, Mass., says worldwide sales of automated testing tools rose by 8.5% in 2003 and are expected to grow at an annual compound rate of 9.3% through 2007. "This sector has recovered faster than the overall IT market," she says.


The increasingly integrated nature of IT systems is another factor pushing companies toward automated testing. Human testers can't always accurately re-create the flow of transactions between applications. That's why Varian Medical Systems Inc., a Palo Alto, Calif.-based maker of medical devices, opted to purchase an automated functional testing tool, SilkTest, from Segue Software Inc. last year.
















Automating the 40 Monkeys Automating the 40 Monkeys

Image Credit: Richard Borge


"Our applications pass data like treatment and patient information, so there is a real-time flow between them. We could only test the whole system effectively with automation," explains Ashish Katrekar, quality assurance manager at Varian.
Also, manual testing added as much as six months to Varian's development cycle, seriously lengthening the time to market for its products. "Our test suites had grown so big that we couldn't run them quickly. We needed automation to achieve a quicker turnover of products," says Katrekar.


Vendors such as Mercury, Segue Software, Compuware Corp., IBM's Rational unit, RadView Software Ltd. and Empirix Inc. offer products for testing client/server and Web-based applications, as well as mainframe and other legacy systems. Most of these products provide an interface for programming test scripts, as well as a capture-replay tool or visual scripting option for nontechnical users. Also included are reporting tools, and many vendors are starting to offer diagnostics capabilities, as well as monitoring tools for tracking application performance after deployment.



Additional Resources
Forrester Consulting - Optimizing Users and Applications in a Mobile World
WHITE PAPER
Solving application issues over the WAN requires careful consideration. Based on their independent research, Forrester Consulting offers recommendations on how to tackle application performance issues, insufficient bandwidth and the inability to quickly restore users in a disaster.

Read now.

Security KnowledgeVault
WHITE PAPER
Security is not an option. This KnowledgeVault Series offers professional advice how to be proactive in the fight against cybercrimes and multi-layered security threats; how to adopt a holistic approach to protecting and managing data; and how to hire a qualified security assessor. Make security your Number 1 priority.

Read now.

Cut Communications Costs Once and for All
WHITE PAPER
New IP-based communications systems are being deployed by small and midsized businesses at a rapid rate. Learn how these organizations are enabling faster responsiveness, creating better customer experiences, speeding office or mobile interactions, and dramatically reducing existing communications costs.

Read now.

Applications White Papers
Forrester Total Economic Impact (TEI) Case Study - Oracle
In this paper, Forrester Consulting examines the total economic impact and potential return on investment (ROI) realized by three Enterprise organizations as they...
The Hidden Truth About Virtualizing Business-Critical Applications
This IDG whitepaper highlights key findings based on the Quickpoll Survey conducted with more than 300 Enterprise and Commercial IT decision makers worldwide...
Top 10 Myths About Virtualizing Business-Critical Applications
Even though virtualization has brought positive change to enterprise IT over the last decade, some skepticism remains about how valuable virtualization can be...
Enterprise Java Applications on VMware: Unix to Linux Migration Guide
This guide focuses on key considerations for IT Architects who are in the process of migrating Java applications from UNIX to Linux as...
Virtualizing Tier 1 Applications: A Critical Step on the Journey Toward the Private Cloud  
This IDC white paper explains how much of the Enterprise IT community is at a crossroads in extending their journey to the private...
All Applications White Papers
Applications Webcasts
Live Webcast
Banish Poor Application Performance: Eliminate Business Disruptions, Increase End User Productivity
End User Experience, 30-Min Webinar
Wed. Feb. 22nd ~ 11 AM ET

Are you ready to gain the proactive ability to rapidly respond...
Apps QuickStart Series Part 2: Designing and Deploying SQL Server on VMware vSphere
Download this webcast to learn about the design considerations for virtualizing SQL workloads, performance and scalability information and high-availability options, as well as...
Apps QuickStart Series Part 1: Designing and Deploying Exchange 2010 on VMware vSphere
Download this webcast to learn the virtual hardware design considerations for Exchange 2010, deployment using the building block approach, options for high-availability and...
Virtualize Business-Critical Applications with Confidence
Virtualizing business-critical applications has become a key focus for organizations as they move along their virtualization journey. With the launch of VMware vSphere®...
Discover the Benefits of Virtualization for Federal Applications
Want to say goodbye to missed SLAs? VMware can help you virtualize mission-critical applications such as Oracle, MS Exchange and SharePoint to achieve...
Reduce Application Lifecycle Management Costs with VMware ThinApp
Traditional desktop application deployment and management is a time-consuming and costly endeavor for IT. From development to deployment, including help desk support, the...
All Applications Webcasts
Newsletter Sign-Up

Receive the latest news test, reviews and trends on your favorite technology topics

Choose a newsletter
  1. View all newsletters | Privacy Policy
IT Jobs