Automating the 40 Monkeys

Sue Hildreth   Today’s Top Stories   or  Other Software Stories  

Why SaaS is Vital to Email and Web Security Take Control! Managing Your Application Library The Advantages of Migrating to Windows Vista® and Office 2007 Simultaneously Magic Quadrant for Application Delivery Controllers Improving Correspondence Management for Financial Services Firms with Adobe LiveCycle ES The Trend from Unix to Linux in SAP Data Centers SaaS Solutions for Remote Systems Management Learn-Fast Guide: Software as a Service is Growing Up SaaS Solutions for Remote Systems Management Sign up to receive Software Resource Alerts

October 4, 2004 (Computerworld) -- Some call it "the 40 monkeys test." Others prefer the more diplomatic "Friday night pizza party." Whatever the name, it's the traditional method for predeployment software testing: coercing a few dozen employees to come in after hours and beta-test an application to uncover bugs and performance problems before it's rolled out to customers and employees.

Unfortunately, it doesn't always work. "You ask a guy to run a hundred tests, he's eventually going to miss something," says Arthur Povlot, business development manager at Tescom Software Systems Testing Ltd. in London.

It's also virtually unrepeatable. "If 50 people find problems, which I fix and then want to do another test ... well, it just isn't easy to get everyone back again," says Dave Wollin, managing group director of IT at AXA Financial Inc. The New York-based finance and insurance company used Mercury Interactive Corp.'s testing tool before deploying a Web application to field agents.

The desire for repeatability and accuracy is one reason organizations are moving to automate testing, both to uncover bugs and ensure that they meet performance standards.

Melissa Webster, research director at IDC in Framingham, Mass., says worldwide sales of automated testing tools rose by 8.5% in 2003 and are expected to grow at an annual compound rate of 9.3% through 2007. "This sector has recovered faster than the overall IT market," she says.

The increasingly integrated nature of IT systems is another factor pushing companies toward automated testing. Human testers can't always accurately re-create the flow of transactions between applications. That's why Varian Medical Systems Inc., a Palo Alto, Calif.-based maker of medical devices, opted to purchase an automated functional testing tool, SilkTest, from Segue Software Inc. last year.

Image Credit: Richard Borge

Vendors such as Mercury, Segue Software, Compuware Corp., IBM's Rational unit, RadView Software Ltd. and Empirix Inc. offer products for testing client/server and Web-based applications, as well as mainframe and other legacy systems. Most of these products provide an interface for programming test scripts, as well as a capture-replay tool or visual scripting option for nontechnical users. Also included are reporting tools, and many vendors are starting to offer diagnostics capabilities, as well as monitoring tools for tracking application performance after deployment.

Continued...
1 | 2 | 3 | 4 | NEXT  

Print this Story

Send Us Feedback

E-mail this Story

Digg this Story

Slashdot this Story

Automating the 40 Monkeys

Sidebar: Monitoring Tools: The Next Step

"There is no doubt that iPhone 2.0.x software is buggier and slower (in contact browsing for instance, not Internet speed)..." Read more... "Reseller's team has just installed a new mainframe for this client, and the senior systems tech is justly proud that..." Read more... Read more Software posts or See all Blogs

Cellular operators say they're ready for Gustav Psystar calls Apple a 'monopoly' in antitrust charges Doubt cast on Seinfeld as Windows TV ads near More top stories...

IT workers hit hardest by offshore outsourcing, survey finds Microsoft: No more Windows Live Mail crashes with IE8 Beta 2 Microsoft warns of IE8 lock-in with XP SP3

Telecommuting: 6 questions to ask before you say yes Telework can change office dynamics in ways you hadn't anticipated. Proceed cautiously. Wi-Fi tweaks for speed freaks Got a painfully slow connection or random dead spots? Our tips will help you get the most out of your wireless network. 5 ways to drive your best workers out the door Listen up, managers: Employees don't quit the job; they quit you. Ultraportable laptops: Their rise and possible fall Netbooks, ultraportables, mini-notebooks — whatever you call them, they've been grabbing headlines. Are they here for the long term or just a flash in the pan? Windows Vista A to Z Reviews, analyses, how-tos, visual tours, hot issues and predictions about Microsoft's new OS. More Continuing Coverage After 9/11: Homeland Security Apple's iPhone Ask a Premier 100 IT Leader Bill Gates steps down BlackBerry Legal Battle Data Security Breaches Electronic Voting Firefox H-1B Visas HP's Boardroom Scandal Handheld Devices Hurricane Katrina Aftermath Microsoft Legal Issues Microsoft's Vista Open Source RFID Technology SCO's Linux Fight Sarbanes-Oxley Act Spam Voice Over IP Wi-Fi Windows Meta File Vulnerability Windows XP Service Pack 3 IT Careers 2010 Four years from now, the IT field will be a vastly different place. Will you be ready? More Special Reports Premier 100 IT Leaders 2007 Best in Class 2006 Computerworld Horizon Awards 2006 Premier 100 IT Leaders 2006 Salary Survey 2007 Best Places to Work in IT 2007 IT Forecast 2007 Premier 100 IT Leaders 40 Years of Computerworld ASPs, Take Two Best Places to Work in IT 2003 Best Places to Work in IT 2004 Best Places to Work in IT 2005 Best Places to Work in IT 2006 Business Intelligence Home Runs Business Intelligence: Smarter BI Business Intelligence: The Future of BI CRM Goes Vertical CRM: Sober CRM Career Planning Guide 2005 Careers: IT Profession 2010 Computerworld Horizon Awards 2005 Data Management: Mining for Gems Data Management: Taming Data Chaos Development: Hard-Workin' Web Sites Development: New Tools New Choices Development: The New World of Application Development Development: The Web Services Tsunami Development: Web Services Hurdles Disaster Recovery: Preparing for the Worst E-commerce Grows Up E-mail/Groupware: Big Decisions Faces of Mobile IT Forecast 2006 Global Mobile Hardware: Multiple Cores, Multiple Challenges Hardware: On-Demand Un-Hyped Hardware: The Shape of Things to Come Horizon Awards: 10 Cool Cutting Edge Technologies IT Management: Guide to Managing Vendors IT Management: Navigating Global IT IT Management: Recovery Ahead IT Management: The Future of IT IT Management: The Resourceful Project Manager Innovative Technology Awards 2004 Management: Reinventing IT Microsoft in Transition Mobile/Wireless Leaders and Laggards Mobile/Wireless: The Untethered Worker Mobile/Wireless: Tiny Gadgets, Huge Costs Network Management: Taking Control Networking: Turbulence Ahead! Networking: VoIP Goes Mainstream Operating Systems: In the Slow Lane Operating Systems: Linux Goes Global Operating Systems: Should You Nix Unix? Outsourcing: Offshore Buyer's Guide Outsourcing: Outsourcing Dangers Premier 100 IT Leaders 2004 Best in Class Premier 100 IT Leaders 2005 Best in Class ROI: Do the Math! Salary Survey 2003 Salary Survey 2004 Salary Survey 2005 Security Action Plan Security: Compliance Headaches Security: Proactive Security Security: Risk and Reward Security: Tips From Security Pros Souped-up Security Storage: Battling Complexity Storage: Cheap & Secure Data Stores Storage: Stretching Your Storage Dollars Storage: The Lean Storage Machine Storage: The New Rules of Storage Storage: The Ultimate Backup Guide Supply Chain: Missing Links Supply Chain: RFID Reality Check The Business of Security Web 2.0 Security Wireless: Wireless At Work All Zones Application Performance Zone Business Continuity Zone The File Data Management Zone Security Management Zone ITIL Best Practices Zone The SAS Zone Business Intelligence and Analytics Zone Windows Protection Zone Identity & Security Management Zone See your link here

Computerworld Technology Briefing: An open-source path to optimal virtualization Download this Technology Briefing now! (Source: Novell/IBM/Intel) Virtualization is about a lot more than just lowering total cost of ownership. In fact users that have taken an open source path to virtualization have realized the additional, mission-critical benefit of markedly reduced IT complexity, as well as a more flexible infrastructure that is easier to change to meet shifting, often unpredictable business requirements. Download this executive briefing  From Laggard to Leader: Transforming the Data Center From Laggard to Leader: Transforming the Data Center Register for this complimentary live webcast today! Go to the webcast  Windows Vista®: A Cyber Security Shield Get this paper now! (Source: Dell) Windows Vista® incorporates a number of new and enhanced security features that address spyware, security vulnerabilities and end user naivete. Download this white paper  White Papers Read up on the latest ideas and technologies from companies that sell hardware, software and services. Archiving Compliance with Sunbelt Exchange Archiver The Impact of Messaging and Web Threats Advanced Load Balancing: 8 Things You Need to Handle Today's Network Traffic View more whitepapers

• Automating the 40 Monkeys
• Sidebar: Monitoring Tools: The Next Step

• Cellular operators say they're ready for Gustav
• IT workers hit hardest by offshore outsourcing, survey finds
• Psystar calls Apple a 'monopoly' in antitrust charges
• More top stories 

Brought to you by Computerworld and InfoWorld, this virtual conference focuses on key areas such as: Service-oriented architecture (SOA) The event-driven enterprise Software-as-a-service (SaaS) Business architecture Plus many more tools to build, implement and maintain an agile architecture for the enterprise. This new and exciting event happens on September 25th from 10am - 6pm ET / 7am-3pm PT. Register now

Creating Tiered Storage Architecture This paper shows how Brocade StorageX enables tiers of storage across Windows and NetApp storage to align storage practices with organizational objectives. Download this white paper now!

Best Places to Work in IT Where can you earn top dollar, get the best benefits, the latest IT and more? Find out in our 14th annual survey.