Quality management for Web services
Computerworld - Web services provide organizations with flexible, standards-based mechanisms for deploying business logic and functionality to distributed consumers. When functionality is distributed, however, quality management becomes imperative.
Mission-critical functions and sensitive data handling must work quickly and accurately at all times. To ensure this level of quality, organizations must employ test processes to ensure that the Web services are developed and deployed to meet these standards.
Defining the service
Quality starts with requirements. In order to design and deliver Web services, developers must know what functionality is needed. The more specific the requirements, the better the development effort. "The Web service must be fast" is a useless requirement. "The Web service must provide accurate responses in under two seconds on a 24/7 basis with up to 500 concurrent users" is better because having measurable requirements allows developers to work toward a goal. Defining boundaries like "up to 500 users" gives the project scope. Without these boundaries, code is likely to be developed inefficiently.
Likewise, testers must know what functional and performance requirements have been defined. Developers work on interpreting user requirements to generate code. Test strategy should be done concurrently to ensure that testers work from the same requirements used by development. If test strategy is based on developed code as opposed to initial requirements, the resulting end product may be based on a single individual's misinterpretation of a requirement.
By creating tests based on the original requirement documents, additional people interpret the project needs. That said, if differences in requirement interpretation arise, resolution early in the process occurs as opposed to discovery after development is complete. In this example, the testing group acts as an early check and balance on the software development process.
Once service-level agreements (SLA) are established, both parties (provider and consumer) need to agree on what measurements to take, what metrics to report, the success criteria and the ramifications should the provider fail to deliver. Following deployment of the Web services, both parties have a vested interest in monitoring the delivery of functionality. Web service testing and monitoring must cover the agreed upon metrics including the following:
- Availability: must be running and reachable
- Performance: must respond to requests within acceptable time limits
- Accuracy: must be accurate regardless of load
- Standards compliance: must work with all potential client types
- Integration: must work with all services and applications within the enterprise
Managing the quality process
Managing the flow of development and testing from inception through deployment necessitates communication. Requirements must be disseminated, business risks assessed, tests defined and results published. Each group and



- Excel 2010 Cheat Sheet
- Register for this Computerworld Insider Cheat Sheet and gain access to hundreds of premium content articles, guides, product reviews and more.
- Enterprise Java Applications on VMware: Unix to Linux Migration Guide
- This guide focuses on key considerations for IT Architects who are in the process of migrating Java applications from UNIX to Linux as...
- Desktop Modernization eBook
- This eBook looks at the challenges involved in delivering and managing desktops, today and in the future. Its goal is to demonstrate how...
- Market Landscape Report: Online File Sharing and Collaboration in the Enterprise
- The trend toward "consumerization" marches onward in IT; more and more end-users are choosing their own hardware plaforms and software applications in lieu...
- A Standards-based Mobile Application IdM Architecture
- This white paper explains how an identity management architecture, with the help of both SAML and OAuth, can support the two broad categories-web...
- Microsoft Volume Licensing Comparison - Enterprise
- With this quick-reference document, you can easily compare the available Microsoft Volume Licensing programs for enterprise organizations with 250+ devices, and tailor a... All Enterprise Architecture and SOA White Papers
- Quantifying the Business Value of VMware View - Webcast
- Many enterprises have discovered that the use of virtualization to support desktop workloads creates a range of significant benefits. These benefits include price...
- Optimizing Networks for the Cloud
- Join guest speaker, Rohit Mehra, IDC Director of Enterprise Communications Infrastructure, to explore current trends, discuss best practices for optimizing Data Center and...
- Apps QuickStart Series Part 2: Designing and Deploying SQL Server on VMware vSphere
- Download this webcast to learn about the design considerations for virtualizing SQL workloads, performance and scalability information and high-availability options, as well as...
- Apps QuickStart Series Part 1: Designing and Deploying Exchange 2010 on VMware vSphere
- Download this webcast to learn the virtual hardware design considerations for Exchange 2010, deployment using the building block approach, options for high-availability and...
- Customer Spotlight: How IPC The Hospitalist Company Implemented Oracle on VMware
- Have you been looking to hear about customer's experiences with the new VMware vCenter Site Recovery Manager product? View this webcast to learn... All Enterprise Architecture and SOA Webcasts