The Art of Application Performance Testing by Molyneaux, Ian -- Read -- Imperial Library of Trantor

Index

The Art of Application Performance Testing

SPECIAL OFFER: Upgrade this ebook with O’Reilly A Note Regarding Supplemental Files Preface

Audience About This Book Conventions Used in This Book Glossary Using Code Examples Safari® Enabled How to Contact Us Acknowledgments

1. Why Performance Test?

What Is Performance? The End-User Perspective

Performance Measurement Performance Standards The Internet Effect

Bad Performance: Why It’s So Common

The IT Business Value Curve Performance Testing Maturity: What the Analysts Think Lack of Performance Considerations in Application Design Performance Testing Is Left to the Last Minute How Many Users Are There? Underestimating Your Popularity Performance Testing Is Still an Informal Discipline Not Using Automated Testing Tools Application Technology Impact

Summary

2. The Fundamentals of Effective Application Performance Testing

Choosing an Appropriate Performance Testing Tool

Testing Tool Architecture What to Look for in an Automated Performance Testing Tool The Alternatives

Designing an Appropriate Performance Test Environment

Virtualization Injection Capacity Addressing Different Deployment Models Environment Checklist Software Installation Constraints

Setting Realistic and Appropriate Performance Targets

Consensus Key Performance Targets Availability or Uptime Concurrency, Scalability, and Throughput Response Time Network Utilization Server Utilization

Making Sure Your Application Is Stable Enough for Performance Testing Obtaining a Code Freeze Identifying and Scripting the Business-Critical Transactions

Transaction Checklist Transaction Replay Validation What to Measure? To Log In or Not to Log In Peaceful Coexistence

Providing Sufficient Test Data of High Quality

Input Data Target Data Runtime Data Data Security

Ensuring Accurate Performance Test Design

Pacing Injection Profile Setting the Number of Virtual Users per Transaction Deciding on Performance Test Types Load Injection Point of Presence Putting It All Together

Identifying the Server and Network Key Performance Indicators (KPIs)

Server KPIs Network KPIs

Allocating Enough Time to Performance Test Effectively Summary

3. The Process of Performance Testing

The Proof of Concept (POC)

Proof of Concept Checklist

Prerequisites Process Deliverables

From Requirements to Performance Test

Activity Duration Guidelines Step 1: Pre-Engagement Requirements Capture Step 2: Test Environment Build Step 3: Transaction Scripting Step 4: Performance Test Build Step 5: Performance Test Execution STEP 6 (Post-Test Phase): Analyze Results, Report, Retest

Case Study 1: Online Banking

Application Landscape Application Users Step 1: Pre-Engagement Requirements Capture Step 2: Test Environment Build Step 3: Transaction Scripting Step 4: Performance Test Build Step 5: Performance Test Execution Online Banking Case Study Review

Case Study 2: Call Center

Summary

4. Interpreting Results: Effective Root-Cause Analysis

The Analysis Process

Real-Time Analysis Post-Test Analysis

Types of Output from a Performance Test

Statistics Primer Response-Time Measurement Throughput and Capacity Monitoring Key Performance Indicators (KPIs)

Remote monitoring Installed agent

Server KPI Performance Network KPI Performance Load Injector Performance

Root-Cause Analysis

Scalability and Response Time Digging Deeper Inside the Application Server Looking for the “Knee” Dealing with Errors Baseline Data

Analysis Checklist

Pre-Test Tasks Tasks During Test Execution Post-Test Tasks

Summary

5. Application Technology and Its Impact on Performance Testing

Asynchronous Java and XML (AJAX)

Push Versus Pull

Citrix

Citrix Checklist

HTTP Protocol

Web Services .NET Remoting Browser Caching Secure Sockets Layer (SSL)

Java Oracle

Oracle Two-Tier Oracle Forms Server (OFS) Oracle Checklist

SAP

SAP Checklist

Service-Orientated Architecture (SOA) Web 2.0

Windows Communication Foundation (WCF) and Windows Presentation Foundation (WPF)

Oddball Application Technologies: Help, My Load Testing Tool Won’t Record It!

Before Giving Up in Despair . . . Alternatives to Capture at the Middleware Level Manual Scripting

A. Transaction Examples B. POC and Performance Test Quick Reference

The Proof of Concept

Proof of Concept Checklist

Prerequisites Process Deliverables

Performance Test Execution Checklist

Activity Duration Guidelines Step 1: Pre-Engagement Requirements Capture Step 2: Test Environment Build Step 3: Transaction Scripting Step 4: Performance Test Build Step 5: Performance Test Execution Step 6 (Post-Test Phase): Analyze Results, Report, Retest

Analysis Checklist

Pre-Test Tasks Tasks During Test Execution Post-Test Tasks

C. Automated Tool Vendors

Application Performance Optimization Load and Performance Testing

Free Tools

Web Remote Performance Testing and Monitoring Functional Testing Requirements Management

Free Tools

Service-Oriented Architecture (SOA) Testing

D. Sample KPI Monitoring Templates

Windows Generic KPI: Counters Application Specific KPI Templates

E. Sample Project Plan Index About the Author Colophon SPECIAL OFFER: Upgrade this ebook with O’Reilly

← Prev
Back
Next →

← Prev
Back
Next →