Dynamic Think Time Estimation for Accurate Load Testing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional testing systems fail to accurately simulate real user behavior by treating response time and think time as independent factors, leading to inaccurate test results in production environments.
Innovation Solution
The method involves simulating user interactions by measuring response times and computing estimated think times based on preceding response times, using ranges and modification constants to adjust think times according to changes in response times, thereby correlating response times with think times for more accurate simulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If conventional testing systems treat response time and think time as independent factors, then the testing system is simpler to implement, but the accuracy of test results deteriorates
Solution Approach 1:
The patent implements feedback by using the measured response time to dynamically adjust the think time parameter. The think time is calculated as a function of the response time (e.g., think time = response time × multiplier), creating a closed-loop system where the output of one measurement (response time) feeds back to influence the next action (think time). This resolves the contradiction by adding feedback mechanism that improves accuracy while maintaining reasonable system complexity.
Solution Approach 2:
The patent transitions from static, fixed think time values to dynamic think time calculations that adapt based on measured response times. The think time becomes a variable parameter that changes according to system performance characteristics, allowing the testing system to accurately simulate real user behavior patterns where think time naturally varies with response time. This dynamic approach improves measurement precision without requiring overly complex system architecture.
2Ease of operation
If fixed think time is used for all users, then the testing system is easier to operate, but the simulation of real user behavior deteriorates
Solution Approach 1:
The patent implements self-service by having the testing system automatically calculate and adjust think times based on measured response times, eliminating the need for manual configuration of think time parameters. The system self-adapts to different user behaviors and system performance characteristics, automatically generating appropriate think time values for each simulated user based on their individual response time patterns. This maintains ease of operation while significantly improving the reliability of user behavior simulation.
Solution Approach 2:
The patent changes the parameter of think time from a fixed value to a calculated variable that depends on response time measurements. By dynamically adjusting the think time parameter based on measured system performance, the system can accurately simulate diverse user behavior patterns without requiring complex manual setup. This parameter transformation allows the system to adapt to different scenarios automatically, improving simulation accuracy while keeping the system easy to operate.
Data Source
AI summary
Methods, systems, and computer programs, for estimating think times. One of the methods includes receiving a request to perform a test of one or more computing resources. The test of the one or more computing resources is performed by simulating an interaction of one or more simulated users with the one or more computing resources. Requests are submitted from the simulated user for execution by the one or more computing resources. Respective response times of the one or more computing resources to each of the requests are measured. An estimated think time of the simulated user is computed, wherein the estimated think time is computed based on at least one preceding response time.