Dynamic Networked Target System Performance Testing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing testing methods for networked systems are static and lack the ability to perform dynamic, real-time performance testing, especially when scaling for larger loads or modifying parameters during testing, which limits their adaptability and customization to user needs.

Innovation Solution

A system and method for dynamically testing networked target systems by receiving instructions and parameters, initializing action repeater devices to simulate user actions, and gathering performance information in real-time, allowing for dynamic adjustment of test parameters and scalability during testing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If static testing methods are used with pre-prepared scripts, then testing can be executed with defined parameters, but the system cannot dynamically adjust parameters or scale during testing

Engineering Contradiction:
Improveability to adjust parameters during testingVSAvoidtesting system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The testing system transitions from static pre-defined scripts to dynamic real-time parameter adjustment. The system allows users to modify testing parameters, scale the number of action repeater devices, and change test specifications during execution without terminating the test, enabling adaptive response to system behavior observations.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system provides self-service capabilities through automated action repeater devices that execute test actions autonomously based on received instructions. The system automatically manages the testing process, including dynamic parameter adjustment and result collection, reducing the need for manual intervention while maintaining flexibility.

Inventive Principle:
Principle #25Self-service

2Quantity of substance

If cloud load testing services are used to simulate many users for peak load testing, then scalability for larger loads is achieved, but the tests cannot be easily modified during execution

Engineering Contradiction:
Improvenumber of simulated usersVSAvoidability to modify tests during execution
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

The system enables dynamic modification of test parameters during execution while maintaining scalability. Users can adjust the number of action repeater devices, modify test actions, and change parameters in real-time without stopping the test, combining the benefits of large-scale simulation with flexible adaptability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The testing process continues uninterrupted while allowing parameter modifications. The system maintains continuous test execution even as users adjust parameters, scale resources, or modify test specifications, ensuring that the useful action of testing proceeds without interruption.

Inventive Principle:
Principle #20Continuity of useful action

3Quantity of substance

If professional services are involved to run cloud load testing, then tests can scale for larger loads, but customization to user needs is limited

Engineering Contradiction:
Improvetesting capacityVSAvoiduser customization capability
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The system empowers users to independently configure and execute customized tests without requiring professional services. Users can define their own test specifications, choose the number of action repeater devices, select geographic locations, and customize test parameters according to their specific needs while the system handles the complex execution and scaling automatically.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The testing system provides universal functionality that accommodates various testing needs through a single platform. It can simulate users from different geographic locations, perform multiple types of actions, scale to different load levels, and adapt to different test requirements, making it versatile for various user scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Adaptability or versatility

If testing parameters are adjusted by terminating and re-executing tests, then new parameters can be tested, but time is lost due to test termination and re-execution

Engineering Contradiction:
Improveparameter adjustment capabilityVSAvoidtest execution time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system maintains continuous test execution while allowing parameter adjustments. Users can modify test parameters, actions, and configurations during test execution without termination, eliminating the time loss associated with stopping and restarting tests while still enabling comprehensive parameter testing.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The system allows users to pre-configure multiple test specifications and parameters before execution. During testing, users can switch between pre-configured parameters or make ad-hoc adjustments without restarting, as the system is already prepared to handle various parameter sets efficiently.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10277475B2System and method for dynamically testing networked target systems
Publication Date: 2019.04.30 PERFORCE SOFTWARE INC
  • US10277475B2 patent drawing
  • US10277475B2 patent drawing
  • US10277475B2 patent drawing

AI summary

A computerized method and system for conducting performance testing of a networked target system (NTS). The method comprises receiving at least one instruction and at least one parameter generated respective of a plurality of actions provided in a received test specification; testing the performance of the NTS using the at least one instruction and the at least one parameter; and gathering information respective of the performance testing of the NTS.