Real-Time Server Testing via Live Message Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional server testing approaches require significant manual effort to design and write test scripts, often fail to simulate real-world scenarios, and cannot effectively handle high-volume traffic, leading to inadequate testing and errors in production environments.

Innovation Solution

Implementing a real-time server testing framework that uses live messages from users to test servers in production environments, eliminating the need for manual script design and allowing servers to be tested under actual production conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual test scripts are used to test servers, then testing coverage can be achieved, but significant manual effort is required

Engineering Contradiction:
Improvetesting coverageVSAvoidmanual effort
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system enables self-service testing by automatically capturing live messages from the production environment and using them to test the server without manual intervention. The server under test serves its own testing needs by processing real-world traffic that naturally occurs in production, eliminating the need for external manual test script execution.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The invention changes the parameter of test data from artificially generated messages to live production messages. By using actual messages that the server receives in production, the testing automatically adapts to real-world scenarios without requiring manual creation of test cases, thereby reducing manual effort while maintaining comprehensive coverage.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If traditional test scripts are used, then testing can be performed, but they cannot simulate high-volume traffic conditions

Engineering Contradiction:
Improvetesting accuracyVSAvoidhigh-volume traffic simulation
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system provides multi-functionality by simultaneously handling both testing and high-volume traffic processing. The server processes live messages for their intended purpose while concurrently using them for testing, allowing the system to adapt to various traffic volumes and patterns that occur in production without requiring separate testing infrastructure.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The testing approach is made dynamic by using live messages that naturally vary in volume, timing, and content according to real production patterns. Instead of static test scripts with fixed parameters, the system adapts to the dynamic characteristics of actual traffic, including high-volume bursts and varying message types, thereby improving testing accuracy for production conditions.

Inventive Principle:
Principle #15Dynamics

3Reliability

If manual test script design is performed, then specific scenarios can be covered, but it requires significant manual effort and time

Engineering Contradiction:
Improvescenario coverageVSAvoidtesting efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system enables self-service testing by automatically capturing live messages from the production environment and using them to test the server without manual intervention. The server under test serves its own testing needs by processing real-world traffic that naturally occurs in production, eliminating the need for external manual test script execution.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The invention changes the parameter of test data from artificially generated messages to live production messages. By using actual messages that the server receives in production, the testing automatically adapts to real-world scenarios without requiring manual creation of test cases, thereby reducing manual effort while maintaining comprehensive coverage.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10705946B2Techniques for real time server testing in a production environment
Publication Date: 2020.07.07 AMAZON TECH INC
  • US10705946B2 patent drawing
  • US10705946B2 patent drawing
  • US10705946B2 patent drawing

AI summary

Techniques are provided for real-time server testing in a production environment. Unlike traditional testing frameworks, embodiments of the present invention enable a server in production to be tested using live messages received from users. This eliminates the need to design and write test scripts to cover various scenarios and enables the server to be tested under live conditions. A test controller executing on the server under test can receive message attributes from a test client that define the types of messages to be used for a particular test. The test controller can identify live messages as they are received by the server that match the message attributes. The messages can be processed by the server in real time and then tested according to message tests received from the test client.