Automated IT Testing via Real Transaction Replay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for testing IT systems under development require manual effort, limited real data usage, and extensive time and cost due to the need for manual testing by multiple personnel, which is inefficient and labor-intensive.
Innovation Solution
A method and system for automated testing using real transaction data, where network packets are captured, request and response data are processed, and compared for success or failure, with error analysis and mapping, to simulate real-world scenarios and reduce manual intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual testing is performed by multiple personnel to guarantee quality, then testing thoroughness is improved, but time consumption and cost increase
Solution Approach 1:
The patent creates virtual copies of real user transaction data and testing scenarios to simulate actual system usage. Instead of relying on manual testing by multiple personnel, the system captures real transaction data from production environments and replay's it through the system under test, automatically verifying functionality and performance without human intervention while maintaining comprehensive test coverage
Solution Approach 2:
The testing system performs self-testing by automatically capturing its own transaction data from the production environment and using that same data to validate the system under test. The system serves its own testing needs by replaying real user transactions through the SUD and automatically comparing results, eliminating the need for separate manual testing teams
2Reliability
If manual testing by multiple personnel is conducted, then system quality is improved, but manpower requirements increase
Solution Approach 1:
The patent replaces human testers with automated virtual agents that capture and replay transaction data. These digital copies of user behaviors perform testing functions that previously required multiple human personnel, dramatically improving productivity while maintaining comprehensive quality validation through automated comparison of system responses against expected outcomes
Solution Approach 2:
The system automatically performs quality validation by capturing real transaction data and using it to test the system under test without human intervention. The automated system handles data capture, transaction replay, response validation, and error reporting, eliminating the need for dedicated testing personnel while maintaining rigorous quality standards
3Reliability
If a large amount of real data is used for testing, then testing realism is improved, but additional conversion programs are required
Solution Approach 1:
The patent captures real transaction data directly from the production environment and creates faithful copies for testing purposes. The system replay's these exact real-world transactions through the system under test without requiring conversion programs, maintaining complete data fidelity and testing realism while avoiding the complexity of data transformation processes
Solution Approach 2:
Instead of converting production data into test data format, the system inverts the approach by capturing data in its original production format and replaying it directly through the system under test. This reversal eliminates the need for conversion programs while maintaining complete data authenticity and testing realism
4Loss of time
If automated testing is implemented, then time consumption is reduced, but testing accuracy may deteriorate
Solution Approach 1:
The automated system maintains high accuracy by creating precise copies of real user transactions and replaying them through the system under test. Each transaction is captured with complete fidelity including all data fields, formats, and sequences, ensuring that automated testing reproduces exact real-world scenarios without loss of precision or accuracy
Solution Approach 2:
The system incorporates automated feedback mechanisms that capture system responses, compare them against expected outcomes, and generate detailed error reports when discrepancies are found. This closed-loop feedback process ensures automated testing maintains high accuracy by immediately identifying and reporting deviations from expected behavior
Data Source
AI summary
A method for testing an IT system automatically, when it comes to testing based on real transaction data including: (a) obtaining a transaction message by capturing a network packet transmitted and received between a user system and a transaction processing system; (b) transmitting a request data included in the transaction message to the system under test; (c) receiving a response data from the system under test; and (d) comparing the response data received from the system under test and a response data included in the transaction message and determining success or failure, is provided.