Parallel Regression Testing for Modified Transaction Processing Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Complex software systems, such as transaction processing systems, require rigorous testing to ensure that modifications do not unintentionally alter previously operational functionality, which is time-consuming and resource-intensive, often leading to extended downtime and increased costs.
Innovation Solution
A method for parallel regression testing that automatically processes previously successful transactions in both the unmodified and modified systems to identify any unexpected differences, eliminating the need for manual test development and reducing downtime.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If extensive manual regression testing is performed to ensure modifications do not break existing functionality, then reliability is improved, but loss of time and productivity deteriorate due to extended system downtime and high resource requirements
Solution Approach 1:
The patent creates a copy of the unmodified system and runs it in parallel with the modified system. This copy serves as a reference to compare outputs against, enabling automated validation without manual intervention. The copying principle allows the system to maintain reliability by comparing results while reducing downtime through parallel automated execution.
Solution Approach 2:
The patent performs preliminary actions by automatically selecting representative transactions from historical data and configuring the parallel testing environment before the modification is deployed. This preliminary setup enables the regression testing to begin immediately after deployment, minimizing the window of system downtime while ensuring comprehensive validation.
2Manufacturing precision
If comprehensive regression testing is performed to validate system functionality after modifications, then manufacturing precision is improved, but loss of time and productivity worsen due to resource intensity and technical complexity
Solution Approach 1:
By copying the unmodified system's behavior in a parallel environment, the patent achieves high test accuracy through direct comparison of outputs. This copying approach maintains manufacturing precision while improving productivity because the comparison is automated and requires minimal human intervention, allowing faster validation cycles.
Solution Approach 2:
The system performs self-service by automatically selecting transactions, configuring test parameters, and comparing results without requiring extensive manual technical expertise. This automation reduces the skill level needed to operate the testing system, thereby improving productivity while maintaining comprehensive validation accuracy.
3Measurement precision
If manual test development and execution is used to verify system modifications, then measurement precision is improved through thorough testing, but device complexity and ease of operation worsen due to high technical skill requirements
Solution Approach 1:
The patent uses copying to automatically replicate test cases and expected results from the unmodified system. This eliminates the need for manual test development while maintaining measurement precision, as the copied test data serves as the ground truth for comparison. The automation significantly reduces operational complexity and skill requirements.
Solution Approach 2:
The system performs self-service by automatically generating test configurations and selecting representative transactions without human intervention. This self-automating capability maintains high defect detection accuracy while dramatically simplifying operation, allowing non-experts to execute comprehensive regression testing.
4Reliability
If extensive regression testing is performed to ensure functionality validity, then reliability is improved, but cost increases due to resource requirements and extended downtime
Solution Approach 1:
The patent applies partial action by selecting a representative subset of transactions from historical data rather than testing every possible scenario. This selective approach maintains reliability by focusing on the most critical and representative cases while significantly reducing resource consumption and associated costs compared to exhaustive testing.
Solution Approach 2:
By copying the unmodified system's output as the reference standard, the patent enables automated comparison that reduces the need for repeated manual testing. This copying mechanism maintains reliability assurance while reducing the cumulative resource consumption associated with multiple manual testing iterations.
Data Source
AI summary
The disclosed embodiments relate to validation of prior system functionality subsequent to modification using parallel regression testing of the old, pre-modified system and new, modified system, based on the processing of a set of previously processed inputs known to have produced valid results. More particularly, the disclosed embodiments provide a system/method for validating a modified transaction processing system to determine whether the modification thereto altered unmodified and previously operational functionality by selecting a set of transactions, previously processed by the unmodified system and known to have produced acceptable results, process them using test instances of both the unmodified and modified versions of the system, and compare the results to determine any differences, aside from those which are expected as a result of the modification. Unexpected differences may be indicative of the modification compromising previously operational functionality of the system which was not intended to be modified.