Real-Time Product Evaluation Using Live Transaction Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Evaluating new products in online services is resource-intensive due to the need for simulating production environments, requiring large numbers of test transactions that consume computing and personnel resources, and often fail to reflect up-to-date user activities.
Innovation Solution
An evaluation computer system accesses transaction details from a subset of current transactions in a production system to generate real-time test input data, allowing for more accurate and efficient evaluation of new products without the need for extensive simulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If simulation environments are used to evaluate new products, then product evaluation can be performed before production deployment, but large numbers of test transactions consume significant computing and personnel resources
Solution Approach 1:
The patent creates a copy of the production environment including the live transaction stream, allowing evaluation of new products using real production data instead of synthetic test data. This copying approach maintains evaluation reliability while reducing the need for extensive resource-intensive simulations
Solution Approach 2:
The system uses the production system's own transaction stream to evaluate new products, allowing the production data to serve the dual purpose of actual transactions and evaluation testing. This self-service approach eliminates the need for separate test transaction generation and reduces computing resource consumption
2Reliability
If simulation environments generate test transactions, then product evaluation can be performed, but the test transactions may not reflect up-to-date user activities
Solution Approach 1:
The system performs preliminary actions by capturing and storing the live transaction stream from the production system before evaluation is needed. This allows the evaluation environment to have access to current, up-to-date transaction data that reflects actual user activities, eliminating the information loss that occurs when using outdated or synthetic test data
Solution Approach 2:
By copying the actual production transaction stream rather than generating synthetic test transactions, the system ensures that evaluation data remains current and relevant to actual user activities. This copying mechanism preserves the authenticity and timeliness of transaction data
Data Source
AI summary
Techniques are disclosed relating to accessing, by an evaluation computer system, transaction details from a subset of current transactions being processed by a production version of a transaction processing service that is implemented on a production computer system. The evaluation computer system may perform, in real-time, tests on a particular product using the transaction details. The evaluation computer system may then store output from the tests that are performed using the transaction details.