Test Generation Apparatus Using Reference Model Comparison
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Creating an output that gives an expected result for software testing is labor-intensive, making it difficult to automate the process.
Innovation Solution
A test generation apparatus that compares the output of a test target system with a reference model's output and stores the input and output based on this comparison, enabling automatic creation of inputs and outputs for software testing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual creation of expected results is used for software testing, then testing accuracy is maintained, but productivity decreases due to significant manual work required
Solution Approach 1:
The patent creates a reference model that copies the behavior and interface of the test target system. This reference model automatically generates expected results by processing the same input data, eliminating manual creation while maintaining accuracy through behavioral replication.
Solution Approach 2:
The reference model acts as an intermediary between the input data and expected results. Instead of directly manually creating expected results, the system uses the reference model to generate them automatically, reducing manual work while preserving testing reliability.
2Productivity
If automated test generation is implemented, then productivity improves, but device complexity increases due to additional comparison and generation units
Solution Approach 1:
The reference model serves multiple functions: it replicates system behavior, generates expected results, and provides a basis for comparison. This multi-functionality reduces the need for separate dedicated components, managing system complexity while enabling automated test generation.
Solution Approach 2:
The patent merges the functions of test execution, result generation, and comparison into an integrated system. The test generation apparatus combines multiple operations (executing test target, executing reference model, comparing results) into a unified automated process.
3Reliability
If comprehensive test coverage is achieved, then reliability improves, but loss of time increases due to extensive manual effort required
Solution Approach 1:
The reference model is prepared in advance to mirror the test target system's behavior. This preliminary setup enables automatic generation of expected results during testing, eliminating the need for manual result creation for each test case and achieving comprehensive coverage efficiently.
Solution Approach 2:
The system performs self-testing by using the reference model to automatically generate expected results and compare them with actual results. This self-service capability eliminates manual intervention, allowing comprehensive test coverage without proportional increases in manual time investment.
Data Source
AI summary
A test generation apparatus includes: a comparison unit configured to compare an output of a test target system executed based on an input, with an output of a reference model executed based on the input; and a test generation unit configured to store the input and the output of the test target system in a storage unit, based on the result of the comparison performed by the comparison unit.