Self-Checking Test Case Generation via Goal Hierarchy Path Inheritance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The complexity of functional verification in digital systems grows exponentially, leading to inefficiencies in creating comprehensive test plans, generating test cases, and measuring coverage, resulting in significant delays and expenses due to logic bugs caused by incomplete verification processes.
Innovation Solution
A method and apparatus for constructing a comprehensive test plan using a hierarchy of goals to generate test cases through reduced case analysis graphs, which automatically create self-checking test cases and provide direct measurement of test plan coverage, alleviating the effort in creating test cases and ensuring all scenarios are tested efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If comprehensive test plans are created manually to cover all scenarios, then test coverage is improved, but the time and effort required to create and maintain test plans increases exponentially
Solution Approach 1:
The patent segments the test plan creation process by dividing it into reusable templates and parameters. Test plans are broken down into modular components that can be independently defined and then automatically instantiated multiple times, transforming an exponential creation process into a linear one based on the number of scenarios.
Solution Approach 2:
The patent applies preliminary action by pre-defining test plan templates with common scenarios and parameters before actual test execution. These templates are created in advance and stored for automatic retrieval and instantiation, eliminating the need to manually create each test case from scratch during verification.
2Adaptability or versatility
If the number of state bits increases to improve system functionality, then system capability is improved, but the complexity of functional testing increases exponentially
Solution Approach 1:
The patent uses copying by automatically generating multiple test cases from a single template definition. Instead of manually creating unique test cases for each scenario combination, the system copies and instantiates predefined templates with different parameter values, reducing testing complexity regardless of the number of state bits.
Solution Approach 2:
The patent applies parameter changes by systematically varying test parameters across multiple instantiations of a template. The system automatically generates test cases by changing parameter values according to defined ranges and combinations, allowing comprehensive coverage of increased system functionality without proportionally increasing test creation complexity.
3Reliability
If manual test case creation is used to ensure coverage of all scenarios, then test completeness is improved, but productivity decreases due to the large number of scenarios
Solution Approach 1:
The patent implements self-service by enabling the test generation system to automatically create, manage, and maintain test cases without manual intervention. The system autonomously instantiates test plans from templates, tracks coverage, and updates test suites based on scenario definitions, dramatically improving verification throughput while maintaining completeness.
Solution Approach 2:
The patent uses feedback mechanisms to automatically track which scenarios have been tested and which remain uncovered. The system monitors test execution results and uses this feedback to identify gaps in coverage and automatically generate additional test cases as needed, ensuring completeness without manual oversight.
Data Source
AI summary
A method, system and apparatus for constructing a comprehensive test plan for a design under test (DUT) using a hierarchy of goals to generate test cases are provided. Embodiments of the present invention provide for automatically generating a first test case of the test plan from the goal hierarchy by traversing a path from a starting goal to an ending goal, wherein a first goal in the path has a first definition for one or more of a slot and a method. The ending goal of will then assume the first definition of the slot or method, as needed. A further aspect of the invention is generating a second test case by traversing a second path through the hierarchy. If the second path involves traversing a second goal with a second definition of the slot or method, then the ending goal will assume the second definition of the slot or method, as needed.