Automated Regression Testing Approach

Abstract

The invention discloses a method for automatic regression testing, step 1, regression start and operation, according to the specific conditions of the project, the regression tests of different types of test vectors are managed by type and level, and for different stages of hierarchical verification, respectively select Carry out module-level, subsystem-level or system-level regression testing, and generate regular information files and error information files; Step 2, post-processing regression information, perform statistical analysis on the regression test results of each level, and generate project regression homepages respectively, including Project information and regression version, coverage; generate module or regression classification pages, including a list of module classification types and a summary of passed or failed test cases; generate detailed regression results pages for each module, including each test case name, simulation run time , random times, passed or not, statistics of failure types, general information file index of simulation results. The invention can improve the efficiency of the design verification process and the completeness of the verification.

Description

technical field [0001] The invention relates to a method for automatic regression testing in verification work of chip front-end design. Background technique [0002] Regression testing plays a very important role in chip front-end verification. Because as the complexity of the chip becomes higher and higher, the required front-end test vectors are also continuously refined and increased. If there is no effective regression test method to effectively manage it, the entire verification work may fall into an inefficient work. state. [0003] With the continuous development and complexity of verification technologies and methods, new requirements and challenges are constantly raised for regression testing, which plays an important role in verification, that is, how to ensure the quality of verification work as much as possible within a limited time and improve the quality of front-end testing. The scientific and efficient design verification process provides a guarantee for t...

AI Technical Summary

Problems solved by technology

[0005] Such a regression test method can meet the requirements when the verification complexity is low and the number of test vectors is small; however, as the design and verification environment becomes more and more complex, the emphasis and number of test vectors continue to increase Under the current situation, traditional regression testing is becoming more and more difficult to meet the requirements of regression testing in different design verification stages

For example, the increase in the number of test vectors makes it difficult to complete the regression test of all test vectors in one night or in a short period of time. If the problem cannot be fed back as soon as possible, it will bury hidden dangers for further design modifications.

In addition, running a regression test after a long period of time will also prevent the problem from being fed back as soon as possible, so that the design is in a state of constantly modifying the functions (performance) that have already passed, and new modifications may always bring new problems. Such a vicious circle eventually leads to an inefficient circle of design work

Also, if you check the results manually or through simple commands every time, you can only check the approximate results, and you cannot give the key information of each test vector, unless you check the simulation results of each test vector in turn, and if there are many failed test vectors In the case of , such an approach is also difficult to implement; and the results of manual inspection may also produce artificial error detection results

Images