Automatic regression testing method

Abstract

The invention discloses an automatic regression testing method. The automatic regression testing method includes a first step, performing regression starting and running, in other words, respectively managing regression tests on different kinds of test vectors in a classified and graded manner according to specific conditions of projects, respectively selectively performing the module-level, subsystem-level or system-level regression tests for different stages of hierarchical verification and generating conventional information files and error information files; a second step, performing regression information post-processing, in other words, statistically analyzing each grade of regression test results, generating project regression home pages, generating module or regression classification branch pages and generating detailed regression result branch pages of each module. The project regression home pages contain project information, regression versions and coverage rates. The module or regression classification branch pages contain module classification type lists and pass or fail test case summaries. The detailed regression result branch pages of each module contain each test case name, simulation running time, random frequencies, case passing information, fail type statistics and simulation result conventional information file indexes. The automatic regression testing method has the advantage that the design verification process efficiency and the verification completeness can be improved by the aid of the automatic regression testing method.

Description

technical field [0001] The invention relates to a method for automatic regression testing in verification work of chip front-end design. Background technique [0002] Regression testing plays a very important role in chip front-end verification. Because as the complexity of the chip becomes higher and higher, the required front-end test vectors are also continuously refined and increased. If there is no effective regression test method to effectively manage it, the entire verification work may fall into an inefficient work. state. [0003] With the continuous development and complexity of verification technologies and methods, new requirements and challenges are constantly raised for regression testing, which plays an important role in verification, that is, how to ensure the quality of verification work as much as possible within a limited time and improve the quality of front-end testing. The scientific and efficient design verification process provides a guarantee for t...

AI Technical Summary

Problems solved by technology

[0005] Such a regression test method can meet the requirements when the verification complexity is low and the number of test vectors is small; however, as the design and verification environment becomes more and more complex, the emphasis and number of test vectors continue to increase Under the current situation, traditional regression testing is becoming more and more difficult to meet the requirements of regression testing in different design verification stages

For example, the increase in the number of test vectors makes it difficult to complete the regression test of all test vectors in one night or in a short period of time. If the problem cannot be fed back as soon as possible, it will bury hidden dangers for further design modifications.

In addition, running a regression test after a long period of time will also prevent the problem from being fed back as soon as possible, so that the design is in a state of constantly modifying the functions (performance) that have already passed, and new modifications may always bring new problems. Such a vicious circle eventually leads to an inefficient circle of design work

Also, if you check the results manually or through simple commands every time, you can only check the approximate results, and you cannot give the key information of each test vector, unless you check the simulation results of each test vector in turn, and if there are many failed test vectors In the case of , such an approach is also difficult to implement; and the results of manual inspection may also produce artificial error detection results

Images