Verification plan management method and device, computer equipment and computer readable storage medium
By obtaining and updating the design document function point information in the standard file, generating verification plan documents, and updating them based on the use case name and simulation test results, the problem of omissions and inconsistent formats in the integrated circuit front-end verification is solved, and automated management is realized Automatically generate the effect of test cases.
Patent Information
- Application Number
- CN202411284511.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-13
- Publication Date
- 2024-12-10
AI Technical Summary
During the front-end verification process of integrated circuits, it is easy to miss functional points for verification of planned documents, and it is difficult to track added or deleted functional points after updating the design documents. The document format is inconsistent and lacks a format check mechanism, resulting in poor reading and inheritance.
By obtaining the design document function point information in the standard file, generating verification plan documents, and updating the document based on the use case name and simulation test results, using hierarchical structure and classification mechanisms to automatically manage function points and test cases, providing computer equipment and readable storage media for automated management.
Ensure that the verification plan document is complete, automatically generate test cases, and automatically track design document updates, improve the readability and inheritance of the document, and avoid the problems of omissions and inconsistent formats.
Smart Images
Figure CN119106654A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of integrated circuit front-end verification, and in particular to a management method, device, computer equipment and computer-readable storage medium for a verification plan. Background Art
[0002] In the process of IC front-end verification, the verification plan document is a description of the verification steps and inspection mechanism of the function points of the object under test, and is an important basis for verification completeness. The current verification plan is that the verification personnel fill in the test steps and inspection mechanism of the function points in the verification plan document based on their understanding of the design documents. This method has several disadvantages.
[0003] First, when the verifier breaks down the functional points in the design document and writes them into the verification plan document, it is easy to miss some functional points and it is not easy to be detected.
[0004] Second, after the design document is updated, there is no comparison tool, and it is difficult to track the functional points added or deleted in the design document in the verification plan.
[0005] Third, the format of the verification plan document is inconsistent, and there is no format checking mechanism. The handwritten verification plan document by the verifier has problems with readability and inheritance.
[0006] Therefore, it is necessary to provide a verification plan management method, apparatus, computer equipment and computer-readable storage medium to effectively solve the above problems. Summary of the invention
[0007] The present invention provides a management method, device, computer equipment and computer-readable storage medium for a verification plan.
[0008] An embodiment of the present invention provides a method for managing a verification plan, including: Obtaining a standard file, wherein the standard file includes functional point information of a design document; Based on the standard document, a verification plan document is obtained; Obtain a use case name, and obtain a test case based on the use case name and the verification plan document; Based on the test case, a simulation test result is obtained; Based on the simulation test results, the verification plan document is updated.
[0009] Further, the function points include first-level numbered function points, second-level numbered function points and third-level numbered function points; the levels of the first-level numbered function points, second-level numbered function points and third-level numbered function points are successively lowered; Among them, the first-level numbered function point is the main project, the second-level numbered function point is the sub-project or verification target point, and the third-level numbered function point is the verification target point.
[0010] Furthermore, the standard file is in hvp format or csv format.
[0011] Furthermore, the step of obtaining a verification plan document based on the standard file includes: Obtaining an initial verification plan document, wherein the initial verification plan document includes a first array, a second array, a third array, a fourth array, and a fifth array; Obtaining the name information of the main project in the standard file and storing it in the first array in the verification plan document; Obtaining the length information of the main item in the standard file and storing it in a second array in the verification plan document; Obtaining the name information of the sub-item in the standard file and storing it in a third array in the verification plan document; Obtaining the length information of the sub-items in the standard file and storing it in a fourth array in the verification plan document; Obtaining the name information of the verification target point in the standard file and storing it in a fifth array in the verification plan document; The numbering information of the preset mark in the standard file is obtained and stored in the sixth array in the verification plan document.
[0012] Furthermore, it also includes: classifying the main items, sub-items and verification target points in the standard document; Among them, if there is no end symbol in the corresponding numbered function point, it is the main project corresponding to the first-level numbered function point; If there is an end symbol in the corresponding numbered function point, it is a secondary numbered function point; if the corresponding numbered function point further includes the preset mark, it is a verification target point, otherwise it is a sub-item; If there are two end symbols in the corresponding numbered function point, it is the verification target point corresponding to the third-level numbered function point.
[0013] Furthermore, before obtaining the use case name and obtaining the test case based on the use case name and the verification plan document, the method further includes: Common test items are obtained, and the verification plan document is updated based on the common test items; the common test items include register test common items, interrupt test common items, and reset test common items.
[0014] Furthermore, it also includes: The new design document is obtained, and updated function point information is obtained based on the original design document and the new design document.
[0015] Furthermore, a verification plan management device includes: A standard file acquisition module, used to acquire a standard file, wherein the standard file includes functional point information of a design document; A parsing module, used for obtaining a verification plan document based on the standard file; A test case processing module, used to obtain a test case name, and obtain a test case based on the test case name and the verification plan document; A simulation module, used to obtain simulation test results based on the test case; An updating module is used to update the verification plan document based on the simulation test results.
[0016] Furthermore, a computer device is provided, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of any of the above-mentioned methods when executing the computer program.
[0017] Furthermore, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps of any of the above-mentioned methods are implemented.
[0018] Compared with the prior art, the technical solution of the embodiment of the present invention has the following beneficial effects: The verification plan management method, apparatus, computer equipment and computer-readable storage medium provided in the embodiments of the present invention can automatically manage the functional points and verification plans in the design documents, ensuring that the verification plan document does not omit the functional points in the design documents.
[0019] Furthermore, the above-mentioned verification plan management method, apparatus, computer equipment and computer-readable storage medium can also automatically generate test cases to ensure that no test cases are missed.
[0020] Furthermore, the above-mentioned verification plan management method, apparatus, computer equipment and computer-readable storage medium can also read new design documents, compare them with previous documents, and automatically obtain the differences in the documents. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are some embodiments of the present invention, not all embodiments. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.
[0022] Figure 1 A flowchart of the traditional validation program management approach.
[0023] Figure 2 A flowchart of a verification plan management method provided by an embodiment of the present invention.
[0024] Figure 3 A structural block diagram of a verification plan management device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0025] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0026] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.
[0027] View now Figure 1 , the traditional verification plan management method includes the following steps: Step 101, the verification personnel extracts functional points based on the design document and fills the functional points that need to be verified into the verification plan document.
[0028] Step 102: The verification personnel write test cases according to the verification plan document.
[0029] Step 103, fill in the case status into the verification plan document according to the simulation result of the case.
[0030] In the above traditional verification plan management method, the current verification plan is that the verification personnel fill in the test steps and inspection mechanisms of the functional points in the verification plan document based on their understanding of the design document. This method has several disadvantages.
[0031] First, when the verifier breaks down the functional points in the design document and writes them into the verification plan document, it is easy to miss some functional points and it is not easy to be detected.
[0032] Second, after the design document is updated, there is no comparison tool, and it is difficult to track the functional points added or deleted in the design document in the verification plan.
[0033] Third, the format of the verification plan document is inconsistent, and there is no format checking mechanism. The handwritten verification plan document by the verification personnel has problems with poor readability and inheritance.
[0034] Based on the problems existing in the prior art, the embodiments of the present invention provide a new management method, apparatus, computer device and computer-readable storage medium for a verification plan.
[0035] Figure 2 A flowchart of a verification plan management method provided by an embodiment of the present invention. Figure 2 As shown, an embodiment of the present invention provides a verification plan management method, including: Step S201, obtaining a standard file.
[0036] Specifically, the standard file contains the functional point information of the design document. The standard file can be in HVP format or CSV format, and of course in other examples, it can also be other standard formats known in the art. The verification personnel use the Verdi or VManager tool to reverse the functional points of the design document and obtain the HVP or CSV standard file.
[0037] In some examples, the function points are divided into levels, including at least two levels, which can be two levels or three levels in this embodiment. Specifically, the function points include first-level numbered function points, second-level numbered function points and third-level numbered function points. The levels of the first-level numbered function points, the second-level numbered function points and the third-level numbered function points decrease in sequence. Among them, the first-level numbered function point is the main item (Main_item), the second-level numbered function point is the sub-item (sub_item) or the verification target point (target_object), and the third-level numbered function point is the verification target point (target_object). In this embodiment, when the second-level numbered function point is a sub-item, the level of the function point is three levels; when the second-level numbered function point is a verification target point, the level of the function point is two levels.
[0038] Step S202, obtaining a verification plan document based on the standard file.
[0039] In some examples, step S202 specifically includes: Step S2011, obtaining an initial verification plan document, the initial verification plan document including a first array, a second array, a third array, a fourth array and a fifth array.
[0040] Step S2022, obtaining the name information of the main project in the standard file and storing it in the first array in the verification plan document.
[0041] Step S2023, obtaining the length information of the main item in the standard file and storing it in the second array in the verification plan document.
[0042] Step S2024, obtaining the name information of the sub-item in the standard file and storing it in the third array in the verification plan document.
[0043] Step S2025, obtaining the length information of the sub-items in the standard file and storing it in the fourth array in the verification plan document.
[0044] Step S2026, obtaining the name information of the verification target point in the standard file and storing it in the fifth array in the verification plan document; Step S2027, obtaining the numbering information of the preset mark in the standard file and storing it in the sixth array in the verification plan document.
[0045] Specifically, first classify the main items, sub-items and verification target points in the standard file. Among them, if there is no end symbol in the corresponding numbered function point, it is the main item corresponding to the first-level numbered function point. If there is an end symbol in the corresponding numbered function point, it is a second-level numbered function point. If the corresponding numbered function point further includes a preset mark, it is a verification target point, otherwise it is a sub-item. If there are two end symbols in the corresponding numbered function point, it is a verification target point corresponding to the third-level numbered function point.
[0046] In some examples, the end symbol in the numbering function is ".". If there is no "." in the numbering function, it means that the numbering function is a first-level numbering, and the number name is stored in the first array, that is, the name array of the main item (main_item_n), and the length of the number is stored in the second array, that is, the length array of the main item (main_item_l). In this embodiment, the first-level numbering function cannot be used as a verification target point (target_object), otherwise an error will be reported.
[0047] If there is a "." in the numbering function, it means that the numbering function is a secondary numbering function, and it is further judged whether it is a sub-item or a verification target point. In this embodiment, it can be judged based on whether there is a preset mark (idx) in the numbering function. If there is a preset mark, the secondary numbering function is directly used as the verification target point. In this case, the sub-item is empty, and the name information of the verification target point is stored in the fifth array, that is, the verification target point array (target_object), and the corresponding preset mark number is stored in the sixth array, that is, the test mark array (test_idx).
[0048] If there is no preset flag (idx) in the numbering function, the secondary numbering function is a sub-item and the number name is stored in the third array, that is, the sub-item name array (sub_item_n), and the length of the number is stored in the fourth array, that is, the sub-item length array (sub_item_l).
[0049] In some examples, if there are more than two ending symbols ".", that is, if there are more than three levels of numbering, an error is reported.
[0050] The initial verification plan document includes the above-mentioned first array (main_item_n), second array (main_item_l), third array (sub_item_n), fourth array (sub _item_l), fifth array (target_object) and sixth array (test_idx). In the initial verification plan document, the information of the first array to the sixth array is empty. After obtaining the information of the first array, the second array, the third array, the fourth array, the fifth array and the sixth array, these information are respectively set in the corresponding columns of the initial verification plan document, so as to obtain the verification plan document.
[0051] In some examples, between step S202 and step S203 or before step S202 , the process further includes obtaining common test items and updating the verification plan document based on the common test items.
[0052] Specifically, the common test items include register test common items, interrupt test common items and reset test common items. The verification plan information corresponding to the common test items can be configured before or after the verification plan corresponding to the functional point of the design document in the verification plan document. The steps for obtaining the verification plan information of the common test items can be similar to the method for obtaining the verification plan corresponding to the functional point in the design document, which will not be repeated here. Of course, in other examples, the corresponding method for obtaining the verification plan information of the common test items can also be configured based on actual needs.
[0053] Step S203, obtaining the use case name, and obtaining the test case based on the use case name and the verification plan document.
[0054] Specifically, the verification planner can input the corresponding use case name (Test Name) based on the design document, and the system obtains the corresponding test case based on each use case name and the information in the verification plan document. For example, the test case name can include new phase (new), configuration phase (configuration_phase) and main phase (main_phase). Exemplarily, the system can store the corresponding relationship between the use case name, verification plan document information and test case, and the corresponding test case can be found by looking up the table.
[0055] Step S204, obtaining simulation test results based on the test case.
[0056] Specifically, the system performs simulation tests based on test cases and obtains simulation test results, which may include pass (PASS) and fail (FAIL). When the simulation test result is PASS, it means that the function point test has passed; when the simulation test result is FAIL, it means that the function point test has failed.
[0057] Step S205: updating the verification plan document based on the simulation test results.
[0058] Specifically, the verification plan document may also include a status column for the simulation test. After obtaining the simulation test results, the system stores the row number and status corresponding to the use case name of the simulation test in the use case result (case_result) dictionary, and updates the simulation test results to the Status column of the verification plan document.
[0059] In some examples, the method further includes: obtaining a new design document, and obtaining updated function point information based on the original design document and the new design document. Specifically, the updated function points may include added function points and deleted function points, and the updated function point information may be highlighted to better track the verification plan.
[0060] Furthermore, the present invention also provides a management device for a verification plan. Figure 3 As shown, the verification plan management device 30 includes: a standard file acquisition module 31, a parsing module 32, a test case processing module 33, a simulation module 34 and an updating module 35.
[0061] Among them, the standard file acquisition module 31 is used to obtain the standard file, which contains the functional point information of the design document. The parsing module 32 is used to obtain the verification plan document based on the standard file. The test case processing module 33 is used to obtain the use case name, and obtain the test case based on the use case name and the verification plan document. The simulation module 34 is used to obtain the simulation test results based on the test case. The update module 35 is used to update the verification plan document based on the simulation test results.
[0062] In some examples, function points include first-level numbered function points, second-level numbered function points, and third-level numbered function points; the levels of first-level numbered function points, second-level numbered function points, and third-level numbered function points are reduced in sequence. Among them, the first-level numbered function point is the main project, the second-level numbered function point is the sub-project or verification target point, and the third-level numbered function point is the verification target point.
[0063] In some examples, the standard file is in hvp format or csv format.
[0064] In some examples, the parsing module 32 performs the following steps: obtaining an initial verification plan document, the initial verification plan document including a first array, a second array, a third array, a fourth array and a fifth array; obtaining the name information of the main item in the standard file, and storing it in the first array in the verification plan document; obtaining the length information of the main item in the standard file, and storing it in the second array in the verification plan document; obtaining the name information of the sub-item in the standard file, and storing it in the third array in the verification plan document; obtaining the length information of the sub-item in the standard file, and storing it in the fourth array in the verification plan document; obtaining the name information of the verification target point in the standard file, and storing it in the fifth array in the verification plan document; obtaining the numbering information of the preset mark in the standard file, and storing it in the sixth array in the verification plan document.
[0065] In some examples, a classification module is also included for classifying the main projects, sub-projects and verification target points in the standard file; wherein, if there is no end symbol in the corresponding numbered function point, it is the main project corresponding to the first-level numbered function point; if there is an end symbol in the corresponding numbered function point, it is the second-level numbered function point; if the corresponding numbered function point further includes a preset mark, it is a verification target point, otherwise it is a sub-project; if there are two end symbols in the corresponding numbered function point, it is the verification target point corresponding to the third-level numbered function point.
[0066] In some examples, before obtaining the use case name and obtaining the test case based on the use case name and the verification plan document, the test case processing module 33 also executes: obtaining common test items and updating the verification plan document based on the common test items; the common test items include register test common items, interrupt test common items and reset test common items.
[0067] In some examples, a difference marking module is also included, which is used to obtain new design documents and obtain updated function point information based on the original design documents and the new design documents.
[0068] Furthermore, the present application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the task scheduling method in any of the above embodiments are implemented.
[0069] Furthermore, the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the task scheduling method in any of the above embodiments are implemented.
[0070] The verification plan management device, computer equipment and computer-readable storage medium provided by the present invention can implement any step in the above-mentioned verification plan management method, and this application will not go into details.
[0071] The verification plan management method, apparatus, computer equipment and computer-readable storage medium provided in the embodiments of the present invention can automatically manage the functional points and verification plans in the design documents, ensuring that the verification plan document does not omit the functional points in the design documents.
[0072] Furthermore, the above-mentioned verification plan management method, apparatus, computer equipment and computer-readable storage medium can also automatically generate test cases to ensure that no test cases are missed.
[0073] Furthermore, the above-mentioned verification plan management method, apparatus, computer equipment and computer-readable storage medium can also read new design documents, compare them with previous documents, and automatically obtain the differences in the documents.
[0074] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for managing a verification plan, characterized in that: include: Obtaining a standard file, wherein the standard file includes functional point information of a design document; Based on the standard document, a verification plan document is obtained; Obtain a use case name, and obtain a test case based on the use case name and the verification plan document; Based on the test case, a simulation test result is obtained; Based on the simulation test results, the verification plan document is updated.
2. The verification plan management method according to claim 1, characterized in that: The function points include first-level numbered function points, second-level numbered function points and third-level numbered function points; the levels of the first-level numbered function points, second-level numbered function points and third-level numbered function points decrease in sequence; Among them, the first-level numbered function point is the main project, the second-level numbered function point is the sub-project or verification target point, and the third-level numbered function point is the verification target point.
3. The verification plan management method according to claim 2, characterized in that: The standard file is in hvp format or csv format.
4. The method for managing a verification plan according to claim 2, characterized in that: The step of obtaining the verification plan document based on the standard file includes: Obtaining an initial verification plan document, wherein the initial verification plan document includes a first array, a second array, a third array, a fourth array, and a fifth array; Obtaining the name information of the main project in the standard file and storing it in the first array in the verification plan document; Obtaining the length information of the main item in the standard file and storing it in a second array in the verification plan document; Obtaining the name information of the sub-item in the standard file and storing it in a third array in the verification plan document; Obtaining the length information of the sub-items in the standard file and storing it in a fourth array in the verification plan document; Obtaining the name information of the verification target point in the standard file and storing it in a fifth array in the verification plan document; The numbering information of the preset mark in the standard file is obtained and stored in the sixth array in the verification plan document.
5. The verification plan management method according to claim 4, characterized in that: Also includes: Classify the main items, sub-items and verification target points described in the standard document; Among them, if there is no end symbol in the corresponding numbered function point, it is the main project corresponding to the first-level numbered function point; If there is an end symbol in the corresponding numbered function point, it is a secondary numbered function point; if the corresponding numbered function point further includes the preset mark, it is a verification target point, otherwise it is a sub-item; If there are two end symbols in the corresponding numbered function point, it is the verification target point corresponding to the third-level numbered function point.
6. The method for managing a verification plan according to claim 1, characterized in that: The method of obtaining the use case name and obtaining the test case based on the use case name and the verification plan document further includes: Common test items are obtained, and the verification plan document is updated based on the common test items; the common test items include register test common items, interrupt test common items, and reset test common items.
7. The verification plan management method according to claim 1, characterized in that: Also includes: The new design document is obtained, and updated function point information is obtained based on the original design document and the new design document.
8. A management device for a verification plan, characterized in that: include: A standard file acquisition module, used to acquire a standard file, wherein the standard file contains functional point information of a design document; A parsing module, used for obtaining a verification plan document based on the standard file; A test case processing module, used to obtain a test case name, and obtain a test case based on the test case name and the verification plan document; A simulation module, used to obtain simulation test results based on the test case; An updating module is used to update the verification plan document based on the simulation test results.
9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.