Verification method and device, electronic equipment and storage medium

Abstract

This disclosure provides a verification method, apparatus, electronic device, and storage medium. The method includes: acquiring a first verification test case; creating a corresponding verification environment based on the first verification test case, wherein the verification environment has a corresponding first parameter configuration tree, the first parameter configuration tree including at least parameter nodes corresponding to each environment component; and verifying the object under test based on the verification environment and the corresponding first parameter configuration tree to obtain the verification result of the object under test under the first verification test case. During the verification process, the parameters required by each environment component in the verification environment are obtained from the parameter nodes corresponding to each environment component. This disclosure manages the parameters of the verification environment uniformly through a parameter configuration tree, and the parameters of the environment components of the verification environment are uniformly obtained from the corresponding parameter nodes, achieving separation of the parameters of the environment components from the environment, effectively improving parameter readability and management efficiency, and thus improving the efficiency of verification work.

Description

Technical Field

[0001] This disclosure relates to chip technology, and in particular to a verification method and apparatus, electronic devices, and storage media. Background Technology

[0002] In the field of chip front-end verification, configurable verification environment is one of the important means to improve the versatility of verification environment. Verification environment is usually complex and difficult to maintain. In this case, the relevant technologies usually define the parameters of the environment component in the environment component class. For different verification test cases, the environment needs to be modified again, resulting in poor parameter readability, low management efficiency, and thus low verification efficiency. Summary of the Invention

[0003] To address the aforementioned technical problems, this disclosure is proposed. Embodiments of this disclosure provide a verification method, apparatus, electronic device, and storage medium.

[0004] According to one aspect of the present disclosure, a verification method is provided, comprising: obtaining a first verification case; creating a corresponding verification environment based on the first verification case, wherein the verification environment includes environment components required by the first verification case, the verification environment has a corresponding first parameter configuration tree, the first parameter configuration tree including at least parameter nodes corresponding to each of the environment components; verifying a test object based on the verification environment and the corresponding first parameter configuration tree, and obtaining a verification result of the test object under the first verification case, wherein, during the verification process, the parameters required by each of the environment components in the verification environment are obtained from the parameter nodes corresponding to each of the environment components.

[0005] According to another aspect of the present disclosure, a verification apparatus is provided, comprising:

[0006] A first acquisition module is used to acquire a first verification test case; a first processing module is used to create a corresponding verification environment based on the first verification test case, wherein the verification environment includes environment components required by the first verification test case, and the verification environment has a corresponding first parameter configuration tree, the first parameter configuration tree including at least parameter nodes corresponding to each of the environment components; a second processing module is used to verify the object under test based on the verification environment and the corresponding first parameter configuration tree, and obtain the verification result of the object under test under the first verification test case, wherein during the verification process, the parameters required by each of the environment components in the verification environment are obtained from the parameter nodes corresponding to each of the environment components.

[0007] According to another aspect of the present disclosure, a computer-readable storage medium is provided, the storage medium storing a computer program for performing the verification method described in any of the above embodiments of the present disclosure.

[0008] According to another aspect of the present disclosure, an electronic device is provided, the electronic device comprising: a processor; a memory for storing executable instructions of the processor; the processor being configured to read the executable instructions from the memory and execute the instructions to implement the verification method described in any of the above embodiments of the present disclosure.

[0009] Based on the verification method, apparatus, electronic device, and storage medium provided in the above embodiments of this disclosure, a corresponding parameter configuration tree is set for the verification environment of the verification test case, and the parameters of the verification environment are managed in a unified manner. During verification, the parameters of the environment components of the verification environment are uniformly obtained from the corresponding parameter nodes, so that the parameters of the environment components are separated from the environment. For different verification test cases, only the parameters in the parameter configuration tree need to be updated, without modifying the environment, which effectively improves the readability and management efficiency of parameters, thereby improving the efficiency of verification work.

[0010] The technical solutions of this disclosure will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0011] The above and other objects, features, and advantages of this disclosure will become more apparent from the more detailed description of the embodiments thereof in conjunction with the accompanying drawings. The drawings are provided to further illustrate the embodiments of this disclosure and form part of the specification. They are used together with the embodiments of this disclosure to explain the disclosure and do not constitute a limitation thereof. In the drawings, the same reference numerals generally represent the same components or steps.

[0012] Figure 1 This is an exemplary application scenario of the verification method provided in this disclosure;

[0013] Figure 2 This is a flowchart illustrating a verification method provided in an exemplary embodiment of this disclosure;

[0014] Figure 3 This is a flowchart illustrating step 202 provided in an exemplary embodiment of this disclosure;

[0015] Figure 4 This is a flowchart illustrating a verification method provided in another exemplary embodiment of this disclosure;

[0016] Figure 5 This is an exemplary structural diagram of an initial parameter configuration tree provided in an exemplary embodiment of this disclosure;

[0017] Figure 6 This is an exemplary structural diagram of a first parameter configuration tree provided in an exemplary embodiment of this disclosure;

[0018] Figure 7This is a schematic diagram of the structure of the verification environment corresponding to the first parameter configuration tree provided in an exemplary embodiment of this disclosure;

[0019] Figure 8 This is a flowchart illustrating a verification method provided in yet another exemplary embodiment of this disclosure;

[0020] Figure 9 This is a schematic diagram of the structure of one application embodiment of the electronic device disclosed herein;

[0021] Figure 10 This is a schematic diagram illustrating the node mapping relationship between the parameter configuration tree and the verification environment provided in an exemplary embodiment of this disclosure;

[0022] Figure 11 This is a flowchart illustrating a verification method provided in yet another exemplary embodiment of this disclosure;

[0023] Figure 12 This is a schematic diagram of the structure of a verification device provided in an exemplary embodiment of this disclosure;

[0024] Figure 13 This is a schematic diagram of the structure of the first processing module 502 provided in an exemplary embodiment of this disclosure;

[0025] Figure 14 This is a schematic diagram of the structure of a verification device provided in another exemplary embodiment of this disclosure;

[0026] Figure 15 This is a schematic diagram of the structure of the second processing module 503 provided in an exemplary embodiment of this disclosure;

[0027] Figure 16 This is a schematic diagram of the structure of an application embodiment of the electronic device disclosed herein. Detailed Implementation

[0028] Hereinafter, exemplary embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of the present disclosure, and not all embodiments of the present disclosure, and it should be understood that the present disclosure is not limited to the exemplary embodiments described herein.

[0029] It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of this disclosure.

[0030] Those skilled in the art will understand that the terms "first," "second," etc., in the embodiments of this disclosure are only used to distinguish different steps, devices, or modules, and do not represent any specific technical meaning, nor do they indicate a necessary logical order between them.

[0031] It should also be understood that in the embodiments of this disclosure, "a plurality of" can refer to two or more, and "at least one" can refer to one, two or more.

[0032] It should also be understood that any component, data or structure mentioned in the embodiments of this disclosure can generally be understood as one or more unless expressly defined or given to the contrary in the context.

[0033] Furthermore, the term "and / or" in this disclosure is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this disclosure generally indicates that the preceding and following related objects have an "or" relationship.

[0034] It should also be understood that the description of the various embodiments in this disclosure emphasizes the differences between the various embodiments, and the similarities or similarities can be referred to each other. For the sake of brevity, they will not be described in detail.

[0035] At the same time, it should be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not drawn according to actual scale.

[0036] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit this disclosure or its application or use.

[0037] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0038] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0039] The embodiments disclosed herein can be applied to electronic devices such as terminal devices, computer systems, and servers, and can operate together with a wide range of other general-purpose or special-purpose computing system environments or configurations. Examples of well-known terminal devices, computing systems, environments, and / or configurations suitable for use with electronic devices such as terminal devices, computer systems, and servers include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputer systems, mainframe computer systems, and distributed cloud computing environments including any of the above systems, etc.

[0040] Electronic devices such as terminal devices, computer systems, and servers can be described in the general context of computer system executable instructions (such as program modules) executed by a computer system. Typically, program modules can include routines, programs, object programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types. Computer systems / servers can be implemented in distributed cloud computing environments, where tasks are executed by remote processing devices linked through communication networks. In distributed cloud computing environments, program modules can reside on local or remote computing system storage media, including storage devices.

[0041] This disclosure outlines

[0042] In the process of realizing this disclosure, the inventors discovered that in the field of chip front-end verification, the verification environment usually has a large number of parameters and is difficult to maintain. In response to this situation, the relevant technologies usually define the parameters of the environment component directly in the environment component class. For different verification test cases, it is necessary to directly modify the parameter values ​​in the environment, which leads to poor parameter readability, low management efficiency, and thus low verification efficiency.

[0043] Exemplary Overview

[0044] Figure 1 This is an exemplary application scenario of the verification method provided in this disclosure.

[0045] When it is necessary to verify the object under test (DUT), corresponding verification test cases need to be developed. Verification test cases describe the verification task, including verification objectives, verification environment, input data, verification steps, expected results, and other relevant information. By running verification test cases, the necessary verification environment is built. The verification environment integrates and connects the required environmental components to work, such as generating corresponding stimulus information and transmitting it to the DUT. The DUT processes the stimulus information and obtains the processing results. The verification environment monitors the output results of the DUT and compares them with the expected results to verify whether the DUT outputs the correct results. Simultaneously, the verification environment uses statistical information such as function coverage to check the verification completeness of the DUT. The DUT is the code segment describing the function of the device under test, such as the code segment describing the function of a chip. Environment components may include sequence generators, sequences, transaction data, drivers, functional coverage statistics, monitors, scoreboards, reference models, input interfaces, output interfaces, etc., which can be set according to actual needs. In the embodiments of this disclosure, in the created verification environment, there is no need to directly define related parameters in each environment component. By configuring a corresponding parameter configuration tree for the verification environment, the parameters required by each environment component are deployed to the parameter nodes on the corresponding parameter configuration tree. During the verification process, each environment component obtains relevant parameters from its corresponding parameter nodes, thereby separating the parameters required by the environment component from the environment. For different verification test cases, only the parameters in the parameter configuration tree need to be updated, without modifying the environment, which effectively improves the readability and management efficiency of parameters.

[0046] Exemplary methods

[0047] Figure 2 This is a flowchart illustrating a verification method provided in an exemplary embodiment of this disclosure. This embodiment can be applied to electronic devices, specifically such as terminal devices, servers, server clusters, etc. Figure 2 As shown, it includes the following steps:

[0048] Step 201: Obtain the first verification test case.

[0049] The first verification test case is a functional coverage test case, which includes relevant environmental information for creating the verification environment, such as the parameter configuration information of the verification environment. The parameter configuration information can be used to determine the first parameter configuration tree corresponding to the verification environment.

[0050] Step 202: Based on the first verification test case, create a corresponding verification environment. The verification environment includes the environment components required by the first verification test case. The verification environment has a corresponding first parameter configuration tree. The first parameter configuration tree includes at least the parameter nodes corresponding to each environment component.

[0051] The environment components required for the first verification test case do not directly include the parameters needed by those components. Instead, the parameters required by each environment component are configured in the first parameter configuration tree corresponding to the verification environment. Each environment component corresponds to a parameter node in the first parameter configuration tree. The first parameter configuration tree is essentially a structured parameter table.

[0052] Step 203: Based on the verification environment and the corresponding first parameter configuration tree, the object under test is verified to obtain the verification result of the object under test under the first verification test case. During the verification process, the parameters required by each environment component in the verification environment are obtained from the parameter node corresponding to each environment component.

[0053] During verification, the test object is verified by executing each environment component according to their connection relationships. During the execution of each environment component, the parameters required by each component are obtained from its corresponding parameter node. The correspondence between environment components and parameter nodes can be established using certain identifiers. For example, each environment component can be encapsulated with a corresponding parameter class, and a corresponding parameter node can be created in the first parameter configuration tree. The environment component contains an object of its corresponding parameter class, and a mapping relationship is established between the parameter class object and the corresponding parameter node in the first parameter configuration tree. The environment component can then access the relevant parameters in the parameter node through its own parameter class object.

[0054] The types of environment components included in the verification environment and the number of each type of environment component can be set through verification test cases according to actual needs.

[0055] The verification method provided in this embodiment sets up a corresponding parameter configuration tree for the verification environment of the verification test case, and manages the parameters of the verification environment in a unified manner. During verification, the parameters of the environment components of the verification environment are uniformly obtained from the corresponding parameter nodes, so that the parameters of the environment components are separated from the environment. For different verification test cases, only the parameters in the parameter configuration tree need to be updated, without modifying the environment, which effectively improves the readability and management efficiency of parameters, thereby improving the efficiency of verification work.

[0056] In one optional example, Figure 3 This is a flowchart illustrating step 202 provided in an exemplary embodiment of the present disclosure. In this example, step 202 may specifically include the following steps:

[0057] Step 2021: Based on the first verification test case, obtain parameter configuration information, which includes the variables and corresponding variable values ​​included in each parameter node of the first parameter configuration tree to be established.

[0058] The first verification test case contains parameter configuration information for determining the first parameter configuration tree. Once the first verification test case is obtained, this parameter configuration information can be retrieved based on it. The variable values ​​corresponding to each variable in this parameter configuration information constitute the relevant information for determining the first parameter configuration tree corresponding to the verification environment for this verification.

[0059] Step 2022: Determine the first parameter configuration tree based on the parameter configuration information.

[0060] Optionally, each parameter node can be pre-set, including variables related to the parameters required by the corresponding environment components, and can be assigned an initial value. After obtaining the parameter configuration information, the initial value in the corresponding parameter node can be updated according to the variable value corresponding to each variable, thereby determining the variable value of the parameter node in the first parameter configuration tree, and thus determining the first parameter configuration tree.

[0061] For example, an initial parameter configuration tree can be pre-established according to actual needs. The initial parameter configuration tree can include original parameter nodes corresponding to various environmental components that may be used. Various parameter variables and their corresponding initial parameter values ​​are configured in the original parameter nodes. Correspondingly, the environmental components corresponding to each original parameter node in each initial parameter configuration tree are pre-set. When performing verification for different verification cases, the required parameter nodes and the required variables and variable values ​​in the parameter nodes can be reset through the verification cases, thereby determining the first parameter configuration tree corresponding to the verification environment of this verification.

[0062] Step 2023: Create a verification environment based on the first parameter configuration tree.

[0063] After determining the first parameter configuration tree, the verification environment can be established by establishing the connection relationship between each environment component according to the correspondence between parameter nodes and environment components.

[0064] This disclosure determines the first parameter configuration tree by setting the parameter configuration information of the first parameter configuration tree corresponding to the verification environment of the current verification in the verification test case. Then, the verification environment of the current verification is created based on the first parameter configuration tree. This realizes that for different verifications, only the corresponding parameter configuration information needs to be set through the verification test case to achieve adaptive updates of the parameters in the parameter configuration tree. This automatically establishes the verification environment required for different verifications without the need to manually modify the parameters in the parameter configuration tree or the environment. This further improves the efficiency of verification work, greatly facilitates the operation of relevant personnel, and enhances the versatility of the verification device of this disclosure.

[0065] Figure 4 This is a flowchart illustrating a verification method provided in another exemplary embodiment of this disclosure.

[0066] In one optional example, step 2021 specifically includes:

[0067] Step 20211: Based on the first verification test case, obtain parameter configuration information; the parameter configuration information includes the node attribute variables and corresponding node attribute values, environment parameter variables and corresponding parameter values ​​included in each parameter node of the first parameter configuration tree to be established; the node attribute value indicates whether the node is enabled under the first verification test case; correspondingly, step 2022 specifically includes:

[0068] Step 20221: Update the parameter nodes of the initial parameter configuration tree according to the node attribute values ​​of each parameter node and the parameter values ​​corresponding to the environment parameter variables included in each parameter node to obtain the first parameter configuration tree; the initial parameter configuration tree includes a preset number of initial parameter nodes and the inheritance and inclusion relationships between each initial parameter node.

[0069] The initial parameter configuration tree is a pre-built parameter configuration tree with significant capabilities. It establishes a parameter configuration tree corresponding to all environment components that may be used in various verifications, and configures various possible variables and their initial values ​​for the parameter nodes in this tree. For a specific verification, the parameter nodes of the verification test case are enabled, the required parameter nodes are set, and the variable values ​​corresponding to the variables that need to be updated are set. By running the verification test case, the initial parameter configuration tree is updated, resulting in the first parameter configuration tree corresponding to the verification environment for this verification. Inheritance and inclusion relationships include inheritance and / or inclusion relationships; the specific relationships between the various environment components can be set according to actual needs.

[0070] For example, the node attribute variable "disable" and its corresponding node attribute value can be "0" or "1", where "0" indicates enabled and "1" indicates disabled. Alternatively, other variable symbols can be used to represent the node attribute variable. The specific node attribute value can also be set according to actual needs, as long as it clearly represents the specific attribute of the node. The environment parameter variable includes the number of sub-components included in this environment component, "Driver_Num", with a corresponding parameter value of "3". This indicates that the environment component corresponding to this parameter node includes 3 driver environment components, and these 3 driver environment components are derived from the aforementioned environment component corresponding to this parameter node. This is only an illustrative example; the specific representation can be set according to actual needs, and this disclosure embodiment does not limit it.

[0071] This disclosure enables various verifications by pre-establishing a highly capable initial parameter configuration tree. By setting the required parameter nodes, variables, and variable values ​​for different verification cases, it is possible to easily meet the different verification requirements of different test objects. Even if new requirements are added to the environment components during the verification iteration process, there is no need to manually modify the environment structure, which greatly reduces the workload, further improves the efficiency of verification work, and enhances the versatility of the verification device disclosed herein.

[0072] In one optional example, step 2023 may specifically include:

[0073] Step 20231: Create a verification environment based on the node attribute values ​​of each parameter node in the first parameter configuration tree and the preset mapping relationship; the preset mapping relationship includes the mapping relationship between each parameter node and the environment component.

[0074] The preset mapping relationship is a pre-established mapping relationship between parameter nodes and environment components. Specifically, this preset mapping relationship can be obtained based on the original parameter node and environment component mapping relationship in a pre-established initial parameter configuration tree with greater capabilities. After determining the first parameter configuration tree, each parameter node includes a node attribute value. The node attribute value indicates whether the parameter node is enabled. When the node attribute value indicates that the parameter node is enabled, it means that the environment component corresponding to the parameter node needs to be established. When the node attribute value indicates that the parameter node is disabled, it means that the environment component corresponding to the parameter node does not need to be established. Therefore, based on the enabling status of each parameter node and the mapping relationship between parameter nodes and environment components, the environment components that need to be established can be determined. When establishing an environment component, the required parameters are obtained from the parameter node corresponding to that environment component.

[0075] In an optional example, step 20231 may specifically include: for a first parameter node in the first parameter configuration tree whose node attribute value is enabled, establishing a first environment component corresponding to the first parameter node according to a preset mapping relationship, obtaining the first parameter required for establishing a sub-component from the first parameter node, and establishing a sub-component according to the first parameter when the node attribute value of the parameter node corresponding to the sub-component is enabled, and so on, until the environment component tree corresponding to the first test case is established and the verification environment is obtained.

[0076] The first parameter node can be any node in the first parameter configuration tree whose attribute value is enabled. Since the first parameter node is enabled, an environment component corresponding to it needs to be created. This is done by retrieving the first environment component corresponding to the first parameter node from the pre-set environment components, and obtaining the parameters required for the first environment component from the first parameter node, such as the first parameter for creating a sub-component of the first environment component. Once the relevant parameters for the sub-components to be created under the first environment component are determined, the enabling status of the child nodes under the first parameter node is checked. Based on the enabling status of each child node under the first parameter node and the mapping relationship between parameter nodes and environment components, the relevant sub-components under the first environment component are created. Corresponding to the parameter configuration tree, the environment components of the verification environment also form a tree structure with corresponding derivation and inheritance relationships. Specifically, the specific structure of the verification environment is consistent with the tree structure formed by the enabled parameter nodes in the parameter configuration tree.

[0077] For example, Figure 5 This is an exemplary structural diagram of an initial parameter configuration tree provided by an exemplary embodiment of this disclosure; wherein, disable=0 indicates enable, and other environmental parameter variables are not shown. In this example, each node in the initial parameter configuration tree is initialized to enable. Figure 6 This is an exemplary structural diagram of a first parameter configuration tree provided by an exemplary embodiment of the present disclosure; wherein, disable=0 indicates enable, disable=1 indicates disable, other environmental parameter variables are not shown, and parameter nodes 1113-1118 in the first parameter configuration tree are updated to be disabled relative to the initial parameter configuration tree. It should be noted that if the parent node is disabled, its child nodes are also disabled. Figure 7 This is a schematic diagram of the structure of the verification environment corresponding to the first parameter configuration tree provided in an exemplary embodiment of this disclosure. The environment component i corresponds to the parameter node i.

[0078] This disclosure determines the parameter nodes that need to be established for the corresponding environment components from the initial parameter configuration tree by enabling parameter nodes, thereby realizing adaptive environment establishment and verification based on verification test cases. In this way, the common parameters of various verification functions can be managed through the initial parameter configuration tree, further improving versatility.

[0079] Figure 8 This is a flowchart illustrating a verification method provided in yet another exemplary embodiment of this disclosure.

[0080] In one optional example, the method disclosed herein further includes, prior to obtaining the first verification test case:

[0081] Step 301: Establish an initial environment according to preset requirements. The initial environment includes a preset number of environment components and the inheritance and inclusion relationships between each environment component.

[0082] The preset requirements can be set according to actual needs, such as recent verification requirements or all verification requirements based on experience. The initial environment established includes the environment components that may be needed for various verification requirements. Environment components include various types, and multiple environment components of each type can be established. Multiple environment components of the same type can be distinguished by a unique identifier. For example, five agent environment components can be established, and each agent environment component includes a driver environment component and a monitor environment component. In actual verification, for a test object, only two of the agent environment components may be needed.

[0083] Step 302: Establish a first configuration tree based on the initial environment; the first configuration tree includes the original parameter nodes corresponding to each environment component in the initial environment, and the original parameter nodes include the node attribute variables and environment parameter variables required by their corresponding environment components.

[0084] Since the initial environment includes various environment components that may be needed for various verification requirements, the original parameter nodes in the first configuration tree correspond one-to-one with the environment components of the initial environment. Therefore, the first configuration tree can meet the parameter requirements of various verifications.

[0085] Step 303: Initialize the first configuration tree based on the basic use cases to obtain the initial parameter configuration tree. The basic use cases include the initial node attribute values ​​corresponding to the node attribute variables in each original parameter node and the initial parameter values ​​corresponding to the environment parameter variables.

[0086] The basic test case includes the initial node attribute values ​​and environment parameter values ​​corresponding to the node attribute variables in each original parameter node. Therefore, running the basic test case can initialize the first configuration tree, assign the initial node attribute values ​​to the node attribute variables in the first configuration tree, and assign the initial parameter values ​​to the environment parameter variables in the first configuration tree, thereby initializing the first configuration tree and obtaining the initial parameter configuration tree.

[0087] Step 304: Establish the mapping relationship between the parameter nodes of the initial parameter configuration tree and the environment components in the initial environment, as a preset mapping relationship.

[0088] After obtaining the initial parameter configuration tree, for subsequent applications, it is necessary to establish a mapping relationship between the parameter nodes in the initial parameter configuration tree and the environmental components in the initial environment. This mapping relationship is stored as the aforementioned preset mapping relationship for use in the actual verification process.

[0089] For example, the node handle of a parameter node can be passed to the parameter class object handle of the corresponding environment component to achieve the mapping between the parameter node and the environment component. For example, if the parameter node handle is test_case_cfg, it can be passed to the test_case_cfg handle in the environment component test_case. The specific settings can be configured according to actual needs.

[0090] In an optional example, after establishing the mapping relationship between the parameter nodes of the initial parameter configuration tree and the environment components in the initial environment in step 304, as a preset mapping relationship, the method of this disclosure further includes:

[0091] Step 401: Obtain the registration instruction for the new environment component.

[0092] The "Add Environment Component Registration" command is used to add environment components to the initial environment. It can include relevant information needed to create the new environment component. This command can be triggered by a user, who can be a relevant person. For example, if a relevant person discovers a new environment component that may be needed, but the initial environment does not yet have that component, they can trigger the "Add Environment Component Registration" command through the interactive interface to register the environment component.

[0093] Step 402: Create a new environment component in the initial environment according to the new environment component registration instruction, and create a new parameter node corresponding to the new environment component in the initial parameter configuration tree.

[0094] The principle behind creating new environment components is similar to that of creating individual environment components when creating the initial environment, and will not be elaborated further here. Based on the inheritance and inclusion relationships between the new environment component and other environment components in the initial environment, the position of the new parameter node in the initial parameter configuration tree is determined, and a new parameter node corresponding to the new environment component is created at the corresponding position in the initial parameter configuration tree. The variables and their values ​​included in the new parameter node can be set according to actual needs.

[0095] Optionally, the variables and variable values ​​included in the newly added parameter node can be carried in the newly added environment component registration instruction, so as to obtain the corresponding variables and variable values ​​from the newly added environment component registration instruction.

[0096] Optionally, the variable values ​​included in the newly added parameter node can also be entered by the user through a variable setting interface displayed when the new parameter node is created. The specific setting method is not limited.

[0097] Step 403: Add a mapping relationship between the newly added environment component and the newly added parameter node to the preset mapping relationship.

[0098] To ensure the subsequent application of newly added environment components, it is also necessary to add a mapping relationship between the newly added environment components and the newly added parameter nodes to the preset mapping relationship. This mapping can be done by setting corresponding identifiers, which can be configured according to actual needs.

[0099] In one optional example, Figure 9 This is a flowchart illustrating step 203 provided in an exemplary embodiment of this disclosure. In this example, step 203, based on the verification environment and the corresponding first parameter configuration tree, verifies the object under test to obtain the verification result corresponding to the first verification test case, including:

[0100] Step 2031: Based on the environmental components in the verification environment and the parameters required by each environmental component included in each parameter node of the first parameter configuration tree, generate the stimulus information corresponding to the first verification test case and transmit it to the test object so that the test object can process the stimulus information and obtain the processing result.

[0101] When each environment component is executed, the required parameters are obtained from the corresponding parameter node in the first parameter configuration tree, such as the input required for component execution, or the number of stimuli to be generated. The working principle of the specific environment components will not be elaborated here.

[0102] Step 2032: Based on the processing results, determine the verification result of the object under test under the first verification case.

[0103] The test object responds to the stimulus information, performs corresponding processing, and outputs the processing result. The monitor environment component in the verification environment can monitor the processing result returned to the scoreboard environment component for comparison with the output result of the reference model. The reference model is a behavioral model simulating the test object and outputs the expected result. By comparing the output result of the test object with the expected result, the verification result of the test object under the first verification test case is obtained. The specific working principle of the verification environment will not be elaborated here.

[0104] In one optional example, Figure 10This is a schematic diagram of the node mapping relationship between the parameter configuration tree and the verification environment provided in an exemplary embodiment of this disclosure. In this example, the verification of a CPU (Central Processing Unit) containing two AXI (Advanced eXtensible Interface, a bus protocol) ports is taken as an example. In this example, the parameter nodes that are not enabled in the parameter configuration tree are not shown. During verification, the created verification environment includes the necessary environment components. Instead of directly defining parameters within each component, a corresponding parameter class is encapsulated for each component, and the component itself contains an object of this parameter class (e.g., cpu_sub_env_cfg, axi_driver_cfg, etc. in the diagram). This parameter class object encapsulates the parameters required by the component. These parameters are deployed to parameter nodes in the corresponding parameter configuration tree, identified by the parameter class object. During verification, the component accesses the relevant parameters in the parameter nodes through its own parameter class object to obtain the necessary parameters. This separates the parameters required by the component from the environment itself. For different verification test cases, only the parameters in the parameter configuration tree need to be updated, without modifying the environment, effectively improving parameter readability and management efficiency. Even if a component doesn't currently require parameters, a parameter class can be defined for it, and the component can contain a parameter class object. Members in the parameter class can be empty, and can be added later as needed.

[0105] For example, Table 1 shows sample code for the parameter class. Lines 1-9 define the cpu_sub_env parameter class cpu_sub_env_configure, which contains the parameter axi_agent_num, which affects how many axi_agents are instantiated in cpu_sub_env; lines 11-19 are the cpu_sub_env class, which is the environment component, and line 12 contains the cpu_sub_env_cfg parameter class object.

[0106] Table 1

[0107]

[0108] For example, Table 2 shows sample code for parameter class inclusion and nested instantiation in the parameter configuration tree. The `test_case_configure` class contains `tb_env_cfg` objects, and the `tb_env_configure` class contains `cpu_sub_env_cfg` objects. Lines 6 and 15 illustrate nested instantiation, where the objects contained within a class are instantiated within the class's constructor.

[0109] Table 2

[0110]

[0111] For example, when a new uart_sub_env component needs to be added to the verification environment, a new uart_sub_env_config parameter class object uart_sub_env_cfg needs to be added to the parameter configuration tree at the same time.

[0112] In one optional example, Figure 11 This is a flowchart illustrating a verification method provided in yet another exemplary embodiment of this disclosure. In this example, the method includes:

[0113] 1. Establish an initial environment based on preset requirements. The initial environment includes a preset number of environment components and the inheritance and inclusion relationships between each environment component.

[0114] 2. Establish the first configuration tree based on the initial environment; the first configuration tree includes the original parameter nodes corresponding to each environment component in the initial environment, and the original parameter nodes include the node attribute variables and environment parameter variables required by their corresponding environment components.

[0115] 3. Initialize the first configuration tree based on the basic use cases to obtain the initial parameter configuration tree. The basic use cases include the initial node attribute values ​​corresponding to the node attribute variables in each original parameter node and the initial parameter values ​​corresponding to the environment parameter variables.

[0116] 4. Establish the mapping relationship between the parameter nodes of the initial parameter configuration tree and the environment components in the initial environment, as a preset mapping relationship.

[0117] 5. Obtain the first verification test case.

[0118] 6. Based on the first verification test case, obtain the parameter configuration information. The parameter configuration information includes the variables and corresponding variable values ​​included in each parameter node of the first parameter configuration tree to be established. The variables include node attribute variables and environment parameter variables. Correspondingly, the variable values ​​include the node attribute values ​​corresponding to the node attribute variables and the parameter values ​​corresponding to the environment parameter variables.

[0119] 7. Update the parameter nodes of the initial parameter configuration tree according to the node attribute values ​​of each parameter node and the parameter values ​​corresponding to the environment parameter variables included in each parameter node to obtain the first parameter configuration tree; the initial parameter configuration tree includes a preset number of initial parameter nodes and the inheritance and inclusion relationships between each initial parameter node.

[0120] 8. Create a verification environment based on the node attribute values ​​and preset mapping relationships of each parameter node in the first parameter configuration tree; the preset mapping relationships include the mapping relationships between each parameter node and the environment components.

[0121] 9. Based on the parameters required by each environment component in the verification environment and each parameter node in the first parameter configuration tree, generate the stimulus information corresponding to the first verification test case and transmit it to the test object so that the test object can process the stimulus information and obtain the processing result.

[0122] 10. Based on the processing results, determine the verification result of the object under test in the first verification case.

[0123] The specific operations of steps 1-10 above have been described in detail in the foregoing embodiments or examples, and will not be repeated here.

[0124] This disclosure separates the parameter configuration interface from the environment, using an independent initial parameter configuration tree (configure tree) to centrally manage all parameters. The inheritance and inclusion relationships of the environment component parameter classes in the initial environment are completely consistent with those of the environment component classes. For example, if the environment component class `tb_env` inherits from `tb_base_env`, then the corresponding parameter class `tb_env_configure` inherits from `tb_base_env_configure`; if the environment component class `tb_env` contains `cpu_sub_env`, then the corresponding parameter class `tb_env_configure` contains `cpu_sub_env_configure`. Before instantiating the environment, a configure tree is established through nested instantiation. Because the inheritance and inclusion relationships of the parameter classes are completely consistent with those of the environment component classes, the structure of this configure tree is completely consistent with the structure of the environment. The parameter nodes in the configure tree correspond one-to-one with the environment component nodes in the initial environment. During verification, for different verification requirements, the verification environment required for the actual verification is established by enabling the nodes in the initial parameter configuration tree.

[0125] Any of the verification methods provided in this disclosure can be executed by any suitable device with data processing capabilities, including but not limited to: terminal devices and servers. Alternatively, any of the verification methods provided in this disclosure can be executed by a processor, such as by a processor executing any of the verification methods mentioned in this disclosure by calling corresponding instructions stored in memory. Further details will not be elaborated below.

[0126] Exemplary device

[0127] Figure 12 This is a schematic diagram of a verification apparatus provided in an exemplary embodiment of the present disclosure. The apparatus of this embodiment can be used to implement corresponding method embodiments of the present disclosure, such as… Figure 12 The device shown includes: a first acquisition module 501, a first processing module 502, and a second processing module 503.

[0128] The first acquisition module 501 is used to acquire the first verification test case.

[0129] The first processing module 502 is used to create a corresponding verification environment based on the first verification case obtained by the first acquisition module 501. The verification environment includes the environment components required by the first verification case and has a corresponding first parameter configuration tree. The first parameter configuration tree includes at least the parameter nodes corresponding to each environment component.

[0130] The second processing module 503 is used to verify the object under test based on the verification environment and the corresponding first parameter configuration tree created by the first processing module 502, and to obtain the verification result of the object under test under the first verification test case. During the verification process, the parameters required by each environment component in the verification environment are obtained from the parameter nodes corresponding to each environment component.

[0131] In one optional example, Figure 13 This is a schematic diagram of the structure of a first processing module 502 provided in an exemplary embodiment of this disclosure. In this example, the first processing module 502 includes: a first acquisition unit 5021, a first determination unit 5022, and an environment creation unit 5023. The first acquisition unit 5021 is used to acquire parameter configuration information based on a first verification test case acquired by the first acquisition module 501. The parameter configuration information includes the variables and corresponding variable values ​​included in each parameter node of the first parameter configuration tree to be established. The first determination unit 5022 is used to determine the first parameter configuration tree based on the parameter configuration information acquired by the first acquisition unit 5021. The environment creation unit 5023 is used to create a verification environment based on the first parameter configuration tree obtained by the first determination unit 5022.

[0132] In an optional example, the variables and corresponding variable values ​​included in each parameter node of the first parameter configuration tree include node attribute variables and their corresponding node attribute values, and environment parameter variables and their corresponding parameter values; the node attribute value indicates whether the node is enabled under the first verification test case; correspondingly, the first determining unit 5022 is specifically used to: update the parameter nodes of the initial parameter configuration tree according to the node attribute values ​​of each parameter node and the parameter values ​​corresponding to the environment parameter variables included in each parameter node, to obtain the first parameter configuration tree; the initial parameter configuration tree includes a preset number of initial parameter nodes and the inheritance and inclusion relationships between each initial parameter node.

[0133] In an optional example, the environment creation unit 5023 is specifically used to: create a verification environment based on the node attribute values ​​of each parameter node in the first parameter configuration tree and the preset mapping relationship; the preset mapping relationship includes the mapping relationship between each parameter node and the environment component.

[0134] In an optional example, the environment creation unit 5023 is specifically used to: for the first parameter node in the first parameter configuration tree whose node attribute value is enabled, establish the first environment component corresponding to the first parameter node according to the preset mapping relationship, obtain the first parameter required for the establishment of the sub-component from the first parameter node, and establish the sub-component according to the first parameter when the node attribute value of the parameter node corresponding to the sub-component is enabled, and so on, until the environment component tree corresponding to the first test case is established and the verification environment is obtained.

[0135] Figure 14 This is a schematic diagram of the structure of a verification device provided in another exemplary embodiment of this disclosure.

[0136] In an optional example, the apparatus of this disclosure further includes: a first establishment module 504, a second establishment module 505, an initialization module 506, and a first mapping module 507. The first establishment module 504 is used to establish an initial environment according to preset requirements. The initial environment includes a preset number of environment components and the inheritance and inclusion relationships between these environment components. The second establishment module 505 is used to establish a first configuration tree based on the initial environment established by the first establishment module 504. The first configuration tree includes original parameter nodes corresponding to each environment component in the initial environment. Each original parameter node includes node attribute variables and environment parameter variables required by its corresponding environment component. The initialization module 506 is used to initialize the first configuration tree established by the second establishment module 505 based on basic use cases to obtain an initial parameter configuration tree. The basic use cases include initial node attribute values ​​corresponding to the node attribute variables in each original parameter node and initial parameter values ​​corresponding to the environment parameter variables. The first mapping module 507 is used to establish a mapping relationship between the parameter nodes of the initial parameter configuration tree and the environment components in the initial environment, as a preset mapping relationship.

[0137] In an optional example, the apparatus of this disclosure further includes: a second acquisition module 508, a third establishment module 509, and a second mapping module 510. The second acquisition module 508 is used to acquire a new environment component registration instruction; the third establishment module 509 is used to establish a new environment component in the initial environment according to the new environment component registration instruction acquired by the second acquisition module 508, and to establish a new parameter node corresponding to the new environment component in the initial parameter configuration tree; the second mapping module 510 is used to add a mapping relationship between the new environment component and the new parameter node in a preset mapping relationship.

[0138] In one optional example, Figure 15This is a schematic diagram of the structure of the second processing module 503 provided in an exemplary embodiment of this disclosure. In this example, the second processing module 503 includes: an stimulus generation unit 5031 and a result determination unit 5032. The stimulus generation unit 5031 is used to generate stimulus information corresponding to the first verification test case based on the parameters required by each environmental component in the verification environment and each parameter node of the first parameter configuration tree, and transmit it to the object under test so that the object under test can process the stimulus information and obtain the processing result; the result determination unit 5032 is used to determine the verification result of the object under test under the first verification test case based on the processing result.

[0139] Exemplary electronic devices

[0140] This disclosure also provides an electronic device, including: a memory for storing computer programs;

[0141] A processor is configured to execute a computer program stored in the memory, wherein when the computer program is executed, it implements the verification method described in any of the above embodiments of the present disclosure.

[0142] Figure 16 This is a schematic diagram of an application embodiment of the electronic device disclosed herein. In this embodiment, the electronic device 10 includes one or more processors 11 and a memory 12.

[0143] The processor 11 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.

[0144] The memory 12 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 11 may execute the program instructions to implement the verification methods of the various embodiments of this disclosure described above and / or other desired functions. Various contents such as input signals, signal components, and noise components may also be stored in the computer-readable storage medium.

[0145] In one example, the electronic device 10 may also include an input device 13 and an output device 14, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0146] For example, the input device 13 may be the microphone or microphone array described above, used to capture the input signal of the sound source.

[0147] In addition, the input device 13 may also include, for example, a keyboard, a mouse, etc.

[0148] The output device 14 can output various information to the outside, including determined distance information, direction information, etc. The output device 14 may include, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0149] Of course, for the sake of simplicity, Figure 16 Only some of the components of the electronic device 10 relevant to this disclosure are shown, omitting components such as buses, input / output interfaces, etc. In addition, the electronic device 10 may include any other suitable components depending on the specific application.

[0150] Exemplary computer program products and computer-readable storage media

[0151] In addition to the methods and apparatus described above, embodiments of this disclosure may also be computer program products comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the verification methods according to various embodiments of this disclosure as described in the "Exemplary Methods" section of this specification.

[0152] The computer program product can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of this disclosure. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on a user's computing device, partially on a user's computing device, as a standalone software package, partially on a user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0153] Furthermore, embodiments of this disclosure may also be computer-readable storage media having computer program instructions stored thereon, which, when executed by a processor, cause the processor to perform the steps in the verification methods according to various embodiments of this disclosure described in the "Exemplary Methods" section above.

[0154] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0155] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.

[0156] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For system embodiments, since they largely correspond to method embodiments, the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0157] The block diagrams of devices, apparatuses, devices, and systems disclosed herein are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0158] The methods and apparatus of this disclosure may be implemented in many ways. For example, they may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order of steps for the methods is for illustrative purposes only, and the steps of the methods of this disclosure are not limited to the order specifically described above, unless otherwise specifically stated. Furthermore, in some embodiments, this disclosure may also be implemented as a program recorded on a recording medium, the program including machine-readable instructions for implementing the verification method according to this disclosure. Thus, this disclosure also covers recording media storing programs for performing the methods according to this disclosure.

[0159] It should also be noted that in the apparatus, devices, and methods of this disclosure, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions to this disclosure.

[0160] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.

[0161] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.

Claims

1. A verification method, comprising: Obtain the first verification test case; Based on the first verification test case, a corresponding verification environment is created. The verification environment includes various environment components required by the first verification test case. The verification environment has a corresponding first parameter configuration tree, which includes at least parameter nodes corresponding to each environment component. Each parameter node includes parameters related to the parameters required by the corresponding environment component and their corresponding variable values. The verification environment is created based on the node attribute values ​​of each parameter node in the first parameter configuration tree and a pre-established mapping relationship between parameter nodes and environment components. The node attribute values ​​indicate whether the parameter node is enabled under the first verification test case. Based on the verification environment and the corresponding first parameter configuration tree, the object under test is verified to obtain the verification result of the object under test under the first verification case. During the verification process, the parameters required by each environment component in the verification environment are obtained from the parameter nodes corresponding to each environment component. Each environment component works together to obtain the verification result.

2. The method according to claim 1, wherein, The step of creating a corresponding verification environment based on the first verification case includes: Based on the first verification test case, obtain parameter configuration information, which includes the variables and corresponding variable values ​​included in each parameter node of the first parameter configuration tree to be established. The first parameter configuration tree is determined based on the parameter configuration information; The verification environment is created based on the first parameter configuration tree.

3. The method according to claim 2, wherein, The variables and corresponding variable values ​​included in each parameter node of the first parameter configuration tree include node attribute variables and their corresponding node attribute values, and environment parameter variables and their corresponding parameter values. Determining the first parameter configuration tree based on the parameter configuration information includes: Based on the node attribute values ​​of each parameter node and the parameter values ​​corresponding to the environment parameter variables included in each parameter node, the parameter nodes of the initial parameter configuration tree are updated to obtain the first parameter configuration tree. The initial parameter configuration tree includes a preset number of initial parameter nodes and the inheritance and inclusion relationships between each initial parameter node.

4. The method according to claim 3, wherein, The step of creating the verification environment based on the first parameter configuration tree includes: The verification environment is created based on the node attribute values ​​of each parameter node in the first parameter configuration tree and the preset mapping relationship; the preset mapping relationship includes the mapping relationship between each parameter node and the environment component.

5. The method according to claim 4, wherein, The step of creating the verification environment based on the node attribute values ​​and preset mapping relationships of each parameter node in the first parameter configuration tree includes: For a first parameter node in the first parameter configuration tree whose node attribute value is enabled, a first environment component corresponding to the first parameter node is established according to the preset mapping relationship. The first parameter required for establishing a sub-component is obtained from the first parameter node. When the node attribute value of the parameter node corresponding to the sub-component is enabled, the sub-component is established according to the first parameter. This process is repeated until the environment component tree corresponding to the first verification case is established, and the verification environment is obtained.

6. The method according to claim 3, wherein, Before obtaining the first verification test case, the following is also included: An initial environment is established according to preset requirements. The initial environment includes a preset number of environment components and the inheritance and inclusion relationships between the environment components. A first configuration tree is established based on the initial environment; the first configuration tree includes the original parameter nodes corresponding to each environment component in the initial environment, and the original parameter nodes include the node attribute variables and environment parameter variables required by their corresponding environment components; The first configuration tree is initialized based on the basic use case to obtain the initial parameter configuration tree. The basic use case includes the initial node attribute value corresponding to the node attribute variable and the initial parameter value corresponding to the environment parameter variable in each original parameter node. Establish a mapping relationship between the parameter nodes of the initial parameter configuration tree and the environmental components in the initial environment, as a preset mapping relationship.

7. The method according to claim 6, wherein, After establishing the mapping relationship between the parameter nodes of the initial parameter configuration tree and the environment components in the initial environment as a preset mapping relationship, the method further includes: Get the command to register the new environment component; According to the new environment component registration instruction, a new environment component is established in the initial environment, and a new parameter node corresponding to the new environment component is established in the initial parameter configuration tree; Add a mapping relationship between the newly added environmental component and the newly added parameter node to the preset mapping relationship.

8. The method according to any one of claims 1-7, wherein, The step of verifying the object under test based on the verification environment and the corresponding first parameter configuration tree, and obtaining the verification result corresponding to the first verification test case, includes: Based on the environmental components in the verification environment and the parameters required by each environmental component included in each parameter node of the first parameter configuration tree, incentive information corresponding to the first verification case is generated and transmitted to the test object so that the test object can process the incentive information and obtain the processing result. Based on the processing result, the verification result of the object under test in the first verification case is determined.

9. A verification device, comprising: The first acquisition module is used to acquire the first verification test case; A first processing module is configured to create a corresponding verification environment based on the first verification test case. The verification environment includes multiple environment components required by the first verification test case. The verification environment has a corresponding first parameter configuration tree, which includes at least parameter nodes corresponding to each environment component. Each parameter node includes parameters related to the parameters required by the corresponding environment component and their corresponding variable values. The verification environment is created based on the node attribute values ​​of each parameter node in the first parameter configuration tree and a pre-established mapping relationship between parameter nodes and environment components. The node attribute values ​​indicate whether the parameter node is enabled under the first verification test case. The second processing module is used to verify the object under test based on the verification environment and the corresponding first parameter configuration tree, and obtain the verification result of the object under test under the first verification case. In the verification process, the parameters required by each environment component in the verification environment are obtained from the parameter nodes corresponding to each environment component, and each environment component works together to obtain the verification result.

10. A computer-readable storage medium storing a computer program for performing the verification method according to any one of claims 1-8.

11. An electronic device, the electronic device comprising: processor; Memory used to store the processor's executable instructions; The processor is configured to read the executable instructions from the memory and execute the instructions to implement the verification method according to any one of claims 1-8.

Images