Test method and device, communication equipment, storage medium and computer program product

Abstract

The invention relates to a test method and device, communication equipment, a storage medium and a computer program product. The method comprises the steps of determining input parameters of an arrangement process based on test instance data obtained in a test environment, and running a target PSR design package to obtain a rule output value of the target PSR design package. And if the rule output value does not meet the preset condition, correcting the target PSR design package to obtain a corrected PSR design package, and taking the corrected PSR design package as the target PSR design package until the rule output value meets the preset condition to obtain an output parameter of the target PSR design package. If the parameter meets the normal condition, the target PSR design package is determined to be a normal PSR design package, the PSR design package can be corrected, the accuracy of the PSR design package is improved through the simulation test of the digital twin structure, the complete test of the service can be realized based on the PSR design package, and the test performance is improved.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a testing method, apparatus, communication equipment, storage medium and computer program product. Background Art

[0002] With the continuous development of cloud network technology, cloud network products can be designed based on the PSR model, and design packages can be obtained, and the design packages can be sent to the orchestration system for implementation. The orchestration systems in each region can develop, test, and debug the actual cloud network-related businesses based on the received design packages. Among them, the so-called PSR model refers to the hierarchical decoupling of resources (R), services (S), and products (P), and the assembly and design based on the underlying cloud network capabilities to form services and provide communication services / products to the outside.

[0003] In the related technology, although the PSR design pattern can achieve layered decoupling of the P layer, S layer, and R layer, since the PSR design packages under the PSR pattern design are also decoupled, complete business testing cannot be performed during the business testing of the PSR design package, and the test performance is low. Summary of the invention

[0004] The embodiments of the present application provide a testing method, apparatus, communication device, storage medium and computer program product, which can bring about the beneficial effect of improving testing performance.

[0005] A testing method, comprising:

[0006] Acquire test instance data of the target PSR design package in the test environment;

[0007] Using the test instance data as an input parameter of the orchestration process of the target PSR design package, and running the target PSR design package to obtain the rule output value of the target PSR design package;

[0008] If the rule output value does not meet the preset condition, the target PSR design package is corrected to obtain a corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the step of running the target PSR design package is re-executed until the rule output value meets the preset condition, and the output parameter of the target PSR design package is obtained;

[0009] If the output parameters meet normal conditions, it is determined that the target PSR design package is a normal PSR design package.

[0010] In one of the embodiments, the test environment is constructed based on resource data in the target system and a preset digital twin tool, the test environment is a digital twin environment, the resources include components for constructing services, the business in the target system includes one sub-business or multiple sub-businesses, and the sub-business includes one resource data or multiple resource data.

[0011] In one of the embodiments, the target PSR design package includes at least one or more of PSR attributes, PSR interface parameters and rules.

[0012] In one embodiment, the target PSR design package includes at least PSR attributes, interface parameters and rules of the PSR; and using the test instance data as an input parameter of the orchestration process of the target PSR design package includes:

[0013] The test instance data is used as an input parameter of the PSR attribute, the test instance data is used as an input parameter of the PSR interface parameter, and the test instance data is used as an input parameter of the rule.

[0014] In one embodiment, the rule output value satisfies a preset condition, and the output parameter of the target PSR design package is obtained, including:

[0015] If the rule output value satisfies the preset condition, the target PSR design package continues to be run based on the data in the test environment to obtain the output parameters of the target PSR design package.

[0016] In one embodiment, the step of modifying the target PSR design package to obtain a modified PSR design package includes:

[0017] Based on a preset substring search algorithm, as well as the rule type, rule implementation method, rule output parameters and rule input parameters of the target PSR design package, matching is performed among multiple preset PSR design packages to obtain a similar PSR design package that meets the preset similarity conditions, and the target PSR design package is corrected based on the similar PSR design package to obtain a corrected PSR design package.

[0018] In one embodiment, the step of modifying the target PSR design package based on the similar PSR design package to obtain the modified PSR design package includes:

[0019] The target PSR design package is modified based on the rules contained in the similar PSR design package to obtain a modified PSR design package.

[0020] In one of the embodiments, if the output parameter satisfies a normal condition, determining that the target PSR design package is a normal PSR design package includes:

[0021] If it is determined that the target PSR design package provides the telecommunication service corresponding to the target PSR design package, and provides the sub-service corresponding to the target PSR design package, then it is determined that the output parameters of the target PSR design package meet normal conditions, and the target PSR design package is determined to be a normal PSR design package.

[0022] In one embodiment, the method further comprises:

[0023] Generate correction record information based on the corrected PSR design package, and send the correction record information to the PSR design system.

[0024] In one embodiment, the method further comprises:

[0025] Send the normal PSR design package to the orchestration system.

[0026] A testing device, comprising:

[0027] A first acquisition module is used to acquire test instance data of a target PSR design package in a test environment;

[0028] A first output module, used to use the test instance data as an input parameter of the orchestration process of the target PSR design package, and run the target PSR design package to obtain a rule output value of the target PSR design package;

[0029] A correction module, used for correcting the target PSR design package if the rule output value does not meet the preset condition to obtain a corrected PSR design package, and using the corrected PSR design package as the target PSR design package to re-execute the step of running the target PSR design package until the rule output value meets the preset condition to obtain the output parameter of the target PSR design package;

[0030] The first determination module is used to determine that the target PSR design package is a normal PSR design package if the output parameter meets the normal condition.

[0031] In one of the embodiments, the test environment is constructed based on resource data in the target system and a preset digital twin tool, the test environment is a digital twin environment, the resources include components for constructing services, the business in the target system includes one sub-business or multiple sub-businesses, and the sub-business includes one resource data or multiple resource data.

[0032] In one of the embodiments, the target PSR design package includes at least one or more of PSR attributes, PSR interface parameters and rules.

[0033] In one embodiment, the target PSR design package includes at least PSR attributes, PSR interface parameters and rules; the first output module is specifically used for:

[0034] The test instance data is used as an input parameter of the PSR attribute, the test instance data is used as an input parameter of the PSR interface parameter, and the test instance data is used as an input parameter of the rule.

[0035] In one embodiment, the correction module is specifically used to:

[0036] If the rule output value satisfies the preset condition, the target PSR design package continues to be run based on the data in the test environment to obtain the output parameters of the target PSR design package.

[0037] In one embodiment, the correction module is further specifically used for:

[0038] Based on a preset substring search algorithm, as well as the rule type, rule implementation method, rule output parameters and rule input parameters of the target PSR design package, matching is performed among multiple preset PSR design packages to obtain a similar PSR design package that meets the preset similarity conditions, and the target PSR design package is corrected based on the similar PSR design package to obtain a corrected PSR design package.

[0039] In one embodiment, the correction module is further specifically used for:

[0040] The target PSR design package is modified based on the rules contained in the similar PSR design package to obtain a modified PSR design package.

[0041] In one embodiment, the first determining module is specifically configured to:

[0042] If it is determined that the target PSR design package provides the telecommunication service corresponding to the target PSR design package, and provides the sub-service corresponding to the target PSR design package, then it is determined that the output parameters of the target PSR design package meet normal conditions, and the target PSR design package is determined to be a normal PSR design package.

[0043] In one embodiment, the device further comprises:

[0044] A record generation module is used to generate correction record information based on the corrected PSR design package and send the correction record information to the PSR design system.

[0045] In one embodiment, the device further comprises:

[0046] The sending module is used to send the normal PSR design package to the orchestration system.

[0047] A communication device, comprising: a processor and a receiver;

[0048] The receiver is used to obtain test instance data of a target PSR design package in a test environment;

[0049] The processor is used to use the test instance data as the input parameter of the orchestration process of the target PSR design package, and run the target PSR design package to obtain the rule output value of the target PSR design package; if the rule output value does not meet the preset condition, the target PSR design package is corrected to obtain a corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the step of running the target PSR design package is re-executed until the rule output value meets the preset condition to obtain the output parameter of the target PSR design package; if the output parameter meets the normal condition, the target PSR design package is determined to be a normal PSR design package.

[0050] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the following steps:

[0051] Acquire test instance data of the target PSR design package in the test environment;

[0052] Using the test instance data as an input parameter of the orchestration process of the target PSR design package, and running the target PSR design package to obtain the rule output value of the target PSR design package;

[0053] If the rule output value does not meet the preset condition, the target PSR design package is corrected to obtain a corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the step of running the target PSR design package is re-executed until the rule output value meets the preset condition, and the output parameter of the target PSR design package is obtained;

[0054] If the output parameters meet normal conditions, it is determined that the target PSR design package is a normal PSR design package.

[0055] A computer program product includes a computer program, wherein when the computer program is executed by a processor, the test method provided by the embodiment of the present application is implemented, and the method may be:

[0056] Acquire test instance data of the target PSR design package in the test environment;

[0057] Using the test instance data as an input parameter of the orchestration process of the target PSR design package, and running the target PSR design package to obtain the rule output value of the target PSR design package;

[0058] If the rule output value does not meet the preset condition, the target PSR design package is corrected to obtain a corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the step of running the target PSR design package is re-executed until the rule output value meets the preset condition, and the output parameter of the target PSR design package is obtained;

[0059] If the output parameters meet normal conditions, it is determined that the target PSR design package is a normal PSR design package.

[0060] The above-mentioned test method, device, communication equipment, storage medium and computer program product, the method includes: obtaining the test instance data of the target PSR design package in the test environment; using the test instance data as the input parameter of the orchestration process of the target PSR design package, and running the target PSR design package to obtain the rule output value of the target PSR design package; if the rule output value does not meet the preset condition, the target PSR design package is corrected to obtain the corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the step of running the target PSR design package is re-executed until the rule output value meets the preset condition, and the output parameter of the target PSR design package is obtained; if the output parameter meets the normal condition, the target PSR design package is determined to be a normal PSR design package. By adopting this method, the PSR design package can be corrected, the accuracy of the PSR design package can be improved through simulation testing constructed by digital twins, the complete test of the business can be realized based on the PSR design package, and the test performance based on the PSR design package can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] Figure 1 A schematic diagram of a test method in one embodiment;

[0062] Figure 2 A schematic diagram of an architecture in an embodiment;

[0063] Figure 3 A schematic flow chart of a testing method in another embodiment;

[0064] Figure 4 is a structural block diagram of a testing device in one embodiment;

[0065] Figure 5 FIG. 4 is a diagram showing the internal structure of a communication device in one embodiment. DETAILED DESCRIPTION

[0066] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0067] In related technologies, products or networks are designed based on the PSR model, and the design data is packaged into a design package for distribution, which can generally be distributed to the orchestration system for implementation. The orchestration system in each region can test the actual business based on the received design package. The PSR model refers to the hierarchical decoupling of resources (R), services (S), and products (P), and the assembly and design based on the underlying cloud network capabilities to form services, and provide communication services or communication products to the outside.

[0068] The test method provided in the embodiment of the present application can realize the hierarchical decoupling of the P layer, S layer, and R layer based on the PSR design pattern, improve the reuse rate of PSR, increase the efficiency of designing PSR, and reduce the design cost. Although the PSR design packages under the PSR pattern design will also be decoupled, resulting in the inability to perform complete business testing during the business testing of the PSR design package, the test method provided in the embodiment of the present application can build a simulation test environment based on digital twin technology, obtain test instance data from the simulation test environment, and correct the design package data to realize simulation testing based on digital twin construction to improve the accuracy of the PSR design package. In one example, the design package of S requires the instance data of R for complete business testing.

[0069] It should be noted that the beneficial effects brought about by the embodiments of the present application or the technical problems solved are not limited to this one, but may also include other implicit or related problems. For details, please refer to the description of the following embodiments.

[0070] Before introducing the specific embodiments of the present invention, the professional terms involved in the present invention are explained first:

[0071] PSR: The PSR (Product / Service / Resource) conceptual model defined in the TMF specification is abstracted from the service capabilities provided by customer-oriented services (CFS), resource-oriented services (RFS), and resources (Resource).

[0072] CFS: Customer Facing Service, customer-oriented service.

[0073] RFS: Resource Facing Service, service facing the cloud and network.

[0074] Res: Resource, communication resources.

[0075] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0076] In one embodiment, Figure 1 As shown, a testing method is provided, which is applied to a terminal and includes the following steps:

[0077] Step 102, obtaining test instance data of the target PSR design package in the test environment;

[0078] The test environment may be a test environment constructed by the target software, for example, a digital twin environment; the target software may be a digital twin software; in one example, the terminal may construct a digital twin simulation test environment through the resource data in the target system and the digital twin software. The PSR design package is a designed business structure, which may include a service layer, a sub-service layer, and a resource layer. In one example, the PSR design package may be displayed in a tree structure, and the test instance data may be the actual data required for the PSR design package to run in the orchestration system and run through the orchestration process.

[0079] Specifically, the terminal can extract test instance data for running the PSR design package in the constructed test environment. For example, the terminal can obtain test instance data corresponding to the PSR design package in the digital twin simulation test environment.

[0080] Step 104, using the test instance data as an input parameter of the orchestration process of the target PSR design package, and running the target PSR design package to obtain the rule output value of the target PSR design package.

[0081] The rule output value of the target PSR design package may be the rule output value of the target PSR design package during operation. The input parameter may be an input parameter.

[0082] Specifically, the terminal can use the test instance data obtained in the digital twin environment as the input parameter of the target PSR design package, run the target PSR design package, and collect the rule output values ​​output during the operation of the target PSR design package.

[0083] Step 106, if the rule output value does not meet the preset conditions, the target PSR design package is corrected to obtain a corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the steps of running the target PSR design package are re-executed until the rule output value meets the preset conditions, and the output parameters of the target PSR design package are obtained.

[0084] The preset condition can be a condition for judging whether the rule output value meets the requirements, and different types of rules can correspond to different preset conditions. The output parameter can be an output parameter or the execution result of the PSR design package.

[0085] Specifically, the terminal can obtain the rule output value output by the target PSR design package during the operation process, and judge whether the rule output value meets the preset conditions; if the terminal determines that the current rule output value does not meet the preset conditions, the terminal can correct the target PSR design package to obtain the corrected PSR design package. Based on this, the terminal can use the corrected PSR design package as the target PSR design package, return to re-execute the step of running the target PSR design package in the above step 104, and obtain the rule output value of the target PSR design package during the operation process, and re-judge whether the rule output value meets the preset conditions. If it is determined that the current rule output value meets the preset conditions, the terminal can continue to run the target PSR design package, and after executing the complete business logic based on the data in the digital twin environment, the output parameters are obtained.

[0086] Step 108: If the output parameters meet the normal conditions, the target PSR design package is determined to be a normal PSR design package.

[0087] Among them, the normal condition may be the ability to provide the services and sub-services of the target operator in accordance with the requirements of the PSR design package.

[0088] Specifically, if the terminal determines that the output parameters of the current target PSR design package meet normal conditions, that is, the terminal determines that the target PSR design package can provide target operator services and sub-services according to the requirements of the design package, then the terminal can determine that the target PSR design package is a normal PSR design package.

[0089] In the above test method, the test instance data of the target PSR design package is obtained in the test environment. The test instance data is used as the input parameter of the orchestration process of the target PSR design package, and the target PSR design package is run to obtain the rule output value of the target PSR design package. If the rule output value does not meet the preset conditions, the target PSR design package is corrected to obtain the corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the steps of running the target PSR design package are re-executed until the rule output value meets the preset conditions to obtain the output parameter of the target PSR design package. If the output parameter meets the normal conditions, it is determined that the target PSR design package is a normal PSR design package. By adopting this method, the PSR design package can be corrected, the accuracy of the PSR design package can be improved through simulation testing constructed by digital twins, the complete testing of the business can be achieved based on the PSR design package, and the test performance based on the PSR design package can be improved.

[0090] In one embodiment, the test environment is constructed based on the resource data in the target system and a preset digital twin tool. The test environment is a digital twin environment. The resource data includes components for constructing services. The business in the target system includes one sub-business or multiple sub-businesses. The sub-business includes one resource data or multiple resource data.

[0091] Specifically, the test environment can be a digital twin environment or a digital twin simulation test environment. The target system can be a business system, for example, an orchestration system or a resource system. The preset digital twin tool can be a digital twin software. Components can include physical components and non-physical components, for example, data from different technical fields, including network elements, numbers, addresses, ports, links, software programs, systems and technical components, etc. Resource data can be the smallest component unit. The business can include at least one sub-business, which can be a target operator business, and the services of the target operator business can include communication services provided by the target operator for user equipment, etc. The target operator business can include multiple sub-businesses, each of which includes one resource or multiple resources. In other words, each sub-business is composed of at least one resource data, and the sub-business can be provided by a single network domain.

[0092] The specific environment construction process may include: the terminal can collect the target operator business services, target operator business sub-services and resource data running in the orchestration system or resource system, and input the collected target operator business services, target operator business sub-services and resource data into the digital twin software for construction to obtain a digital twin simulation test environment.

[0093] In this embodiment, by building a digital twin environment through digital twin software, the business can be tested completely and the PSR design package can be modified to ensure test integrity and improve test performance.

[0094] In one of the embodiments, the target PSR design package includes at least one or more of PSR attributes, PSR interface parameters, and rules.

[0095] Specifically, the target PSR design package can design the service structure of the target operator, and the target PSR design package may include a target operator service layer, a target operator sub-service layer and a resource layer. The target PSR design package may be displayed in a tree structure, which can show how to compose the target operator's business from the smallest component unit to components, until it constitutes a target operator service that can be directly provided to the user equipment. The content of the target PSR design package may include the target operator service layer or the sub-service layer of the target operator. The target PSR design package may also include at least one or more of PSR attributes, PSR interface parameters and rules. For example, it may include only PSR attributes, or PSR interface parameters, or rules, and may also include multiple of PSR attributes, PSR interface parameters and rules.

[0096] In this embodiment, the effectiveness of the test is ensured by the PSR attributes, PSR interface parameters and rules contained in the PSR design package.

[0097] In one of the embodiments, the target PSR design package includes at least PSR attributes, interface parameters and rules of the PSR. Specifically, the target PSR design package may include PSR attributes, interface parameters and rules of the PSR.

[0098] Accordingly, “using the test instance data as an input parameter of the orchestration process of the target PSR design package” may include:

[0099] The test instance data is used as the input parameter of the PSR attribute, the test instance data is used as the input parameter of the PSR interface parameter, and the test instance data is used as the input parameter of the rule.

[0100] Specifically, the terminal may use the test instance data as input parameters of PSR attributes, may use the test instance data as input parameters of PSR interface parameters, and may use the test instance data as input parameters of rules.

[0101] In one example, in a digital twin environment, the terminal runs the test instance data according to the process in the target PSR design package, and uses the test instance data as an input parameter for running the orchestration process in the PSR design package in the digital twin environment; when the target PSR design package is the target operator service layer, the terminal can use the test instance data as the input CRM data for simulation acceptance; when the target PSR design package is the target operator service sublayer, the target PSR design package is used as part of the complete orchestration process of the target operator's business, and the test instance data is used as an input parameter for the orchestration link.

[0102] In this embodiment, by using the test instance data as the PSR attributes, PSR interface parameters and rule input parameters included in the PSR design package, the integrity of the test and the performance of the test can be further improved.

[0103] In one embodiment, the rule output value satisfies the preset condition, and the output parameter of the target PSR design package is obtained, which may include:

[0104] If the rule output value meets the preset conditions, the target PSR design package continues to run based on the data in the test environment to obtain the output parameters of the target PSR design package.

[0105] Specifically, the rules in the target PSR design package may include value-taking rules and exception handling rules; the content of the value-taking rules may include that the input parameters can be converted according to the rules to obtain output parameters, and the value-taking rules stipulate that the output parameters correspond to a preset value range, and the preset condition may be that if the output value of the rule in the target PSR design package matches the preset value range, then the terminal can determine that the rule output value meets the preset condition; that is, if the terminal determines that the output parameter corresponding to the rule in the target PSR design package matches the preset value range, then it is determined that the rule output value meets the preset condition. Based on this, the terminal can continue to run the target PSR design package based on the data in the test environment until the target PSR design package runs through the entire process and obtains the output parameters of the target PSR design package, that is, obtains the result of whether the target PSR design package can provide the target operator service.

[0106] In one example, the rule may also include an exception handling rule, and the terminal may determine the handling method of the link exception based on the input parameter. The exception handling rule includes an exception handling rule decision table, and the content of the decision table may include a plurality of output parameters corresponding to each type of input parameter. The terminal may determine the plurality of output parameters corresponding to the input parameter based on the input parameter corresponding to the rule output value. If the terminal finds the rule output value in the plurality of output parameters, the terminal may determine that the current rule output value meets the preset conditions. The plurality of output parameters may correspond to a plurality of handling methods.

[0107] In this embodiment, by judging the output value of the rule, it is possible to judge whether the PSR design package needs to be revised. By correcting the PSR design package, the design accuracy of the PSR design package can be improved.

[0108] In one embodiment, modifying the target PSR design package to obtain a modified PSR design package may include:

[0109] Based on a preset substring search algorithm, as well as the rule type, rule implementation method, rule output parameters and rule input parameters of the target PSR design package, matching is performed among multiple preset PSR design packages to obtain similar PSR design packages that meet preset similarity conditions, and the target PSR design package is corrected based on the similar PSR design package to obtain a corrected PSR design package.

[0110] The preset substring search algorithm may be the Rabin-Karp algorithm, and the preset PSR design package may be a design package that has been verified to be normal, or a design package that is determined to meet the business logic, etc. The terminal may determine the design package with the highest similarity as the design package that meets the preset similarity condition, etc.

[0111] Specifically, the terminal can search and match among multiple preset PSR design packages based on a preset substring search algorithm and the type of rule of the target PSR design package to be corrected, the input parameter of the rule, and the output parameter corresponding to the rule (i.e., the rule output value), as well as the implementation method of the rule, and respectively calculate the similarity between each preset PSR design package and the target PSR design package, and use the preset PSR design package with the highest similarity as a similar PSR design package of the target PSR design package. Based on this, the terminal can correct the target PSR design package based on the similar PSR design package to obtain a corrected PSR design package. Based on this, the terminal can re-execute the step of running the target PSR design package based on the corrected PSR design package, that is, the terminal can use the corrected PSR design package as the target PSR design package center to execute the step of running the target PSR design package to obtain the rule output value of the target PSR design package.

[0112] In this embodiment, similar PSR design packages of the target PSR design package are searched through rules, and the target PSR design package is modified based on the similar PSR design package, so as to further improve the design accuracy of the PSR design package.

[0113] In one embodiment, modifying the target PSR design package based on the similar PSR design package to obtain the modified PSR design package may include:

[0114] The target PSR design package is modified based on the rules contained in the similar PSR design package to obtain a modified PSR design package.

[0115] Specifically, the terminal can modify the type, input parameters, output parameters (i.e., rule output value), and implementation method of the rules of the target PSR design package based on the type, input parameters, output parameters (i.e., rule output value), and implementation method of the rules contained in the similar PSR design package to obtain a modified PSR design package.

[0116] In this embodiment, the rules of the target PSR design package are modified by using the rules included in the similar PSR design package to improve the design accuracy of the PSR design package.

[0117] In one embodiment, if the output parameter satisfies the normal condition, determining that the target PSR design package is a normal PSR design package may include:

[0118] If it is determined that the target PSR design package provides the target operator service corresponding to the target PSR design package, and provides the sub-service corresponding to the target PSR design package, then it is determined that the output parameters of the target PSR design package meet normal conditions, and the target PSR design package is determined to be a normal PSR design package.

[0119] Specifically, if the terminal determines that the current target PSR design package can provide the target operator service designed by the target PSR design package, and can also provide the target operator sub-service designed by the target PSR design package, then the terminal can determine that the output parameters of the target PSR design package meet normal conditions. Based on this, the terminal can determine that the PSR design package is a normal PSR design package. In an example, the target operator service can be a telecommunications service, etc.

[0120] In this embodiment, whether the output parameters of the PSR design package are normal is judged by whether the service can be provided, and design packages with defects can be further eliminated to ensure that the design package can fully run the business logic and achieve complete testing of the business.

[0121] In one embodiment, the testing method further comprises:

[0122] Generate revision record information based on the revised PSR design package, and send the revision record information to the PSR design system.

[0123] The correction record information may be record data of a correction process of correcting a target PSR design package based on a similar PSR design package. For example, the correction record information may be output in the form of a correction report, etc.

[0124] Specifically, the terminal can record the correction process, generate correction record information, and send the correction record information to the PSR design system that generates the PSR design package, so that the PSR design system can improve the design process of the design package based on the correction record information to avoid the issuance of defective design packages. The correction process can be a process in which the terminal corrects the target PSR design package based on a similar PSR design package.

[0125] In this embodiment, correction record information is sent to the PSR design system that generates the PSR design package, so that the PSR design system can improve the design process of the design package based on the correction record information to avoid the issuance of defective design packages.

[0126] In one embodiment, the testing method further comprises:

[0127] Send a normal PSR design package to the orchestration system.

[0128] Specifically, the terminal may send the normal PSR design package to the orchestration system.

[0129] like Figure 2 As shown, it may be an architecture diagram corresponding to a test method provided in this embodiment, which includes a digital twin, a PSR design package and a test environment, wherein the digital twin may be a preset digital twin tool, i.e., digital twin software, and the terminal may build a test environment based on the digital twin software, and the test environment may be a digital twin environment. The PSR design package may obtain PSR pattern instance data from the digital twin environment and run the PSR design package in the test environment, and the PSR design package includes decoupled P layer, S layer and R layer.

[0130] like Figure 3 The flowchart shown may be a test method provided by this embodiment, including: building a twin test environment, parsing the PSR design package, obtaining test instance data using the digital twin according to the PSR design package, and running the PSR design package; judging whether the PSR design package is run through, and whether the output of the PSR design package (rule output value) meets expectations (preset conditions); if the process is run through and the output meets expectations, then determining that the test passes and the result is fed back to the PSR design system; if the process does not run through or the output meets expectations, then, if it is determined that the process has not run through, determining that the test fails and the report is fed back to the PSR design system; if the rule output value does not meet expectations, the rule is corrected through the Rabin-Karp algorithm, and returning to re-execute the step of running the PSR design package.

[0131] Specifically, step 1 in the test method provided in this embodiment can be to obtain the instance values ​​required for PSR design package analysis for simulation testing, and according to the test results, use digital twin technology and Rabin-Karp to correct the content of the PSR design package, and continuously iterate the correct content until the simulation result is correct, thereby implementing a business digital twin testing method.

[0132] Specifically, step 2 in the test method provided in this embodiment can be to collect and orchestrate the telecommunications business services, telecommunications business sub-services and resource data running in the resource system, import the digital twin software, and build; resources represent the physical and non-physical components used to construct sub-services. They come from the fields of application, computing, and network, and include network elements, numbers, addresses, ports, links, software, IT systems, and technical components; in the telecommunications service design view, resources are the smallest granularity objects. Telecommunications business sub-services are provided by a single network domain. In the telecommunications business design view, a sub-service consists of one or more resources, and a telecommunications business consists of one or more sub-services. Telecommunications business services represent certain communication services provided by telecommunications operators to customers.

[0133] Specifically, step 3 in the test method provided in this embodiment can be to obtain the test instance data required for testing the PSR design package in the digital twin environment; the PSR design package is the designed telecommunications business structure; it includes the telecommunications service layer, the telecommunications sub-service layer and the resource layer. Displayed in a tree structure, it shows how to visually design the telecommunications business from the smallest granularity component to components with increasingly larger granularity until a complete telecommunications service that can be directly provided to users is formed; the content of the PSR design package can be a telecommunications service layer or a telecommunications sub-service layer; the test instance data refers to the actual data required for the designed PSR design package to run through the orchestration process when the orchestration system is actually running.

[0134] Specifically, step 4 in the test method provided in this embodiment can be to use the instance data obtained in the digital twin environment as the input parameter of the PSR design package, as the instance value of the PSR attributes and PSR-API parameters, and as the input parameter of the execution rules in the PSR design package, and run the instance data according to the process in the PSR design package in the twin environment; use the instance data as the input parameter of the orchestration process in the PSR design package in the twin link. If the PSR design package is a telecommunications service layer, the instance data is used as the input CRM data for simulating telecommunications acceptance. If it is a telecommunications service sublayer, the PSR design package is part of the complete orchestration process of the telecommunications business, and the instance data is used as the input parameter of the orchestration process link.

[0135] Step 5 can be whether the rule output meets the preset value during the operation; if it meets the preset value, continue to run the PSR design package and quote the data in the twin environment to run the complete business process; if it does not meet the preset value, in the twin environment, use the Rabin-Karp algorithm to use the rule type, rule implementation method, rule input and output parameters, and decision table value to match the existing rule with the highest similarity to correct the PSR design package rule, and re-execute step 4 after correcting the rule until the rule output value meets the preset value.

[0136] Step 6. After the complete business logic is run through in the digital twin environment and normal output parameters are obtained, the design package is the design package that meets the business logic and can be sent to the orchestration system normally. If there is a correction process in the test, a correction report is given and the report is fed back to the PSR design system as a reference for modifying the PSR design. If there is a PSR design defect that causes the business logic to be incomplete, the design package defect report is fed back to inform the PSR design system to avoid the delivery of defective design packages.

[0137] It should be understood that although Figure 1-3 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1-3 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.

[0138] In one embodiment, Figure 4 As shown, a testing device 400 is provided, comprising: a first acquisition module 402, a first output module 404, a correction module 406 and a first determination module 408, wherein:

[0139] The first acquisition module 402 is used to acquire the test instance data of the target PSR design package in the test environment.

[0140] The first output module 404 is used to use the test instance data as an input parameter of the orchestration process of the target PSR design package, and run the target PSR design package to obtain the rule output value of the target PSR design package.

[0141] Correction module 406 is used to correct the target PSR design package if the rule output value does not meet the preset condition, obtain a corrected PSR design package, and use the corrected PSR design package as the target PSR design package to re-execute the steps of running the target PSR design package until the rule output value meets the preset condition, thereby obtaining the output parameters of the target PSR design package.

[0142] The first determination module 408 is configured to determine that the target PSR design package is a normal PSR design package if the output parameter satisfies a normal condition.

[0143] In one of the embodiments, the test environment is constructed based on resource data in the target system and a preset digital twin tool, the test environment is a digital twin environment, the resources include components for constructing services, the business in the target system includes one sub-business or multiple sub-businesses, and the sub-business includes one resource data or multiple resource data.

[0144] In one of the embodiments, the target PSR design package includes at least one or more of PSR attributes, PSR interface parameters and rules.

[0145] In one embodiment, the target PSR design package includes at least PSR attributes, PSR interface parameters and rules. The first output module is specifically used for:

[0146] The test instance data is used as an input parameter of the PSR attribute, the test instance data is used as an input parameter of the PSR interface parameter, and the test instance data is used as an input parameter of the rule.

[0147] In one embodiment, the correction module is specifically used to:

[0148] If the rule output value satisfies the preset condition, the target PSR design package continues to be run based on the data in the test environment to obtain the output parameters of the target PSR design package.

[0149] In one embodiment, the correction module is further specifically used for:

[0150] Based on a preset substring search algorithm, as well as the rule type, rule implementation method, rule output parameters and rule input parameters of the target PSR design package, matching is performed among multiple preset PSR design packages to obtain a similar PSR design package that meets the preset similarity conditions, and the target PSR design package is corrected based on the similar PSR design package to obtain a corrected PSR design package.

[0151] In one embodiment, the correction module is further specifically used for:

[0152] The target PSR design package is modified based on the rules contained in the similar PSR design package to obtain a modified PSR design package.

[0153] In one embodiment, the first determining module is specifically configured to:

[0154] If it is determined that the target PSR design package provides the telecommunication service corresponding to the target PSR design package, and provides the sub-service corresponding to the target PSR design package, then it is determined that the output parameters of the target PSR design package meet normal conditions, and the target PSR design package is determined to be a normal PSR design package.

[0155] In one embodiment, the device further comprises:

[0156] A record generation module is used to generate correction record information based on the corrected PSR design package and send the correction record information to the PSR design system.

[0157] In one embodiment, the device further comprises:

[0158] The sending module is used to send the normal PSR design package to the orchestration system.

[0159] For the specific definition of the test device, please refer to the definition of the test method above, which will not be repeated here. Each module in the above test device can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0160] Figure 5 It is a schematic diagram of the structure of an access network device provided by an embodiment of the present invention. Figure 5 The access network device 500 shown includes: at least one processor 501, a memory 502, and at least one network interface 504. The various components in the access network device 500 are coupled together through a bus system 505. It can be understood that the bus system 505 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 505 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, the bus system 505 is not shown in FIG. Figure 5 Various buses are labeled as bus system 505. In addition, the embodiment of the present invention also includes a transceiver 506, which can be multiple components, that is, including a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium.

[0161] It can be understood that the memory 502 in the embodiment of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct RAM bus random access memory (DRRAM). The memory 502 of the system and method described in the embodiments of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.

[0162] In some implementations, the memory 502 stores the following elements, executable modules or data structures, or their subsets, or their extensions: operating system 5021. The operating system 5021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks.

[0163] In an embodiment of the present invention, by calling the program or instruction stored in the memory 502, the processor is used to obtain the test instance data of the target PSR design package in the test environment. The test instance data is used as the input parameter of the orchestration process of the target PSR design package, and the target PSR design package is run to obtain the rule output value of the target PSR design package. If the rule output value does not meet the preset condition, the target PSR design package is corrected to obtain the corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the step of running the target PSR design package is re-executed until the rule output value meets the preset condition to obtain the output parameter of the target PSR design package. If the output parameter meets the normal condition, the target PSR design package is determined to be a normal PSR design package.

[0164] Part or all of the methods disclosed in the above embodiments of the present invention may also be applied to the processor 501, or implemented by the processor 501, or implemented by the processor 501 in cooperation with other components (such as a transceiver). The processor 501 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 501 or by instructions in the form of software. The above processor 501 may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention may be implemented or executed. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present invention may be directly embodied as being executed by a hardware decoding processor, or may be executed by a combination of hardware and software modules in a decoding processor. The software module may be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 502, and the processor 501 reads the information in the memory 502 and completes the steps of the above method in combination with its hardware.

[0165] It is to be understood that the embodiments described in the embodiments of the present invention may be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSP devices, DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application or a combination thereof.

[0166] For software implementation, the technology described in the embodiments of the present invention can be implemented by a module (such as a process, function, etc.) that performs the functions described in the embodiments of the present invention. The software code can be stored in a memory and executed by the processor 501. The memory can be implemented in the processor 501 or outside the processor 501.

[0167] In one of the embodiments, the test environment is constructed based on resource data in the target system and a preset digital twin tool, the test environment is a digital twin environment, the resources include components for constructing services, the business in the target system includes one sub-business or multiple sub-businesses, and the sub-business includes one resource data or multiple resource data.

[0168] In one of the embodiments, the target PSR design package includes at least one or more of PSR attributes, PSR interface parameters and rules.

[0169] In one embodiment, the target PSR design package includes at least PSR attributes, interface parameters and rules of the PSR. The processor is specifically configured to:

[0170] The test instance data is used as an input parameter of the PSR attribute, the test instance data is used as an input parameter of the PSR interface parameter, and the test instance data is used as an input parameter of the rule.

[0171] In one embodiment, the processor is specifically configured to:

[0172] If the rule output value satisfies the preset condition, the target PSR design package continues to be run based on the data in the test environment to obtain the output parameters of the target PSR design package.

[0173] In one embodiment, the processor is specifically configured to:

[0174] Based on a preset substring search algorithm, as well as the rule type, rule implementation method, rule output parameters and rule input parameters of the target PSR design package, matching is performed among multiple preset PSR design packages to obtain a similar PSR design package that meets the preset similarity conditions, and the target PSR design package is corrected based on the similar PSR design package to obtain a corrected PSR design package.

[0175] In one embodiment, the processor is specifically configured to:

[0176] The target PSR design package is modified based on the rules contained in the similar PSR design package to obtain a modified PSR design package.

[0177] In one embodiment, the processor is specifically configured to:

[0178] If it is determined that the target PSR design package provides the telecommunication service corresponding to the target PSR design package, and provides the sub-service corresponding to the target PSR design package, then it is determined that the output parameters of the target PSR design package meet normal conditions, and the target PSR design package is determined to be a normal PSR design package.

[0179] In one embodiment, the processor is specifically configured to:

[0180] Generate correction record information based on the corrected PSR design package, and send the correction record information to the PSR design system through the transmitter.

[0181] In one of the embodiments, the transmitter is further configured to send the normal PSR design package to an orchestration system.

[0182] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0183] Get test case data of the target PSR design package in the test environment.

[0184] The test instance data is used as an input parameter of the orchestration process of the target PSR design package, and the target PSR design package is run to obtain the rule output value of the target PSR design package.

[0185] If the rule output value does not meet the preset conditions, the target PSR design package is corrected to obtain a corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the steps of running the target PSR design package are re-executed until the rule output value meets the preset conditions and the output parameters of the target PSR design package are obtained.

[0186] If the output parameters meet normal conditions, it is determined that the target PSR design package is a normal PSR design package.

[0187] In one of the embodiments, the test environment is constructed based on resource data in the target system and a preset digital twin tool, the test environment is a digital twin environment, the resources include components for constructing services, the business in the target system includes one sub-business or multiple sub-businesses, and the sub-business includes one resource data or multiple resource data.

[0188] In one of the embodiments, the target PSR design package includes at least one or more of PSR attributes, PSR interface parameters and rules.

[0189] In one embodiment, the target PSR design package includes at least PSR attributes, interface parameters and rules of the PSR. When the computer program is executed by the processor, the following steps are also implemented:

[0190] The test instance data is used as an input parameter of the PSR attribute, the test instance data is used as an input parameter of the PSR interface parameter, and the test instance data is used as an input parameter of the rule.

[0191] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0192] If the rule output value satisfies the preset condition, the target PSR design package continues to be run based on the data in the test environment to obtain the output parameters of the target PSR design package.

[0193] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0194] Based on a preset substring search algorithm, as well as the rule type, rule implementation method, rule output parameters and rule input parameters of the target PSR design package, matching is performed among multiple preset PSR design packages to obtain a similar PSR design package that meets the preset similarity conditions, and the target PSR design package is corrected based on the similar PSR design package to obtain a corrected PSR design package.

[0195] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0196] The target PSR design package is modified based on the rules contained in the similar PSR design package to obtain a modified PSR design package.

[0197] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0198] If it is determined that the target PSR design package provides the telecommunication service corresponding to the target PSR design package, and provides the sub-service corresponding to the target PSR design package, then it is determined that the output parameters of the target PSR design package meet normal conditions, and the target PSR design package is determined to be a normal PSR design package.

[0199] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0200] Generate correction record information based on the corrected PSR design package, and send the correction record information to the PSR design system.

[0201] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0202] Send the normal PSR design package to the orchestration system.

[0203] The present application also provides a computer program product including instructions, which, when executed on a computer, causes the computer to perform the following steps:

[0204] Get test case data of the target PSR design package in the test environment.

[0205] The test instance data is used as an input parameter of the orchestration process of the target PSR design package, and the target PSR design package is run to obtain the rule output value of the target PSR design package.

[0206] If the rule output value does not meet the preset conditions, the target PSR design package is corrected to obtain a corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the steps of running the target PSR design package are re-executed until the rule output value meets the preset conditions and the output parameters of the target PSR design package are obtained.

[0207] If the output parameters meet normal conditions, it is determined that the target PSR design package is a normal PSR design package.

[0208] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0209] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0210] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A testing method, characterized in that: The method comprises: Acquire test instance data of the target PSR design package in the test environment; Using the test instance data as an input parameter of the orchestration process of the target PSR design package, and running the target PSR design package to obtain the rule output value of the target PSR design package; If the rule output value does not meet the preset condition, the target PSR design package is corrected to obtain a corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the step of running the target PSR design package is re-executed until the rule output value meets the preset condition, and the output parameter of the target PSR design package is obtained; If the output parameters meet normal conditions, it is determined that the target PSR design package is a normal PSR design package.

2. The method according to claim 1, characterized in that The test environment is constructed based on the resource data in the target system and a preset digital twin tool. The test environment is a digital twin environment. The resources include components for constructing services. The business in the target system includes one sub-business or multiple sub-businesses, and the sub-business includes one resource data or multiple resource data.

3. The method according to claim 1, characterized in that The target PSR design package includes at least one or more of PSR attributes, PSR interface parameters and rules.

4. The method according to claim 3, characterized in that The target PSR design package at least includes PSR attributes, PSR interface parameters and rules; the test instance data is used as an input parameter of the orchestration process of the target PSR design package, including: The test instance data is used as an input parameter of the PSR attribute, the test instance data is used as an input parameter of the PSR interface parameter, and the test instance data is used as an input parameter of the rule.

5. The method according to any one of claims 1 to 4, characterized in that: The rule output value satisfies the preset condition, and the output parameter of the target PSR design package is obtained, including: If the rule output value satisfies the preset condition, the target PSR design package continues to be run based on the data in the test environment to obtain the output parameters of the target PSR design package.

6. The method according to claim 1, characterized in that The step of modifying the target PSR design package to obtain a modified PSR design package includes: Based on a preset substring search algorithm, as well as the rule type, rule implementation method, rule output parameters and rule input parameters of the target PSR design package, matching is performed among multiple preset PSR design packages to obtain a similar PSR design package that meets the preset similarity conditions, and the target PSR design package is corrected based on the similar PSR design package to obtain a corrected PSR design package.

7. The method according to claim 6, characterized in that The step of modifying the target PSR design package based on the similar PSR design package to obtain a modified PSR design package includes: The target PSR design package is modified based on the rules contained in the similar PSR design package to obtain a modified PSR design package.

8. The method according to claim 1, characterized in that If the output parameter satisfies a normal condition, determining that the target PSR design package is a normal PSR design package includes: If it is determined that the target PSR design package provides the target operator service corresponding to the target PSR design package, and provides the sub-service corresponding to the target PSR design package, then it is determined that the output parameters of the target PSR design package meet normal conditions, and the target PSR design package is determined to be a normal PSR design package.

9. The method according to claim 7 or 8, characterized in that: The method further comprises: Generate correction record information based on the corrected PSR design package, and send the correction record information to the PSR design system.

10. The method according to claim 1, characterized in that The method further comprises: The normal PSR design package is sent to the orchestration system.

11. A testing device, characterized in that: The device comprises: A first acquisition module is used to acquire test instance data of a target PSR design package in a test environment; A first output module, used to use the test instance data as an input parameter of the orchestration process of the target PSR design package, and run the target PSR design package to obtain a rule output value of the target PSR design package; A correction module, used for correcting the target PSR design package if the rule output value does not meet the preset condition to obtain a corrected PSR design package, and using the corrected PSR design package as the target PSR design package to re-execute the step of running the target PSR design package until the rule output value meets the preset condition to obtain the output parameter of the target PSR design package; The first determination module is used to determine that the target PSR design package is a normal PSR design package if the output parameter meets the normal condition.

12. A communication device, characterized in that: include: processors and receivers; The receiver is used to obtain test instance data of a target PSR design package in a test environment; The processor is used to use the test instance data as an input parameter of the orchestration process of the target PSR design package, and run the target PSR design package to obtain a rule output value of the target PSR design package; If the rule output value does not meet the preset condition, the target PSR design package is corrected to obtain a corrected PSR design package, and the corrected PSR design package is used as the target PSR design package, and the step of running the target PSR design package is re-executed until the rule output value meets the preset condition, and the output parameter of the target PSR design package is obtained; If the output parameters meet normal conditions, it is determined that the target PSR design package is a normal PSR design package.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 10 are implemented.

14. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 10 are implemented.

Images