Simulation test method and device, nonvolatile storage medium and electronic equipment

By receiving business order data, generating product loading process instances, and recording test data, the problem of insufficient simulation testing in the product design phase in the telecommunications industry is solved. This enables the discovery and correction of configuration errors during the design phase, improving development efficiency and reducing costs.

CN121807694APending Publication Date: 2026-04-07CHINA TELECOM CORP LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-12-03
Publication Date
2026-04-07

AI Technical Summary

Technical Problem

In the operation of cloud networks in the telecommunications industry, the lack of effective simulation testing methods during the product design phase leads to frequent configuration errors when the product loading process is executed in the actual orchestration center, resulting in high costs, low efficiency, and repetitive work.

Method used

By receiving business order data, determining test cases and generating product loading process instances, recording test data and generating test reports, we can achieve in-depth verification of the product information model and discover and correct configuration errors.

Benefits of technology

By identifying and correcting configuration errors in advance during the design phase, frequent occurrences of configuration errors during actual execution are avoided, thus improving development efficiency and reducing costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121807694A_ABST
    Figure CN121807694A_ABST
Patent Text Reader

Abstract

The invention discloses a simulation test method and device, a nonvolatile storage medium and electronic equipment. The method comprises the following steps: receiving business order data, and determining a test case corresponding to the business order data; determining product information in the business order data, and determining a product information model corresponding to the product information; generating a product loading process instance based on the test case and the product information model, the product loading process instance being used for executing a simulation process according to an association relationship and a configuration rule defined in the product information model; and executing the product loading process instance, recording test data in the process of executing the product loading process instance, and generating a test report based on the test data. According to the method and the device, the technical problem that configuration errors frequently occur when a product loading process is executed in an actual arrangement center due to the lack of an effective simulation test means in a product design stage is solved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer technology, in particular to a simulation test method and device, a nonvolatile storage medium and an electronic device. BACKGROUND

[0002] In the current cloud network operation of the telecommunications industry, product design is a complex and critical process, especially the design and verification of the Product Service Resource (PSR) model. The PSR model is an important tool for describing and constructing a multi-level service architecture from underlying network resources to end-user products. In this model, multiple resources constitute network services, one or more network services are combined to form business services, and one or more business services jointly constitute the communication services or products provided externally. Design personnel design products and services in the product service design center according to the PSR model. This design process usually includes detailed planning of the relationships between resources, resource services, business services, and products to ensure that they can be combined and delivered according to the preset logic.

[0003] However, when the designed PSR model is delivered to the orchestration center in the form of an orchestration package for actual execution, problems that were not foreseen in the early design stage will be exposed. These problems mainly result from configuration errors, such as inconsistency of model data, logical defects, or mismatch with the actual environment. The discovery and correction of these problems require an iterative joint debugging test process, i.e., the design personnel need to modify the data in the product service design center, then generate an orchestration package to the orchestration center for retesting, until all problems are solved and the product is officially put online. This traditional testing method has the disadvantages of high cost, low efficiency, and repetitive labor, which not only affects the development speed of the product, but also increases the development and testing costs, and may even cause unnecessary interference to the production environment.

[0004] Currently, no effective solutions have been proposed to address the above problems. SUMMARY

[0005] The present application provides a simulation test method and device, a nonvolatile storage medium and an electronic device to at least solve the technical problem of frequent configuration errors when the product loading process is executed in the actual orchestration center due to the lack of effective simulation test means in the product design stage.

[0006] According to an aspect of the present application, a simulation test method is provided, comprising: receiving service order data, and determining a test case corresponding to the service order data; determining product information in the service order data, and determining a product information model corresponding to the product information, wherein the product information model is used to define an association relationship and a configuration rule between a product, a service and a resource; generating a product loading process instance based on the test case and the product information model, wherein the product loading process instance is used to execute a simulation process according to the association relationship and the configuration rule defined in the product information model; executing the product loading process instance, recording test data in the process of executing the product loading process instance, and generating a test report based on the test data.

[0007] Optionally, the determining of the test case corresponding to the service order data comprises: performing standardization processing on the service order data to obtain standardized order data, wherein the standardization processing comprises data cleaning, format standardization and integrity checking; performing order-to-delivery conversion on the standardized order data to generate input information recognizable by the orchestration engine, wherein the order-to-delivery conversion comprises mapping service parameters in the standardized order data into resource description parameters required by the orchestration engine; extracting a service order identifier and product specification parameters from the standardized order data, and extracting resource topology description information from the input information recognizable by the orchestration engine; combining the service order identifier, the product specification parameters and the resource topology description information into a test parameter set; selecting a target template matched with the test parameter set from a test case template library, instantiating the target template and generating the test case.

[0008] Optionally, the determining of the product information in the service order data and the product information model corresponding to the product information comprises: extracting a product identifier and a product version number from the service order data, and generating a product model query request based on the product identifier and the product version number; routing the product model query request to a corresponding product model database, and loading a product information model corresponding to the product identifier and the product version number from the product model database, wherein the product information model comprises at least one of the following: product specification, service component list, resource configuration template and service rule definition.

[0009] Optionally, based on the test case and the product information model, a product loading process instance is generated, including: obtaining input information recognizable by the orchestration engine from the test case, and parsing a service component list and a resource configuration template from the product information model; determining a service component sequence based on the service component list; generating instantiation configuration parameters of each business service component in the service component sequence according to the resource configuration template and the input information recognizable by the orchestration engine; generating an initial process instance according to the service component sequence and the instantiation configuration parameters corresponding to the service component sequence; integrating verification rules defined in the test case with the initial process instance, and configuring process monitoring points and assertion check points at preset steps to obtain the product loading process instance; wherein the process monitoring points are used to collect and report state data and performance indicators of the process instance at runtime, and the assertion check points are used to compare actual output of the process instance with preset expected results, and determine success or failure of the test steps according to the comparison results.

[0010] Optionally, the product loading process instance is executed, including: step S1, loading the test case and the corresponding product information model bound to the product loading process instance, and initializing a process execution context; step S2, traversing each service component in the order of the service component sequence, for a target service component currently being processed, extracting corresponding resource configuration rules and assignment logic from the product information model; step S3, constructing a dispatching message of the target service component according to the instantiation configuration parameters generated for the target service component and the resource configuration rules, and assigning values to message fields in the dispatching message according to the assignment logic; step S4, sending the assigned dispatching message to the corresponding simulation environment to perform simulated dispatching; step S5, receiving a response message returned by the simulation environment, verifying the response message according to business verification rules defined in the product information model, and updating the process execution context according to the verification result; step S6, obtaining execution state data, and determining whether the execution result in the execution state data meets the expectation through the assertion check point; step S7, repeating the above steps S2 to S6 until all service components in the service component sequence are processed.

[0011] Optionally, the method further comprises: determining whether a manual intervention checkpoint is reached by a state flag bit in the process execution context during execution of the product loading process instance; suspending execution of the product loading process instance, presenting a current to-be-processed order message or required simulation response parameters to a tester, and activating corresponding manual operation authority in a case where the manual intervention checkpoint is reached; receiving a task instruction input by the tester based on the presented information, wherein the task instruction comprises an order confirmation instruction, a simulation response data filling instruction, or an error injection instruction; updating the task instruction to the process execution context, and resuming execution of the product loading process instance based on the updated context data; displaying execution state data collected from a process monitoring point and verification error information generated from an assertion checkpoint in real time during human-computer interaction; and recording the task instruction, execution state data changes triggered by the task instruction, and related verification error information to a process execution log.

[0012] Optionally, the test report is generated based on the test data, comprising: collecting original test data from the process execution log in a case where it is determined that the product loading process instance is executed completely, wherein the original test data comprises process state information, error information, comparison results, and performance indicators; aggregating and analyzing the original test data to obtain structured test results, wherein the aggregation and analysis comprises: summarizing comparison results of the assertion checkpoints according to verification rules in the test case, and generating an error statistical report based on the error information; generating a test report draft based on the structured test results and a preset report template, wherein the test report draft comprises a test execution summary, error analysis details, and performance indicator statistics; and associating the test report draft with corresponding test cases and execution snapshots of the product loading process instance to generate the test report.

[0013] According to still another aspect of the present application, a simulation test device is also provided, comprising: a receiving module configured to receive business order data and determine test cases corresponding to the business order data; a determining module configured to determine product information in the business order data and determine product information models corresponding to the product information, wherein the product information models are configured to define association relationships and configuration rules between products, business services, and resources; a first generating module configured to generate product loading process instances based on the test cases and the product information models, wherein the product loading process instances are configured to execute simulation processes according to the association relationships and configuration rules defined in the product information models; and a second generating module configured to execute the product loading process instances, record test data during execution of the product loading process instances, and generate test reports based on the test data.

[0014] According to still another aspect of the present application, a non-volatile storage medium is also provided, comprising a stored program, wherein the program controls a device in which the storage medium is located to execute the simulation test method described above when the program is executed.

[0015] According to still another aspect of the present application, an electronic device is provided, comprising a memory and a processor, the processor being configured to execute a program stored in the memory, wherein the program, when executed, implements the simulation test method described above.

[0016] According to still another aspect of the present application, a computer program is provided, wherein the computer program, when executed by a processor, implements the simulation test method described above.

[0017] According to still another aspect of the present application, a computer program product is provided, the computer program product comprising a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores a computer program, and the computer program, when executed by a processor, implements the simulation test method described above.

[0018] In the present application, a service order data is received, and a test case corresponding to the service order data is determined; product information in the service order data is determined, and a product information model corresponding to the product information is determined, wherein the product information model is used to define an association relationship and a configuration rule between a product, a service and a resource; based on the test case and the product information model, a product loading process instance is generated, wherein the product loading process instance is used to execute a simulation process according to the association relationship and the configuration rule defined in the product information model; the product loading process instance is executed, and in the process of executing the product loading process instance, test data is recorded, and a test report is generated based on the test data, which achieves the purpose of deeply verifying the product information model, thereby realizing the technical effect of discovering and correcting configuration errors in the design stage in advance, and further solving the technical problem of frequent configuration errors in the actual arrangement center when executing the product loading process due to the lack of effective simulation test means in the product design stage. BRIEF DESCRIPTION OF DRAWINGS

[0019] The accompanying drawings, which are included to provide a further understanding of the present application and constitute a part of this application, illustrate certain illustrative embodiments of the present application and together with the description serve to explain the present application. In the drawings:

[0020] Figure 1 is a flowchart of a simulation test method according to an embodiment of the present application;

[0021] Figure 2 is a schematic diagram of a PSR model according to an embodiment of the present application;

[0022] Figure 3 is a structural diagram of a simulation test device according to an embodiment of the present application;

[0023] Figure 4is a structural diagram of another simulation test device according to an embodiment of the present application;

[0024] Figure 5 is a hardware structure block diagram of a computer terminal of a simulation test method according to an embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to enable persons skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by persons skilled in the art without creative work should fall within the scope of protection of the present application.

[0026] It should be noted that the terms "first", "second", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units that are not clearly listed or inherent to the process, method, product or device.

[0027] According to an embodiment of the present application, a method embodiment of a simulation test method is provided. It should be noted that the steps shown in the flowchart of the drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described herein can be executed in an order different from that shown herein.

[0028] Figure 1 is a flowchart of a simulation test method according to an embodiment of the present application, as Figure 1 shown, the method comprises the following steps:

[0029] Step S102, receiving service order data and determining the test case corresponding to the service order data.

[0030] The received service order data refers to the product subscription request details initiated by the customer in the telecommunication service, for example, a converged package subscribed by the customer, including high-speed Internet access, fixed telephone service and mobile network traffic service, as well as the subscription quantity, service starting date, additional options (such as additional voice call minutes), payment method and customer basic information. The service order data can be obtained through a simulated customer relationship management (CRM) order receiving interface, and the simulation process ensures the diversity and authenticity of the data, so that the real business scenario can be reproduced in the test environment.

[0031] Then, test cases are constructed based on the characteristics and requirements of the order data. For example, for the subscription of the converged package described above, the test cases can include verifying whether the package service is correctly allocated to the customer account, checking whether the network and telephone service opening instructions are generated as expected, evaluating whether the additional options are handled properly, and confirming whether the payment and billing process is correct. Each test case targets one or more specific links in the product loading process, for testing the performance and stability of the product information model in different scenarios.

[0032] In step S104, the product information in the service order data is determined, and the product information model corresponding to the product information is determined, wherein the product information model is used to define the association relationship and configuration rules between the product, service and resource.

[0033] For example, the product information model is a PSR model, Figure 2 is a schematic diagram of a PSR model according to an embodiment of the present application. In the PSR model, the resource (Resource) refers to the basic physical or logical components in the telecommunication network, such as lines, switches, routers or software platforms, which constitute the basis of network services. The resource service (Service) is a higher level service based on the underlying resources, such as data transmission service, voice service or mobile network service, which can be provided independently or combined together to form more complex service services. The product (Product) is the communication solution finally provided to the user, which can be composed of one or more service services to meet the specific user needs.

[0034] In step S104, if the service order data corresponds to a "cloud network converged package", the product information includes the basic services of the package (such as bandwidth, voice call), additional services (such as additional data traffic or security services) and related customer information.

[0035] Determining the product information corresponding to the product information model is a key step in transforming abstract product concepts into specific, executable rules and relationships. The product information model is based on the PSR model design concept, and the product information model clearly defines the hierarchical structure and interaction mechanism between products, business services, and underlying resources. In the product information model, the product is decomposed into different levels of services and resources, each level having its specific attributes and configuration rules. Taking the "cloud network integration package" as an example, the product information model defines which network services the package is composed of, which specific resources each network service involves, and how resources are scheduled and configured to support the implementation of business services. The model can also include rule adapters to obtain the parameters required for order allocation, ensuring that the order allocation and response process conforms to the expected behavior pattern.

[0036] By mapping product information into the product information model, it can be clearly seen how the product is deconstructed from high-level business requirements into specific network operations and resource allocation.

[0037] Step S106, based on the test case and the product information model, a product loading process instance is generated, wherein the product loading process instance is used to execute a simulation process according to the correlation relationship and configuration rules defined in the product information model.

[0038] For example, suppose there is a test case to verify whether the automatic configuration process of the "cloud network integration package" after the customer places an order can proceed as expected. This package includes internet access service, telephone service, and cloud storage service. According to the definition of the product information model, the internet access service is associated with the broadband resource, the telephone service is associated with the telephone line resource, and the cloud storage service is associated with the storage resource of the cloud platform. In addition, the model also defines the dependency relationship between services, such as the allocation of broadband resources must precede the configuration of telephone line resources.

[0039] Based on the above test case and product information model, the generated product loading process instance will include the following steps: 1. Parse the "cloud network integration package" subscription information in the test case, including package type, customer information, and subscription date, etc. 2. According to the product information model, identify the resources and services related to the package, i.e. broadband resources, telephone line resources, and cloud storage resources. 3. Build the scheduling order of resources and services to ensure that the allocation of broadband resources precedes the configuration of other resources. 4. Define the order allocation parameters in resource configuration, and use rule adapters to ensure that the parameters meet the configuration rules in the product design. 5. Design an exception handling mechanism in the process instance, for example, when the broadband resource allocation fails, the simulation work order should automatically jump to the error handling process, prompting to reallocate resources or manual intervention. 6. Create an execution script for the test case, including the complete process of simulating customer ordering, resource allocation, service activation, and finally verifying the configuration status of the package.

[0040] In step S108, the product loading process instance is executed, and in the process of executing the product loading process instance, test data is recorded, and a test report is generated based on the test data.

[0041] During the execution process, test data is continuously collected and recorded. The test data includes the dispatching and receiving time of the work order, the state change of the resource and service, the correctness verification result of the configuration parameter, the response time of each link, and any abnormal or error information. The purpose of recording the test data is to comprehensively understand the running status of the simulation test, including but not limited to the smoothness of the process, performance bottlenecks, resource conflicts, and configuration errors.

[0042] Then, based on the collected test data, a detailed test report is generated. The test report lists the results of each product loading process instance execution, specifically indicating the successful and failed links, and provides possible solutions for the failure or abnormal situation. For example, if a resource limit error is detected during the simulation of resource allocation, the report indicates which specific resource has reached the upper limit, and provides suggestions for increasing resource capacity or adjusting resource allocation strategy. The test report will also include key indicators recorded during the execution process, such as average response time, success rate, and error rate, which help to evaluate the efficiency and robustness of the product design. More importantly, the report will highlight the design flaws or logical loopholes found during the test process, allowing designers to make necessary adjustments and optimizations before the product is officially released.

[0043] The above steps receive business order data, determine the test case corresponding to the business order data, determine the product information in the business order data, and determine the product information model corresponding to the product information, wherein the product information model is used to define the association relationship and configuration rules between the product, business service and resource; based on the test case and the product information model, a product loading process instance is generated, wherein the product loading process instance is used to execute a simulation process according to the association relationship and configuration rules defined in the product information model; the product loading process instance is executed, and in the process of executing the product loading process instance, test data is recorded, and a test report is generated based on the test data. The method achieves the purpose of deeply verifying the product information model, thereby realizing the technical effect of discovering and correcting configuration errors in the design stage in advance.

[0044] The following steps shown in FIG. 8 are exemplarily explained and explained. Figure 1

[0045] ​According to some optional embodiments of the present application, determining the test case corresponding to the business order data can be achieved by the following method: standardizing the business order data to obtain standardized order data, wherein the standardization includes data cleaning, format normalization, and integrity checking; converting the standardized order data from order to delivery to generate input information recognizable by the orchestration engine, wherein the conversion from order to delivery includes mapping the business parameters in the standardized order data to the resource description parameters required by the orchestration engine; extracting the business order identifier and product specification parameters from the standardized order data, and extracting the resource topology description information from the input information recognizable by the orchestration engine; combining the business order identifier, product specification parameters, and resource topology description information into a test parameter set; selecting a target template matching the test parameter set in the test case template library, instantiating the target template, and generating a test case.

[0046] The data cleaning is used to eliminate redundant, inconsistent, or incorrect information in the business order data, to ensure the accuracy and reliability of the data. For example, remove duplicate order entries, correct format errors in fields, and handle any obvious logical contradictions. Format normalization refers to converting the cleaned business order data into a unified format to facilitate the reading and parsing of subsequent processing tools. For example, converting the data into standard formats such as JSON, XML, or CSV, to ensure that the orchestration engine can recognize and process this information. For example, standardizing all date fields to ISO 8601 format to ensure consistency of timestamps. The integrity check includes checking whether the business order data contains all the necessary fields and information in the orchestration process. Missing any key parameters can cause the simulation test to fail or result in deviation.

[0047] Further, the business parameters in the standardized order data are mapped to the resource description parameters required by the orchestration engine, that is, the high-level business requirements in the order are converted into specific network resources and business service configurations. For example, a business parameter such as "unlimited data traffic" will be converted to a resource description parameter of "maximum bandwidth 100 Mbps, traffic threshold unlimited".

[0048] Then the business order identifier and product specification parameters are extracted from the standardized order data, the business order identifier is used to uniquely identify each order, and the product specification parameters are detailed descriptions of product configurations. At the same time, the resource topology description information is extracted from the input information recognizable by the orchestration engine, wherein the resource topology description information is used to describe the location and connection mode of resources in the network. The business order identifier, product specification parameters, and resource topology description information are integrated into a test parameter set.

[0049] Finally in the test case template library, according to the content of the test parameter set, the most matched template is selected. The template in the test case template library presets the test framework of various common business scenarios, and through instantiation of the selected template, the specific test parameter set information can be filled in, and then the individualized test case for the current business order is generated. For example, if the test parameter set indicates that a composite product including broadband and fixed telephone service is to be tested, then the corresponding composite product test template is selected, and specific parameters such as order ID, broadband speed, and telephone line quantity are filled in to generate a test case that accurately simulates the order loading process.

[0050] According to some optional embodiments of the present application, determining the product information in the business order data and determining the product information model corresponding to the product information can be implemented by the following method: extracting the product identifier and the product version number from the business order data, and generating a product model query request based on the product identifier and the product version number; routing the product model query request to the corresponding product model database, and loading the product information model corresponding to the product identifier and the product version number from the product model database, wherein the product information model includes at least one of the following: product specifications, service component list, resource configuration template, and business rule definition.

[0051] In the present embodiment, first, the product identifier and the product version number are extracted from the business order data. The product identifier and the product version number are the core components of the product model query request, which together define the specific product and its version of the order being processed, thereby ensuring that the product information model loaded in subsequent operations is the latest and completely matches the order requirements. The product identifier is a unique identification code of the product in the system, which ensures that the target product can be accurately locked even in a large number of products and complex business environment. The product version number is used to reflect the iteration history of the product, which is crucial for identifying specific function settings, configuration details, and possible differences. For example, a broadband package may undergo multiple modifications, such as adding new additional services or adjusting price strategies, and the product version number can ensure that the latest or specified version of the relevant information is loaded.

[0052] Then, based on the extracted product identifier and product version number, a product model query request is generated. The model query request follows specific data structure and format specifications to ensure that it can be correctly parsed and routed to the corresponding product model database. In the query request, the product identifier and version number are explicitly identified to enable the database to quickly locate the correct model data.

[0053] The model query request is routed to a product model database containing the specified product identifier and version number information. In the product model database, the corresponding product information model is retrieved from the storage according to the key information provided in the query request. The product information model includes not only the detailed description of the product specifications, but also the service component list for determining the business services involved in the product and their interdependencies, the resource configuration template for defining the allocation and usage patterns of the underlying resources required to implement the product, and the business rule definition for specifying the logical constraints and decision-making processes in the product loading, service activation, and resource allocation processes.

[0054] For example, a query request can refer to "Cloud Network Converged Package V2", and the product model database will return a model including the latest specifications of the package (such as maximum bandwidth, call minutes, storage size), service components (broadband service, telephone service, cloud storage service), resource configuration templates (such as broadband resource allocation to specific regional network nodes, telephone service associated with local switches), and business rules (such as only when the broadband resource allocation is successful, the telephone service dispatch is performed to ensure the order of service component loading). The loaded product information model not only provides a complete blueprint for product design, but also prepares detailed data basis and execution rules for subsequent simulation testing.

[0055] In some optional embodiments of the present application, based on the test case and the product information model, a product loading process instance is generated, which can be achieved by the following method: obtaining the input information recognizable by the orchestration engine from the test case, and parsing the service component list and the resource configuration template from the product information model; determining the service component sequence based on the service component list; generating the instantiation configuration parameters of each business service component in the service component sequence according to the resource configuration template and the input information recognizable by the orchestration engine; generating an initial process instance according to the service component sequence and the instantiation configuration parameters corresponding to the service component sequence; integrating the verification rules defined in the test case with the initial process instance, and configuring process monitoring points and assertion check points at preset steps to obtain the product loading process instance; wherein the process monitoring points are used to collect and report the state data and performance indicators of the process instance at runtime, and the assertion check points are used to compare the actual output of the process instance with the preset expected result, and determine the success or failure of the test step according to the comparison result.

[0056] Specifically, first, the product requirements described in the test case are converted into a format that the orchestration engine can understand and process. The input information includes details of the business order, such as the type and quantity of services ordered, as well as customer and contract information related to them.

[0057] Then parse the service component list and service configuration template inside the product information model. The service component list lists all the business services that constitute a specific product, and each service component represents a specific service in the product, such as broadband access, voice communication, cloud storage, etc. The resource configuration template describes in detail how to implement these service components on the underlying cloud network infrastructure, including resource selection rules, resource allocation strategies, and interdependencies between service components.

[0058] Based on the service component list, the service component sequence is generated. The service component sequence is the execution order of the service components in the product loading process. The service component sequence takes into account the dependencies between service components and the loading order specified in the product design, ensuring the on-demand allocation and ordered activation of sources and services.

[0059] According to the resource configuration template and the input information that the orchestration engine can recognize, the instantiation configuration parameters of each service component are generated. That is, the general configuration template is converted into personalized configuration for a specific order, ensuring that the product loading process can meet the unique needs of the order. For example, according to the broadband speed level ordered by the customer, determine the appropriate network resources from the resource configuration template and instantiate the configuration parameters for it, such as IP address, bandwidth limit, quality of service (QoS) settings, etc.

[0060] Further, the initial process instance is generated. The initial process instance includes a complete and sequentially arranged set of service components, as well as detailed configuration parameters corresponding to each component.

[0061] Combine the verification rules defined in the test case with the initial process instance to configure process monitoring points and assertion check points in the preset steps, thereby obtaining the final product loading process instance. The process monitoring point is located at each key service component loading link, and its role is to capture and report state data and performance indicators, such as resource utilization, order processing time, etc., during the process running, thereby providing real-time feedback and data support for test analysis. The assertion check point is located at the key point required by the verification rule, and its task is to compare the actual output of the process instance with the preset expected result to determine whether the test is successful. For example, check whether the customer can successfully access the Internet after configuring the broadband service, which is part of the assertion check.

[0062] Through fine process control and rule integration, the product loading process instance can fully simulate real-world business scenarios while ensuring the coverage and depth of the test.

[0063] As some optional embodiments of the present application, the product loading process instance is executed, which can be implemented by the following method: step S1, loading the test case bound with the product loading process instance and the corresponding product information model, and initializing the process execution context; step S2, traversing each service component according to the order of the service component sequence, and for the target service component currently being processed, extracting the corresponding resource configuration rule and assignment logic from the product information model; step S3, constructing the dispatching message of the target service component according to the instantiated configuration parameters and resource configuration rules generated for the target service component, and assigning values to the message fields in the dispatching message according to the assignment logic; step S4, sending the assigned dispatching message to the corresponding simulation environment to perform simulation dispatching; step S5, receiving the response message returned by the simulation environment, verifying the response message according to the business verification rules defined in the product information model, and updating the process execution context according to the verification result; step S6, obtaining the execution state data, and determining whether the execution result in the execution state data meets the expectation through the assertion checkpoint; step S7, repeating the above steps S2 to S6 until all service components in the service component sequence are processed.

[0064] Specifically, step S1: loading the test case and the product information model.

[0065] Before starting the test, the test case bound with the product loading process instance is loaded first. The test case is designed in advance according to a specific business scenario and requirements, including detailed product loading steps and expected results. At the same time, the corresponding product information model is loaded. The product information model includes a service component list, a resource configuration template, business rule definitions, etc. The process execution context is initialized, that is, a clean environment is prepared for this test, historical data is cleared, and it is ensured that each test is performed in a completely new and undisturbed state, enhancing the accuracy and reliability of the test results.

[0066] Step S2: traverse the service component and extract the rule.

[0067] According to the service component sequence (i.e. the predetermined order of business service loading), each service component is processed one by one. For the service component currently being processed, its related resource configuration rule and assignment logic are extracted from the product information model. The resource configuration rule is used to determine how to implement this service on the underlying resource, and the assignment logic is used to determine how to fill in the instantiated configuration parameters to generate an accurate dispatching message.

[0068] Step S3: construct the dispatching message and assignment.

[0069] According to the instantiation configuration parameters of the service component and the extracted resource configuration rules, a dispatching message is constructed. The dispatching message is an instruction issued to the backend system, including all details required for loading and configuring the service. The specific message fields in the dispatching message are assigned using assignment logic to ensure that their contents meet the requirements of product design and the constraints of business rules.

[0070] Step S4: Perform simulation dispatching.

[0071] The constructed dispatching message is sent to the simulation environment configured for the service component. The simulation environment can simulate the behavior of the real business system without affecting the actual production environment. After receiving the dispatching message, the simulation environment performs the corresponding resource allocation and service loading process, i.e., simulation dispatching.

[0072] Step S5: Response message verification and context update.

[0073] The response message returned by the simulation environment is received. The response message carries the results of simulation dispatching, including the status of resource allocation, the status of service loading, etc. According to the business verification rules defined in the product information model, the response message is analyzed and verified in detail to check whether the service component is correctly loaded and configured. If the response message meets the expectations, the execution context is updated to indicate that the current service component is successfully loaded; otherwise, the failure conditions are recorded, and relevant logs and data are saved for subsequent analysis.

[0074] Step S6: Assertion check and execution status confirmation.

[0075] The latest execution status data is obtained, which includes the latest status of resource allocation, the activation status of the service component, and any changes in intermediate states. By comparing the execution status data with the expected results defined in the test case through assertion checkpoints, it is determined whether the product loading process meets the expectations.

[0076] Step S7: Repeat execution until completion.

[0077] Steps S2 to S6 are repeated until all service components in the service component sequence are processed. That is, the entire product loading process has been fully verified through the simulation test environment.

[0078] In some optional embodiments of the present application, the simulation test method further comprises the following steps: during the execution of the product loading process instance, determining whether a manual intervention checkpoint is reached by a state flag in the process execution context; in the case that the manual intervention checkpoint is reached, suspending the execution of the product loading process instance, presenting the current to-be-processed dispatching message or the required simulation response parameters to the tester, and activating the corresponding manual operation authority; receiving the task instructions input by the tester based on the presented information, wherein the task instructions include: dispatching confirmation instructions, simulation response data filling instructions, or error injection instructions; updating the task instructions to the process execution context, and resuming the execution of the product loading process instance based on the updated context data; in the human-computer interaction process, real-time display of the execution state data collected from the process monitoring points and the verification error information generated from the assertion checkpoints; recording the task instructions, the execution state data changes triggered by the task instructions, and the related verification error information to the process execution log.

[0079] In the present embodiment, first, the state flag in the process execution context is checked, wherein the state flag is used to identify whether the process has reached a pre-defined manual intervention checkpoint. The existence of the manual intervention checkpoint is to introduce the direct judgment of the tester at the key nodes of the simulation test, so as to ensure that the test process can adapt to complex business logic or special situations.

[0080] If it is detected that the process has indeed reached the manual intervention checkpoint, the further automatic execution of the product loading process instance is suspended. At this time, the human-computer interaction mode is switched to, and the current to-be-processed dispatching message is presented to the tester. The dispatching message describes in detail the resource allocation requirements and configuration parameters of the service component to be executed, or presents the required simulation response parameters, which are set by the tester to simulate the response of the back-end system to the dispatching in the real scene.

[0081] Then, the specific manual operation authority is activated, allowing the tester to directly operate the dispatching message or the simulation response parameters. Specifically, it includes receiving the dispatching confirmation instructions of the tester, confirming that the content of the dispatching message is correct, and the execution can continue according to the plan; or receiving the simulation response data filling instructions, allowing the tester to modify or supplement the response data to the dispatching in the simulation environment, so as to test the product loading process under different response conditions; and the error injection instructions, i.e., the tester consciously introduces errors or abnormal conditions in the process, to evaluate the error handling capability and robustness of the product loading process.

[0082] After receiving the task instruction from the tester, the task instruction is incorporated into the process execution context, that is, the state of the current process and the guidance of the next action are updated. Based on the updated context data, the execution of the product loading process instance is restarted to ensure that the operation intention of the tester is accurately executed and the process can continue according to the new instruction.

[0083] In the process of human-computer interaction, the execution state data collected from the process monitoring point is continuously collected and displayed in real time. The execution state data includes but is not limited to the state of the service component, the progress of resource allocation, and the performance indicators in the simulation process. At the same time, any verification error information generated from the assertion check point is continuously displayed, which is used to reveal the discrepancy between the actual output and the expectation, and helps the tester to identify and solve problems in time.

[0084] Finally, all manual operation instructions, execution state data changes caused by these instructions, and verification error information encountered during testing are recorded in the process execution log one by one. The process execution log is a detailed record of the testing process, which not only provides traceability for the testing process, but also provides basic data for subsequent error analysis, process optimization, and test case improvement.

[0085] As another optional embodiment of the present application, a test report is generated based on the test data, which can be realized by the following method: in the case where it is determined that the product loading process instance execution is completed, the original test data is collected from the process execution log, wherein the original test data includes: process state information, error information, comparison result and performance indicators; the original test data is aggregated and analyzed to obtain structured test results, wherein the aggregation and analysis includes: the comparison results of the assertion check points are summarized according to the verification rules in the test case, and the error statistical report is generated based on the error information; based on the structured test results and the preset report template, a test report draft is generated, wherein the test report draft includes: test execution summary, error analysis details and performance indicator statistics; the test report draft is associated with the corresponding test case and the execution snapshot of the product loading process instance to generate the test report.

[0086] It can be understood that the original test data includes but is not limited to process state information, which is used to record the stages and states of the product loading process during execution; error information, which is used to record any abnormal situation or failure point encountered in the process execution; comparison result, which is used to show the difference between the actual output and the expected result at the assertion check point; and performance indicators, which quantify the efficiency and resource consumption of the process execution.

[0087] Further, the original test data is aggregated and analyzed to distill the complex test information into clear and structured test results. Specifically, according to the preset verification rules in the test cases, the comparison results of the assertion checkpoints are summarized, all points that fail to pass the verification are identified, and the degree of deviation between the actual output and the expected output is determined, thereby forming the overall evaluation of the test. At the same time, based on the collected error information, an error statistical report is generated, which includes all types of errors, frequencies and possible causes, providing a basis for subsequent error troubleshooting and system optimization.

[0088] Then a draft of the test report is generated, which follows a preset report template to ensure the systematicness and readability of the information. The draft of the test report includes a test execution summary, which describes the test process and overall results; error analysis details, which describe the problems identified in the error statistical report and provide possible solution suggestions; and performance indicator statistics, which visually present the performance of the product loading process through charts and data points, including resource consumption, execution time and other key indicators.

[0089] Finally, the draft of the test report is associated with the corresponding test cases and the complete execution snapshots of the product loading process instances, ensuring that each conclusion and analysis in the report has a basis, and the testers and designers can trace back to each detail of the process through the execution snapshots to verify or further study the information in the report. The test report is not only a summary document, but also a comprehensive evaluation that integrates test design, execution details and analysis results.

[0090] Figure 3 is a structural diagram of a simulation test device according to an embodiment of the present application, as shown in Figure 3 The device mainly includes a test input module, a simulator module, and a visualization and control module.

[0091] The test input module first simulates the interaction logic of the order acceptance interface of the CRM system inside the communication operator. Through simulation, data sets representing different types of product orders can be generated. The data sets not only include customer basic information such as account number and contact information, but more importantly, include specific product requirements such as broadband package selection and cloud storage capacity customization. By accurately simulating the order generation process of the CRM system, the generated order data can be highly consistent with actual business operations.

[0092] The test input module then performs Order-to-Delivery (OD) conversion, translating product order data into a language understood by the orchestration center. OD conversion specifically involves converting abstract customer requirements into concrete, structured resource allocation and business service configuration instructions, ensuring that product loading processes can be accurately executed both in real orchestration environments and in simulation environments. This process requires parsing product identifiers and configuration options from orders, mapping them to resource types and service components used by the orchestration center, and generating a set of standardized test input data suitable for product loading processes.

[0093] Based on the converted data, the test input module creates and manages order test cases, each representing a loading process simulation for a specific product configuration. These test cases not only include all steps of a single product loading but also encompass complex scenarios such as multi-product combinations, priority conflict handling, and resource contention, ensuring that simulation tests cover a wide range of diverse business requirements.

[0094] The simulator module is the core of the entire architecture, responsible for translating order test cases generated by the test input module into executable process instances and executing these instances in a controlled environment to verify the validity and integrity of PSR model data. First, the simulator module uses the database model adapter to convert PSR model data designed by the product service design center or provincial design into a domain model that the simulator can directly manipulate. This conversion process ensures that the format and structure of the model data meet the execution requirements of the simulator while also ensuring the portability and scalability of the model.

[0095] Then, the process instance generator generates instances that accurately reflect product loading processes based on the converted domain model and product requirements from order data. These process instances include all necessary steps and conditions, such as resource reservation and allocation, service component loading order, and dependencies between stages.

[0096] The simulation scheduler then takes over the process instances and performs simulation execution based on pre-set scheduling strategies and rules. This process consists of four key stages: first, it obtains the necessary parameters for dispatching orders at each stage by calling the rule adapter, ensuring that correct service configuration information is passed during dispatching; second, it executes simulated order dispatching, with each stage's orders following the service component loading logic and resource allocation strategies defined in the PSR model; third, it simulates the responses of backend systems, including various reactions under normal and abnormal conditions, to comprehensively test system performance under different scenarios; finally, it continuously collects error information during test execution, including but not limited to order processing failures and resource allocation imbalances.

[0097] The visualization and control module provides a visual observation window and flexible control means for the tester. On one hand, the visualization module can present the whole picture of the product loading process in a graphical manner, including the execution path of the process instance, the status and performance indicators of each link, and the test results at the assertion check points. The visualization capability greatly simplifies the understanding difficulty of the test results, enabling the tester to quickly locate the problem and assess the overall health status of the process.

[0098] On the other hand, the control module gives the tester the ability to intervene in the simulation process and control the dispatching timing of the work order and the content of the simulated response. For example, the tester can simulate an abnormal situation of temporary resource depletion through this module to observe how the system handles such a situation, or change the priority of the work order to test the flexibility of the resource scheduling strategy. The human-computer interactive test control not only increases the depth and breadth of the test, but also helps the designer to evaluate the design rationality of the PSR model under various extreme or special conditions, and to find potential risk points in advance.

[0099] Under the framework of simulation testing, the present application simulates the dispatching and response links in the loading process of the telecommunications product in detail, specifically including the whole process from receiving the product order to configuring the resource service, involving the construction of the dispatching message, the automatic assignment of the message field, the simulated dispatching of the work order, and the simulation of the backend system response, as well as the testing of abnormal situations and error handling mechanisms. Through highly realistic simulation, comprehensive testing of the configuration data integrity and logical correctness at the product order level can be achieved.

[0100] Especially crucial is that the present simulation testing technology has excellent compatibility, which can seamlessly interface with the existing product data of the provincial scheduling center, meaning that when the telecommunications product undergoes upgrading or changes, the simulator can be immediately used to efficiently verify the configuration data of the upgraded product without the need for large-scale adjustment of the scheduling center. This feature significantly speeds up the product iteration speed and reduces the cost and online time caused by data configuration errors.

[0101] For the designer, the present application provides a powerful tool to support the rapid verification of the accuracy of the PSR model data at the early design stage, avoiding the additional workload caused by the discovery of design defects at the later stage. By integrating simulation testing at the design stage, the designer can promptly correct any deficiencies in the model, ensuring that the underlying data structure and business logic of the product have undergone rigorous testing before being formally put into the production environment, thereby reducing the subsequent joint debugging requirements and saving a large amount of time and resources, effectively improving the efficiency and quality of product development.

[0102] In summary, the technical scheme provided by the application not only strengthens the verification of PSR model data, ensures the reliability and consistency of product design, but also improves the development process efficiency of telecommunication products and services in all aspects through simulating order generation, OD conversion, product loading process and human-computer interaction test, and opens up a new path for technical innovation and customer service improvement of the telecommunication industry.

[0103] Figure 4 is a structural diagram of another simulation test device according to an embodiment of the application, as shown in the figure, the device comprises: Figure 4

[0104] The receiving module 42 is configured to receive the service order data and determine the test case corresponding to the service order data.

[0105] The determining module 44 is configured to determine the product information in the service order data and determine the product information model corresponding to the product information, wherein the product information model is used to define the association relationship and configuration rules between the product, service and resource.

[0106] The first generating module 46 is configured to generate the product loading process instance based on the test case and the product information model, wherein the product loading process instance is used to execute the simulation process according to the association relationship and configuration rules defined in the product information model.

[0107] The second generating module 48 is configured to execute the product loading process instance, record the test data in the process of executing the product loading process instance, and generate the test report based on the test data.

[0108] Optionally, the test case corresponding to the service order data is determined, specifically including the following steps: performing standardization processing on the service order data to obtain standardized order data, wherein the standardization processing includes data cleaning, format standardization and integrity checking; performing order-to-delivery conversion on the standardized order data to generate input information recognizable by the orchestration engine, wherein the order-to-delivery conversion includes mapping the service parameters in the standardized order data into resource description parameters required by the orchestration engine; extracting the service order identifier and product specification parameters from the standardized order data, and extracting the resource topology description information from the input information recognizable by the orchestration engine; combining the service order identifier, product specification parameters and resource topology description information into a test parameter set; selecting a target template matched with the test parameter set in a test case template library, instantiating the target template and generating a test case.

[0109] ​Optionally, product information in the business order data is determined, and a product information model corresponding to the product information is determined, specifically including the following steps: product identifier and product version number are extracted from the business order data, and a product model query request is generated based on the product identifier and the product version number; the product model query request is routed to a corresponding product model database, and a product information model corresponding to the product identifier and the product version number is loaded from the product model database, wherein the product information model includes at least one of the following: product specifications, a service component list, a resource configuration template, and business rule definitions.

[0110] Optionally, based on the test case and the product information model, a product loading process instance is generated, specifically including the following steps: input information recognizable by the orchestration engine is obtained from the test case, and a service component list and a resource configuration template are parsed from the product information model; based on the service component list, a service component sequence is determined; based on the resource configuration template and the input information recognizable by the orchestration engine, instantiation configuration parameters of each business service component in the service component sequence are generated; based on the service component sequence and the instantiation configuration parameters corresponding to the service component sequence, an initial process instance is generated; verification rules defined in the test case are integrated with the initial process instance, and process monitoring points and assertion check points are configured at preset steps to obtain a product loading process instance; wherein the process monitoring points are used to collect and report state data and performance indicators of the process instance at runtime, and the assertion check points are used to compare actual output of the process instance with preset expected results, and determine success or failure of the test step according to the comparison result.

[0111] Optionally, the product loading process instance is executed, specifically including the following steps: step S1, loading the test case and the corresponding product information model bound to the product loading process instance, and initializing a process execution context; step S2, traversing each service component in the order of the service component sequence, for a target service component currently being processed, extracting corresponding resource configuration rules and assignment logic from the product information model; step S3, constructing a dispatching message of the target service component according to the instantiation configuration parameters generated for the target service component and the resource configuration rules, and assigning values to message fields in the dispatching message according to the assignment logic; step S4, sending the assigned dispatching message to a corresponding simulation environment to perform simulated dispatching; step S5, receiving a response message returned by the simulation environment, verifying the response message according to business verification rules defined in the product information model, and updating the process execution context according to the verification result; step S6, obtaining execution state data, and determining whether the execution result in the execution state data meets the expectation through the assertion check point; step S7, repeating the above steps S2 to S6 until all service components in the service component sequence are processed.

[0112] Optionally, the method further comprises: determining whether a manual intervention checkpoint is reached by a state flag bit in the process execution context during execution of the product loading process instance; suspending execution of the product loading process instance, presenting a current to-be-processed dispatching message or required simulation response parameters to a tester, and activating corresponding manual operation authority in a case where the manual intervention checkpoint is reached; receiving a task instruction input by the tester based on the presented information, wherein the task instruction comprises a dispatching confirmation instruction, a simulation response data filling instruction, or an error injection instruction; updating the task instruction to the process execution context, and resuming execution of the product loading process instance based on the updated context data; displaying execution state data collected from a process monitoring point and verification error information generated from an assertion checkpoint in real time during human-computer interaction; and recording the task instruction, execution state data changes triggered by the task instruction, and related verification error information to a process execution log.

[0113] Optionally, a test report is generated based on the test data, and specifically includes the following steps: collecting original test data from the process execution log in a case where execution of the product loading process instance is determined to be completed, wherein the original test data comprises process state information, error information, comparison results, and performance indicators; aggregating and analyzing the original test data to obtain structured test results, wherein the aggregation and analysis comprises: summarizing comparison results of the assertion checkpoints according to verification rules in the test case, and generating an error statistical report based on the error information; generating a test report draft based on the structured test results and a preset report template, wherein the test report draft comprises a test execution summary, error analysis details, and performance indicator statistics; and associating the test report draft with corresponding test cases and execution snapshots of the product loading process instance to generate the test report.

[0114] It should be noted that each of the modules in the above Figure 4 may be a program module (for example, a program instruction set implementing a certain specific function) or a hardware module, and for the latter, it can be in the following form, but is not limited to this: the form of each of the above modules is a processor, or the functions of each of the above modules are implemented by a processor.

[0115] It should be noted that the preferred embodiments of the embodiments shown in Figure 4 are described above, and will not be described here. Figure 1

[0116] Figure 5 A hardware structure block diagram of a computer terminal for implementing the simulation test method is shown. As shown in Figure 5 ​As shown, the computer terminal 50 may include one or more processors 502 (shown as 502a, 502b, ..., 502n in the figure) 502 (processor 502 may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.), a memory 504 for storing data, and a transmission module 506 for communication functions. In addition, it may also include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of a BUS bus), a network interface, a power supply, and / or a camera. Those skilled in the art will understand that... Figure 5 The structure shown is for illustrative purposes only and does not limit the structure of the aforementioned electronic device. For example, computer terminal 50 may also include... Figure 5 The more or fewer components shown, or having the same Figure 5 The different configurations shown.

[0117] It should be noted that the aforementioned one or more processors 502 and / or other data processing circuits are generally referred to herein as "data processing circuits". These data processing circuits may be embodied, in whole or in part, in software, hardware, firmware, or any other combination thereof. Furthermore, the data processing circuits may be a single, independent processing module, or may be integrated, in whole or in part, into any other element within the computer terminal 50. As involved in the embodiments of this application, the data processing circuits serve as processor control (e.g., selection of a variable resistor termination path connected to an interface).

[0118] The memory 504 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the simulation testing method in this embodiment. The processor 502 executes various functional applications and data processing by running the software programs and modules stored in the memory 504, thereby realizing the above-mentioned simulation testing method. The memory 504 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 504 may further include memory remotely located relative to the processor 502, and these remote memories can be connected to the computer terminal 50 via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0119] The transmission module 506 is configured to receive or send data via a network. The network can include, for example, a wireless network provided by a communication provider of the computer terminal 50. In one example, the transmission module 506 includes a network interface controller (NIC) that can connect to other network devices through a base station to communicate with the Internet. In one example, the transmission module 506 can be a radio frequency (RF) module that is configured to communicate with the Internet wirelessly.

[0120] The display can be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the computer terminal 50.

[0121] It is noted that in some alternative embodiments, the above Figure 5 The computer terminal can include hardware elements (including circuitry), software elements (including computer code stored on a computer readable medium), or a combination of both hardware and software elements. It should be noted that in some embodiments, the functions of the computer terminal described above can be provided by one or more of the hardware elements and / or software elements. Figure 5 is merely one example of a particular implementation and is intended to illustrate the types of components that can be present in the computer terminal described above.

[0122] It is noted that in some alternative embodiments, the above Figure 5 The computer terminal is configured to perform the simulation test method described above, and thus the above explanations regarding the method of executing the commands also apply to the electronic device, which will not be repeated here. Figure 1 The computer terminal is configured to perform the simulation test method described above, and thus the above explanations regarding the method of executing the commands also apply to the electronic device, which will not be repeated here.

[0123] The non-volatile storage medium includes a stored program, wherein the program, when executed, controls a device in which the storage medium is located to perform the simulation test method described above.

[0124] The non-volatile storage medium includes a stored program, wherein the program, when executed, controls a device in which the storage medium is located to perform the simulation test method described above.

[0125] The embodiment of the application further provides an electronic device, comprising a memory and a processor, the processor is used for running a program stored in the memory, wherein the program performs the simulation test method above when running.

[0126] The processor is used for running a program performing the following functions: receiving service order data, and determining a test case corresponding to the service order data; determining product information in the service order data, and determining a product information model corresponding to the product information, wherein the product information model is used for defining an association relationship and a configuration rule between a product, a service and a resource; generating a product loading process instance based on the test case and the product information model, wherein the product loading process instance is used for executing a simulation process according to the association relationship and the configuration rule defined in the product information model; and executing the product loading process instance, recording test data in the process of executing the product loading process instance, and generating a test report based on the test data.

[0127] The above sequence numbers of the embodiments of the application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0128] In the above embodiments of the application, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0129] In the above embodiments of the application, the collected information is information and data authorized by the user or authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of related data comply with relevant laws, regulations and standards, necessary protection measures are taken, do not violate public order and good customs, and provide corresponding operation portal for user to choose authorization or refusal.

[0130] In the several embodiments of the application, it should be understood that the disclosed technology can be implemented in other ways. Of course, the unit described as the division is only a description of logic function division. For example, there can be another division way for actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, unit or module, and can be electrical or other forms.

[0131] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on multiple units. According to actual needs, part or all of the units can be selected to achieve the purpose of the embodiment scheme.

[0132] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0133] When the integrated unit is realized in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the part that contributes to the related art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The foregoing storage medium includes a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store program codes.

[0134] The above is only the preferred embodiment of the present application. It should be noted that for those skilled in the art, without departing from the principle of the present application, a number of improvements and refinements can be made, which should be considered as the protection scope of the present application.

Claims

1. A simulation testing method, characterized in that, include: Receive business order data and determine the test cases corresponding to the business order data; The product information in the business order data is determined, and the product information model corresponding to the product information is determined, wherein the product information model is used to define the association relationship and configuration rules between products, business services and resources; Based on the test cases and the product information model, a product loading process instance is generated, wherein the product loading process instance is used to execute a simulated process according to the association relationship and configuration rules defined in the product information model; Execute the product loading process instance, record test data during the execution of the product loading process instance, and generate a test report based on the test data.

2. The method according to claim 1, characterized in that, Determine the test cases corresponding to the business order data, including: The business order data is standardized to obtain standardized order data, wherein the standardization process includes: data cleaning, format normalization, and integrity verification. The standardized order data is transformed from order to delivery to generate input information that the orchestration engine can recognize. The transformation from order to delivery includes mapping the business parameters in the standardized order data to the resource description parameters required by the orchestration engine. The business order identifier and product specification parameters are extracted from the standardized order data, and resource topology description information is extracted from the input information that the orchestration engine can recognize. The business order identifier, the product specification parameters, and the resource topology description information are combined into a test parameter set; In the test case template library, select a target template that matches the test parameter set, instantiate the target template, and generate the test case.

3. The method according to claim 1, characterized in that, Determine the product information in the business order data, and determine the product information model corresponding to the product information, including: Extract the product identifier and product version number from the business order data, and generate a product model query request based on the product identifier and product version number; The product model query request is routed to the corresponding product model database, and the product information model corresponding to the product identifier and the product version number is loaded from the product model database. The product information model includes at least one of the following: product specifications, service component list, resource configuration template, and business rule definition.

4. The method according to claim 1, characterized in that, Based on the test cases and the product information model, a product loading process instance is generated, including: The orchestration engine can recognize the input information from the test cases, and the service component list and resource configuration template are parsed from the product information model. Based on the list of service components, determine the sequence of service components; Based on the resource configuration template and the input information recognizable by the orchestration engine, instantiation configuration parameters for each business service component in the service component sequence are generated; An initial process instance is generated based on the service component sequence and the instantiation configuration parameters corresponding to the service component sequence; The verification rules defined in the test cases are integrated with the initial process instance, and process monitoring points and assertion checkpoints are configured in the preset steps to obtain the product loading process instance; wherein, the process monitoring points are used to collect and report the status data and performance indicators of the process instance during runtime, and the assertion checkpoints are used to compare the actual output of the process instance with the preset expected results, and determine the success or failure of the test step based on the comparison results.

5. The method according to claim 4, characterized in that, Executing the product loading process instance includes: Step S1: Load the test cases and corresponding product information models bound to the product loading process instance, and initialize the process execution context; Step S2: Traverse each service component in the order of the service component sequence. For the target service component being processed, extract the corresponding resource configuration rules and assignment logic from the product information model. Step S3: Based on the instantiation configuration parameters generated for the target service component and the resource configuration rules, construct the dispatch message of the target service component, and assign values ​​to the message fields in the dispatch message according to the assignment logic; Step S4: Send the assigned dispatch message to the corresponding simulation environment to execute the simulated dispatch. Step S5: Receive the response message returned by the simulated environment, verify the response message according to the business verification rules defined in the product information model, and update the process execution context according to the verification result; Step S6: Obtain execution status data, and determine whether the execution result in the execution status data meets expectations through the assertion checkpoint; Step S7: Repeat steps S2 to S6 above until all service components in the service component sequence have been processed.

6. The method according to claim 5, characterized in that, The method further includes: During the execution of the product loading process instance, the status flag in the process execution context is used to determine whether a manual intervention checkpoint has been reached. Upon reaching the manual intervention checkpoint, the execution of the product loading process instance is paused, the currently pending dispatch message or the required simulated response parameters are displayed to the tester, and the corresponding manual operation permission is activated. Receive task instructions input by the tester based on the displayed information, wherein the task instructions include: order confirmation instruction, simulated response data filling instruction, or error injection instruction; Update the task instructions to the process execution context, and resume the execution of the product loading process instance based on the updated context data; During the human-computer interaction process, the execution status data collected from the process monitoring points and the verification error information generated from the assertion checkpoints are displayed in real time. The task instructions, the changes in execution status data triggered by the task instructions, and the related verification error information are recorded in the process execution log.

7. The method according to claim 6, characterized in that, A test report is generated based on the test data, including: Once it is determined that the product loading process instance has been completed, raw test data is collected from the process execution log, wherein the raw test data includes: process status information, error information, the comparison results, and performance indicators; The original test data is aggregated and analyzed to obtain structured test results. The aggregation and analysis includes: summarizing the comparison results of the assertion checkpoints according to the verification rules in the test cases, and generating an error statistics report based on the error information. Based on the structured test results and the preset report template, a draft test report is generated, which includes: a test execution summary, error analysis details, and performance metric statistics. The test report is generated by associating the initial draft of the test report with the corresponding test cases and the execution snapshot of the product loading process instance.

8. A simulation testing device, characterized in that, include: The receiving module is used to receive business order data and determine the test cases corresponding to the business order data; The determination module is used to determine the product information in the business order data and determine the product information model corresponding to the product information, wherein the product information model is used to define the association relationship and configuration rules between products, business services and resources; The first generation module is used to generate a product loading process instance based on the test cases and the product information model, wherein the product loading process instance is used to execute a simulated process according to the association relationship and the configuration rules defined in the product information model; The second generation module is used to execute the product loading process instance, record test data during the execution of the product loading process instance, and generate a test report based on the test data.

9. A non-volatile storage medium, characterized in that, The non-volatile storage medium includes a stored program, wherein, when the program is executed, it controls the device containing the non-volatile storage medium to perform the simulation test method according to any one of claims 1 to 7.

10. An electronic device, characterized in that, include: A memory and a processor, the processor being configured to run a program stored in the memory, wherein the program, when running, executes the simulation test method according to any one of claims 1 to 7.

11. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the simulation testing method according to any one of claims 1 to 7.