Simulation method, apparatus and system, and storage medium

Abstract

A simulation method, apparatus and system, and a storage medium. A network simulation service consumer entity can propose an expectation of achieving different simulation performance requirements, such that a network simulation service provider entity can acquire model parameters according to the expectation, and acquire a simulation model for simulation on the basis of the model parameters, rather than always considering a simulation model having better comprehensive performance in all dimensions to perform simulation in any scenario. The simulation performance requirements of the network simulation service consumer entity can be balanced, thereby improving the simulation efficiency.

Description

Simulation method, device, system and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on November 17, 2023, with application number 202311544550.5 and invention name “Simulation method, device, system and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a simulation method, device, system and storage medium. Background Art

[0003] Communication networks can leverage digital twin technology to find better solutions beyond physical networks. Network twins are the application of digital twin technology to communication networks, aiming to develop a wide range of network applications and achieve efficient, data-driven network management and maintenance.

[0004] A key application of network twins is network simulation. Current simulation models generally select models that are optimal across a range of dimensions. These dimensions may include simulation accuracy, simulation duration, and computing resources. However, these three dimensions are strongly correlated: given fixed computing resources, the desired simulation accuracy generally requires a longer simulation duration to complete a task. A shorter simulation duration results in lower network simulation accuracy. If both high simulation accuracy and long simulation duration are desired, additional computing resources may be required.

[0005] However, the current network simulation service providing entity uses the default simulation accuracy, default simulation duration, and default computing resources to perform network simulation, which may not necessarily meet the needs of the network simulation service production entity.

[0006] Therefore, how to enable the network simulation service providing entity to better provide network simulation services is a problem that needs to be solved at present.

[0007] Summary of the Invention

[0008] The present application provides a simulation method, device, system and storage medium to enable a network simulation service provider to better provide network simulation services.

[0009] In a first aspect, a simulation method is provided. The method can be executed by a network simulation service provider, or by a chip or circuit configured in the network simulation service provider, or by a logic module or software that implements all or part of the network simulation service provider's functions. This application is not limited thereto.

[0010] The method includes: receiving simulation performance requirements, which indicate the requirements of the network simulation service consumer entity for the performance of network simulation; and sending a simulation report, which indicates the results of the network simulation; wherein the network simulation is a simulation of network management operations performed in a communication network based on the simulation performance requirements.

[0011] In this aspect, the network simulation service providing entity receives the expected simulation performance requirements sent by the network simulation service consuming entity, so that the network simulation service providing entity can perform simulation according to the simulation performance requirements, rather than considering the simulation model with better comprehensive dimensions for simulation in any scenario, which enables the network simulation service providing entity to better provide network simulation services.

[0012] In a possible implementation, the simulation report includes indication information, where the indication information indicates whether the performance and / or process of the network simulation meets the simulation performance requirement.

[0013] In another possible implementation, the method further includes: constructing a correspondence between at least one historical simulation performance requirement and at least one model parameter; and based on the correspondence, obtaining model parameters corresponding to the received simulation performance requirement, the model parameters being used to construct a simulation model, and the simulation model being used to simulate network management operations performed in a communication network.

[0014] In this implementation, the simulation module in the network simulation service provider entity can obtain the correspondence between at least one historical simulation performance requirement and at least one model parameter through the real network data collected in the past, including model parameters, network simulation results, and real results of physical network operation. When the simulation performance requirement is received, the model parameters corresponding to the received simulation performance requirement can be obtained, which can improve the accuracy of the obtained model parameters. The network simulation service provider entity can store the above correspondence locally or on a third-party server, and can update the above correspondence based on the simulation history. The richer the historical data collected by the simulation module, the more accurate the model parameters obtained by the subsequent network simulation service provider entity based on the simulation performance requirement query.

[0015] In another possible implementation, when a first simulation performance requirement and a second simulation performance requirement are received, the method further includes: receiving priority information, the priority information also indicating a first priority and a second priority, the first priority corresponding to the first simulation performance requirement, the second priority corresponding to the second simulation performance requirement, and the first priority being higher than the second priority; when the results of the network simulation cannot both meet the first simulation performance requirement and the second simulation performance requirement, selecting corresponding model parameters based on the first simulation performance requirement; and obtaining the simulation model based on the selected model parameters.

[0016] In this implementation, the network simulation service providing entity can also receive priority information sent by the network simulation service consuming entity. When the network simulation service providing entity obtains model parameters to determine that the results of the network simulation cannot meet both the first simulation performance requirement and the second simulation performance requirement, it can give priority to meeting the simulation performance requirement with a higher priority, thereby better constructing a simulation model to meet the needs of the network simulation service consuming entity.

[0017] In another possible implementation, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, the second simulation performance requirement includes simulation duration, which indicates the time consumed by the network simulation.

[0018] In a second aspect, a simulation method is provided. The method can be executed by a network simulation service consumer entity, or by a chip or circuit configured in the network simulation service consumer entity, or by a logic module or software capable of implementing all or part of the functions of the network simulation service consumer entity. This application is not limited to this.

[0019] The method includes: sending simulation performance requirements, which indicate the requirements of the network simulation service consumer entity for the performance of network simulation; and receiving a simulation report, which indicates the results of the network simulation; wherein the network simulation is a simulation of network management operations performed in a communication network based on the simulation performance requirements.

[0020] In this aspect, the network simulation service consuming entity sends the expected simulation performance requirements to the network simulation service providing entity, so that the network simulation service providing entity can perform simulation according to the simulation performance requirements, rather than considering the simulation model with better comprehensive dimensions for simulation in any scenario, which enables the network simulation service providing entity to better provide network simulation services.

[0021] In a possible implementation, the simulation report includes indication information, where the indication information indicates whether the performance and / or process of the network simulation meets the simulation performance requirement.

[0022] In another possible implementation, when sending the first simulation performance requirement and the second simulation performance requirement, the method further includes: sending priority information, the priority information indicating a first priority and a second priority, the first priority corresponding to the first simulation performance requirement, the second priority corresponding to the second simulation performance requirement, and the first priority being higher than the second priority.

[0023] In this implementation, the network simulation service consuming entity can also send priority information to the network simulation service providing entity. When the network simulation service providing entity obtains model parameters and determines that the result of the first network simulation cannot meet the first simulation performance requirement, and the result of the second network simulation cannot meet the second simulation performance requirement, it can give priority to meeting the simulation performance requirement with a higher priority, thereby better constructing a simulation model to meet the needs of the network simulation service consuming entity.

[0024] In another possible implementation, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, the second simulation performance requirement includes simulation duration, which indicates the time consumed by the network simulation.

[0025] In a third aspect, a simulation method is provided. The method can be executed by a network simulation service provider, or by a chip or circuit configured in the network simulation service provider, or by a logic module or software that implements all or part of the network simulation service provider's functions. This application is not limited to this.

[0026] The method includes: receiving first indication information, the first indication information indicating that when simulation is performed based on multiple simulation performance requirements, priority is given to satisfying a first simulation performance requirement among multiple simulation performance requirements, the simulation performance requirement indicating the performance requirements of the network simulation service consumer entity for network simulation; and sending a simulation report, the simulation report indicating the result of the network simulation; wherein the network simulation is a simulation of network management operations performed in a communication network based on the multiple simulation performance requirements.

[0027] In this aspect, the network simulation service providing entity can receive an instruction sent by the network simulation service consuming entity to give priority to achieving the first simulation performance requirement when performing simulation based on multiple simulation performance requirements. The network simulation service providing entity can obtain the corresponding model parameters and construct a simulation model based on the instruction, which can enable the network simulation service providing entity to better provide network simulation services so that the results of the network simulation meet the needs of the network simulation service consuming entity.

[0028] In a possible implementation, the simulation report includes second indication information, where the second indication information indicates whether the performance and / or process of the network simulation meets the multiple simulation performance requirements, or whether it meets the first simulation performance requirement.

[0029] In another possible implementation, the method further includes: constructing a correspondence between at least one historical simulation performance requirement and at least one model parameter; and based on the correspondence, obtaining a model parameter corresponding to the first simulation performance requirement, the model parameter being used to construct a simulation model, and the simulation model being used to simulate network management operations performed in a communication network.

[0030] In this implementation, the simulation module in the network simulation service provider entity can obtain the correspondence between at least one historical simulation performance requirement and at least one model parameter through the real network data collected in the past, including model parameters, network simulation results, and real results of physical network operation. When the simulation performance requirement is received, the model parameters corresponding to the received simulation performance requirement can be obtained, which can improve the accuracy of the obtained model parameters. The network simulation service provider entity can store the above correspondence locally or on a third-party server, and can update the above correspondence based on the simulation history. The richer the historical data collected by the simulation module, the more accurate the model parameters obtained by the subsequent network simulation service provider entity based on the simulation performance requirement query.

[0031] In another possible implementation, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, the first simulation performance requirement includes simulation duration, which indicates the time consumed by the network simulation.

[0032] In a fourth aspect, a simulation method is provided. The method can be executed by a network simulation service consumer entity, or by a chip or circuit configured in the network simulation service consumer entity, or by a logic module or software capable of implementing all or part of the functions of the network simulation service consumer entity. This application is not limited to this.

[0033] The method includes: sending a first indication message, wherein the first indication message indicates that when simulation is performed based on multiple simulation performance requirements, priority is given to satisfying a first simulation performance requirement among multiple simulation performance requirements, wherein the simulation performance requirement indicates the performance requirement of the network simulation service consumer entity for network simulation; and receiving a simulation report, wherein the simulation report indicates the result of the network simulation; wherein the network simulation is a simulation of network management operations performed in a communication network based on the multiple simulation performance requirements.

[0034] In this aspect, the network simulation service consuming entity can send an indication to the network simulation service providing entity that it expects to prioritize achieving the first simulation performance requirement when performing simulation based on multiple simulation performance requirements. The network simulation service providing entity can obtain the corresponding model parameters and construct a simulation model based on the indication, which can enable the network simulation service providing entity to better provide network simulation services so that the results of the network simulation meet the needs of the network simulation service consuming entity.

[0035] In a possible implementation, the simulation report includes second indication information, where the second indication information indicates whether the performance and / or process of the network simulation meets the multiple simulation performance requirements, or whether it meets the first simulation performance requirement.

[0036] In another possible implementation, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, the first simulation performance requirement includes simulation duration, which indicates the time consumed by the network simulation.

[0037] In a fifth aspect, a simulation device is provided that can implement the method of the network simulation service provider entity described in the first aspect or any implementation of the first aspect. For example, the network simulation service provider entity can be a chip or circuit. The method can be implemented through software, hardware, or hardware executing corresponding software.

[0038] In one possible implementation, the device includes: a transceiver unit and a processing unit; wherein the transceiver unit is used to receive simulation performance requirements, and the simulation performance requirements indicate the requirements of the network simulation service consumer entity for the performance of network simulation; and the transceiver unit is also used to send a simulation report, and the simulation report indicates the results of the network simulation; wherein the network simulation is a simulation of network management operations performed in a communication network based on the simulation performance requirements.

[0039] Optionally, the simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meets the simulation performance requirement.

[0040] Optionally, the processing unit is used to construct a correspondence between at least one historical simulation performance requirement and at least one model parameter; and the processing unit is also used to obtain model parameters corresponding to the received simulation performance requirement based on the correspondence, and the model parameters are used to construct a simulation model, and the simulation model is used to simulate network management operations performed in a communication network.

[0041] Optionally, when the transceiver unit receives the first simulation performance requirement and the second simulation performance requirement, the transceiver unit is further used to receive priority information, the priority information also indicates a first priority and a second priority, the first priority corresponds to the first simulation performance requirement, the second priority corresponds to the second simulation performance requirement, and the first priority is higher than the second priority; the processing unit is further used to select corresponding model parameters based on the first simulation performance requirement when the results of the network simulation cannot meet both the first simulation performance requirement and the second simulation performance requirement; and the processing unit is further used to obtain the simulation model based on the selected model parameters.

[0042] Optionally, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, the second simulation performance requirement includes simulation duration, which indicates the time consumed by the network simulation.

[0043] In a sixth aspect, a simulation device is provided that can implement the method of the network simulation service consumption entity described in the second aspect or any implementation of the second aspect. For example, the network simulation service consumption entity can be a chip or circuit. The method can be implemented through software, hardware, or hardware executing corresponding software.

[0044] In one possible implementation, the device includes: a transceiver unit and a processing unit; wherein the transceiver unit is used to send simulation performance requirements, and the simulation performance requirements indicate the requirements of the network simulation service consumer entity for the performance of network simulation; and the transceiver unit is also used to receive a simulation report, and the simulation report indicates the results of the network simulation; wherein the network simulation is a simulation of network management operations performed in a communication network based on the simulation performance requirements.

[0045] Optionally, the simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meets the simulation performance requirement.

[0046] Optionally, when the transceiver unit sends the first simulation performance requirement and the second simulation performance requirement, the transceiver unit is also used to send priority information, the priority information indicating a first priority and a second priority, the first priority corresponding to the first simulation performance requirement, the second priority corresponding to the second simulation performance requirement, and the first priority is higher than the second priority.

[0047] Optionally, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, the second simulation performance requirement includes simulation duration, which indicates the time consumed by the network simulation.

[0048] In a seventh aspect, a simulation device is provided that can implement the method of the network simulation service provider entity described in the third aspect or any implementation of the third aspect. For example, the network simulation service provider entity can be a chip or circuit. The method can be implemented through software, hardware, or hardware executing corresponding software.

[0049] In one possible implementation, the device includes: a transceiver unit and a processing unit; wherein the transceiver unit is used to receive first indication information, the first indication information indicates that when simulation is performed based on multiple simulation performance requirements, the first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, the simulation performance requirement indicates the performance requirement of the network simulation service consumer entity for the network simulation; and the transceiver unit is also used to send a simulation report, the simulation report indicates the result of the network simulation; wherein the network simulation is a simulation of network management operations performed in a communication network based on the multiple simulation performance requirements.

[0050] Optionally, the simulation report includes second indication information, and the second indication information indicates whether the performance and / or process of the network simulation meets the multiple simulation performance requirements, or whether it meets the first simulation performance requirement.

[0051] Optionally, the processing unit is used to construct a correspondence between at least one historical simulation performance requirement and at least one model parameter; and the processing unit is also used to obtain model parameters corresponding to the first simulation performance requirement based on the correspondence, and the model parameters are used to construct a simulation model, and the simulation model is used to simulate network management operations performed in a communication network.

[0052] Optionally, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, the first simulation performance requirement includes simulation duration, which indicates the time consumed by the network simulation.

[0053] In an eighth aspect, a simulation device is provided that can implement the method of the network simulation service consumption entity described in the fourth aspect or any implementation of the fourth aspect. For example, the network simulation service consumption entity can be a chip or circuit. The method can be implemented through software, hardware, or hardware executing corresponding software.

[0054] In one possible implementation, the device includes: a transceiver unit and a processing unit; wherein the transceiver unit is used to send a first indication information, wherein the first indication information indicates that when simulation is performed based on multiple simulation performance requirements, the first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, and the simulation performance requirement indicates the performance requirement of the network simulation service consumer entity for the network simulation; and the transceiver unit is also used to receive a simulation report, wherein the simulation report indicates the result of the network simulation; wherein the network simulation is a simulation of network management operations performed in a communication network based on the multiple simulation performance requirements.

[0055] Optionally, the simulation report includes second indication information, and the second indication information indicates whether the performance and / or process of the network simulation meets the multiple simulation performance requirements, or whether it meets the first simulation performance requirement.

[0056] Optionally, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, the first simulation performance requirement includes simulation duration, which indicates the time consumed by the network simulation.

[0057] In combination with any one of the fifth to eighth aspects or the fifth to eighth aspects, in another possible implementation, the simulation device in any one of the fifth to eighth aspects or the fifth to eighth aspects includes a processor coupled to a memory; the processor is configured to support the device to perform the corresponding functions in the above-mentioned network management operation instruction synchronization method. The memory is used to couple with the processor, which stores the necessary programs (instructions) and / or data for the device. Optionally, the simulation device may further include a communication interface for supporting communication between the device and other network elements. Optionally, the memory may be located inside the simulation device or outside the simulation device.

[0058] In combination with the fifth to eighth aspects or any one of the fifth to eighth aspects, in another possible implementation, the simulation device in the fifth to eighth aspects or any one of the fifth to eighth aspects includes a processor and a transceiver, the processor is coupled to the transceiver, and the processor is used to execute a computer program or instruction to control the transceiver to receive and send information; when the processor executes the computer program or instruction, the processor is also used to implement the above method through a logic circuit or execution code instruction. The transceiver can be a transceiver, a transceiver circuit or an input-output interface, which is used to receive signals from other devices outside the simulation device and transmit them to the processor or send signals from the processor to other devices outside the simulation device. When the simulation device is a chip, the transceiver is a transceiver circuit or an input-output interface.

[0059] When the simulation device in any of the fifth to eighth aspects or the fifth to eighth aspects is a chip or chip module, the sending unit may be an output unit, such as an output circuit or a communication interface; and the receiving unit may be an input unit, such as an input circuit or a communication interface. When the simulation device is a terminal or access network device, the sending unit may be a transmitter or a transmitter; and the receiving unit may be a receiver or a receiver.

[0060] In a ninth aspect, a simulation system is provided, comprising the simulation device as described in the fifth aspect or any one of the implementations of the fifth aspect and the simulation device as described in the sixth aspect or any one of the implementations of the sixth aspect.

[0061] In a tenth aspect, a simulation system is provided, comprising the simulation device as described in the seventh aspect or any one of the implementations of the seventh aspect and the simulation device as described in the eighth aspect or any one of the implementations of the eighth aspect.

[0062] In the eleventh aspect, a computer-readable storage medium is provided, in which a computer program or instruction is stored. When a computer executes the computer program or instruction, the methods described in the above aspects are implemented.

[0063] In a twelfth aspect, a computer program product comprising instructions is provided, which, when executed on a simulation device, causes the simulation device to execute the methods described in the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] FIG1 is a schematic diagram of a simulation process provided by an embodiment of the present application;

[0065] FIG2 is a schematic diagram of the architecture of a simulation system provided in an embodiment of the present application;

[0066] FIG3 is a schematic diagram of a flow chart of a simulation method provided in an embodiment of the present application;

[0067] FIG4 is a schematic diagram of a flow chart of another simulation method provided in an embodiment of the present application;

[0068] FIG5 is a schematic diagram of a flow chart of another simulation method provided in an embodiment of the present application;

[0069] FIG6 is a schematic diagram of a flow chart of another simulation method provided in an embodiment of the present application;

[0070] FIG7 is a schematic structural diagram of a simulation device provided in an embodiment of the present application;

[0071] FIG8 is a schematic structural diagram of another simulation device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0072] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application.

[0073] The following "at least one" in this application refers to one or more items. "Multiple" refers to two or more items. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated with each other are in an "or" relationship. In addition, it should be understood that although the terms "first", "second", etc. may be used to describe each object in this application, these objects should not be limited to these terms. These terms are only used to distinguish each object from each other. The terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, features defined as "first", "second", etc. may explicitly or implicitly include one or more of these features. In the description of this application, unless otherwise specified, the meaning of "multiple" is two or more.

[0074] The terms "including" and "having" and any variations thereof mentioned in the following description of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices. It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any method or design described in this application as "exemplary" or "for example" should not be interpreted as being more preferred or more advantageous than other methods or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way.

[0075] The following specific embodiments illustrate the implementation of the present application. Those skilled in the art can understand other advantages and effects of the present application from the contents disclosed in this specification. Although the description of the present application will be introduced in conjunction with the preferred embodiment, this does not mean that the features of this application are limited to this implementation. On the contrary, the purpose of introducing the application in conjunction with the implementation is to cover other options or modifications that may be extended based on the claims of the present application. In order to increase the in-depth understanding of the present application, the following description will contain many specific details. The present application can also be implemented without using these details. In addition, in order to avoid confusion or blurring the focus of the present application, some specific details will be omitted in the description. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other unless there is a conflict.

[0076] Digital twins (DTs) are a technology increasingly relevant to system automation. DTs are virtual replicas of real-world systems—physical systems—on which operations can be performed. Faced with the ever-increasing types, scale, and complexity of services, communications networks also need to leverage digital twin technology to find solutions beyond physical networks. Network twins, the application of digital twin technology to communications networks, aim to develop a wide range of network applications and enable efficient, data-driven network management and maintenance.

[0077] A network twin is a digital twin whose physical counterpart is a communication network or some part of a communication network. A communication network can include, for example, physical network elements and components, virtualized network functions (VNFs) (i.e., network function elements instantiated as software-based entities), physical hosts for such VNFs, services, and traffic flows.

[0078] Specifically, a network twin refers to a digital mirror image of a physical network established in a digital manner. With the help of the historical network data, real-time network data and algorithmic models of the physical network, the physical network is digitized to achieve synchronous analysis, prediction and improvement optimization of the physical network. That is, the network twin contains a digital expression of the physical network and is used to simulate the physical network. Among them, the digital expression includes algorithmic models and data, etc. The network twin can also be called a network twin entity, a digital twin or a digital twin entity, and this application does not limit it. Among them, the physical network is a network formed by connecting various physical devices or network elements (such as hosts, routers, switches, etc.) and media (optical cables, cables, twisted pairs, etc.) in the network. The physical network can be a mobile access network, a transmission network, a mobile core network, a backbone network, etc.; the physical network can also be a data center network, a campus network, an industrial Internet of Things, etc. Network data can also be called network operation data, which is used to represent the operating status of the physical network. It can be configuration parameters, alarm data, performance data, etc. of physical devices or network elements.

[0079] To better simulate and test various scenarios within physical networks, network simulation service providers must update their network twins based on the physical network's operational status. The more frequently the network simulation service provider interacts with the physical network, and the more timely the data collected, the more accurate the simulation and prediction results. Therefore, stringent requirements are placed on the accuracy, timeliness, and interactivity of the network data collection and feedback process within the physical network.

[0080] A key application of network twins is network simulation. In network simulation, the network twin acts as a secure sandbox, safely verifying the impact of specific network management operations on the physical network after being sent to it. For example, it can verify energy-saving solutions and signaling storm solutions.

[0081] Different scenarios have different requirements for simulation accuracy and duration. For example, in the verification scenario of a signaling storm solution, a network failure causes users to disconnect and repeatedly retry, resulting in an accumulation of signaling that cannot be processed, leading to a signaling storm. When a large amount of signaling impacts core network elements, it can cause multiple elements to experience cascading downtime due to congestion, causing the storm to spread. Before issuing flow control policies, the network simulation service consumer entity first performs simulation on the twin network. Therefore, the network simulation service consumer entity hopes to obtain network simulation results quickly so that the policy can be implemented as quickly as possible to minimize the spread of the signaling storm. In the verification scenario of an energy-saving solution, the network simulation service consumer entity simulates the energy-saving configuration content to be issued to the network element on the network twin and returns the relevant performance indicators to the network simulation service consumer entity. Therefore, simulation scenarios for energy-saving solutions generally do not have strict time constraints, and the network simulation service consumer entity hopes to obtain relatively accurate network simulation results.

[0082] As shown in FIG1 , a schematic diagram of a simulation process provided in an embodiment of the present application is provided. The process may specifically include the following steps:

[0083] S101. A network simulation service consuming entity sends a simulation request to a network simulation service providing entity.

[0084] The simulation request is used to request a network simulation service provider to perform network simulation. The simulation request includes a simulation object, a service identifier, and a simulation configuration. The service identifier is used to identify, for example, a signaling storm solution or an energy-saving solution.

[0085] S102. After receiving the simulation request, the network simulation service providing entity performs network simulation according to the simulation request and sends a simulation response to the network simulation service consuming entity.

[0086] After receiving a simulation request, the network simulation service provider's simulation module selects a simulation model that is optimal based on comprehensive dimensions, such as simulation accuracy, simulation duration, and computing resources, based on the service identifier.

[0087] The network simulation service providing entity uses the simulation model to perform network simulation and obtain network simulation results.

[0088] After the simulation is completed, the network simulation service provider sends a simulation response to the network simulation service consumer, wherein the simulation response includes the result of the network simulation.

[0089] However, when the simulation module performs simulations, there is a strong correlation between simulation accuracy, simulation duration, and computing resources. Given fixed computing resources, if you want higher simulation accuracy, the simulation time will generally increase. If you want a shorter simulation time, the network simulation results will have lower accuracy. If you want both higher simulation accuracy and longer simulation time, you may need to use additional computing resources.

[0090] Therefore, the current network simulation service provider uses the default simulation accuracy, default simulation duration, and default computing resources for network simulation, which may not necessarily meet the needs of the network simulation service producer. In some scenarios, the network simulation service consumer may wish to sacrifice one of simulation accuracy, simulation duration, or computing resources to achieve a higher standard for the other. For example, in the energy-saving solution verification scenario, because there is no time limit, the network simulation service consumer is willing to spend more time on simulation to obtain high-precision network simulation results. The network simulation service consumer has higher requirements for simulation accuracy than simulation duration. In the signaling storm solution verification scenario, because signaling storm resolution is time-sensitive, the network simulation service consumer needs to obtain network simulation results in a short time, and the simulation accuracy can be slightly lower. The network simulation service consumer has higher requirements for simulation duration than for simulation accuracy.

[0091] Existing simulation modules generally provide a comprehensive and optimal simulation model based on service identifiers. In simulation scenarios with specific requirements for simulation accuracy and duration, this may result in low accuracy or excessively long simulation times for the final network simulation results.

[0092] In view of this, the present application provides a simulation solution, in which a network simulation service consumer entity can put forward expectations for achieving different simulation performance requirements, so that a network simulation service provider entity can perform simulation according to the expectation, rather than considering the simulation model with better comprehensive dimensions for simulation in any scenario, so that the network simulation service provider entity can better provide network simulation services.

[0093] As shown in Figure 2, it is a schematic diagram of the architecture of a simulation system provided in an embodiment of the present application. The system 2000 includes a network simulation service consumption entity 201 and a network simulation service provider entity 202, which can interact with each other. Exemplarily, the network simulation service consumption entity 201 can be located in the simulation system (network management system, NMS); the network simulation service provider entity 202 can be located in the element management system (element management system, EMS). The network simulation service consumption entity 201 is used to propose simulation performance requirements and receive simulation reports; the network simulation service provider entity 202 is used to provide network simulation services, and can perform simulation according to simulation performance requirements and return simulation reports, etc.

[0094] In one embodiment of the present application, the network simulation service consuming entity 201 sends a simulation performance requirement to the network simulation service providing entity 202, wherein the simulation performance requirement indicates the network simulation service consuming entity's requirement for the performance of the network simulation; and the network simulation service providing entity 202 sends a simulation report to the network simulation service consuming entity 201, wherein the simulation report indicates the result of the network simulation; wherein the network simulation is a simulation of network management operations performed in a communication network based on the simulation performance requirement.

[0095] In another embodiment of the present application, the network simulation service consuming entity 201 sends a first indication message to the network simulation service providing entity 202, wherein the first indication message indicates that when simulation is performed based on multiple simulation performance requirements, the first simulation performance requirement among the multiple simulation performance requirements should be met first, and the simulation performance requirement indicates the network simulation service consuming entity's requirement for the performance of network simulation; and the network simulation service providing entity 202 sends a simulation report to the network simulation service consuming entity 201, wherein the simulation report indicates the result of the network simulation.

[0096] Based on the system shown in FIG2 , the simulation method provided by the embodiment of the present application is described below:

[0097] As shown in FIG3 , a flow chart of a simulation method provided in an embodiment of the present application is shown. Exemplarily, the method may include the following steps:

[0098] S301. A network simulation service consuming entity sends a simulation performance requirement to a network simulation service providing entity. Correspondingly, the network simulation service providing entity receives the simulation performance requirement.

[0099] As mentioned above, the simulation module in the current network simulation service providing entity generally uses the default simulation accuracy, default simulation duration, and default computing resources to perform network simulation when performing network simulation, which may not necessarily meet the needs of the network simulation service production entity. However, the three dimensions of simulation accuracy, simulation duration, and computing resources are strongly correlated, and often some simulation performance requirements cannot meet higher standards. In some scenarios, the network simulation service consuming entity does not need to achieve a better overall dimension, but rather to make one or more of the simulation performance requirements meet higher standards as much as possible. Therefore, in this embodiment, the network simulation service consuming entity can put forward its own expectations for achieving different simulation performance requirements, allowing the network simulation service consuming entity to customize the different simulation performance requirements required, and thus, the network simulation service consuming entity sends the simulation performance requirement to the network simulation service providing entity. The simulation performance requirement indicates the network simulation service consuming entity's demand for the performance of network simulation, wherein network simulation is the simulation of network management operations performed in a communication network based on the simulation performance requirement. The simulation performance requirement can also be called simulation performance requirement, simulation performance indicator (performance metrics), etc.

[0100] For example, a network simulation service consuming entity may send a simulation performance requirement for which it has higher expectations, such as a first simulation performance requirement, but may not send other simulation performance requirements, such as a second simulation performance requirement, allowing the network simulation service providing entity to determine the second simulation performance requirement. For example, a network simulation service consuming entity may also send multiple simulation performance requirements.

[0101] Exemplarily, the simulation performance requirement may be expressed as a range, such as [minimum value, maximum value], or the simulation performance requirement may be expressed as a single number or percentage to indicate the minimum requirement, accuracy level, etc. to be achieved.

[0102] The network simulation service consumer also sends a simulation object and service identifier to the network simulation service provider. The simulation object refers to the target of network management operations that the network simulation service consumer will issue to the physical network. This simulation object can be, for example, a network element in the physical network. Simulation services include various types, such as the aforementioned energy-saving solution simulation and signaling storm solution simulation. Different types of simulation services can have different service identifiers.

[0103] Exemplarily, the network simulation service consuming entity may send a simulation request to the network simulation service providing entity. The simulation request includes the above-mentioned simulation performance requirement, as well as a simulation object and a service identifier.

[0104] S302: The network simulation service providing entity sends a simulation report to the network simulation service consuming entity. Correspondingly, the network simulation service consuming entity receives the simulation report.

[0105] After receiving the above-mentioned simulation performance requirements, the network simulation service provider entity obtains the corresponding model parameters according to the simulation performance requirements, and obtains a simulation model based on the simulation object, service identifier, and model parameters. Then, based on the obtained simulation model, the simulation object is simulated to obtain the network simulation result. That is, the network simulation result in this embodiment is obtained based on the simulation model simulation, and the simulation model is obtained based on the simulation object, service identifier, and model parameters. The model parameters correspond to the simulation performance requirements. Since the network simulation service provider entity obtains the simulation model based on the simulation performance requirements sent by the network simulation service consumer entity, rather than using a simulation model with better comprehensive dimensions in any scenario, the network simulation service provider entity can select and create a simulation model that better meets the needs of the network simulation service consumer entity.

[0106] It can be understood that the network simulation service providing entity performs simulation based on the simulation model obtained above. Although the network simulation service consuming entity puts forward its own expected simulation performance requirements, whether the simulation performance requirements can be achieved also needs to consider other parameters within the network simulation service providing entity, such as the computing resources of the network simulation service providing entity, etc., or the simulation performance requirements proposed by the network simulation service consuming entity may be too high. Therefore, after the network simulation service providing entity simulates, the following conclusion can be drawn: whether the results of the network simulation meet the simulation performance requirements.

[0107] After the network simulation service providing entity obtains the result of the network simulation, it sends a simulation report to the network simulation service consuming entity, and the simulation report indicates the result of the network simulation. Exemplarily, the simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meets the above-mentioned simulation performance requirements. For example, the indication information is 1 bit, and when the value of the indication information is "0", it indicates that the performance and / or process of the network simulation does not meet the simulation performance requirements; when the value of the indication information is "1", it indicates that the performance and / or process of the network simulation meets the simulation performance requirements. The simulation report can also be called the simulation performance achievement status, the degree of completion of the simulation performance requirements, etc.

[0108] According to a simulation method provided in an embodiment of the present application, a network simulation service consuming entity sends its own desired simulation performance requirements, so that a network simulation service providing entity can perform simulation according to the simulation performance requirements, thereby enabling the network simulation service providing entity to better provide network simulation services.

[0109] The above embodiment describes how a network simulation service provider obtains a simulation report based on simulation performance requirements. The following embodiment will further describe how a network simulation service provider obtains an accurate simulation report:

[0110] As shown in FIG4 , a flow chart of another simulation method provided in an embodiment of the present application is shown. Exemplarily, the method may include the following steps:

[0111] S401. The network simulation service providing entity establishes a correspondence between at least one historical simulation performance requirement and at least one model parameter.

[0112] The simulation module in the network simulation service providing entity can obtain the correspondence between at least one historical simulation performance requirement and at least one model parameter through the real network data collected in the past, including model parameters, network simulation results, and actual execution results of the communication network (physical network).

[0113] For example, the simulation performance requirement can be simulation accuracy, which indicates the degree of closeness between the network simulation results expected by the network simulation service consumer and the actual results of the communication network execution. The higher the simulation accuracy, the more reliable the simulation model and network simulation results are, and the greater the probability that the actual results of the communication network execution will meet the expected results. Simulation accuracy can be expressed as a range, such as [minimum value, maximum value], or it can be expressed as a single number or percentage to indicate the minimum precision, accuracy level, etc. that must be achieved.

[0114] For example, the simulation performance requirement can be simulation duration, which indicates the simulation duration expected by the network simulation service consumer. The simulation duration can be expressed as a range, such as [minimum value, maximum value], or as a single number representing the maximum acceptable runtime, a level of runtime speed / duration, and so on. The simulation duration can also be replaced with or referred to as simulation speed, simulation runtime, simulation duration, and so on.

[0115] Among them, the model parameters include the simulation step size and the number of simulations. Generally speaking, the larger the simulation step size, the fewer the number of sampling points, and accordingly, the lower the simulation accuracy and the shorter the simulation time; conversely, the smaller the simulation step size, the more the number of sampling points, and accordingly, the higher the simulation accuracy, but the longer the simulation time. The number of simulations is proportional to the simulation accuracy and proportional to the simulation time. The simulation module can construct the corresponding relationship between at least one historical simulation accuracy, at least one historical simulation time and at least one model parameter as shown in Table 1:

[0116] Table 1

[0117] The network simulation service provider can store the above correspondence locally or on a third-party server and can update the above correspondence based on the simulation history. The richer the historical data collected by the simulation module, the more accurate the model parameters obtained by the subsequent network simulation service provider based on the simulation performance requirements.

[0118] S402: The network simulation service consuming entity sends a simulation performance requirement to the network simulation service providing entity. Correspondingly, the network simulation service providing entity receives the simulation performance requirement.

[0119] For the specific implementation of this step, reference may be made to step S301 of the embodiment shown in FIG3 , and details thereof will not be repeated here.

[0120] S403. The network simulation service providing entity obtains model parameters corresponding to the received simulation performance requirements based on the corresponding relationship, and obtains a simulation model based on the simulation object, service identifier, and model parameters.

[0121] After receiving the above simulation performance requirements, the network simulation service provider entity queries the above correspondence and obtains the model parameters corresponding to the received simulation performance requirements. For example, if the network simulation service provider entity receives a simulation accuracy of 0.7 and a simulation duration of 0.65 from the network simulation service consumer entity, the network simulation service provider entity queries the above correspondence and obtains a simulation step size of 2 and a number of simulations of 2.

[0122] Furthermore, the network simulation service providing entity obtains the simulation model based on the simulation object, the service identifier and the queried model parameters.

[0123] S404. The network simulation service providing entity simulates the simulation object based on the simulation model to obtain a network simulation result.

[0124] For the specific implementation of this step, reference may be made to step S302 of the embodiment shown in FIG3 , and details thereof will not be repeated here.

[0125] S405. The network simulation service providing entity sends a simulation report to the network simulation service consuming entity. Correspondingly, the network simulation service consuming entity receives the simulation report.

[0126] For the specific implementation of this step, reference may be made to step S302 of the embodiment shown in FIG3 , and details thereof will not be repeated here.

[0127] According to a simulation method provided in an embodiment of the present application, a network simulation service consuming entity sends its own expected simulation performance requirements, so that a network simulation service providing entity can clarify the network simulation service consuming entity's expectations for the simulation performance requirements of the simulation model, thereby obtaining model parameters according to the simulation performance requirements, and obtaining a simulation model based on the model parameters for simulation, which can enable the network simulation service providing entity to better provide network simulation services; and the network simulation service providing entity pre-constructs a correspondence between at least one historical simulation performance requirement and at least one model parameter through prior knowledge, which can enable the network simulation service providing entity to quickly query the model parameters that should be adopted and quickly obtain the simulation model after receiving the simulation performance requirements sent by the network simulation service consuming entity, thereby further improving the simulation efficiency and accuracy.

[0128] In the above embodiment, the network simulation service consumer sends the expected simulation performance requirements, and the network simulation service provider obtains model parameters based on the simulation performance requirements. However, in some scenarios, when there are multiple simulation performance requirements, since the simulation performance requirements are mutually balanced, it is possible that the simulation model cannot meet all the above simulation performance requirements. Therefore, the following embodiments are also provided below:

[0129] As shown in FIG5 , a flowchart of another simulation method provided in an embodiment of the present application is shown. Exemplarily, the method may include the following steps:

[0130] S501. The network simulation service providing entity establishes a correspondence between at least one historical simulation performance requirement and at least one model parameter.

[0131] For the specific implementation of this step, reference may be made to step S401 of the embodiment shown in FIG4 , and details thereof will not be repeated here.

[0132] S502. The network simulation service consuming entity sends a first simulation performance requirement and / or a second simulation performance requirement, and priority information to the network simulation service providing entity. Correspondingly, the network simulation service providing entity receives the first simulation performance requirement and / or the second simulation performance requirement, and priority information.

[0133] The specific implementation of this step can refer to step S301 of the embodiment shown in Figure 3 or step S402 of the embodiment shown in Figure 4 . The difference is that the network simulation service consuming entity also sends priority information to the network simulation service providing entity. This priority information indicates which simulation performance requirement should be prioritized when the network simulation result determined by obtaining model parameters cannot simultaneously meet the first simulation performance requirement and the second simulation performance requirement. In one example, the priority information includes a first priority and a second priority. The first priority corresponds to the first simulation performance requirement, and the second priority corresponds to the second simulation performance requirement. The first priority is higher than the second priority. Therefore, when the network simulation result determined by obtaining model parameters cannot simultaneously meet the first simulation performance requirement and the second simulation performance requirement, the first simulation performance requirement with the higher priority is prioritized. In another example, the priority information is an indication. For example, if the network simulation service consuming entity sends the first simulation performance requirement and the second simulation performance requirement, the indication information indicates that when the network simulation result determined by obtaining model parameters cannot simultaneously meet the first simulation performance requirement and the second simulation performance requirement, the first simulation performance requirement or the second simulation performance requirement should be prioritized. For example, the indication information is 1 bit. When the value of the 1 bit is "1", it indicates that the priority meets the first simulation performance requirement; when the value of the 1 bit is "0", it indicates that the priority meets the second simulation performance requirement.

[0134] Exemplarily, the network simulation service consuming entity sends a simulation request to the network simulation service providing entity. The simulation request includes the first simulation performance requirement and / or the second simulation performance requirement, as well as a simulation object, a service identifier, and priority information.

[0135] S503. Based on the corresponding relationship, when the network simulation result cannot simultaneously meet the first simulation performance requirement and the second simulation performance requirement, the network simulation service providing entity selects corresponding model parameters based on the first simulation performance requirement, and obtains the simulation model based on the simulation object, service identifier and the selected model parameters.

[0136] After receiving the first and second simulation performance requirements, the network simulation service provider queries the corresponding relationship and obtains the model parameters corresponding to the first and second simulation performance requirements. However, since the simulation performance requirements are mutually constrained, it is possible that the selected model parameters may not satisfy all the simulation performance requirements. Therefore, the network simulation service provider selects the model parameters corresponding to the simulation performance requirement with the highest priority based on the priority information, and obtains the simulation model based on the simulation object, the service identifier, and the selected model parameters.

[0137] If the network simulation service providing entity determines that the selected model parameters can meet the simulation performance requirements with a higher priority, it may further select model parameters that can also meet the simulation performance requirements with a lower priority.

[0138] S504. The network simulation service providing entity simulates the simulation object based on the simulation model to obtain a network simulation result.

[0139] For the specific implementation of this step, reference may be made to step S302 of the embodiment shown in FIG3 or step S404 of the embodiment shown in FIG4 , and details thereof will not be repeated here.

[0140] S505. The network simulation service providing entity sends a simulation report to the network simulation service consuming entity. Correspondingly, the network simulation service consuming entity receives the simulation report.

[0141] The specific implementation of this step can refer to step S302 of the embodiment shown in Figure 3 or step S405 of the embodiment shown in Figure 4, which will not be repeated here. The simulation report indicates whether the result of the network simulation meets the first simulation performance requirement.

[0142] According to a simulation method provided in an embodiment of the present application, a network simulation service consuming entity may also carry priority information when sending an expected simulation performance requirement, so that when the network simulation service providing entity obtains model parameters to determine that the result of the network simulation cannot simultaneously meet multiple simulation performance requirements, it can give priority to meeting the simulation performance requirement that the network simulation service consuming entity more expects to meet, thereby better constructing a simulation model to meet the needs of the network simulation service consuming entity.

[0143] In the above embodiments, the network simulation service consuming entities all provide their desired simulation performance requirements. However, in some scenarios, the network simulation service consuming entities cannot provide specific desired simulation performance requirements, but can only propose expectations for which simulation performance requirements should be met first, that is, they have their own preferences for which simulation performance requirements should be met first. The following describes this solution in detail through an embodiment:

[0144] FIG6 is a flow chart of another simulation method provided in an embodiment of the present application. Exemplarily, the method may include the following steps:

[0145] S601. The network simulation service providing entity establishes a correspondence between at least one historical simulation performance requirement and at least one model parameter.

[0146] For the specific implementation of this step, reference may be made to step S401 of the embodiment shown in FIG. 4 or step S501 of the embodiment shown in FIG. 5 , and details thereof will not be repeated here.

[0147] S602: The network simulation service consuming entity sends first indication information to the network simulation service providing entity. Correspondingly, the network simulation service providing entity receives the first indication information.

[0148] This embodiment is different from the above-mentioned embodiment in that, in this embodiment, since the network simulation service consuming entity may not know the specific simulation performance requirements, but only knows that it expects to give priority to a certain simulation performance requirement during simulation, the network simulation service consuming entity does not send specific simulation performance requirements to the network simulation service providing entity, but sends a first indication information. The first indication information indicates that when simulating based on multiple simulation performance requirements, the first simulation performance requirement among multiple simulation performance requirements is given priority. Furthermore, the first indication information can also indicate that multiple simulation performance requirements are given priority. The simulation performance requirement indicates the performance requirement of the network simulation service consuming entity for the network simulation, wherein network simulation is the simulation of performing network management operations in a communication network. The simulation performance requirement can also be called a simulation performance requirement, a simulation performance indicator, etc.

[0149] For example, factors that a network simulation service provider entity needs to consider when obtaining model parameters include simulation accuracy, simulation duration, and computing resources. A network simulation service consumer entity may not be able to provide the specific simulation accuracy and simulation duration that it expects, but it can indicate through the first indication information that it hopes the simulation model will prioritize improving the simulation accuracy, or that it hopes the simulation system will prioritize reducing the simulation duration.

[0150] S603. The network simulation service providing entity obtains model parameters based on the corresponding relationship and the first indication information, and obtains a simulation model based on the simulation object, the service identifier, and the model parameters.

[0151] After receiving the first indication information from the network simulation service consuming entity, the network simulation service providing entity may, when acquiring model parameters, acquire model parameters corresponding to the first simulation performance requirement based on the first indication information and the aforementioned correspondence, with the acquisition of the model parameters prioritizing satisfaction of the first simulation performance requirement that the network simulation service consuming entity desires to be satisfied. After acquiring the model parameters, a simulation model is constructed based on the model parameters.

[0152] S604. The network simulation service providing entity simulates the simulation object based on the simulation model to obtain a network simulation result.

[0153] For the specific implementation of this step, reference may be made to step S302 of the embodiment shown in FIG3 , step S404 of the embodiment shown in FIG4 , or step S504 of the embodiment shown in FIG5 , which will not be described in detail here.

[0154] S605. The network simulation service providing entity sends a simulation report to the network simulation service consuming entity. Correspondingly, the network simulation service consuming entity receives the simulation report.

[0155] After obtaining the result of the network simulation, the network simulation service providing entity can determine whether the result of the network simulation meets multiple simulation performance requirements, or whether it meets the first simulation performance requirement, and therefore send a simulation report to the network simulation service consuming entity, wherein the simulation report indicates the result of the network simulation. Exemplarily, the simulation report includes second indication information, and the second indication information indicates whether the performance and / or process of the network simulation meets multiple simulation performance requirements, or whether it meets the first simulation performance requirement. For example, the second indication information is 1 bit, and when the value of the indication information is "0", it indicates that the performance and / or process of the network simulation does not meet the simulation performance requirements; when the value of the second indication information is "1", it indicates that the performance and / or process of the network simulation meets the simulation performance requirements. Furthermore, the simulation report can also include the results of the above-mentioned network simulation, and can also indicate whether the results of the network simulation meet other simulation performance requirements.

[0156] According to a simulation method provided in an embodiment of the present application, a network simulation service consuming entity can send an indication to a network simulation service providing entity of which simulation performance requirement it expects to prioritize. The network simulation service providing entity can obtain corresponding model parameters and construct a simulation model based on the indication, so that the network simulation service providing entity can better provide simulation services and make the results of network simulation meet the needs of the network simulation service consuming entity.

[0157] It can be understood that in the above embodiments, the methods and / or steps implemented by the network simulation service providing entity can also be implemented by components (such as chips or circuits) that can be used for the network simulation service providing entity; the methods and / or steps implemented by the network simulation service consuming entity can also be implemented by components (such as chips or circuits) that can be used for the network simulation service consuming entity.

[0158] The above description mainly describes the solutions provided by the embodiments of the present application from the perspective of the interaction between various entities. Accordingly, the embodiments of the present application also provide a simulation device, which is used to implement the various methods described above. The simulation device can be a network simulation service provider entity in the above method embodiments, or a component that can be used by the network simulation service provider entity; alternatively, the simulation device can be a network simulation service consumer entity in the above method embodiments, or a component that can be used by the network simulation service consumer entity. It is understood that in order to implement the above functions, the simulation device includes hardware structures and / or software modules corresponding to performing each function. Those skilled in the art should readily appreciate that, in combination with the various exemplary units and algorithm steps described in the embodiments disclosed herein, the present application can be implemented in hardware or a combination of hardware and computer software. Whether a function is implemented in hardware or in a hardware-driven manner by computer software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0159] In the embodiment of the present application, the functional modules of the simulation device can be divided according to the above method embodiment. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing unit. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods.

[0160] Based on the same concept of the above simulation method, this application also provides the following simulation device:

[0161] As shown in FIG7 , a schematic diagram of the structure of a simulation device provided in an embodiment of the present application is shown. The simulation device 7000 includes a transceiver unit 701 and a processing unit 702 .

[0162] When the simulation device is used to implement the functions of the network simulation service providing entity in the above-mentioned method embodiment, the transceiver unit 701 is used to execute the functions of the network simulation service providing entity in steps S301 and S302 in the embodiment as shown in Figure 3; or, the transceiver unit 701 is used to execute the functions of the network simulation service providing entity in steps S402 and S405 in the embodiment as shown in Figure 4, and the processing unit 702 is used to execute steps S401, S403 and S404 in the embodiment as shown in Figure 4; or, the transceiver unit 701 is used to execute the functions of the network simulation service providing entity in steps S502 and S505 in the embodiment as shown in Figure 5, and the processing unit 702 is used to execute steps S501, S503 and S504 in the embodiment as shown in Figure 5; or, the transceiver unit 701 is used to execute the functions of the network simulation service providing entity in steps S602 and S605 in the embodiment as shown in Figure 6, and the processing unit 702 is used to execute steps S601, S603 and S604 in the embodiment as shown in Figure 6.

[0163] When the simulation device is used to implement the functions of the network simulation service consumption entity in the above-mentioned method embodiment, the transceiver unit 701 is used to execute the functions of the network simulation service consumption entity in steps S301 and S302 in the embodiment as shown in Figure 3; or, the transceiver unit 701 is used to execute the functions of the network simulation service consumption entity in steps S402 and S405 in the embodiment as shown in Figure 4; or, the transceiver unit 701 is used to execute the functions of the network simulation service consumption entity in steps S502 and S505 in the embodiment as shown in Figure 5; or, the transceiver unit 701 is used to execute the functions of the network simulation service consumption entity in steps S602 and S605 in the embodiment as shown in Figure 6.

[0164] For the specific implementation of the above-mentioned transceiver unit 701 and the processing unit 702, reference may be made to the description in the above-mentioned method embodiment, which will not be repeated here.

[0165] As shown in Figure 8, it is a structural diagram of another simulation device provided in an embodiment of the present application. The simulation device 8000 includes a processor 801, and may also include an interface circuit 802 and a memory 803 (represented by dotted lines in the figure). The processor 801 and the interface circuit 802 are coupled to each other. It will be understood that the interface circuit 802 can be a transceiver or an input and output interface. The memory 803 is used to store instructions executed by the processor 801, or to store input data required for the processor 801 to run instructions, or to store data generated after the processor 801 runs instructions. Among them, the processor 801 is used to implement the functions of the processing unit 702 in the embodiment shown in Figure 7 above; and the interface circuit 802 is used to implement the functions of the transceiver unit 701 in the embodiment shown in Figure 7 above.

[0166] When the above-mentioned simulation device is a chip applied to a network simulation service provider, the chip implements the functions of the network simulation service provider in the above-mentioned method embodiment. The chip receives information from other modules (such as a radio frequency module or antenna) in the network simulation service provider, and the information is sent by the network simulation service consumer to the network simulation service provider; or the chip sends information to other modules (such as a radio frequency module or antenna) in the network simulation service provider, and the information is sent by the network simulation service provider to the network simulation service consumer.

[0167] When the above-mentioned simulation device is a chip applied to a network simulation service consuming entity, the chip implements the functions of the network simulation service consuming entity in the above-mentioned method embodiment. The chip receives information from other modules (such as a radio frequency module or antenna) in the network simulation service consuming entity, and the information is sent by the network simulation service providing entity to the network simulation service consuming entity; or the chip sends information to other modules (such as a radio frequency module or antenna) in the network simulation service consuming entity, and the information is sent by the network simulation service consuming entity to the network simulation service providing entity.

[0168] In addition, it should be noted that the aforementioned transceiver unit and / or processing unit may be implemented through virtual modules, for example, the processing unit may be implemented through a software function unit or a virtual device, and the transceiver unit may be implemented through a software function or a virtual device. Alternatively, the processing unit or transceiver unit may also be implemented through a physical device, for example, if the device is implemented using a chip / chip circuit, the transceiver unit may be an input / output circuit and / or a communication interface, performing input operations (corresponding to the aforementioned receiving operations) and output operations (corresponding to the aforementioned sending operations); the processing unit is an integrated processor or microprocessor or integrated circuit.

[0169] The division of modules in this application is illustrative and represents only a logical functional division. In actual implementation, other division methods may be used. Furthermore, the functional modules in the examples of this application may be integrated into a single processor, exist physically as separate modules, or two or more modules may be integrated into a single module. The aforementioned integrated modules may be implemented in either hardware or software functional modules.

[0170] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0171] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is executed, the method in the above embodiment is implemented.

[0172] An embodiment of the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method in the above embodiment.

[0173] An embodiment of the present application also provides a simulation system, including the above-mentioned simulation device.

[0174] The present application also provides a circuit, which is coupled to a memory and is used to execute the method shown in the above embodiment. The circuit may include a chip circuit.

[0175] It should be noted that the above units or one or more of the units can be implemented by software, hardware, or a combination of the two. When any of the above units or units is implemented by software, the software exists in the form of computer program instructions and is stored in a memory, and a processor can be used to execute the program instructions and implement the above method flow.

[0176] In this application, a processor may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field-programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or execute the methods, steps, and logic block diagrams disclosed in this application. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in this application may be directly executed by a hardware processor, or by a combination of hardware and software modules within the processor.

[0177] The processor can be built into a system on chip (SoC) or ASIC, or it can be a standalone semiconductor chip. In addition to the core that executes software instructions to perform calculations or processing, the processor can also include necessary hardware accelerators, such as field programmable gate arrays (FPGAs), programmable logic devices (PLDs), or logic circuits that implement specialized logic operations.

[0178] When the above units or units are implemented in hardware, the hardware can be any one or any combination of a CPU, a microprocessor, a digital signal processing (DSP) chip, a microcontroller unit (MCU), an artificial intelligence processor, an ASIC, a SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator or a non-integrated discrete device, which can run the necessary software or not rely on the software to execute the above method flow.

[0179] Optionally, an embodiment of the present application further provides a chip system, comprising: at least one processor and an interface, wherein the at least one processor is coupled to a memory via the interface, and when the at least one processor executes a computer program or instruction in the memory, the chip system executes the method in any of the above method embodiments. Optionally, the chip system may be composed of a chip, or may include a chip and other discrete devices, which is not specifically limited in the embodiments of the present application.

[0180] In the present application, the memory may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), or a volatile memory, such as a random-access memory (RAM). The memory is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory in the present application may also be a circuit or any other device that can implement a storage function, for storing program instructions and / or data.

[0181] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner to facilitate understanding.

[0182] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using a software program, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a digital versatile disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0183] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art can understand and implement other changes to the disclosed embodiments by reviewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple situations. A single processor or other unit can implement several functions listed in the claims. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0184] It is understood that the various numbers used in the embodiments of this application are merely for ease of description and are not intended to limit the scope of the embodiments of this application. The order of the sequence numbers of the above-mentioned processes does not necessarily imply a specific order of execution; the order of execution of the processes should be determined by their functions and inherent logic.

[0185] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0186] The components in the device of the embodiment of the present application can be merged, divided, or deleted according to actual needs. Those skilled in the art can combine or combine the different embodiments and features of the different embodiments described in this specification.

[0187] The above embodiments are intended only to illustrate the technical solutions of the present application and are not intended to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they may still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein with equivalents; and such modifications or replacements do not deviate from the essence of the corresponding technical solutions within the scope of the technical solutions of the embodiments of the present application.

[0188] In this application, under the premise of no logical contradiction, the examples can reference each other, for example, the methods and / or terms between method embodiments can reference each other, for example, the functions and / or terms between device embodiments can reference each other, for example, the functions and / or terms between device examples and method examples can reference each other.

[0189] Obviously, those skilled in the art may make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include these modifications and variations.

Claims

1. A simulation method, characterized in that: The method comprises: receiving a simulation performance requirement, wherein the simulation performance requirement indicates a requirement of a network simulation service consumption entity on network simulation performance; sending a simulation report, the simulation report indicating a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the simulation performance requirement.

2. The method according to claim 1, characterized in that The simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meets the simulation performance requirement.

3. The method according to claim 1 or 2, characterized in that When the first simulation performance requirement and the second simulation performance requirement are received, the method further includes: receiving priority information, the priority information indicating a first priority and a second priority, the first priority corresponding to the first simulation performance requirement, the second priority corresponding to the second simulation performance requirement, and the first priority being higher than the second priority; When the result of the network simulation cannot satisfy both the first simulation performance requirement and the second simulation performance requirement, selecting corresponding model parameters based on the first simulation performance requirement; A simulation model is obtained based on the selected model parameters.

4. The method according to claim 3, characterized in that The first simulation performance requirement includes simulation accuracy, and the simulation accuracy indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, The second simulation performance requirement includes a simulation duration, and the simulation duration indicates the time consumption of the network simulation.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: Constructing a correspondence between at least one historical simulation performance requirement and at least one model parameter; Based on the corresponding relationship, model parameters corresponding to the received simulation performance requirements are obtained, and the model parameters are used to construct a simulation model, and the simulation model is used to perform the network simulation.

6. A simulation method, characterized in that: The method comprises: Sending a simulation performance requirement, wherein the simulation performance requirement indicates a requirement of a network simulation service consumer entity on network simulation performance; receiving a simulation report indicating a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the simulation performance requirement.

7. The method according to claim 6, characterized in that The simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meets the simulation performance requirement.

8. The method according to claim 6 or 7, characterized in that When sending the first simulation performance requirement and the second simulation performance requirement, the method further includes: Priority information is sent, where the priority information indicates a first priority and a second priority, where the first priority corresponds to the first simulation performance requirement, the second priority corresponds to the second simulation performance requirement, and the first priority is higher than the second priority.

9. The method according to claim 8, characterized in that The first simulation performance requirement includes simulation accuracy, and the simulation accuracy indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, The second simulation performance requirement includes a simulation duration, and the simulation duration indicates the time consumption of the network simulation.

10. A simulation method, characterized in that: The method comprises: receiving first indication information, wherein the first indication information indicates that when simulation is performed based on multiple simulation performance requirements, a first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, wherein the simulation performance requirement indicates a requirement of a network simulation service consumer entity for network simulation performance; sending a simulation report, the simulation report indicating a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the multiple simulation performance requirements.

11. The method according to claim 10, characterized in that The simulation report includes second indication information, and the second indication information indicates whether the performance and / or process of the network simulation meets the multiple simulation performance requirements, or whether it meets the first simulation performance requirement.

12. The method according to claim 10, characterized in that The method further comprises: Constructing a correspondence between at least one historical simulation performance requirement and at least one model parameter; Based on the corresponding relationship, a model parameter corresponding to the first simulation performance requirement is obtained, and the model parameter is used to construct a simulation model The simulation model is used to perform the network simulation.

13. The method according to any one of claims 10 to 12, wherein the first simulation performance requirement comprises simulation accuracy, wherein the simulation accuracy indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or The first simulation performance requirement includes simulation duration, and the simulation duration indicates the time consumption of the network simulation.

14. A simulation method, characterized in that: The method comprises: Sending first indication information, wherein the first indication information indicates that when simulation is performed based on multiple simulation performance requirements, a first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, wherein the simulation performance requirement indicates a requirement of a network simulation service consumer entity for network simulation performance; receiving a simulation report indicating a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the multiple simulation performance requirements.

15. The method according to claim 14, characterized in that The simulation report includes second indication information, and the second indication information indicates whether the performance and / or process of the network simulation meets the multiple simulation performance requirements, or whether it meets the first simulation performance requirement.

16. The method according to claim 14 or 15, wherein the first simulation performance requirement comprises simulation accuracy, wherein the simulation accuracy indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, The first simulation performance requirement includes simulation duration, and the simulation duration indicates the time consumption of the network simulation.

17. A simulation method, characterized in that: The method comprises: The network simulation service consuming entity sends a simulation performance requirement to the network simulation service providing entity, wherein the simulation performance requirement indicates the requirement of the network simulation service consuming entity for the performance of the network simulation; The network simulation service providing entity sends a simulation report to the network simulation service consuming entity, wherein the simulation report indicates a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the simulation performance requirement.

18. A simulation method, characterized in that: The method comprises: The network simulation service consumption entity sends first indication information to the network simulation service providing entity, wherein the first indication information indicates that when simulation is performed based on multiple simulation performance requirements, a first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, and the simulation performance requirement indicates the network simulation service consumption entity's requirement on network simulation performance; The network simulation service providing entity sends a simulation report to the network simulation service consuming entity, wherein the simulation report indicates a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the multiple simulation performance requirements.

19. A simulation device, characterized in that: The apparatus comprises modules for implementing the method according to any one of claims 1-16.

20. A simulation device, characterized in that: The device comprises a processor, a memory, and instructions stored in the memory and executed on the processor, wherein when the instructions are executed, the simulation device executes the method according to any one of claims 1 to 16.

21. A simulation system, characterized in that: It comprises a network simulation service providing entity and a network simulation service consuming entity, wherein the network simulation service providing entity comprises a module for executing the method according to any one of claims 1-5, and the network simulation service consuming entity comprises a module for implementing the method according to any one of claims 6-9.

22. A simulation system, characterized in that: It comprises a network simulation service providing entity and a network simulation service consuming entity, wherein the network simulation service providing entity comprises a module for executing the method according to any one of claims 10-13, and the network simulation service consuming entity comprises a module for implementing the method according to any one of claims 14-16.

23. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises instructions, and when the instructions are executed by a processor, the method according to any one of claims 1 to 16 is implemented.

24. A computer program product, characterized in that The computer program product comprises program instructions, and when the program instructions are executed, the method according to any one of claims 1 to 16 is implemented.

Images