Simulation method, device and system and storage medium

Abstract

The invention discloses a simulation method, device and system and a storage medium. The network simulation service consumption entity can propose the expectation for achieving different simulation performance requirements, so that the network simulation service providing entity can obtain the model parameters according to the expectation and obtain the simulation model for simulation based on the model parameters instead of considering the simulation model with better comprehensive dimension for simulation in any scene, and the simulation efficiency of the network simulation service providing entity is improved. Simulation performance requirements of network simulation service consumption entities can be balanced, and simulation efficiency can be improved.

Description

Technical Field

[0001] The present application relates to the field of communication technologies, and in particular, to a simulation method, apparatus, system, and storage medium. Background Art

[0002] A communication network can utilize digital twin technology to seek better solutions outside the physical network. A network twin is an application of digital twin technology in the field of communication networks, aiming to develop various rich network applications and achieve efficient data-driven network management and maintenance.

[0003] An important application of network twins is network simulation. Currently, the general simulation model is to select a simulation model that is superior in comprehensive dimensions. The comprehensive dimensions may include simulation accuracy, simulation duration, and computing resources. However, these three dimensions of simulation accuracy, simulation duration, and computing resources are strongly correlated: when the computing resources are fixed, if a higher simulation accuracy is desired, generally, the simulation duration required to complete a simulation task is longer; if a shorter simulation duration is desired, the simulation accuracy of the network simulation result is lower. If high simulation accuracy and short simulation duration are desired, additional computing resources may need to be invoked.

[0004] However, the current network simulation service provider entity performs network simulation using default simulation accuracy, default simulation duration, and default computing resources, which may not necessarily meet the needs of the network simulation service producer entity.

[0005] Therefore, how to enable the network simulation service provider entity to better provide network simulation services is a problem that needs to be solved currently. Summary of the Invention

[0006] The present application provides a simulation method, apparatus, system, and storage medium to enable the network simulation service provider entity to better provide network simulation services.

[0007] In a first aspect, a simulation method is provided. This method can be executed by a network simulation service provider entity, or by a chip or circuit configured in the network simulation service provider entity, or by a logic module or software capable of implementing all or part of the functions of the network simulation service provider entity. The present application does not limit this.

[0008] Wherein, the method includes: receiving a simulation performance requirement, where the simulation performance requirement indicates the requirement of a network simulation service consumer entity for the performance of network simulation; and sending a simulation report, where the simulation report indicates the result of the network simulation; wherein, the network simulation is a simulation of performing network management operations in a communication network based on the simulation performance requirement.

[0009] In this regard, the network simulation service providing entity can perform simulation according to the desired simulation performance requirements sent by the network simulation service consuming entity, rather than considering a simulation model with better comprehensive dimensions in any scenario, so that the network simulation service providing entity can better provide network simulation services.

[0010] In a possible implementation, the simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meet the simulation performance requirements.

[0011] In another possible implementation, the method further includes: constructing a correspondence between at least one historical simulation performance requirement and at least one model parameter; and based on the correspondence, obtaining a model parameter corresponding to the received simulation performance requirement, where the model parameter is used to construct a simulation model for simulating the execution of network management operations in a communication network.

[0012] In this implementation, the simulation module in the network simulation service providing entity can obtain a correspondence between at least one historical simulation performance requirement and at least one model parameter through real network data collected in the past, including model parameters, the results of network simulation, and the real results of physical network operation. When receiving a simulation performance requirement, it can obtain a model parameter corresponding to the received simulation performance requirement, which can improve the accuracy of the obtained model parameter. The network simulation service providing entity can store the above correspondence locally or on a third-party server and can update the above correspondence according to the simulation history. The richer the historical data collected by the simulation module, the more accurate the model parameter obtained by the subsequent network simulation service providing entity according to the simulation performance requirement.

[0013] In yet another possible implementation, when receiving a first simulation performance requirement and a second simulation performance requirement, the method further includes: receiving priority information, where the priority information also indicates a first priority and a second priority, the first priority corresponds to the first simulation performance requirement, the second priority corresponds to the second simulation performance requirement, and the first priority is higher than the second priority; when the results of the network simulation cannot meet both the first simulation performance requirement and the second simulation performance requirement, selecting a corresponding model parameter based on the first simulation performance requirement; and obtaining the simulation model based on the selected model parameter.

[0014] In this implementation, the network simulation service providing entity may also receive the priority information sent by the network simulation service consuming entity. When the network simulation service providing entity obtains the model parameters and determines that the results of the network simulation cannot meet the first simulation performance requirement and the second simulation performance requirement, it preferentially meets the simulation performance requirement with a higher priority, so as to better construct the simulation model to meet the requirements of the network simulation service consuming entity.

[0015] In another possible implementation, the first simulation performance requirement includes simulation accuracy, and the simulation accuracy indicates the degree of closeness between the results of the network simulation expected by the network simulation service consuming entity and the results actually executed by the communication network; and / or, the second simulation performance requirement includes simulation duration, and the simulation duration indicates the time consumed by the network simulation.

[0016] In a second aspect, a simulation method is provided. This method can be executed by the network simulation service consuming entity, or can be executed by a chip or circuit configured in the network simulation service consuming entity, or can also be executed by a logic module or software that can implement all or part of the functions of the network simulation service consuming entity. This application does not make any limitations in this regard.

[0017] Among them, the method includes: sending a simulation performance requirement, where the simulation performance requirement indicates the requirements of the network simulation service consuming entity for the performance of the network simulation; and receiving a simulation report, where the simulation report indicates the results of the network simulation; where the network simulation is a simulation of performing network management operations in the communication network based on the simulation performance requirement.

[0018] In this aspect, the network simulation service consuming entity sends the desired simulation performance requirement to the network simulation service providing entity, enabling the network simulation service providing entity to perform the simulation according to this simulation performance requirement, rather than considering a simulation model with better comprehensive dimensions in any scenario for simulation, which can enable the network simulation service providing entity to better provide network simulation services.

[0019] In a possible implementation, the simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meet the simulation performance requirement.

[0020] In another possible implementation, when sending the first simulation performance requirement and the second simulation performance requirement, the method further includes: sending priority information, where the priority information indicates a first priority and a second priority, the first priority corresponds to the first simulation performance requirement, the second priority corresponds to the second simulation performance requirement, and the first priority is higher than the second priority.

[0021] In this implementation, the network simulation service consuming entity may also send priority information to the network simulation service providing entity. When the network simulation service providing entity obtains model parameters and determines that the result of the first network simulation cannot meet the first simulation performance requirement and the result of the second network simulation cannot meet the second simulation performance requirement, it may preferentially satisfy the simulation performance requirement with a higher priority, so as to better construct a simulation model to meet the requirements of the network simulation service consuming entity.

[0022] In another possible implementation, the first simulation performance requirement includes simulation accuracy, and the simulation accuracy indicates the degree of closeness between the result of the network simulation that the network simulation service consuming entity expects and the result actually executed by the communication network; and / or, the second simulation performance requirement includes simulation duration, and the simulation duration indicates the time consumption of the network simulation.

[0023] In a third aspect, a simulation method is provided. This method may be executed by a network simulation service providing entity, or may be executed by a chip or circuit configured in the network simulation service providing entity, or may also be executed by a logic module or software capable of implementing all or part of the functions of the network simulation service providing entity. This application does not make a limitation in this regard.

[0024] Among them, the method includes: receiving first indication information, where the first indication information indicates that when performing a simulation based on multiple simulation performance requirements, the first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, and the simulation performance requirement indicates the requirement of the network simulation service consuming entity for the performance of the network simulation; and sending a simulation report, where the simulation report indicates the result of the network simulation; where the network simulation is a simulation of performing network management operations in a communication network based on the multiple simulation performance requirements.

[0025] In this aspect, the network simulation service providing entity may receive an indication from the network simulation service consuming entity that when performing a simulation based on multiple simulation performance requirements, the first simulation performance requirement is preferentially achieved. The network simulation service providing entity may obtain corresponding model parameters and construct a simulation model according to this indication, which can enable the network simulation service providing entity to better provide network simulation services and make the result of the network simulation meet the requirements of the network simulation service consuming entity.

[0026] In a possible implementation, the simulation report includes second indication information, and the second indication information indicates whether the performance and / or process of the network simulation meet the multiple simulation performance requirements, or whether they meet the first simulation performance requirement.

[0027] In another possible implementation, the method further includes: establishing a correspondence between at least one historical simulation performance requirement and at least one model parameter; and obtaining, based on the correspondence, a model parameter corresponding to the first simulation performance requirement, where the model parameter is used to construct a simulation model for simulating the execution of network management operations in a communication network.

[0028] In this implementation, the simulation module in the network simulation service providing entity can obtain a correspondence between at least one historical simulation performance requirement and at least one model parameter through previously collected real network data, including model parameters, network simulation results, and real results of physical network operation. When receiving a simulation performance requirement, it can obtain a model parameter corresponding to the received simulation performance requirement, which can improve the accuracy of the obtained model parameter. The network simulation service providing entity can store the above correspondence locally or on a third-party server and can update the above correspondence according to the simulation history. The richer the historical data collected by the simulation module, the more accurate the model parameter obtained by the subsequent network simulation service providing entity according to the simulation performance requirement.

[0029] In yet another possible implementation, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness that the network simulation service consuming entity expects between the result of the network simulation and the result actually executed by the communication network; and / or, the first simulation performance requirement includes simulation duration, which indicates the time consumption of the network simulation.

[0030] In a fourth aspect, a simulation method is provided. This method can be executed by a network simulation service consuming entity, or by a chip or circuit configured in the network simulation service consuming entity, or by a logic module or software capable of implementing all or part of the functions of the network simulation service consuming entity. This application does not limit this.

[0031] Wherein, the method includes: sending first indication information indicating that when simulating based on multiple simulation performance requirements, the first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, where the simulation performance requirement indicates the requirement of the network simulation service consuming entity for the performance of the network simulation; and receiving a simulation report indicating the result of the network simulation; wherein, the network simulation is for simulating the execution of network management operations in a communication network based on the multiple simulation performance requirements.

[0032] In this regard, the network simulation service consuming entity may send an indication to the network simulation service providing entity that when simulating based on multiple simulation performance requirements, it is desired to prioritize achieving the first simulation performance requirement. The network simulation service providing entity may obtain corresponding model parameters according to this indication and construct a simulation model, which can enable the network simulation service providing entity to better provide network simulation services and make the results of the network simulation meet the requirements of the network simulation service consuming entity.

[0033] In a possible implementation, the simulation report includes second indication information, which indicates whether the performance and / or process of the network simulation meet the multiple simulation performance requirements, or whether they meet the first simulation performance requirement.

[0034] In another possible implementation, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the results of the network simulation that the network simulation service consuming entity expects and the results actually executed by the communication network; and / or, the first simulation performance requirement includes simulation duration, which indicates the time consumed by the network simulation.

[0035] In a fifth aspect, a simulation device is provided, which can implement the method of the network simulation service providing entity in the first aspect or any implementation of the first aspect. For example, the network simulation service providing entity may be a chip or a circuit. The above method may be implemented through software, hardware, or by hardware executing corresponding software.

[0036] In a possible implementation manner, the device includes: a transceiver unit and a processing unit; wherein, the transceiver unit is configured to receive simulation performance requirements, which indicate the requirements of the network simulation service consuming entity for the performance of the network simulation; and the transceiver unit is further configured to send a simulation report, which indicates the results of the network simulation; wherein, the network simulation is to simulate the execution of network management operations in the communication network based on the simulation performance requirements.

[0037] Optionally, the simulation report includes indication information, which indicates whether the performance and / or process of the network simulation meet the simulation performance requirements.

[0038] Optionally, the processing unit is configured to construct a correspondence between at least one historical simulation performance requirement and at least one model parameter; and the processing unit is further configured to obtain, based on the correspondence, the model parameters corresponding to the received simulation performance requirements, where the model parameters are used to construct a simulation model, and the simulation model is used to simulate the execution of network management operations in the communication network.

[0039] Optionally, when the transceiver unit receives the first simulation performance requirement and the second simulation performance requirement, the transceiver unit is further configured to receive priority information, where the priority information further indicates a first priority and a second priority, the first priority corresponds to the first simulation performance requirement, the second priority corresponds to the second simulation performance requirement, and the first priority is higher than the second priority; the processing unit is further configured to, when the results of the network simulation cannot satisfy both the first simulation performance requirement and the second simulation performance requirement, select corresponding model parameters based on the first simulation performance requirement; and the processing unit is further configured to obtain the simulation model based on the selected model parameters.

[0040] Optionally, the first simulation performance requirement includes simulation accuracy, and the simulation accuracy indicates the degree of closeness between the results of the network simulation expected by the network simulation service consuming entity and the results actually executed by the communication network; and / or, the second simulation performance requirement includes simulation duration, and the simulation duration indicates the time consumed by the network simulation.

[0041] In a sixth aspect, a simulation device is provided, which can implement the method of the network simulation service consuming entity in the second aspect or any one of the implementations of the second aspect. For example, the network simulation service consuming entity may be a chip or a circuit. The above method can be implemented through software, hardware, or by hardware executing corresponding software.

[0042] In a possible implementation, the device includes: a transceiver unit and a processing unit; where the transceiver unit is configured to send a simulation performance requirement, and the simulation performance requirement indicates the requirements of the network simulation service consuming entity for the performance of the network simulation; and the transceiver unit is further configured to receive a simulation report, and the simulation report indicates the results of the network simulation; where the network simulation is to simulate the execution of network management operations in a communication network based on the simulation performance requirement.

[0043] Optionally, the simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meet the simulation performance requirement.

[0044] Optionally, when the transceiver unit sends the first simulation performance requirement and the second simulation performance requirement, the transceiver unit is further configured to send priority information, where the priority information indicates a first priority and a second priority, the first priority corresponds to the first simulation performance requirement, the second priority corresponds to the second simulation performance requirement, and the first priority is higher than the second priority.

[0045] Optionally, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consuming entity and the result actually executed by the communication network; and / or, the second simulation performance requirement includes simulation duration, which indicates the time consumption of the network simulation.

[0046] In a seventh aspect, a simulation device is provided, which can implement the method of the network simulation service providing entity in the third aspect or any one of the implementations of the third aspect. For example, the network simulation service providing entity may be a chip or a circuit. The above method can be implemented by software, hardware, or by hardware executing corresponding software.

[0047] In a possible implementation manner, the device includes: a transceiver unit and a processing unit; wherein, the transceiver unit is configured to receive first indication information, which indicates that when performing a simulation based on multiple simulation performance requirements, the first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, and the simulation performance requirement indicates the requirements of the network simulation service consuming entity for the performance of the network simulation; and the transceiver unit is further configured to send a simulation report, which indicates the result of the network simulation; wherein, the network simulation is a simulation of performing network management operations in a communication network based on the multiple simulation performance requirements.

[0048] Optionally, the simulation report includes second indication information, which indicates whether the performance and / or process of the network simulation meet the multiple simulation performance requirements, or whether they meet the first simulation performance requirement.

[0049] Optionally, the processing unit is configured to construct a correspondence between at least one historical simulation performance requirement and at least one model parameter; and the processing unit is further configured to obtain, based on the correspondence, the model parameter corresponding to the first simulation performance requirement, and the model parameter is used to construct a simulation model for simulating the performance of network management operations in a communication network.

[0050] Optionally, the first simulation performance requirement includes simulation accuracy, which indicates the degree of closeness between the result of the network simulation expected by the network simulation service consuming entity and the result actually executed by the communication network; and / or, the first simulation performance requirement includes simulation duration, which indicates the time consumption of the network simulation.

[0051] In an eighth aspect, a simulation device is provided, which can implement the method of the network simulation service consuming entity in the fourth aspect or any implementation of the fourth aspect. For example, the network simulation service consuming entity may be a chip or a circuit. The above method can be implemented by software, hardware, or by hardware executing corresponding software.

[0052] In a possible implementation manner, the device includes: a transceiver unit and a processing unit; wherein, the transceiver unit is configured to send first indication information, the first indication information indicating that when performing simulation based on multiple simulation performance requirements, the first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, and the simulation performance requirement indicates the requirement of the network simulation service consuming entity for the performance of the network simulation; and the transceiver unit is further configured to receive a simulation report, the simulation report indicating the result of the network simulation; wherein, the network simulation is a simulation of performing network management operations in a communication network based on the multiple simulation performance requirements.

[0053] Optionally, the simulation report includes second indication information, the second indication information indicating whether the performance and / or process of the network simulation meet the multiple simulation performance requirements, or whether they meet the first simulation performance requirement.

[0054] Optionally, the first simulation performance requirement includes simulation accuracy, the simulation accuracy indicating the degree of closeness between the result of the network simulation expected by the network simulation service consuming entity and the result actually executed by the communication network; and / or, the first simulation performance requirement includes simulation duration, the simulation duration indicating the time consumed by the network simulation.

[0055] Combined with the fifth aspect to the eighth aspect or any one of the fifth aspect to the eighth aspect, in another possible implementation manner, the simulation device in any one of the fifth aspect to the eighth aspect or the fifth aspect to the eighth aspect includes a processor coupled to a memory; the processor is configured to support the device to execute the corresponding functions in the above network management operation instruction synchronization method. The memory is used to be coupled to the processor and stores the necessary programs (instructions) and / or data of the device. Optionally, the simulation device may further include a communication interface for supporting the communication between the device and other network elements. Optionally, the memory may be located inside the simulation device or outside the simulation device.

[0056] Combined with the fifth aspect to the eighth aspect or any one of the fifth aspect to the eighth aspect, in another possible implementation, the simulation device in the fifth aspect to the eighth aspect or any one of the fifth aspect to the eighth aspect includes a processor and a transceiver device. The processor is coupled to the transceiver device. The processor is configured to execute a computer program or instruction to control the transceiver device to receive and transmit information. When the processor executes the computer program or instruction, the processor is further configured to implement the above method through a logic circuit or execute code instructions. Wherein, the transceiver device may be a transceiver, a transceiver circuit or an input / output interface, and is configured to receive a signal from another device outside the simulation device and transmit it to the processor or transmit a signal from the processor to another device outside the simulation device. When the simulation device is a chip, the transceiver device is a transceiver circuit or an input / output interface.

[0057] When the simulation device in the fifth aspect to the eighth aspect or any one of the fifth aspect to the eighth aspect is a chip or a chip module, the sending unit may be an output unit, such as an output circuit or a communication interface; the receiving unit may be an input unit, such as an input circuit or a communication interface. When the simulation device is a terminal or an access network device, the sending unit may be a transmitter or a transmitter; the receiving unit may be a receiver or a receiver.

[0058] In a ninth aspect, a simulation system is provided, including the simulation device as described in the fifth aspect or any one of the implementations of the fifth aspect and the simulation device as described in the sixth aspect or any one of the implementations of the sixth aspect.

[0059] In a tenth aspect, a simulation system is provided, including the simulation device as described in the seventh aspect or any one of the implementations of the seventh aspect and the simulation device as described in the eighth aspect or any one of the implementations of the eighth aspect.

[0060] In an eleventh aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program or instruction. When a computer executes the computer program or instruction, the methods described in the above aspects are implemented.

[0061] In a twelfth aspect, a computer program product including instructions is provided. When the instructions run on a simulation device, the simulation device is caused to execute the methods described in the above aspects. Description of the Drawings

[0062] Figure 1 It is a schematic diagram of a simulation process provided by an embodiment of the present application;

[0063] Figure 2 It is a schematic diagram of the architecture of a simulation system provided by an embodiment of the present application;

[0064] Figure 3 A schematic flowchart of a simulation method provided by an embodiment of the present application;

[0065] Figure 4 A schematic flowchart of another simulation method provided by an embodiment of the present application;

[0066] Figure 5 A schematic flowchart of another simulation method provided by an embodiment of the present application;

[0067] Figure 6 A schematic flowchart of another simulation method provided by an embodiment of the present application;

[0068] Figure 7 A schematic structural diagram of a simulation device provided by an embodiment of the present application;

[0069] Figure 8 A schematic structural diagram of another simulation device provided by an embodiment of the present application. Detailed implementation manners

[0070] The embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application.

[0071] At least one (item) involved in the present application below indicates one (item) or more (items). More (items) means two (items) or more than two (items). "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after. In addition, it should be understood that although terms such as first and second may be used in the present application to describe various objects, these objects should not be limited to these terms. These terms are only used to distinguish each object from each other. Terms such as "first" and "second" are only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features. Thus, features defined with "first", "second", etc. may explicitly or implicitly include one or more of such features. In the description of the present application, unless otherwise specified, the meaning of "multiple" is two or more than two.

[0072] As used in the following description of the present application, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally further include other steps or units not listed, or may optionally further include other steps or units inherent to these processes, methods, products or devices. It should be noted that in the present application, words such as "exemplary" or "for example" are used to mean examples, illustrations or explanations. Any method or design described as "exemplary" or "for example" in the present application should not be construed as being more preferred or advantageous than other methods or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0073] The following specific embodiments illustrate the implementation manners of the present application. Those skilled in the art can understand other advantages and effects of the present application from the content disclosed in this specification. Although the description of the present application will be introduced in conjunction with the preferred embodiments, this does not mean that the features of this application are limited to this implementation manner. On the contrary, the purpose of introducing the application in conjunction with the implementation manner is to cover other alternatives or modifications that may be extended based on the claims of the present application. In order to enhance the in-depth understanding of the present application, many specific details will be included in the following description. The present application may also be implemented without using these details. In addition, in order to avoid confusing or obscuring the key points of the present application, some specific details will be omitted in the description. It should be noted that, without conflict, the embodiments in the present application and the features in the embodiments may be combined with each other.

[0074] Digital twin (DT) is a technology increasingly associated with system automation. A DT is a virtual replica of a real-world system - a "physical" system - on which operations can be performed. Facing the growing types, scales and complexities of business, communication networks also need to utilize digital twin technology to seek better solutions beyond the physical network. Network twin is the application of digital twin technology in the field of communication networks, aiming to develop various rich network applications and achieve efficient data-driven network management and maintenance.

[0075] A network twin is a digital twin whose physical counterpart is a communication network or some parts of a communication network. A communication network may include, for example, physical network elements and components, virtualized network functions (VNFs) (i.e., network function elements instantiated as software-based entities), physical hosts for such VNFs, services and traffic, etc.

[0076] Specifically, a network twin refers to a digital mirror of a physical network established in a digital manner. By leveraging the historical network data, real-time network data, and algorithm models of the physical network, the physical network is digitized to achieve synchronous analysis, prediction, improvement, and optimization of the physical network. That is, a network twin contains a digital representation of the physical network and is used to simulate the physical network. Among them, the digital representation includes algorithm models and data, etc. A network twin can also be referred to as a network twin entity, a digital twin, or a digital twin entity, and this application does not make any restrictions. Among them, a physical network is a network formed by connecting various physical devices or network elements (such as hosts, routers, switches, etc.) and media (optical cables, cables, twisted pairs, etc.) in the network. The physical network can be a mobile access network, a transmission network, a mobile core network, a backbone network, etc.; the physical network can also be a data center network, a campus network, an industrial Internet of Things, etc. Network data, also known as network operation data, is used to represent the operating state of the physical network and can be configuration parameters, alarm data, performance data, etc. of physical devices or network elements.

[0077] To better simulate and test various scenarios in the physical network, the entity providing the network simulation service needs to update the network twin according to the operating conditions of the physical network. The more frequently the entity providing the network simulation service interacts with the physical network and the more timely the data is collected, the more accurate the simulation and prediction effects will be. Therefore, strict requirements are imposed on the accuracy, timeliness, and interactivity of the network data collection and feedback process of the physical network.

[0078] An important application of the network twin is network simulation. In network simulation, the network twin acts as a secure sandbox to safely verify the impact on the physical network after specific network management operation instructions are sent to the physical network, such as the verification of energy-saving solutions and signaling storm solutions.

[0079] Different scenarios have different requirements for simulation accuracy and simulation duration. For example, in the verification scenario of the signaling storm solution, the network is interrupted due to a fault, users keep retrying after losing network connection, and signaling accumulates and cannot be processed, forming a signaling storm. When a large amount of signaling impacts the core network elements, it may cause multiple elements to crash due to congestion in a chain reaction, leading to the spread of the storm. Before the entity consuming the network simulation service issues a flow control strategy, it first conducts a simulation on the twin network. Therefore, the entity consuming the network simulation service hopes to obtain the results of the network simulation in a short time, implement the strategy as soon as possible, and reduce the spread of the signaling storm. In the verification scenario of the energy-saving solution, the entity consuming the network simulation service simulates the energy-saving configuration content to be sent to the network elements on the network twin and returns the relevant performance indicators to the entity consuming the network simulation service. Therefore, the simulation scenario of the energy-saving solution usually does not have a strong time limit, and the entity consuming the network simulation service hopes to obtain relatively accurate results of the network simulation.

[0080] As Figure 1 shown, it is a schematic diagram of a simulation process provided by an embodiment of the present application. The process may specifically include the following steps:

[0081] S101. The network simulation service consuming entity sends a simulation request to the network simulation service providing entity.

[0082] Among them, the simulation request is used to request the network simulation service providing entity to perform network simulation. The simulation request includes a simulation object, a service identifier, and simulation configuration. The service identifier is used to identify, for example, a signaling storm solution or an energy-saving solution, etc.

[0083] S102. After receiving the simulation request, the network simulation service providing entity performs network simulation according to the simulation request and sends a simulation response to the network simulation service consuming entity.

[0084] After receiving the simulation request, the simulation module in the network simulation service providing entity selects a relatively optimal simulation model in the comprehensive dimension according to the service identifier. The comprehensive dimension may include simulation accuracy, simulation duration, computing resources, etc.

[0085] The network simulation service providing entity uses the simulation model to perform network simulation and obtains the result of the network simulation.

[0086] After the simulation ends, the network simulation service providing entity sends a simulation response to the network simulation service consuming entity. Among them, the simulation response includes the result of the network simulation.

[0087] However, when the simulation module performs simulation, the three dimensions of simulation accuracy, simulation duration, and computing resources are strongly correlated: when the computing resources are fixed, if it is desired to have higher simulation accuracy, generally the simulation duration required to complete a simulation task is longer; if it is desired to have a shorter simulation duration, the simulation accuracy of the result of the network simulation is lower. If it is desired to have relatively high simulation accuracy and simulation duration, additional computing resources may need to be invoked.

[0088] Therefore, when the current network simulation service provider entity conducts network simulation using default simulation accuracy, default simulation duration, and default computing resources, it may not necessarily meet the requirements of the network simulation service production entity. In some scenarios, the network simulation service consumer entity may wish to sacrifice one of the simulation accuracy, simulation duration, and computing resources to achieve a higher standard for another. For example, in the verification scenario of an energy-saving solution, since there is no time limit, the network simulation service consumer entity is willing to spend more time on simulation to obtain high-precision network simulation results, and the network simulation service consumer entity has a higher requirement for simulation accuracy than for simulation duration. In the verification scenario of a signaling storm solution, since the resolution of the signaling storm is time-critical, the network simulation service consumer entity needs to obtain network simulation results within a short time, and the simulation accuracy can be slightly lower. The network simulation service consumer entity has a higher requirement for simulation duration than for simulation accuracy.

[0089] Existing simulation modules generally provide a relatively optimal simulation model in terms of comprehensive dimensions based on service identifiers. In simulation scenarios with specific requirements for simulation accuracy and simulation duration, it may lead to too low accuracy of the final network simulation results or too long simulation duration.

[0090] In view of this, the present application provides a simulation solution. The network simulation service consumer entity can put forward expectations for achieving different simulation performance requirements, enabling the network simulation service provider entity to perform simulation according to this expectation, rather than considering a relatively optimal simulation model in terms of comprehensive dimensions for simulation in any scenario. This can enable the network simulation service provider entity to better provide network simulation services.

[0091] As Figure 2 shown, it is a schematic diagram of the architecture of a simulation system provided by an embodiment of the present application. The system 2000 includes a network simulation service consumer entity 201 and a network simulation service provider entity 202, and the two can interact with each other. Exemplarily, the network simulation service consumer entity 201 may be located in a simulation system (network management system, NMS); the network simulation service provider entity 202 may be located in an element management system (element management system, EMS). The network simulation service consumer entity 201 is used to put forward simulation performance requirements and receive simulation reports; the network simulation service provider entity 202 is used to provide network simulation services, and can perform simulation according to the simulation performance requirements and return simulation reports, etc.

[0092] In one embodiment of the present application, a network simulation service consuming entity 201 sends a simulation performance requirement to a network simulation service providing entity 202, where the simulation performance requirement indicates the requirement of the network simulation service consuming entity for the performance of network simulation; and the network simulation service providing entity 202 sends a simulation report to the network simulation service consuming entity 201, where the simulation report indicates the result of the network simulation; wherein, the network simulation is to simulate the execution of network management operations in a communication network based on the simulation performance requirement.

[0093] In another embodiment of the present application, the network simulation service consuming entity 201 sends first indication information to the network simulation service providing entity 202, where the first indication information indicates that when simulating based on multiple simulation performance requirements, the first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, and the simulation performance requirement indicates the requirement of the network simulation service consuming entity for the performance of network simulation; and the network simulation service providing entity 202 sends a simulation report to the network simulation service consuming entity 201, where the simulation report indicates the result of the network simulation.

[0094] Based on the system as Figure 2 shown, the simulation method provided by the embodiments of the present application is described below:

[0095] As Figure 3 shown, it is a schematic flowchart of a simulation method provided by an embodiment of the present application. Exemplarily, the method may include the following steps:

[0096] S301. The network simulation service consuming entity sends a simulation performance requirement to the network simulation service providing entity. Correspondingly, the network simulation service providing entity receives the simulation performance requirement.

[0097] As described above, when the simulation module in the current network simulation service providing entity performs network simulation, it generally uses the default simulation accuracy, default simulation duration, and default computing resources for network simulation, which may not necessarily meet the requirements of the network simulation service production entity. However, there is a strong correlation among the three dimensions of simulation accuracy, simulation duration, and computing resources, and often some simulation performance requirements cannot reach higher standards. In some scenarios, the network simulation service consuming entity does not need to achieve better performance in all dimensions, but rather to make one or more of the simulation performance requirements reach higher standards as much as possible. Therefore, in this embodiment, the network simulation service consuming entity can put forward its own expectations for achieving different simulation performance requirements, allowing the network simulation service consuming entity to customize the different simulation performance requirements it needs. Thus, the network simulation service consuming entity sends the simulation performance requirements to the network simulation service providing entity. The simulation performance requirements indicate the performance requirements of the network simulation service consuming entity for network simulation, where the network simulation is to simulate the execution of network management operations in a communication network based on the simulation performance requirements. The simulation performance requirements can also be referred to as simulation performance requirements, simulation performance indicators (performance metrics), etc.

[0098] Exemplarily, the network simulation service consuming entity can send the simulation performance requirements with higher expectations, such as sending the first simulation performance requirements, and not sending other simulation performance requirements, such as the second simulation performance requirements, allowing the network simulation service providing entity to determine the second simulation performance requirements by itself. Exemplarily, the network simulation service consuming entity can also send multiple simulation performance requirements.

[0099] Exemplarily, the expression form of the simulation performance requirements can be a range, such as expressed as: [minimum value, maximum value], or the simulation performance requirements can also be indicated by a single number or percentage to indicate the minimum requirements, accuracy levels, etc. that must be achieved.

[0100] The network simulation service consuming entity also sends the simulation object and service identifier to the network simulation service providing entity. The simulation object refers to the object targeted by the network management operation that the network simulation service consuming entity will issue to the physical network. The simulation object can be a network element in the physical network, etc. The simulation services include multiple types, such as the simulation of the above energy-saving solutions and the simulation of signaling storm solutions. Different types of simulation services can have different service identifiers.

[0101] Exemplarily, the network simulation service consuming entity can send a simulation request to the network simulation service providing entity, and the simulation request includes the above simulation performance requirements, as well as the simulation object and service identifier.

[0102] S302. The network simulation service providing entity sends a simulation report to the network simulation service consuming entity. Correspondingly, the network simulation service consuming entity receives the simulation report.

[0103] After receiving the above simulation performance requirements, the network simulation service providing entity obtains corresponding model parameters according to the simulation performance requirements, and obtains a simulation model based on the simulation object, service identifier, and model parameters. Then, the simulation object is simulated based on the obtained simulation model to obtain the result of the network simulation. That is, the result of the network simulation in this embodiment is obtained by simulating based on the simulation model, the simulation model is obtained based on the simulation object, service identifier, and model parameters, and the model parameters correspond to the simulation performance requirements. Since the network simulation service providing entity obtains the simulation model based on the simulation performance requirements sent by the network simulation service consuming entity, rather than using a simulation model with better comprehensive dimensions in any scenario, the network simulation service providing entity can select and create a simulation model that better meets the needs of the network simulation service consuming entity.

[0104] It can be understood that although the network simulation service consuming entity puts forward its own expected simulation performance requirements, when the network simulation service providing entity performs simulation based on the obtained simulation model, whether the simulation performance requirements can be met also needs to consider other parameters inside the network simulation service providing entity, such as the computing resources of the network simulation service providing entity, etc., or the simulation performance requirements put forward by the network simulation service consuming entity may be too high. Therefore, after the network simulation service providing entity performs simulation, the following conclusion can be drawn: whether the result of the network simulation meets the simulation performance requirements.

[0105] After obtaining the result of the network simulation, the network simulation service providing entity sends a simulation report to the network simulation service consuming entity, and the simulation report indicates the result of the network simulation. Exemplarily, the simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meet the above simulation performance requirements. For example, the indication information is 1 bit. When the value of the indication information is "0", it indicates that the performance and / or process of the network simulation do not meet the simulation performance requirements; when the value of the indication information is "1", it indicates that the performance and / or process of the network simulation meet the simulation performance requirements. The simulation report can also be referred to as the simulation performance achievement status, the completion degree of the simulation performance requirements, etc.

[0106] According to a simulation method provided by an embodiment of the present application, the network simulation service consuming entity enables the network simulation service providing entity to perform simulation according to the simulation performance requirements by sending its own expected simulation performance requirements, which can enable the network simulation service providing entity to better provide network simulation services.

[0107] The above embodiments describe that the network simulation service providing entity obtains a simulation report based on simulation performance requirements. The following embodiments will further describe how the network simulation service providing entity obtains an accurate simulation report:

[0108] As Figure 4 shown, it is a schematic flowchart of another simulation method provided by an embodiment of the present application. Exemplarily, the method may include the following steps:

[0109] S401. The network simulation service providing entity constructs a correspondence relationship between at least one historical simulation performance requirement and at least one model parameter.

[0110] The simulation module in the network simulation service providing entity can obtain a correspondence relationship between at least one historical simulation performance requirement and at least one model parameter through previously collected real network data, including model parameters, the results of network simulation, and the actual execution results of the communication network (physical network).

[0111] Exemplarily, the above simulation performance requirement may be simulation accuracy. The simulation accuracy indicates the degree of closeness between the result of the network simulation expected by the network simulation service consuming entity and the actual execution result of the communication network. The higher the simulation accuracy, the more credible the simulation model and the result of the network simulation, and the greater the probability that the actual execution result of the communication network conforms to the expected result. The expression form of the simulation accuracy may be a range, for example, expressed as: [minimum value, maximum value]. Or, the simulation accuracy may also be indicated by a single number or a percentage to indicate the minimum accuracy or accuracy level to be achieved, etc.

[0112] Exemplarily, the above simulation performance requirement may be the simulation duration. The simulation duration indicates the simulation duration expected by the network simulation service consuming entity. The expression form of the simulation duration may be a range, for example, expressed as: [minimum value, maximum value]. Or, the simulation duration may also be indicated by a single number to represent the longest acceptable running duration, the level of running speed / duration, etc. This simulation duration can also be replaced by or referred to as simulation speed, simulation running time, simulation duration, etc.

[0113] Among them, the model parameters include the simulation step size and the number of simulation times. Generally, the larger the simulation step size, the fewer the number of sampling points. Correspondingly, the simulation accuracy is relatively lower and the simulation duration is relatively shorter. On the contrary, the smaller the simulation step size, the more the number of sampling points. Correspondingly, the simulation accuracy is relatively higher, but the simulation duration is longer. The number of simulation times is proportional to the simulation accuracy and proportional to the simulation duration. Then the simulation module can construct a correspondence relationship between at least one historical simulation accuracy, at least one historical simulation duration and at least one model parameter as shown in Table 1 below:

[0114] Table 1

[0115] Simulation step size Number of simulation runs Simulation accuracy Simulation duration 1 1 0.5 0.6 2 1 0.3 0.5 1 2 0.83 0.8 2 2 0.7 0.65

[0116] The network simulation service providing entity can store the above corresponding relationship locally or on a third - party server, and can update the above corresponding relationship according to the simulation history. The richer the historical data collected by the simulation module, the more accurate the model parameters obtained by the subsequent network simulation service providing entity according to the simulation performance requirements.

[0117] S402. The network simulation service consuming entity sends the simulation performance requirements to the network simulation service providing entity. Correspondingly, the network simulation service providing entity receives the simulation performance requirements.

[0118] For the specific implementation of this step, reference can be made to Figure 3 step S301 of the embodiment shown, which will not be elaborated here.

[0119] S403. Based on the corresponding relationship, the network simulation service providing entity obtains the model parameters corresponding to the received simulation performance requirements, and obtains the simulation model based on the simulation object, service identifier, and model parameters.

[0120] After receiving the above simulation performance requirements, the network simulation service providing entity queries the above corresponding relationship to obtain the model parameters corresponding to the received simulation performance requirements. For example, when the network simulation service providing entity receives the simulation accuracy of 0.7 and the simulation duration of 0.65 sent by the network simulation service consuming entity, the network simulation service providing entity queries the above corresponding relationship and obtains the simulation step size of 2 and the number of simulation times of 2.

[0121] Furthermore, the network simulation service providing entity obtains the simulation model based on the simulation object, service identifier, and the queried model parameters.

[0122] S404. The network simulation service providing entity performs simulation on the simulation object based on the simulation model to obtain the result of the network simulation.

[0123] For the specific implementation of this step, reference can be made to Figure 3 step S302 of the embodiment shown, which will not be elaborated here.

[0124] S405. The network simulation service providing entity sends the simulation report to the network simulation service consuming entity. Correspondingly, the network simulation service consuming entity receives the simulation report.

[0125] For the specific implementation of this step, reference can be made to Figure 3 step S302 of the embodiment shown, which will not be elaborated here.

[0126] According to a simulation method provided by an embodiment of the present application, a network simulation service consuming entity sends its desired simulation performance requirements, enabling the network simulation service providing entity to clarify the expectations of the network simulation service consuming entity for the simulation performance requirements of the simulation model. Thus, the model parameters can be obtained according to the simulation performance requirements, and the simulation model can be obtained based on the model parameters for simulation, which can enable the network simulation service providing entity to better provide network simulation services. Moreover, the network simulation service providing entity can pre-construct the correspondence between at least one historical simulation performance requirement and at least one model parameter through prior knowledge, enabling the network simulation service providing entity to quickly query the model parameters to be adopted and quickly obtain the simulation model after receiving the simulation performance requirements sent by the network simulation service consuming entity, further improving the simulation efficiency and accuracy.

[0127] In the above embodiment, the network simulation service consuming entity sends the desired simulation performance requirements, and the network simulation service providing entity obtains the model parameters based on the simulation performance requirements. However, in some scenarios, when there are multiple simulation performance requirements, since the simulation performance requirements are mutually restrictive, it is possible that the simulation model cannot meet all the above simulation performance requirements. Therefore, the following embodiments are also provided:

[0128] As Figure 5 shown, it is a schematic flowchart of another simulation method provided by an embodiment of the present application. Exemplarily, the method may include the following steps:

[0129] S501. The network simulation service providing entity constructs the correspondence between at least one historical simulation performance requirement and at least one model parameter.

[0130] For the specific implementation of this step, reference can be made to Figure 4 step S401 of the embodiment shown, which will not be elaborated here.

[0131] S502. The network simulation service consuming entity sends the first simulation performance requirement and / or the second simulation performance requirement, as well as priority information, to the network simulation service providing entity. Correspondingly, the network simulation service providing entity receives the first simulation performance requirement and / or the second simulation performance requirement, as well as priority information.

[0132] For the specific implementation of this step, reference can be made to Figure 3 step S301 of the embodiment shown or Figure 4Step S402 of the illustrated embodiment is different in that the network simulation service consuming entity also sends priority information to the network simulation service providing entity. The priority information indicates which simulation performance requirement should be preferentially satisfied when it is determined that the results of the network simulation cannot simultaneously meet the first simulation performance requirement and the second simulation performance requirement when obtaining the model parameters. In one example, the priority information includes a first priority and a second priority. Among them, the first priority corresponds to the first simulation performance requirement, and the second priority corresponds to the second simulation performance requirement. The first priority is higher than the second priority. Then, when it is determined that the results of the network simulation cannot simultaneously meet the first simulation performance requirement and the second simulation performance requirement when obtaining the model parameters, the first simulation performance requirement with a higher priority is preferentially satisfied. In another example, the priority information is an indication information. For example, the network simulation service consuming entity sends the first simulation performance requirement and the second simulation performance requirement, and the indication information indicates which of the first simulation performance requirement and the second simulation performance requirement should be preferentially satisfied when it is determined that the results of the network simulation cannot simultaneously meet the first simulation performance requirement and the second simulation performance requirement when obtaining the model parameters. For example, the indication information is 1 bit. When the value of the 1 bit is "1", it indicates that the first simulation performance requirement is satisfied with priority; when the value of the 1 bit is "0", it indicates that the second simulation performance requirement is satisfied with priority.

[0133] Exemplarily, the network simulation service consuming entity sends a simulation request to the network simulation service providing entity, and the simulation request includes the above-mentioned first simulation performance requirement and / or second simulation performance requirement, as well as a simulation object, a service identifier, and priority information.

[0134] S503. When the results of the network simulation cannot simultaneously meet the first simulation performance requirement and the second simulation performance requirement, the network simulation service providing entity selects the corresponding model parameters based on the first simulation performance requirement according to the corresponding relationship, and obtains a simulation model based on the simulation object, the service identifier, and the selected model parameters.

[0135] After receiving the above-mentioned first simulation performance requirement and second simulation performance requirement, the network simulation service providing entity queries the above-mentioned corresponding relationship to obtain the model parameters corresponding to the first simulation performance requirement and the second simulation performance requirement. However, since the simulation performance requirements are mutually restrictive, it is possible that the results of the network simulation determined by selecting the model parameters cannot all meet the above-mentioned simulation performance requirements. Therefore, the network simulation service providing entity selects the model parameters corresponding to the simulation performance requirement with a higher priority based on the priority information, and obtains a simulation model based on the simulation object, the service identifier, and the selected model parameters.

[0136] If the network simulation service providing entity determines that the selected model parameters can meet the simulation performance requirement with a higher priority, it can further select the model parameters that can also meet the simulation performance requirement with a lower priority.

[0137] S504. The network simulation service providing entity performs simulation on the simulation object based on the simulation model to obtain the result of network simulation.

[0138] For the specific implementation of this step, reference can be made to Figure 3 step S302 of the embodiment shown in Figure 4 step S404 of the embodiment shown in, which will not be elaborated here.

[0139] S505. The network simulation service providing entity sends a simulation report to the network simulation service consuming entity. Correspondingly, the network simulation service consuming entity receives the simulation report.

[0140] For the specific implementation of this step, reference can be made to Figure 3 step S302 of the embodiment shown in Figure 4 step S405 of the embodiment shown in, which will not be elaborated here. The simulation report indicates whether the result of network simulation meets the first simulation performance requirement.

[0141] According to a simulation method provided by an embodiment of the present application, when sending the desired simulation performance requirement, the network simulation service consuming entity can also carry priority information, so that when the network simulation service providing entity determines that the result of network simulation cannot simultaneously meet multiple simulation performance requirements after obtaining the model parameters, it can preferentially meet the simulation performance requirement that the network simulation service consuming entity more expects to meet, thereby better constructing the simulation model to meet the needs of the network simulation service consuming entity.

[0142] In the above embodiments, the network simulation service consuming entity has provided its desired simulation performance requirement. However, in some scenarios, the network simulation service consuming entity cannot give a specific desired simulation performance requirement, but can only put forward the expectation of preferentially meeting which one or which ones of the simulation performance requirements, that is, having its own preference for which one or which ones of the simulation performance requirements. The following will describe this solution in detail through embodiments:

[0143] As Figure 6 shown, it is a schematic flowchart of another simulation method provided by an embodiment of the present application. Exemplarily, the method may include the following steps:

[0144] S601. The network simulation service providing entity constructs the correspondence between at least one historical simulation performance requirement and at least one model parameter.

[0145] For the specific implementation of this step, reference can be made to Figure 4 step S401 of the embodiment shown in Figure 5 step S501 of the embodiment shown in, which will not be elaborated here.

[0146] S602. The network simulation service consuming entity sends first indication information to the network simulation service providing entity. Correspondingly, the network simulation service providing entity receives the above first indication information.

[0147] What is different from the foregoing embodiment in this embodiment is that in this embodiment, since the network simulation service consuming entity may not know the specific simulation performance requirements, but only knows that it hopes to preferentially meet a certain simulation performance requirement during simulation, therefore, the network simulation service consuming entity does not send the specific simulation performance requirements to the network simulation service providing entity, but sends first indication information. Among them, the first indication information indicates that when simulating based on multiple simulation performance requirements, the first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied. Further, the first indication information may also indicate preferentially achieving multiple simulation performance requirements. The simulation performance requirement indicates the requirement of the network simulation service consuming entity for the performance of network simulation, where the network simulation is to simulate the execution of network management operations in a communication network. The simulation performance requirement can also be referred to as simulation performance requirement, simulation performance index, etc.

[0148] For example, the factors that the network simulation service providing entity needs to consider when obtaining model parameters include simulation accuracy, simulation duration, and computing resources, etc. The network simulation service consuming entity may not be able to provide the specific simulation accuracy and simulation duration it expects, but can indicate through the first indication information that it hopes the simulation model to preferentially improve the simulation accuracy, or hopes the simulation system to preferentially reduce the simulation duration.

[0149] S603. The network simulation service providing entity obtains model parameters based on the corresponding relationship and the first indication information, and obtains a simulation model based on the simulation object, service identifier, and model parameters.

[0150] After receiving the first indication information from the network simulation service consuming entity, when obtaining model parameters, the network simulation service providing entity can obtain the model parameters corresponding to the first simulation performance requirement according to the first indication information and the above corresponding relationship, and the acquisition of the model parameters preferentially meets the first simulation performance requirement that the network simulation service consuming entity hopes to preferentially meet. After obtaining the model parameters, a simulation model is constructed based on the model parameters.

[0151] S604. The network simulation service providing entity simulates the simulation object based on the simulation model to obtain the result of network simulation.

[0152] The specific implementation of this step can refer to Figure 3 step S302 of the embodiment shown in Figure 4 step S404 of the embodiment shown in Figure 5 step S504 of the embodiment shown in, which will not be elaborated here.

[0153] The network simulation service providing entity sends a simulation report to the network simulation service consuming entity. Correspondingly, the network simulation service consuming entity receives the simulation report.

[0154] After obtaining the results of the network simulation, the network simulation service providing entity can determine whether the results of the network simulation meet multiple simulation performance requirements, or whether they meet the first simulation performance requirement. Therefore, a simulation report is sent to the network simulation service consuming entity, where the simulation report indicates the results of the network simulation. Exemplarily, the simulation report includes second indication information, and the second indication information indicates whether the performance and / or process of the network simulation meet multiple simulation performance requirements, or whether they meet the first simulation performance requirement. For example, the second indication information is 1 bit. When the value of the indication information is "0", it indicates that the performance and / or process of the network simulation do not meet the simulation performance requirements; when the value of the second indication information is "1", it indicates that the performance and / or process of the network simulation meet the simulation performance requirements. Further, the simulation report may also include the above-mentioned results of the network simulation, and may also indicate whether the results of the network simulation meet other simulation performance requirements.

[0155] According to a simulation method provided by an embodiment of the present application, the network simulation service consuming entity can send an indication of which simulation performance requirement it desires to prioritize to the network simulation service providing entity. The network simulation service providing entity can obtain corresponding model parameters according to this indication and construct a simulation model, so that the network simulation service providing entity can better provide simulation services and make the results of the network simulation meet the requirements of the network simulation service consuming entity.

[0156] It can be understood that in each of the above embodiments, the methods and / or steps implemented by the network simulation service providing entity can also be implemented by components (such as chips or circuits) available for the network simulation service providing entity; the methods and / or steps implemented by the network simulation service consuming entity can also be implemented by components (such as chips or circuits) available for the network simulation service consuming entity.

[0157] The above mainly introduces the solution provided by the embodiments of the present application from the perspective of the interaction between various entities. Correspondingly, the embodiments of the present application also provide a simulation device, which is used to implement the above various methods. The simulation device can be an entity that provides network simulation services in the above method embodiments, or a component that can be used as an entity that provides network simulation services; or, the simulation device can be a consumer entity of network simulation services in the above method embodiments, or a component that can be used as a consumer entity of network simulation services. It can be understood that in order to implement the above functions, the simulation device includes the corresponding hardware structure and / or software module for executing each function. Those skilled in the art should easily realize that, combining the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0158] The embodiments of the present application can divide the functional modules of the simulation device according to the above method embodiments. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above integrated module can be implemented in the form of hardware or in the form of a software functional module. It should be noted that the division of modules in the embodiments of the present application is illustrative, only a logical function division, and there can be other division methods in actual implementation.

[0159] Based on the same concept of the above simulation method, the present application also provides the following simulation device:

[0160] As Figure 7 shown, it is a schematic structural diagram of a simulation device provided by an embodiment of the present application. The simulation device 7000 includes a transceiver unit 701 and a processing unit 702; where:

[0161] When the simulation device is used to implement the functions of the entity that provides network simulation services in the above method embodiments, the transceiver unit 701 is used to execute the functions of the entity that provides network simulation services in steps S301 and S302 in the embodiment shown in Figure 3 ; or, the transceiver unit 701 is used to execute the functions of the entity that provides network simulation services in steps S402 and S405 in the embodiment shown in Figure 4 , and the processing unit 702 is used to execute the steps S401, S403, and S404 in the embodiment shown in Figure 4 ; or, the transceiver unit 701 is used to execute the steps shown in Figure 5The functions of the network simulation service providing entity in steps S502 and S505 in the illustrated embodiment, and the processing unit 702 is used to execute as Figure 5 the steps S501, S503, and S504 in the illustrated embodiment; or, the transceiver unit 701 is used to execute as Figure 6 the functions of the network simulation service providing entity in steps S602 and S605 in the illustrated embodiment, and the processing unit 702 is used to execute as Figure 6 the steps S601, S603, and S604 in the illustrated embodiment.

[0162] When the simulation device is used to implement the functions of the network simulation service consuming entity in the above method embodiment, the transceiver unit 701 is used to execute as Figure 3 the functions of the network simulation service consuming entity in steps S301 and S302 in the illustrated embodiment; or, the transceiver unit 701 is used to execute as Figure 4 the functions of the network simulation service consuming entity in steps S402 and S405 in the illustrated embodiment; or, the transceiver unit 701 is used to execute as Figure 5 the functions of the network simulation service consuming entity in steps S502 and S505 in the illustrated embodiment; or, the transceiver unit 701 is used to execute as Figure 6 the functions of the network simulation service consuming entity in steps S602 and S605 in the illustrated embodiment.

[0163] For the specific implementation of the above transceiver unit 701 and processing unit 702, reference may be made to the description in the above method embodiment, which will not be elaborated here.

[0164] As Figure 8 shown, it is a schematic structural diagram of another simulation device provided by an embodiment of the present application. The simulation device 8000 includes a processor 801, and may further include an interface circuit 802 and a memory 803 (shown by a dotted line in the figure). The processor 801 and the interface circuit 802 are coupled to each other. It can be understood that the interface circuit 802 may be a transceiver or an input / output interface. The memory 803 is used to store instructions executed by the processor 801, or store input data required for the processor 801 to run the instructions, or store data generated after the processor 801 runs the instructions. Among them, the processor 801 is used to implement the functions of the processing unit 702 in the above Figure 7 illustrated embodiment; and the interface circuit 802 is used to implement the functions of the transceiver unit 701 in the above Figure 7 illustrated embodiment.

[0165] When the above simulation device is a chip applied to a network simulation service providing entity, the chip implements the functions of the network simulation service providing entity in the above method embodiments. The chip receives information from other modules (such as a radio frequency module or an antenna) in the network simulation service providing entity, and the information is sent by a network simulation service consuming entity to the network simulation service providing entity; or, the chip sends information to other modules (such as a radio frequency module or an antenna) in the network simulation service providing entity, and the information is sent by the network simulation service providing entity to the network simulation service consuming entity.

[0166] When the above simulation device is a chip applied to a network simulation service consuming entity, the chip implements the functions of the network simulation service consuming entity in the above method embodiments. The chip receives information from other modules (such as a radio frequency module or an antenna) in the network simulation service consuming entity, and the information is sent by a network simulation service providing entity to the network simulation service consuming entity; or, the chip sends information to other modules (such as a radio frequency module or an antenna) in the network simulation service consuming entity, and the information is sent by the network simulation service consuming entity to the network simulation service providing entity.

[0167] In addition, it should be noted that the foregoing transceiver unit and / or processing unit can be implemented by a virtual module. For example, the processing unit can be implemented by a software functional unit or a virtual device, and the transceiver unit can be implemented by a software function or a virtual device. Or, the processing unit or the transceiver unit can also be implemented by a physical device. For example, if the device is implemented by a chip / chip circuit, the transceiver unit can be an input / output circuit and / or a communication interface, performing an input operation (corresponding to the foregoing receiving operation) and an output operation (corresponding to the foregoing sending operation); the processing unit is an integrated processor or a microprocessor or an integrated circuit.

[0168] The division of modules in this application is illustrative, merely a logical function division. In actual implementation, there may be other division methods. In addition, in each example of this application, each functional module can be integrated in a processor, can also exist physically alone, or two or more modules can be integrated in one module. The above integrated module can be implemented in the form of hardware or in the form of a software functional module.

[0169] It can be understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0170] The embodiments of the present application further provide a computer-readable storage medium, in which a computer program or instructions are stored. When the computer program or instructions are executed, the methods in the above embodiments are implemented.

[0171] The embodiments of the present application further provide a computer program product containing instructions. When the instructions run on a computer, the computer is enabled to execute the methods in the above embodiments.

[0172] The embodiments of the present application further provide a simulation system, including the above simulation device.

[0173] The embodiments of the present application further provide a circuit, which is coupled to a memory and is used to execute the methods shown in the above embodiments. The circuit may include a chip circuit.

[0174] It should be noted that one or more of the above units may be implemented by software, hardware, or a combination of both. When any of the above units is implemented by software, the software exists in the form of computer program instructions and is stored in a memory. The processor may be used to execute the program instructions and implement the above method processes.

[0175] In the present application, the processor may be a general-purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and can implement or execute the various methods, steps, and logic block diagrams disclosed in the present application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the methods disclosed in combination with the present application may be directly embodied as being executed by a hardware processor, or executed by a combination of hardware and software modules in the processor.

[0176] The processor can be built into a system on chip (SoC) or an ASIC, or it can be an independent semiconductor chip. In addition to the core for processing software instructions for arithmetic operations or processing, the processor may further include necessary hardware accelerators, such as a field programmable gate array (FPGA), a programmable logic device (PLD), or a logic circuit for implementing dedicated logic operations.

[0177] When the above units or units are implemented in hardware, the hardware can be any one or any combination of a CPU, a microprocessor, a digital signal processing (DSP) chip, a microcontroller unit (MCU), an artificial intelligence processor, an ASIC, an SoC, an FPGA, a PLD, a dedicated digital circuit, a hardware accelerator, or a non-integrated discrete device, which can run the necessary software or execute the above method flow without relying on software.

[0178] Optionally, an embodiment of the present application further provides a chip system, including: at least one processor and an interface. The at least one processor is coupled to a memory through the interface. When the at least one processor runs a computer program or instruction in the memory, the chip system executes the method in any one of the above method embodiments. Optionally, the chip system can be composed of chips, or it can include chips and other discrete devices. The embodiments of the present application do not make specific limitations on this.

[0179] In the present application, the memory can be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., or it can also be a volatile memory, such as a random-access memory (RAM). The memory is any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory in the present application can also be a circuit or any other device capable of implementing a storage function, for storing program instructions and / or data.

[0180] In the embodiments of the present application, words such as "exemplary" or "for example" are used to represent examples, illustrations, or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present relevant concepts in a specific manner for easy understanding.

[0181] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, fiber optic, digital subscriber line (DSL)) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more media integrated therein. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a digital versatile disc (DVD)), or a semiconductor medium (such as a solid state disk (SSD)), etc.

[0182] Although the present application has been described in conjunction with various embodiments herein, however, in the process of implementing the claimed present application, those skilled in the art can understand and achieve other variations of the disclosed embodiments by viewing the accompanying drawings, the disclosure content, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "one" does not exclude a plurality of cases. A single processor or other unit can implement several functions recited in the claims. Certain measures are recited in mutually different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0183] It should be understood that the various numerical numbers involved in the embodiments of the present application are only for the convenience of description and are not used to limit the scope of the embodiments of the present application. The size of the serial numbers of the above processes does not mean the sequence of execution, and the execution sequence of each process should be determined according to its function and internal logic.

[0184] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0185] The components in the device embodiments of the present application can be combined, divided, and deleted according to actual needs. Those skilled in the art can combine or combine the different embodiments and the features of different embodiments described in this specification.

[0186] The above embodiments are only used to illustrate the technical solutions of the present application, not to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0187] In the present application, on the premise of no logical contradiction, the examples can be cited from each other. For example, the methods and / or terms between method embodiments can be cited from each other, for example, the functions and / or terms between device embodiments can be cited from each other, for example, the functions and / or terms between device examples and method examples can be cited from each other.

[0188] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application also intends to include these modifications and variations.

Claims

1. A simulation method, characterized in that: The method comprises: receiving a simulation performance requirement, wherein the simulation performance requirement indicates a requirement of a network simulation service consumption entity on network simulation performance; sending a simulation report, the simulation report indicating a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the simulation performance requirement.

2. The method according to claim 1, characterized in that The simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meets the simulation performance requirement.

3. The method according to claim 1 or 2, characterized in that When the first simulation performance requirement and the second simulation performance requirement are received, the method further includes: receiving priority information, the priority information indicating a first priority and a second priority, the first priority corresponding to the first simulation performance requirement, the second priority corresponding to the second simulation performance requirement, and the first priority being higher than the second priority; When the result of the network simulation cannot satisfy both the first simulation performance requirement and the second simulation performance requirement, selecting corresponding model parameters based on the first simulation performance requirement; A simulation model is obtained based on the selected model parameters.

4. The method according to claim 3, characterized in that The first simulation performance requirement includes simulation accuracy, and the simulation accuracy indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, The second simulation performance requirement includes a simulation duration, and the simulation duration indicates the time consumption of the network simulation.

5. The method according to any one of claims 1 to 4, characterized in that The method further comprises: Constructing a correspondence between at least one historical simulation performance requirement and at least one model parameter; Based on the corresponding relationship, model parameters corresponding to the received simulation performance requirements are obtained, and the model parameters are used to construct a simulation model, and the simulation model is used to perform the network simulation.

6. A simulation method, characterized in that: The method comprises: Sending a simulation performance requirement, wherein the simulation performance requirement indicates a requirement of a network simulation service consumer entity on network simulation performance; receiving a simulation report indicating a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the simulation performance requirement.

7. The method according to claim 6, characterized in that The simulation report includes indication information, and the indication information indicates whether the performance and / or process of the network simulation meets the simulation performance requirement.

8. The method according to claim 6 or 7, characterized in that When sending the first simulation performance requirement and the second simulation performance requirement, the method further includes: Priority information is sent, where the priority information indicates a first priority and a second priority, where the first priority corresponds to the first simulation performance requirement, the second priority corresponds to the second simulation performance requirement, and the first priority is higher than the second priority.

9. The method according to claim 8, characterized in that The first simulation performance requirement includes simulation accuracy, and the simulation accuracy indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or, The second simulation performance requirement includes a simulation duration, and the simulation duration indicates the time consumption of the network simulation.

10. A simulation method, characterized in that: The method comprises: Receive first indication information, wherein the first indication information indicates that when simulation is performed based on multiple simulation performance requirements, a first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, wherein the simulation performance requirement indicates a requirement of a network simulation service consumer entity for network simulation performance; sending a simulation report, the simulation report indicating a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the multiple simulation performance requirements.

11. The method according to claim 10, characterized in that The simulation report includes second indication information, and the second indication information indicates whether the performance and / or process of the network simulation meets the multiple simulation performance requirements, or whether it meets the first simulation performance requirement.

12. The method according to claim 10, characterized in that The method further comprises: Constructing a correspondence between at least one historical simulation performance requirement and at least one model parameter; Based on the corresponding relationship, model parameters corresponding to the first simulation performance requirement are obtained, and the model parameters are used to construct a simulation model, and the simulation model is used to perform the network simulation.

13. The method according to any one of claims 10 to 12, wherein the first simulation performance requirement comprises simulation accuracy, wherein the simulation accuracy indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or The first simulation performance requirement includes simulation duration, and the simulation duration indicates the time consumption of the network simulation.

14. A simulation method, characterized in that: The method comprises: Sending first indication information, wherein the first indication information indicates that when simulation is performed based on multiple simulation performance requirements, a first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, wherein the simulation performance requirement indicates a requirement of a network simulation service consumer entity for network simulation performance; receiving a simulation report indicating a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the multiple simulation performance requirements.

15. The method according to claim 14, characterized in that The simulation report includes second indication information, and the second indication information indicates whether the performance and / or process of the network simulation meets the multiple simulation performance requirements, or whether it meets the first simulation performance requirement.

16. The method according to claim 14 or 15, wherein the first simulation performance requirement comprises simulation accuracy, wherein the simulation accuracy indicates the degree of closeness between the result of the network simulation expected by the network simulation service consumer entity and the result actually executed by the communication network; and / or The first simulation performance requirement includes simulation duration, and the simulation duration indicates the time consumption of the network simulation.

17. A simulation method, characterized in that: The method comprises: The network simulation service consuming entity sends a simulation performance requirement to the network simulation service providing entity, wherein the simulation performance requirement indicates the requirement of the network simulation service consuming entity for the performance of the network simulation; The network simulation service providing entity sends a simulation report to the network simulation service consuming entity, wherein the simulation report indicates a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the simulation performance requirement.

18. A simulation method, characterized in that: The method comprises: The network simulation service consumption entity sends first indication information to the network simulation service providing entity, wherein the first indication information indicates that when simulation is performed based on multiple simulation performance requirements, a first simulation performance requirement among the multiple simulation performance requirements is preferentially satisfied, and the simulation performance requirement indicates the network simulation service consumption entity's requirement on network simulation performance; The network simulation service providing entity sends a simulation report to the network simulation service consuming entity, wherein the simulation report indicates a result of the network simulation; The network simulation is to simulate the network management operation performed in the communication network based on the multiple simulation performance requirements.

19. A simulation device, characterized in that: The apparatus comprises modules for implementing the method according to any one of claims 1-16.

20. A simulation device, characterized in that: The device comprises a processor, a memory, and instructions stored in the memory and executed on the processor, wherein when the instructions are executed, the simulation device executes the method according to any one of claims 1 to 16.

21. A simulation system, characterized in that: It comprises a network simulation service providing entity and a network simulation service consuming entity, wherein the network simulation service providing entity comprises a module for executing the method according to any one of claims 1-5, and the network simulation service consuming entity comprises a module for implementing the method according to any one of claims 6-9.

22. A simulation system, characterized in that: It comprises a network simulation service providing entity and a network simulation service consuming entity, wherein the network simulation service providing entity comprises a module for executing the method according to any one of claims 10-13, and the network simulation service consuming entity comprises a module for implementing the method according to any one of claims 14-16.

23. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises instructions, and when the instructions are executed by a processor, the method according to any one of claims 1 to 16 is implemented.

Images