Digital twin assembly of a telecommunications network

Abstract

A system for performing a simulation on a digital twin (1) of a telecommunications network is configured to determine a minimum assessment accuracy for one or more performance indicators and / or determine a maximum assessment period, select a simulation model (13-15, 23-25, 33-35, 43-45) for each of a plurality of elements (3-8) of the digital twin based on at least one of the minimum assessment accuracy and the maximum assessment period, assemble the selected simulation models (13, 14, 23, 33, 43) into a digital twin, and perform a simulation on the digital twin.

Description

[Technical Field]

[0001] This invention relates to a system for performing simulations on a digital twin of a communication network.

[0002] The present invention further relates to a method for performing simulations on a digital twin of a telecommunications network.

[0003] The present invention also relates to a computer program product that enables a computer system to perform such a method. [Background technology]

[0004] The concepts of "cyber-physical fusion" and "digital twin" are currently being applied or are under development in various fields, including manufacturing, logistics, and smart cities. The basic concept is to provide a digital representation of a physical object that allows for scenario-based experiments to be performed manually or automatically in order to predict and analyze the behavior / reaction of the object before selectively adapting the physical object itself.

[0005] Various models and tools exist for network planning, optimization, and technology / feature development related to mobile networks. Widely used examples include wireless network planning tools, system and link-level simulators, which differ in the degree of modeling accuracy / complexity and evaluation speed, and therefore in their target applications. Link-level simulators, on the one hand, model transmission, channel, and reception patterns in great detail, resulting in the isolation and treatment of only a single wireless link. On the other hand, wireless network planning tools typically utilize somewhat simplified modeling of network technologies to assess relatively large portions of operational networks with many active users. Such tools are generally used by human experts to conduct experiments to derive actions that will be applied to the operational network in a non-automated manner at a later stage.

[0006] In relation to self-organizing networks (SONs), fully automated closed-loop control mechanisms have been developed and implemented, typically characterized by a continuous cycle of measurement, algorithmic processing of measurement results, and application of derived configuration changes to the operational network. The underlying algorithms may be if-then-else type engineering rules or relatively simple artificial intelligence (AI) / machine learning (ML) based solutions, but they have not evolved to the extent of digital twin-based solutions.

[0007] The paper “Digital twin for 5G and beyond”, by HX Nguyen, R. Trestian, D. To, and M. Tatipamula, IEEE Communications Magazine, vol. 59, no. 2, 2021, outlines the concept of digital twins related to mobile communication networks and how they can be used in optimizing 5G networks. The authors present the digital twin as a virtual model that self-learns in real time (using AI / ML technology). The paper further describes the digital twin as an integration of separate models representing different parts of a network.

[0008] Ericsson's online blog, "The future of digital twins: what will they mean for mobile networks?" (https: / / www.ericsson.com / en / blog / 2021 / 7 / future-digital-twins-in-mobile-networks), discusses the trade-offs in the complexity, accuracy, and computational resources required when applying the concept of digital twins to mobile communication networks. The blog suggests mixing models of varying complexity depending on the immediate use case, the network domain being considered, and the level of detail required. However, the blog does not disclose how this can be achieved.

[0009] Currently, there is no "one-size-fits-all" solution for applying digital twins to mobile networks or other telecommunication networks. The simulations performed by digital twins may be too slow in the first scenario but not too slow in the second, and excessively inaccurate in the first scenario but not excessively inaccurate in the second. [Overview of the project] [Problems that the invention aims to solve]

[0010] The first objective of the present invention is to provide a system capable of generating a digital twin suitable for the current situation.

[0011] A second object of the present invention is to provide a method that can be used to generate a digital twin suitable for the present situation. [Means for solving the problem]

[0012] In a first embodiment of the present invention, a system for performing simulations on a digital twin of a telecommunications network includes at least one processor configured to determine a minimum assessment accuracy and / or a maximum assessment period for one or more performance metrics, select a simulation model for each of a plurality of elements of the digital twin based on at least one of the minimum assessment accuracy and the maximum assessment period, assemble the selected simulation models into the digital twin, and perform simulations on the digital twin.

[0013] In this system, when assessment accuracy is important and / or assessment period is not important / low importance, the digital twin may be assembled from complex and / or many elements; when assessment period is important and / or assessment accuracy is not important, the digital twin may be assembled from simple and / or few elements. In this way, the digital twin can be generated to suit the immediate situation. Examples of performance metrics include throughput, latency, and coverage probability. Simulations are typically run with different configuration parameter settings. Simulation models are usually determined collaboratively rather than element by element (separately). Each element has an element type. The telecommunications network may be, for example, a mobile communication network or a cable television network.

[0014] At least one processor may be configured to select a simulation model for each of the elements of a digital twin based on at least one of the minimum assessment accuracy and the maximum assessment period, by determining the quantity of multiple elements based on at least one of the minimum assessment accuracy and the maximum assessment period, and selecting a simulation model for each of the multiple elements. Thus, the digital twin can be assembled from more elements in situations where assessment accuracy is important and / or assessment period is not important / less important. For example, a relatively large number of elements may be selected for the element type that is most relevant to the problem at hand.

[0015] Optionally, for at least one of a plurality of elements, the element type of each element may be associated with a plurality of simulation models having different complexities. The at least one processor is then configured to select (jointly) at least one simulation model for at least one of the at least one element from the plurality of simulation models based on at least one of the minimum verification accuracy and the longest verification period, so as to select a simulation model for each of the plurality of elements of the digital twin based on at least one of the minimum verification accuracy and the longest verification period. Accordingly, the digital twin may be assembled from more complex elements in situations where verification accuracy is important and / or the verification period is not important / low importance.

[0016] The at least one processor may be configured to perform a simulation on the digital twin to determine one or more network configuration parameter settings of the remote communication network and configure the remote communication network with the one or more network configuration parameter settings. Thereby, it becomes possible to configure the operating remote communication network with better network configuration parameter settings. These simulations may be started from the current effective network configuration, or if this is not available, for example, from default parameter settings, vendor recommended parameter settings, in-range parameter settings, or any parameter settings. The operating remote communication network may be, for example, a trial network or a commercial network.

[0017] The one or more network configuration parameter settings may include, for example, antenna tilt setting and / or handover threshold setting and / or transmit power setting. The digital twin of the remote communication network may be additionally or alternatively used to evaluate, for example, the addition of a new site at a certain time and location. In other words, it may be found from the simulation that a new site is beneficial.

[0018] Multiple elements of a digital twin of a telecommunications network may, in the case of a mobile communications network, represent network elements in the wireless, core and / or cloud domains, such as one or more base stations and / or one or more antennas, as well as aspects of user behavior, such as user mobility, equipment / traffic characteristics and / or propagation environment.

[0019] At least one processor may be configured to select one problem definition from several, each of which specifies one or more configuration parameters and one or more corresponding performance metrics to be optimized, further selects a simulation model for each of several elements of the digital twin based on the selected problem definition, and selects one or more configuration parameters for simulation from the selected problem definition. The problem definition may further specify a geographical and / or technical scope. The selected problem definition may include a minimum assessment accuracy and / or a maximum assessment period.

[0020] Thus, the optimal number of elements in the digital twin and / or the optimal complexity of the simulation model for those elements may be selected for a particular problem. This solves the problem of conventional "one-size-fits-all" solutions, where the digital twin may be overly detailed, resulting in unacceptably slow simulations for some problems, or insufficient detail for simulations with sufficient accuracy for others.

[0021] The defined problem may be an optimization problem or an evaluation problem. For example, the objective of an optimization problem may be the optimization of configuration parameters (e.g., slope settings) in a mobile communication network, while the objective of an evaluation problem may be the assessment of the performance of vendor-implemented functions in a mobile communication network with different configuration parameter settings. The assessment of a function essentially includes optimizing the configuration parameters to quantify the merits of the function (i.e., the maximum performance gain achievable assuming an optimized configuration).

[0022] For example, in an optimization problem, the problem may be the optimization of a configuration parameter with respect to a single performance metric or to multiple performance metrics (e.g., a weighted average). The performance metric may be a combination of multiple performance metrics. The optimization of the configuration parameter may be performed under certain constraints, for example, the same constraints used for selecting the simulation model. For example, if a simulation model was selected for each of several elements based on the lowest assessment accuracy, the optimization algorithm may use the same lowest assessment accuracy as a constraint.

[0023] At least one processor may be configured to assemble a simulation model into different digital twin candidates, run multiple simulations for each of the assembled different digital twin candidates to determine training samples, generate utility functions for one or more performance metrics based on the training samples for the multiple digital twin candidates, including the assembled different digital twin candidates, generate cost functions based on the training samples for the multiple digital twin candidates, and select a simulation model for each of the multiple elements of the digital twin by applying the utility functions to the lowest assessment accuracy and / or the cost functions to the longest assessment period. This is a favorable method for selecting a simulation model for each of the multiple elements of the digital twin based on at least one of the lowest assessment accuracy and the longest assessment period.

[0024] The utility function is also called the precision function. The cost function reflects the effort required for assessment, e.g., the number of assessments required to determine the optimal / optimized settings of configuration parameters, multiplied by the computation time required to assess a single configuration of the digital twin. The computation time required to assess a single configuration is determined / learned for the system running the simulation. The utility and cost functions may be generated based on training samples, for example, using AI / ML techniques.

[0025] For example, in the case of an optimization problem, the optimization problem may be solved for each of several initial configuration settings for each digital twin candidate to determine the number of simulations / iterations that need to be performed for each initial configuration to arrive at the optimal / optimized configuration. These initial configuration parameter settings may be selected, for example, based on expertise. By using AI / ML techniques, utility and cost functions can be generated even without data on each possible (initial) setting of the configuration parameter.

[0026] It may not be possible to run multiple simulations for each assembleable digital twin candidate. Therefore, the digital twin candidates from which training samples are taken may be selected from the set of all assembleable digital twins based on expertise. This expertise may relate to the selected problem (domain) and / or the AI / ML techniques used.

[0027] Expertise may be used at a later stage. At least one processor may be configured to select a simulation model for each of several elements by selecting one digital twin candidate from several candidates based on at least one of the (required) minimum assessment accuracy and the (acceptable) maximum assessment period, and further based on expertise. This may be helpful in selecting the digital twin candidate that is best suited to the immediate problem in terms of constraints.

[0028] In other words, the digital twin may be selected from a reduced set of all assembleable digital twins based on expertise. This expertise may be related to the selected problem (domain) and may be the same as, or (partially) different from, the expertise used to select the digital twin candidates. The selection of a simulation model for each element of the digital twin may, but is not required, include the step of selecting one of the digital twin candidates from which training samples have been obtained. For example, for digital twin candidates from which no simulations have been performed, the values ​​of the utility and cost functions may be determined using, for example, AI / ML techniques.

[0029] The training samples described above may include values ​​for one or more performance metrics, and at least one processor may be configured to generate a cost function and / or utility function based on the values ​​of one or more performance metrics. For example, the performance metric values ​​obtained for a particular digital twin candidate may be compared to the performance metric values ​​obtained for the most accurate digital twin candidate in order to generate a utility function.

[0030] At least one processor may be configured to select a simulation model for each of the multiple elements of the digital twin based on the maximum (acceptable) assessment period, such that the simulation of the digital twin has the maximum assessment accuracy without exceeding the maximum (acceptable) assessment period. This is advantageous when it is sufficient not to exceed the maximum (acceptable) assessment period, but it is not necessary to obtain the shortest assessment period; rather, obtaining the highest assessment accuracy under assessment period constraints is more important. This is a trade-off between assessment period and assessment accuracy.

[0031] Alternatively, at least one processor may be configured to select a simulation model for each of the multiple elements of the digital twin based on the minimum assessment accuracy (required) such that the simulation of the digital twin has the shortest assessment period while meeting the minimum assessment accuracy (required). This is advantageous if meeting the minimum assessment accuracy (required) is sufficient, but does not require achieving the highest assessment accuracy. This is another trade-off between assessment period and assessment accuracy.

[0032] In a second aspect of the present invention, a system for generating utility and cost functions for digital twin candidates of a telecommunications network includes at least one processor configured to assemble a simulation model into different digital twin candidates of the telecommunications network, perform multiple simulations for each of the assembled different digital twin candidates to determine training samples, generate utility functions for one or more performance metrics based on the training samples for the multiple digital twin candidates including the assembled different digital twin candidates, generate cost functions for the multiple digital twin candidates based on the training samples, and store information in memory specifying the cost and utility functions generated for the multiple digital twin candidates.

[0033] In a third aspect of the present invention, a computer-implemented method for performing a simulation on a digital twin of a telecommunications network includes the steps of: determining a minimum assessment accuracy and / or a maximum assessment duration for one or more performance metrics; selecting a simulation model for each of a plurality of elements of the digital twin based on at least one of the minimum assessment accuracy and the maximum assessment duration; assembling the selected simulation models into the digital twin; and performing a simulation on the digital twin. The method may be performed by software running on a programmable device. The software may be provided as a computer program product.

[0034] A fourth aspect of the present invention provides a computer-implemented method for generating utility and cost functions for candidate digital twins of a telecommunications network, comprising the steps of: assembling a simulation model into different candidate digital twins of the telecommunications network; performing a plurality of simulations for each of the assembled different candidate digital twins to determine training samples; generating utility functions for one or more performance metrics based on the training samples for the plurality of digital twins, including the assembled different candidate digital twins; generating cost functions for the plurality of digital twins based on the training samples; and storing information in memory specifying the cost and utility functions generated for the plurality of digital twins. The method may be performed by software running on a programmable device. The software may be provided as a computer program product.

[0035] Furthermore, the Specified provides a computer program for performing the method described herein, and a non-temporary computer-readable storage medium for storing the computer program. The computer program may be downloaded or uploaded to, for example, existing devices, or stored at the time of manufacture of these systems.

[0036] A non-temporary computer-readable storage medium stores at least a first software code portion, which, once executed or processed by a computer, is configured to perform actions that are executable for running a simulation against a digital twin of a telecommunications network.

[0037] The executable operations include the steps of determining a minimum assessment accuracy and / or a maximum assessment period for one or more performance metrics; selecting a simulation model for each of several elements of the digital twin based on at least one of the minimum assessment accuracy and the maximum assessment period; assembling the selected simulation models into the digital twin; and running a simulation on the digital twin.

[0038] A non-temporary computer-readable storage medium stores at least a second software code portion, which, when executed or processed by a computer, is configured to perform executable actions to generate utility and cost functions for candidate digital twins of telecommunications networks.

[0039] The executable operations include the steps of assembling a simulation model into different digital twin candidates of a telecommunication network; performing multiple simulations for each of the assembled different digital twin candidates to determine training samples; generating utility functions for one or more performance metrics based on the training samples for the multiple digital twin candidates, including the assembled different digital twin candidates; generating cost functions for the multiple digital twin candidates based on the training samples; and storing information in memory specifying the cost and utility functions generated for the multiple digital twin candidates.

[0040] As those skilled in the art will understand, aspects of the present invention may be implemented as apparatus, methods, or computer program products. Accordingly, aspects of the present invention may take the form of complete hardware embodiments, complete software embodiments (including firmware, resident software, microcode, etc.), or embodiments combining software and hardware embodiments, all of which may be referred to herein as “circuits,” “modules,” or “systems.” The functions described herein can be implemented as algorithms executed by a computer processor / microprocessor. Furthermore, aspects of the present invention may take the form of computer program products implemented on, for example, one or more stored computer-readable media on which computer-readable program code is implemented.

[0041] Any combination of one or more computer-readable media may be used. The computer-readable media may be computer-readable signal media or computer-readable storage media. The computer-readable storage media may be, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, semiconductor systems, devices, or equipment, or any suitable combination thereof. More specific examples of computer-readable storage media include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In the context of the present invention, the computer-readable storage medium may be any tangible medium capable of containing or storing programs used by, or in conjunction with, an instruction execution system, device, or equipment.

[0042] A computer-readable signal medium may include, for example, a propagating data signal on which computer-readable program code is implemented, as part of a baseband or carrier wave. Such a propagating signal may take any of a variety of forms, including but not limited to electromagnetic, optical, or any suitable combination thereof. The computer-readable signal medium may not be a computer-readable storage medium, but any computer-readable medium on which a program used by or in conjunction with an instruction execution system, device, or instrument can communicate, propagate, or transfer.

[0043] Program code implemented on a computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, cable, RF, or any suitable combination thereof. Computer program code that performs the operation of an aspect of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java®, Smalltalk, and C++, and conventional procedural programming languages ​​such as the C programming language or similar programming languages. The program code may run as a standalone software package, entirely on the user's computer, partially on the user's computer, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or wide area network (WAN), or it may be connected to an external computer (for example, via the Internet using an Internet service provider).

[0044] Multiple aspects of the present invention are described below with reference to flow diagrams and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present invention. It will be understood that each block in the flow diagrams and / or block diagrams, and combinations of blocks in the flow diagrams and / or block diagrams, may be executed by computer program instructions. These computer program instructions can be provided to a processor, particularly a microprocessor or central processing unit (CPU) of a general-purpose computer, a dedicated computer, or another programmable data processing device, to generate a machine such that instructions operating through the processor of the computer, the other programmable data processing device, or the other device generate means to perform the functions / operations specified in the blocks or groups of blocks in the flow diagrams and / or block diagrams that are executed.

[0045] These computer program instructions, which can instruct a computer, other programmable data processing device, or other equipment to function in a particular way, can also be stored on a computer-readable medium, so that the instructions stored on the computer-readable medium constitute a product containing instructions that perform functions / operations specified in blocks or groups of blocks in a flow diagram and / or block diagram.

[0046] Computer program instructions can also be loaded into a computer, another programmable data processing device, or other device to cause the computer, other programmable device, or other device to execute a series of operational steps, thereby generating computer implementation processes such that instructions operating in a computer or other programmable device perform processes that execute functions / operations specified in a flow diagram and / or block diagram block or group of blocks.

[0047] The illustrated flowcharts and block diagrams illustrate the architecture, functionality, and operation of possible implementations of devices, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions that implement a specified logical function.

[0048] Note that in some alternative embodiments, the functions described in a block may occur in a different order than described in the drawing. For example, two consecutively shown blocks may actually be executed almost simultaneously, or blocks may sometimes be executed in reverse order depending on the functions involved. Note that each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, can be implemented by a system based on dedicated hardware that performs a specified function or operation, or by a combination of dedicated hardware and computer instructions.

[0049] The above and other aspects of the present invention will become apparent, and will become even clearer, by reference to the illustrative drawings. [Brief explanation of the drawing]

[0050] [Figure 1] This is a flowchart of the first embodiment of a method for performing a simulation. [Figure 2] This is a flowchart of a second embodiment of how to perform a simulation. [Figure 3] This is a flowchart of a third embodiment of how to perform a simulation. [Figure 4] Figure 3 shows a digital twin assembled using the method described. [Figure 5] This section describes the distinct phases that can be distinguished in relation to the steps of this method. [Figure 6] A flowchart of one embodiment of a method for generating cost and utility functions, and a fourth embodiment of a method for performing a simulation, is shown. [Figure 7]Two examples of the use of the cost and utility functions are shown. [Figure 8] Two examples of the use of the cost and utility functions are shown. [Figure 9] This is a block diagram of an embodiment of the system. [Figure 10] This is a block diagram of an exemplary data processing system that implements the method of the present invention. [Modes for carrying out the invention]

[0051] Identical elements in a drawing are indicated by the same reference number.

[0052] Figure 1 shows a first embodiment of a computer-implemented method for performing simulations on a digital twin of a telecommunications network. Step 101 includes at least one of the following steps: a) determining the minimum assessment accuracy (required) with respect to one or more performance metrics, and b) determining the maximum assessment period (acceptable). Step 103 includes selecting a simulation model for each of several elements of the digital twin based on at least one of the minimum assessment accuracy and maximum assessment period determined in step 101. Step 105 includes assembling the simulation models selected in step 103 into the digital twin.

[0053] Step 107 includes the step of running a simulation on the digital twin assembled in Step 105. The simulation may be run to find, for example, one or more optimal configuration parameter settings. For example, a gradient-based optimization strategy may be used. The simulation model may be a black box in which, for example, specific parameter settings may be set / tuned.

[0054] Steps 101, 103, and 105 are part of the digital twin assembly phase 152, and step 107 is part of the digital twin utilization phase 153. According to one definition of the term “digital twin,” the digital twin is updated based on real-time data. In the context of this specification, this is possible but not required.

[0055] In the embodiment of Figure 1, step 103 is performed by steps 121 and 123. Step 121 includes the step of determining the quantities of multiple elements based on at least one of the minimum assessment accuracy and the maximum assessment period. In the embodiment of Figure 1, the quantities of multiple elements are determined in step 121 by determining the quantity of elements for each element type. Optionally, one or more (but not all, in this embodiment) element types have a fixed quantity of elements. The quantities of elements for each of the other element types are determined (jointly) based on at least one of the minimum assessment accuracy and the maximum assessment period. Step 121 may include, but is not required, the step of summing the quantities of elements for each element type.

[0056] Step 123 includes the step of selecting a simulation model for each of the multiple elements. In the embodiment shown in Figure 1, one simulation model is associated with each element type. As a result, the same simulation model is selected for each element of the same element type. For example, a digital twin of a radio access network may use A) base stations, B) antennas, C) propagation environment, and D) user mobility as element types. If two elements of type A, four elements of type B, one element of type C, and one element of type D are determined in step 121, then eight simulation models are selected in step 123, of which two simulation models of type A and four simulation models of type B are identical.

[0057] Figure 2 shows a second embodiment of a computer-implemented method for performing simulations on a digital twin of a telecommunications network. The method in Figure 2 also includes steps 101, 105, and 107, similar to the method in Figure 1. However, in the embodiment of Figure 2, step 103 is performed by steps 131 and 133, and for at least one of the multiple elements, multiple simulation models of different complexity are associated with the element type of each element.

[0058] Step 131 includes the step of determining the quantities of multiple elements. In the embodiment of Figure 2, the quantities of elements with fixed quantities, i.e., elements that do not depend on the minimum assessment accuracy or the maximum assessment period, are determined for all element types. The quantities of elements may still depend on the selected problem definition, as will be explained with reference to Figure 6. In the modified embodiment of Figure 2, step 131 is omitted.

[0059] Step 133 includes the step of (jointly) selecting simulation models for each element that has an element type associated with multiple simulation models, based on the minimum assessment accuracy and / or the longest assessment period. Step 133 further includes the step of selecting a simulation model for each element that has an element type associated with only one simulation model. If the same simulation model for the same element type has been selected for each element, Step 131 may be performed alternatively after or in parallel with Step 133.

[0060] A third embodiment of a computer-implemented method for performing a simulation on a digital twin of a telecommunications network is shown in Figure 3. The method in Figure 3 also includes steps 101, 105, and 107, similar to the methods in Figures 1 and 2. However, in the embodiment of Figure 3, step 103 is performed by step 121 in Figure 1 and step 133 in Figure 2.

[0061] Figure 4 shows a digital twin assembled using the method in Figure 3. Figure 4 shows four element types 11, 21, 31, and 41. In the example in Figure 4, each element type is associated with three different simulation models having different complexity levels (low, medium, and high). These simulation models are stored in a repository with clearly defined inter-element interfaces that support the adapted assembly of simulation models for the digital twin element types. The digital twin in Figure 4 is just one example; for example, there may be more or fewer than four element types, and / or more or fewer than three complexity levels.

[0062] Element type 11 is associated with low-complexity simulation model 13, medium-complexity simulation model 14, and high-complexity simulation model 15. Element type 21 is associated with low-complexity simulation model 23, medium-complexity simulation model 24, and high-complexity simulation model 25. Element type 31 is associated with low-complexity simulation model 33, medium-complexity simulation model 34, and high-complexity simulation model 35. Element type 41 is associated with low-complexity simulation model 43, medium-complexity simulation model 44, and high-complexity simulation model 45.

[0063] In the example in Figure 4, step 121 in Figure 3 determines two elements 3 and 4 for element type 11, two elements 5 and 6 for element type 21, one element 7 for element type 31, and one element 8 for element type 41. These six elements 3 to 8 are shown as elements of digital twin 1 in Figure 4.

[0064] In the example in Figure 4, step 133 in Figure 3 selects simulation models with different levels of complexity for two elements 3 and 4 of element type 11, namely low-complexity simulation model 13 and medium-complexity simulation model 14, and the same simulation model is selected for two elements 5 and 6 of element type 21, namely low-complexity simulation model 23. Furthermore, low-complexity simulation model 33 is selected for a single element 7 of element type 31, and low-complexity simulation model 43 is selected for a single element 8 of element type 41. These simulation models are shown assembled in the digital twin 1 in Figure 4.

[0065] In the embodiments shown in Figures 1-3, the simulation model is selected based solely on the minimum assessment accuracy and / or the longest assessment period. In an alternative embodiment, as described with respect to Figure 6, the simulation model may be selected based on expertise in the problem at hand. For example, expertise can be used to determine, for each element type, the preferred minimum and / or maximum quantity of elements and / or the preferred minimum and / or maximum complexity of the simulation model. For example, expertise may specify that a high-complexity user mobility model is required and / or at least 57 base stations are required for a given problem.

[0066] Examples of illustrating digital twin elements with varying levels of complexity include the following: • Base stations: On the one hand, fully functional replicas of base stations (presumably provided by equipment vendors) may be used, while on the other hand, base stations may be reduced to only a combination of a few key radio resource management mechanisms. Antennas: When the problem concerns the optimization of beamforming parameters, a detailed model of the deployed antenna array may be required, including the number of antenna elements, sub-array structure, and element-level antenna diagrams, whereas for other problems, it may suffice to reduce the antenna array to a single effective transmit / receive antenna with a properly configured antenna diagram. • Propagation environment: In problems involving beamforming or channel-adaptive packet scheduling, it is important to properly incorporate multipath fading into the propagation model, whereas in other problems, it is sufficient to completely exclude multipath fading and model only path loss, and possibly shadow fading. • User Mobility: When optimizing handover or dynamic beam steering parameters, it may be important to consider a detailed user-level mobility model. In other problems, a macroscopic model of traffic flow between industrial and residential areas may suffice, and in other problems, user mobility can be completely ignored.

[0067] Other examples include user equipment, spatiotemporal traffic characteristics, and various core network functions and interfaces.

[0068] As mentioned with respect to Figure 1, Figure 1 shows the assembly phase 152 and the utilization phase 153 of the digital twin. Figure 5 further shows the preparation phase 151 preceding the assembly phase 152. While the assembly phase 152 and utilization phase 153 are online phases, the preparation phase 151 is typically an offline phase. The preparation phase 151 deals with the development of a simulation model of the element types of the digital twin of the telecommunications network of interest, and probably includes the AI / ML methodology of the measurements and modeling itself that were performed on the telecommunications network. In one embodiment, the preparation phase 151 is also responsible for generating various utility or cost functions (e.g., with respect to assessment accuracy and assessment period), see, for example, Figure 6.

[0069] Because the telecommunications network may continue to change depending on the context, preparation phase 151 may be a continuous process of developing / adjusting the simulation models for each element type. Assembly phase 152 deals with the adapted assembly of the digital twin by selecting the relevant models built in preparation phase 151. In utilization phase 153, the assembled digital twin is used in simulation, for example, to assess the impact of candidate configurations / actions and to apply the selected configurations / actions to the twinned telecommunications network.

[0070] In the embodiments shown in Figures 1-3, the utilization phase 153 includes step 107. Step 107 includes the step of running a simulation on the digital twin assembled in step 105. In a modified embodiment of Figures 1-3, step 107 is performed by step 141, and the utilization phase 153 further includes step 143. This is shown in Figure 5.

[0071] Step 141 includes running a simulation on the digital twin assembled in Step 105 to determine one or more network configuration parameter settings for the communication network. Examples of configuration parameters for the radio access network of a mobile communication network include handover thresholds, scheduling weights, admission control thresholds, congestion control parameters, high-volume MIMO / beamforming parameters, CSI feedback configuration parameters, and slicing parameters. Examples of configuration parameters for the core network of a mobile communication network include slicing parameters, routing policy parameters, QoS management parameters, billing policy parameters, service area limiting parameters, PLMN selection parameters, and paging policy parameters. Step 143 includes configuring the twinned telecommunications network with the one or more network configuration settings determined in Step 141.

[0072] Figure 6 shows one embodiment of a computer-implemented method for generating cost and utility functions, and a fourth embodiment of a computer-implemented method for performing a simulation on a digital twin of a telecommunications network. The method for generating cost and utility functions is performed in preparation phase 151. The method for performing a simulation on a digital twin, including steps 101-107, is performed in assembly phase 152 and utilization phase 153.

[0073] As explained earlier, preparation phase 151 focuses on developing element-type simulation models of the digital twin of the telecommunications network of interest, and likely includes AI / ML methodologies for the measurements and modeling itself performed on the telecommunications network. This may be done using conventional techniques. It is assumed that a repository of element-type simulation models of the digital twin with clearly defined inter-element interfaces supporting assembly is available.

[0074] Preparation Phase 151 includes steps 171, 173, 175, 177, 178, 179, 181, 183, and 187. In the first iteration of step 171, step 171 includes the step of selecting a first problem definition from a plurality of problem definitions. Each of the plurality of problem definitions specifies one or more configuration parameters to be optimized and one or more corresponding performance metrics. One or more performance metrics that need to reach a minimum and / or maximum value may be optionally included in the problem definition (as constraints). Examples of performance metrics include throughput and latency.

[0075] Examples of configuration parameters have been discussed with reference to Figure 5. The problem definition may further specify the geographical and / or technical scope. The problem definition may further specify the (required) minimum assessment accuracy and / or the (acceptable) maximum assessment period, but if not specified, this may be entered separately in assembly phase 152.

[0076] The problem definition may specify, for example, an optimization or evaluation problem. In either case, the simulation is performed to find one or more optimal / optimized configuration parameter settings with respect to a performance metric (typically with specific constraints). The objective of solving the optimization problem is to find one or more optimal / optimized configuration parameter settings. The objective of solving the evaluation problem is to find the values ​​of the performance metric corresponding to these one or more optimized / optimized configuration parameter settings.

[0077] In assembly phase 152, problems may be triggered periodically as part of an automated network optimization loop, or by accidental events such as a base station failure or a network engineer triggering an evaluation of vendor-implemented features on a mobile operator's network. If a problem occurs in assembly phase 152, the corresponding problem definition is selected from multiple problem definitions, for example, from a list of problem definitions.

[0078] Regarding target performance metrics, optimization / evaluation problems with clear specifications should preferably include a clear definition of what requires optimization / evaluation, such as a single KPI (e.g., coverage probability) or multiple KPIs (K X , K Y ) a weighted average, i.e., K=α X K X +β Y K Y , (e.g., 0.8 × probability of decrease + 0.2 × handover ping pong ratio), or a combination of optimized KPI and conditional KPI, i.e.

number

number

[0079] In the first iteration of step 173, step 173 includes the step of selecting a simulation model for each of the multiple elements of the first candidate digital twin. Step 173 may be similar to step 103 in Figures 1-3. Thus, a desired number of elements may be determined in step 173 (e.g., per element type) and / or a simulation model having a desired complexity may be determined in step 173 (e.g., per element or per element type). The desired number of elements may depend on the degree of complexity of the selected simulation models. In the first iteration of step 175, step 175 includes the step of assembling the simulation models of the multiple elements into the first candidate digital twin. Step 175 may be similar to step 105 in Figures 1-3.

[0080] Each (candidate) digital twin is a vector n It can be represented as a vector. n This indicates how many elements of the repository are included in the digital twin for each twin element type and associated complexity level available in the repository (for example, n =#High complexity level BS, #Medium complexity level BS, #Low complexity level BS, #High complexity level antenna, #Medium complexity level antenna, #Low complexity level antenna, etc.). Some of these may be set to 0.

[0081] Step 177 includes the step of performing multiple simulations on the digital twin candidate assembled in Step 175 to determine the training samples. Given the problem and n In this scenario, iterative simulations are performed with various settings for one or more configuration parameters (e.g., the range of the slope setting). The training samples typically contain values ​​for one or more performance metrics. n Regarding this, step 177 may include the following two substages: • Determine one or more configuration parameter settings (e.g., the range of slope settings to evaluate a specific problem). Using expertise, one or more configuration parameter settings can be selected, i.e., candidate configurations can be selected. This substage may include the selection of initial settings. • Given n Then, we perform actual simulations for the candidate configurations. n Different trials are performed for each. Each trial includes multiple iterations. (Pseudo)random values ​​may be used in the simulation. For this reason, in order to achieve the statistical accuracy required for the performance metrics, it is preferable to perform a sufficient number of independent replications using different disordered genera as part of each iteration. Different sets of replication may be performed for one or more load levels / scenarios. One or more trials are performed starting from one or more different initial configurations. In each trial, the optimization algorithm iterations are performed until the stopping criteria for the optimization algorithm are met. After the iterations with the initial configurations, and after each subsequent iteration, the optimization algorithm determines the next configuration to try. After the stopping criteria for the optimization algorithm are met, the total time required to determine the optimized configuration (the number of simulations / iterations multiplied by the average time per simulation / iteration), and the corresponding estimates of the performance metrics (considered statistically reliable) are given. n It is saved / output in association with. If multiple trials are performed starting from multiple different initial configurations, the average total time per trial is given n It may be saved / output in association with the following. The individual outputs of this substage can be used as training samples (e.g., [Problem, n It may be used as follows: [KPI name] -> [KPI value, total time]. If the optimized configuration is at the edge of the range of candidate configurations, the range can be adjusted to target candidate configurations beyond that edge. In this case, the first and second substages may be iterated over to select other candidate / initial configurations in the first substage. An example of an optimization algorithm that can be used is gradient-based optimization in multidimensional space. Individual simulation models for each element type are usually black boxes.

[0082] Step 178 includes a step to determine whether it is necessary to run simulations on further digital twin candidates, i.e., whether simulations have been run on a sufficient number of digital twin candidates. The set of digital twin candidates selected in step 173 is preferably narrowed down using expertise. In this case, step 178 includes a step to determine whether a sufficient number of digital twin candidates have been selected from that set to generate appropriate cost and utility functions with reasonable effort.

[0083] If it is necessary to run simulations on further digital twin candidates, step 173 is repeated, and the method proceeds as shown in Figure 6. In the next iteration of step 173, step 173 includes the step of selecting a simulation model for each of the multiple elements of the next digital twin candidate. In the next iteration of step 175, step 175 includes the step of assembling the simulation models of the multiple elements for the next digital twin candidate.

[0084] Steps 179 and 181 are performed after step 178. Step 179 includes generating utility functions for one or more performance metrics for a plurality of digital twin candidates, based on the training samples determined in step 177. The plurality of digital twin candidates include each digital twin candidate assembled in step 175. The utility functions reflect the estimated accuracy for one or more performance metrics. Step 181 includes generating cost functions for a plurality of digital twin candidates, based on the training samples determined in step 177. The cost functions reflect the experienced and optionally estimated assessment efforts. Steps 179 and 181 may include, for example, the use of machine learning techniques to estimate the assessment period and accuracy for twin candidates for which training samples have not been taken. In an alternative embodiment, only utility functions or only cost functions are generated.

[0085] Typically, the utility function is determined based on the values ​​of one or more performance metrics included in the training sample. For example, the utility function is generated by first determining the digital twin candidate using the full-swing digital twin, which yields the most accurate performance results. The full-swing digital twin considers the most complex available simulation model for each element type, and considers the entire network or a subset thereof that yields the same assessment accuracy. The utility function may be determined by normalization such that the function result is 1 for that digital twin candidate and between 0 and 1 for other digital twin candidates. The resulting value of the utility function for a particular digital twin candidate reflects the utility of that digital twin candidate relative to the digital twin candidate with the highest utility (i.e., result value of 1).

[0086] The cost function can be generated, for example, by determining the average or maximum total time required to determine the optimal configuration for each digital twin candidate (e.g., the average or maximum number of iterations of the optimization algorithm using different initial configurations), or by determining the average or maximum number of simulations / iterations required to determine the optimized configuration for each digital twin candidate and multiplying that average or maximum number of simulations / iterations by the computation time required to run one simulation / iteration (e.g., in seconds).

[0087] For each configuration considered, sufficient replication using different random number seeds is preferably performed to obtain sufficient statistical reliability of the obtained performance results. Therefore, each iteration may include one or more replications. Examples of utility and cost functions are shown in Figures 7 and 8. Step 183 includes storing in memory information specifying the cost and utility functions generated for the problem definition selected in step 171.

[0088] Step 187 includes a step to determine whether cost and utility functions should be generated for further problem definitions. If steps 173-183 have been performed for all multiple problem definitions, then preparation phase 151 is complete (although it may not be repeated later). If steps 173-183 have not been performed for all multiple problem definitions, then step 171 is repeated, and the method proceeds as shown in Figure 6. In the next iteration of step 171, step 171 includes a step to select the next problem definition from the multiple problem definitions.

[0089] Machine learning can be used to determine the resulting cost and utility functions for digital twin candidates for which simulations have not yet been performed. It is also possible to learn the cost and utility functions for another problem using training samples obtained from one problem. In that case, steps 179, 181, and 183 may be performed after step 187, rather than before. In either case, the cost and utility functions are generated for each problem from multiple sources, such as a list of potential problems.

[0090] As described above, assembly phase 152 deals with the adapted assembly of the digital twin by selecting the relevant models constructed in preparation phase 151. In the embodiment shown in Figure 6, relevant utility and cost functions are selected in assembly phase 152 to determine the digital twin in the event of a problem.

[0091] Assembly phase 152 includes steps 191, 193, 195, 101, 103, and 105. Step 191 includes the step of selecting one problem definition from several problem definitions. In assembly phase 152, the selected problem definition must address a problem that has occurred in an operational telecommunications network. Therefore, if the problem definition is not selected entirely automatically by the system but is selected based on user input, the user should not select a problem definition that does not address a problem that has occurred. The operational telecommunications network may be, for example, a test network or a commercial network. Step 193 includes the step of reading the cost and utility functions generated in relation to the problem definition selected in step 191 from memory.

[0092] Step 101 includes the steps of determining the (required) minimum assessment accuracy and / or the (acceptable) maximum assessment period for one or more performance metrics specified in the selected problem definition. In the embodiment of Figure 6, the minimum assessment accuracy and / or maximum assessment period are determined separately in step 101 and are not specified in the problem definition. In an alternative embodiment, the problem definition includes the (required) minimum assessment accuracy and / or the (acceptable) maximum assessment period.

[0093] Step 103 is performed after steps 193 and 101 have been performed. Step 103 is performed by step 195. Step 195 includes the step of selecting a simulation model for each of the multiple elements of the digital twin by performing at least one of the following steps: a) applying a utility function corresponding to the problem definition read in step 193 to the minimum assessment precision determined in step 101, and b) applying a cost function corresponding to the problem definition read in step 193 to the maximum assessment period determined in step 101. Step 195 can be considered as the step of selecting a digital twin from a plurality of digital twin candidates based on at least one of the minimum assessment precision and the maximum assessment period, and further based on the selected problem definition.

[0094] The digital twin candidates may differ from one another by having different quantities of elements and / or simulation models of different complexity, as described with respect to Figures 1-3. Step 195 may include a first substep for selecting a subset of multiple digital twin candidates and a second substep for selecting a digital twin from the subset. The subset may be selected, for example, based on expertise. For example, in the case of a gradient optimization problem, only the low-complexity BS may be considered. Information that facilitates the selection of the subset (and information representing expertise) may be included, for example, in the problem definition.

[0095] Multiple digital twin candidates may include all possible digital twin candidates, and may even be infinite. In this case, multiple digital twin candidates may include digital twin candidates from which training samples were not obtained in step 177, but whose utility and cost values ​​can be derived / learned from the utility and cost values ​​determined for other digital twin candidates. Alternatively, multiple digital twin candidates may include only digital twin candidates from which training samples were obtained in step 177.

[0096] As mentioned above, selecting the optimal degree of complexity and / or the optimal number of elements for each element type is crucial for structuring the digital twin, and this selection can be made based on the minimum assessment accuracy and / or the maximum assessment period.

[0097] The actual assessment period typically depends on the available computing resources. Higher complexity requires more computing resources, such as processing power or memory resources; therefore, the availability of such resources can also affect the feasibility of solving a given optimization problem within a given time limit and for a given complexity of the twin. Consequently, the acceptable complexity may be constrained by the constraints of computing resources. It may be assumed that the utilization phase 153 is performed using the same computing resources as the preparation phase 151, and therefore can be used without adjusting the cost function, or that a way of converting time to actual computing resources is known.

[0098] The longest (acceptable) assessment period typically depends on the urgency of the optimization problem. For example, if one site fails and surrounding sites need to reconfigure antenna tilt or power settings, a near-optimal solution may suffice, as long as an optimal solution can be found quickly (fast but crudely), thus reducing the complexity of the twins. Alternatively, a process that periodically updates antenna tilt and power settings in response to spatiotemporal changes in the traffic load being provided does not require an urgent solution, and a more complex twin can be used to achieve a (near-optimal) solution.

[0099] A trade-off may be necessary between the number of elements selected for each element type and the complexity of the elements selected for each element type. This trade-off usually depends on the optimization problem and may be performed with the support of expertise. Some optimization problems are inherently geographically local in nature, such as the cell-specific configuration of packet scheduling parameters. As a result, twin-based experiments to derive the optimal parameter settings can be performed on a single-cell scenario, allowing for the use of a detailed twin within a reasonable timeframe. Alternatively, the antenna tilt optimization problem described above requires an inherently broader (regional) range because the tilt setting affects inter-cell interference and jointly determines coverage. Consequently, the complexity of the twin should be lower than in the previous (local) optimization example, so that antenna-specific tilt settings can be broadly evaluated within a reasonable timeframe.

[0100] Besides geographical limitations, the technical / network scope can also be limited, for example, to include only a RAN or a more sophisticated RAN / CN scope, or to characterize the problem to include only a limited set of protocol layers. Similar to the limited geographic scope, here too, the scope can affect the modeling scope and, consequently, the degree of twin detail required.

[0101] Step 105 includes the step of assembling the simulation model selected in step 103 (for example, for the number of elements and / or complexity determined in step 103), i.e., the simulation model associated with the digital twin selected from the multiple digital twin candidates, to obtain a digital twin. In the embodiment of Figure 6, the digital twin candidate assembled in step 175 is not stored in memory. In an alternative embodiment, if the digital twin selected from the multiple digital twin candidates has already been assembled and stored in memory, for example in step 175, the selected digital twin may be retrieved from memory.

[0102] Next, the adapted digital twin assembled in assembly phase 152 is applied in utilization phase 153 to a set of problem-specific simulations to derive one or more optimal / optimized configuration parameter settings (e.g., slope settings) that may be successively applied to an operational telecommunications network, such as a test telecommunications network or a commercial telecommunications network.

[0103] Utilization phase 153 includes steps 197 and 107. Step 197 includes the step of selecting one or more configuration parameters specified in the problem definition selected in step 191. Step 107 runs a simulation on the digital twin assembled in step 105 using different settings of the one or more configuration parameters selected in step 197, starting from, for example, the current active network configuration, or, if this is unavailable, from, for example, default parameter settings, vendor recommended parameter settings, parameter settings within a range, or arbitrary parameter settings.

[0104] The simulation performed in step 107 is similar to the simulation performed in step 177, but is performed on only one problem and one assembled digital twin, i.e., a selected digital twin candidate. If the (acceptable) maximum period allows, the simulation can be performed with multiple initial settings. For example, new initial settings can be proposed based on insights gained from a given set of simulations with one or more initial settings. The optimization algorithm and stopping criteria used in step 177 may also be used in step 107. As mentioned above, one example of an optimization algorithm that can be used is gradient-based optimization in multidimensional space. Optionally, as described with respect to Figure 5, step 107 is performed by step 141, followed by step 143.

[0105] Figures 7 and 8 show two exemplary use cases of cost and utility functions. While there may be situations where only a cost function or only a utility function is needed, typically, selecting a digital twin from multiple candidates involves a trade-off between the accuracy of the result and the assessment effort (i.e., the time required to determine the optimal / optimized configuration). As discussed with respect to Figure 6, based on (e.g., periodic) offline experiments using separate digital twin candidates, the relevant utility or cost functions (e.g., related to estimated assessment accuracy and estimated assessment effort / time) may be generated, for example, by machine learning.

[0106] In FIGS. 7 and 8, utility function U P ( n )61 and cost function C P ( n )62 are shown. Utility function U P ( n )61 is also called the accuracy function and represents, for each option of each twin, the relative proximity of the performance achieved for a particular problem P to the full - swing (the most realistic, closest to the real - world object, and assumed to be ground - truth) model of the twin. Thus, this curve 61 converges to "1" as the twin option under consideration becomes as complex as the full - swing twin. In fact, depending on the problem being addressed, it may reach the "1" level for twin candidates that are less complex than the full - swing model. The full - swing digital twin 73 considers, for each element type, the most complex available element model with a sufficient number of elements. Ideally, the full - swing digital twin 73 should consider the entire network. However, in practice, a subset of the entire network may be sufficient.

[0107] Cost function C P ( n )62 is also called the assessment effort function and represents the assessment effort (e.g., in seconds) required to determine the optimal / optimized configuration parameter settings for the digital twin n . Cost function C P ( n )62 may be the product of E P ( n ) and T P ( n ). E P ( n ) is the expected number of configurations that need to be simulated to determine the optimal configuration parameter settings (e.g., the number of gradient vectors that need to be simulated as part of the optimization algorithm to determine the optimal / optimized configuration parameter settings, i.e., the number of iterations, and this number typically increases with the number of BSs included in the twin). T P ( n ) is nThis is the computation time required to accurately simulate a single configuration of the given digital twin, i.e., the computation time for a single iteration (absolute value, e.g., in seconds).

[0108] As mentioned above, function U P ( n ), E P ( n ), T P ( n ) depends on the problem (P). E P ( n Varying ) in accordance with the problem can lead to a good estimate of the expected number of simulations required, as it is not averaged out over all potential problems (e.g., the number of possible slope settings is different from the number of possible scheduling parameter settings, so optimization will require a different number of simulations / iterations). For a specific problem, U P ( n ) can be obtained by observing or estimating (e.g., interpolation or using an AI / ML model) one or more realized (potentially complex) performance metrics, T P ( n This can be obtained by calculating the required simulation time for the target (potentially complex) KPIs.

[0109] If periodic or event-driven issues trigger the use of digital twins, the optimal twin option may be selected based on the (required) minimum assessment accuracy and the (acceptable) maximum assessment period. Different trade-offs can be made between the accuracy of the results and the assessment effort to find the optimal digital twin. For example, the following options are possible: I C P ( n )≦C MAX According to U P ( n Maximize ) or II.U P ( n )≧U MIN According to C P ( n Minimize ).

[0110] As explained with respect to step 195 in Figure 6, a subset of multiple digital twin candidates may be selected first based on expertise, and then a digital twin may be selected from that subset. This subset may be selected, for example, based on expertise related to the problem. For example, in the case of a gradient optimization problem, only low-complexity BSs may be considered. This expertise may be the same as, or (partially) different from, the expertise used in preparation phase 151. For example, the expertise used in preparation phase 151 may include knowledge of machine learning in addition to knowledge of the problem.

[0111] Figure 7 shows optional option II. Figure 7 shows the minimum assessment accuracy U represented by line 66. MIN This demonstrates that, while satisfying the conditions, a simulation model is selected for each of the multiple elements of the digital twin based on the minimum required assessment accuracy so that the simulation of the digital twin is performed in the shortest possible assessment period. As explained above, the quantities of the multiple elements may be selected as part of the selection of the simulation model for each of the multiple elements and may not be given a priori.

[0112] Under the conditions described above, the digital twin candidate with the shortest assessment period is digital twin candidate 71, and is therefore selected. The highest assessment accuracy (i.e., 1) is represented by line 65. Full-swing digital twin candidate 73 has the highest assessment accuracy. Curve 61 increases relatively quickly, and the assessment accuracy of a relatively large number of digital twin candidates is 1 or close to 1. The assessment accuracy of digital twin candidate 72 is approximately the same as that of full-swing digital twin candidate 73. Full-swing digital twin candidate 73 and digital twin candidate 72 have at least the lowest assessment accuracy U MIN It has the ability to provide the shortest possible assessment time, but does not have the shortest possible assessment time. Digital twin candidate 70 is U P ( n ) is U MIN Since it does not meet the above conditions, it does not satisfy the requirements.

[0113] Figure 8 shows optional option I. Figure 8 shows the simulation for the digital twin, with the longest assessment period C represented by line 67. MAX This indicates that a simulation model is selected for each of the multiple elements of the digital twin based on the longest allowable assessment period, so as to have the maximum assessment accuracy without exceeding a certain limit. As explained above, the quantities of the multiple elements may be selected as part of the selection of the simulation model for each of the multiple elements and may not be given a priori.

[0114] Under the above conditions, the digital twin candidate with the highest assessment accuracy is digital twin candidate 72, and is therefore selected. C P ( n ) exceeds the maximum assessment period for full-swing digital twin candidate 73, therefore full-swing digital twin candidate 73 does not meet the condition. Digital twin candidates 70 and 71 meet the condition, i.e., C P ( n ) is C MAX It does not exceed [a certain threshold], but it does not possess the maximum possible assessment accuracy.

[0115] In the examples in Figures 7 and 8, only four digital twin candidates, 70-73, are considered, but curves 61 and 62 represent more than these four digital twin candidates. The fact that digital twin candidates 70-73 are considered does not necessarily mean that training samples for all of these digital twin candidates were obtained in the preparation phase. Any other options besides options I and II are also possible. Minimizing the assessment period or maximizing assessment accuracy is not required.

[0116] Figure 9 is a block diagram of one embodiment of a system for performing simulations on a digital twin of a communication network, and one embodiment of a system for generating utility and cost functions for candidate digital twins of a communication network. The system for generating utility and cost functions includes at least device 211, and may further include, for example, device 201. The system for performing simulations on a digital twin of a telecommunications network includes at least device 201, and may further include, for example, device 211. System 210 includes both device 201 and device 211. In the example of Figure 9, the telecommunications network is a mobile communication network 200. The mobile communication network 200 includes, in particular, a radio access network (RAN) 231 and a core network (CN) 221.

[0117] RAN231 includes base stations 233 and 234. The mobile communication network 200 may be a 5G network, RAN231 may be a new 5G radio RAN, and base stations 233 and 234 may be, for example, 5GgNodeB base stations. Each of base stations 233 and 234 may include multiple distributed units that share a common centralized unit in a centralized RAN (C-RAN) architecture. CN221 includes core network elements 223, 224, and 225.

[0118] Device 201 is used online to manage RAN231 and CN221 and may be part of the management network of the mobile communication network 200. Device 211 is used offline to generate utility and cost functions. In the example in Figure 9, mobile devices 241 and 242 are connected to base station 233, and mobile devices 243, 244 and 245 are connected to base station 234.

[0119] The device 211 includes a receiver 213, a transmitter 214, a processor 215, and a memory 217. The processor 215 is configured to assemble simulation models of multiple elements into different digital twin candidates of a telecommunication network, perform multiple simulations for each of the assembled different digital twin candidates to determine training samples, generate utility functions for one or more performance metrics based on the training samples for the multiple digital twin candidates, including the assembled different digital twin candidates, generate cost functions based on the training samples for the multiple digital twin candidates, and store information specifying the generated cost and utility functions for the multiple digital twin candidates in memory.

[0120] The device 201 includes a receiver 203, a transmitter 204, a processor 205, and a memory 207. The processor 205 is configured to determine the minimum assessment accuracy and / or the maximum assessment duration for one or more performance metrics, to select a simulation model for each of the multiple elements of the digital twin based on at least one of the minimum assessment accuracy and the maximum assessment duration, to assemble the selected simulation models into the digital twin, and to run a simulation against the digital twin.

[0121] If the digital twin is of RAN231, base stations 233, 234 and other base stations can be represented as elements of the digital twin. The antennas of base stations 233, 234 and other base stations can also be represented as elements of the digital twin. User mobility and propagation environment can also be represented as elements of the digital twin. If the digital twin is of mobile communication network 200, core network elements 223-224 can also be represented as elements of the digital twin.

[0122] The processor 205 may be configured to select a simulation model for each of the elements of the digital twin based on at least one of the minimum assessment accuracy and the maximum assessment period, by determining the quantity of the elements based on at least one of the minimum assessment accuracy and the maximum assessment period and selecting a simulation model for each of the elements.

[0123] If, additionally or alternatively, one or more element types are associated with multiple simulation models of varying degrees of complexity, the processor 205 may be configured to select a simulation model for each of the multiple elements of the digital twin based on at least one of the minimum assessment accuracy and the maximum assessment period, by jointly selecting a simulation model for each element of one or more element types from the multiple simulation models associated with the corresponding element type, based on at least one of the minimum assessment accuracy and the maximum assessment period.

[0124] In the embodiment shown in Figure 9, the processor 205 is configured to select a simulation model for each of the multiple elements of the digital twin by applying the utility function generated by the instrument 211 to the lowest assessment accuracy and / or by applying the cost function generated by the instrument 211 to the longest assessment period. In an alternative embodiment, the processor 205 is configured to select a simulation model for each of the multiple elements of the digital twin in a different manner.

[0125] In the embodiment shown in Figure 9, devices 201 and 211 are separate devices. In an alternative embodiment, a single device performs the functions performed by devices 201 and 211. In another embodiment, the functions performed by device 201 are performed by multiple devices, and / or the functions performed by device 211 are performed by multiple devices.

[0126] In the embodiment shown in Figure 9, devices 201 and 211 include one processor 205 or 215. In an alternative embodiment, devices 201 and / or 211 include multiple processors. The processors may be general-purpose processors such as Intel or AMD processors, or application-specific processors. The processors may include, for example, multiple cores. The processors may run, for example, a Unix-like or Windows operating system. Memory 205 and / or memory 215 may consist of solid memory, such as one or more solid disks (SSDs) made of flash memory, or one or more hard disks.

[0127] Receivers 203, 213 and transmitters 204, 214 can communicate with each other and with other devices, for example, within a RAN or CN, using one or more communication technologies (wired or wireless). The receivers and transmitters may be combined into a transceiver. Devices 201, 211 may include other elements typical of a computer server or network unit, such as a power supply.

[0128] In a typical example, the exemplary optimization problem requires the assembly of a digital network twin containing a combination of high and low complexity elements. In this example, it is necessary to periodically optimize the downward tilt of the antenna in response to spatiotemporal changes in the traffic load being provided.

[0129] In this typical example, the purpose of adjusting the antenna's downward tilt is to optimize the quality of service provided for a given load scenario under conditions that guarantee a minimum level of coverage (e.g., 99.5%). It is easy to understand that not only the absolute load level but also the spatial distribution of traffic affects the optimal tilt setting. For example, if all users are located near the base station site, the optimal downward tilt is likely to be greater than if users are spread evenly across the area or if the distribution is biased towards the cell edges. Since users tend to move over time (e.g., between working hours and off-hours) and communication needs also change over time (e.g., work-related emails during the day versus HD video streaming at night), it is reasonable that the optimal antenna tilt setting may also change over time.

[0130] The problem definition specifies, for example, a geographical area including 100 base stations, a sector-specific downward antenna tilt as a configuration parameter, and a composite KPI that optimizes quality of service (e.g., throughput rate for the 10th user) under the condition that the coverage level exceeds, for example, 99.5%, as formulated above. Furthermore, the urgency is marked as low and quantified as a maximum assessment time of up to several tens of minutes. This maximum assessment time may be included in the problem definition or specified separately. The latter is advantageous when the (remaining) problem definition is immutable while the maximum assessment time may change.

[0131] In this example, the digital twin required to adequately model the network in the optimization problem includes at least simulation models of the deployed base station antennas, propagation environment, and spatial traffic distribution. For each base station antenna, a fairly accurate (high complexity) simulation model is needed that realistically captures the antenna height, azimuth angle, 3D radiation pattern, and transmit power, because all of these factors have a significant impact on coverage, the experienced SINR, and therefore the quality of service. In particular, it would suffice if a large-scale characterization of the propagation environment, including distance-dependent path loss, indoor penetration loss, and log-normal attenuation factors, were included in a correspondingly selected (low complexity) simulation model.

[0132] In this example, small-scale propagation factors such as multipath fading can be excluded because associated small fluctuations are typically addressed not by adjusting antenna tilt settings, but by adaptive modulation and coding, transmit power control, and channel-adaptive packet scheduling. Finally, an estimate of the spatial traffic distribution valid for future periods is used. Since user-specific level details are not required (macroscopic accuracy up to the 40x40m pixel level is typically preferred) and user mobility can be ignored, a simulation model of moderate complexity is considered sufficient for the spatial traffic distribution. Note that in this assembled digital twin, various factors that may be relevant to other optimization studies, such as detailed modeling of various RRM mechanisms including packet scheduling, handover management, and permit / congestion control, are consciously excluded.

[0133] The simulation takes into account multiple sets of antenna inclinations. To find the optimal downward antenna inclination, an initial set is selected based on the current effective configuration, and then subsequent sets are intelligently selected based on an optimization strategy, for example, gradient-based. All tuples are evaluated for the selected digital twin. With composite KPIs in mind, the optimization strategy tracks the best inclination set assessed so far, and when the approach has sufficiently converged, it is selected as the optimal solution and applied to the operational communication network.

[0134] As described above, the simulation model may be selected at the element type level or at the element level. For explanatory purposes, the following three simulation models with different levels of complexity can be identified for element type propagation environments. • Low-complexity simulation models of propagation environments, as outlined above, may include only large-scale factors such as distance-based path loss, indoor intrusion loss, and log-normal attenuation. This model is suitable for periodic optimization of antenna downward tilt. A slightly more complex (moderately complex) simulation model may further include a small factor of multipath fading, modeled as a relatively simple time / frequency domain variation of propagation gain centered around a large average value. This model can be used to optimize the configuration of a packet scheduler. • High-complexity simulation models of propagation environments include all of the above factors and further involve characterizing small-scale propagation factors for each transmit / receive antenna pair or path, which may be necessary when optimizing physical layer algorithms, SU / MU-MIMO beamforming strategies, and corresponding multi-user packet (co-) scheduling algorithms.

[0135] Figure 10 is a block diagram illustrating an exemplary data processing system capable of performing the methods described with reference to Figures 1-3 and 5-6.

[0136] As shown in Figure 10, the data processing system 300 may include at least one processor 302 coupled to the memory element 304 via a system bus 306. Thus, the data processing system may store program code in the memory element 304. Furthermore, the processor 302 may execute program code accessed from the memory element 304 via the system bus 306. In one embodiment, the data processing system may be implemented as a computer suitable for storing and / or executing program code. However, it should be understood that the data processing system 300 may be implemented in the form of any system including a processor and memory capable of executing the functions described herein.

[0137] The memory element 304 may include, for example, one or more physical memory devices such as a local memory 308 and one or more mass storage devices 310. Local memory may refer to random access memory or other non-persistent memory devices commonly used during the actual execution of program code. Mass storage devices can be implemented as hard drives or other persistent data storage devices. The processing system 300 may also include one or more cache memories (not shown) that temporarily store at least a portion of the program code in order to reduce the number of times the program code is retrieved from the mass storage device 310 during execution.

[0138] The input / output (I / O) devices depicted as input device 312 and output device 314 can be optionally connected to the data processing system. Examples of input devices include, but are not limited to, keyboards, pointing devices such as mice, etc. Examples of output devices include, but are not limited to, monitors or displays, speakers, etc. The input and / or output devices may be connected to the data processing system directly or via an intermediary I / O controller.

[0139] In one embodiment, the input and output devices may be implemented as a combined input / output device (shown in Figure 10 by dashed lines enclosing the input device 312 and the output device 314). An example of such a combined device is a touch-sensitive display, also called a "touchscreen display" or simply a "touchscreen." In such an embodiment, input to the device is provided, for example, by the movement of a physical object such as a stylus or the user's finger on or near the touchscreen display.

[0140] The network adapter 316 may also be coupled to the data processing system to enable coupling to other systems, computer systems, remote network devices, and / or remote storage devices via an intervening private or public network. The network adapter may include a data receiver that receives data transmitted from the systems, devices, and / or networks to the data processing system 300, and a data transmitter that transmits data from the data processing system 300 to the systems, devices, and / or networks. Modems, cable modems, and Ethernet cards are examples of different types of network adapters that may be used with the data processing system 300.

[0141] As shown in Figure 10, the memory element 304 can store the application 318. In various embodiments, the application 318 may be stored in local memory 308, one or more mass storage devices 310, or separately from local memory and mass storage devices. It should be understood that the data processing system 300 may further run an operating system (not shown in Figure 10) that can facilitate the execution of the application 318. The application 318, implemented in the form of executable program code, may be executed by the data processing system 300, for example, a processor 302. In response to the execution of the application, the data processing system 300 may be configured to perform one or more operation or method steps described herein.

[0142] Various embodiments of the present invention may be implemented as program products for use in computer systems, and the program of the program product defines the functions of the embodiments (including the methods described herein). In one embodiment, the program may be contained in various non-temporary computer-readable storage media, and as used herein, “non-temporary computer-readable storage media” includes all computer-readable media, with the sole exception being temporary propagating signals. In another embodiment, the program may be contained in various temporary computer-readable storage media. Exemplary computer-readable storage media include, but are not limited to, (i) non-writable storage media on which information is permanently stored (e.g., read-only memory devices in a computer, such as CD-ROM disks, ROM chips, or any type of solid non-volatile semiconductor memory, readable by a CD-ROM drive), and (ii) writable storage media on which modifiable information is stored (e.g., flash memory, floppy disks or hard disk drives in a diskette drive, or any type of solid random-access semiconductor memory). The computer program is operable on the processor 302 described herein.

[0143] The terms used herein are intended solely to describe specific embodiments and are not intended to limit the invention. The singular forms “a,” “an,” and “the” as used herein are intended to include the plural form unless otherwise evident from the context. Furthermore, the terms “including” and / or “containing,” as used herein, specify the presence of the feature, integer, step, operation, element, and / or element being referred to, but should not be understood to exclude the presence or addition of one or more other features, integers, steps, operations, elements, elements, and / or groups thereof.

[0144] In addition to all means or steps in the following claims, the corresponding structures, materials, actions, and equivalents of functional elements are intended to include any structures, materials, or actions that perform a function in combination with elements described in other claims, as specifically described in the claims. The descriptions of embodiments of the present invention are presented for illustrative purposes only and are not intended to be exhaustive or to limit the implementation to the forms disclosed. Many modifications and variations will be apparent to those skilled in the art without departing the scope of the invention. The embodiments are selected and described in order to best illustrate the principles of the invention and several practical applications, and to make the invention understandable to others skilled in the art through various embodiments with various modifications to suit a particular intended use.

Claims

1. A system (201, 210) that performs a simulation on a digital twin (1) of a telecommunications network (200), wherein at least one processor (205, 215) provided in the system (201, 210) - Determine the minimum assessment accuracy (66) of the simulation with respect to one or more performance indicators that are indicators of the network performance of the telecommunications network (200), and / or determine the maximum assessment period (67) required to run the simulation. - Based on at least one of the minimum assessment accuracy and the maximum assessment period, a simulation model (13-15, 23-25, 33-35, 43-45) is selected for each of the multiple elements (3-8) of the digital twin (1). - Assemble the selected simulation model into the digital twin (1), - Perform the simulation on the digital twin (1) A system configured in such a way.

2. The system (201, 210) according to claim 1, wherein the at least one processor (205, 215) is configured to select the simulation models (13-15, 23-25, 33-35, 43-45) for each of the multiple elements (3-8) of the digital twin (1) based on at least one of the minimum assessment accuracy and the maximum assessment period, by determining the quantity of the multiple elements and selecting a simulation model for each of the multiple elements (3-8).

3. The system (201, 210) according to claim 1, wherein for at least one of the plurality of elements, the element type (11, 21, 31, 41) of each element is associated with a plurality of simulation models (13-15, 23-25, 33-35, 43-45) of different degrees of complexity, and the system is configured to select a simulation model for each of the plurality of elements (3-8) of the digital twin (1) based on at least one of the minimum assessment accuracy and the maximum assessment period by selecting at least one simulation model for the at least one of the plurality of simulation models (13-15, 23-25, 33-35, 43-45) of the at least one element (3-8).

4. In the system (201, 210) according to claim 1, the at least one processor (205, 215) is - A simulation is performed on the digital twin (1) to determine one or more network configuration settings of the remote communication network (200), - The remote communication network (200) is configured with one or more network configuration settings. A system configured in such a way.

5. In the system (201, 210) according to claim 1, the at least one processor (205, 215) is - Select one problem definition from multiple problem definitions, each specifying one or more configuration parameters to be optimized and one or more corresponding performance metrics. - Based on the selected problem definition, a simulation model is selected for each of the multiple elements (3 to 8) of the digital twin (1), - Select one or more configuration parameters for the simulation from the selected problem definition. A system configured in such a way.

6. The system according to claim 5, wherein the selected problem definition includes the minimum assessment accuracy and / or the maximum assessment period.

7. In the system (201, 210) according to claim 1, the at least one processor (205, 215) is - Assemble multiple simulation models into different digital twin candidates (70-73), - Multiple simulations are performed for each of the assembled different digital twin candidates (70-73) to determine the training samples. - For a plurality of digital twin candidates (71-73) including the assembled different digital twin candidates, a utility function (61) relating to one or more performance metrics is generated based on the training samples. - For the multiple digital twin candidates (70-73), a cost function (62) is generated based on the training samples. - The simulation model is selected for each of the plurality of elements of the digital twin (1) by applying the utility function (61) to the minimum assessment accuracy (66) and / or the cost function (62) to the maximum assessment period (67). A system configured in such a way.

8. A system (201, 210) according to claim 7, wherein the training sample includes the values ​​of one or more performance metrics, and the at least one processor (205, 215) is configured to generate the cost function (62) and / or the utility function (61) based on the values ​​of one or more performance metrics.

9. A system (201, 210) according to claim 1, wherein the at least one processor (205, 215) is configured to select the simulation model for each of the plurality of elements (3 to 8) by further selecting one digital twin candidate from a plurality of digital twin candidates (71 to 73) based on expertise, on at least one of the minimum assessment accuracy (66) and the maximum assessment period (67).

10. A system (201, 210) according to any one of claims 1 to 9, wherein the at least one processor (205, 215) is configured to select the simulation model for each of the plurality of elements (3-8) of the digital twin (1) based on the maximum assessment period (67) such that the simulation for the digital twin (1) yields the highest possible assessment accuracy without exceeding the maximum assessment period (67).

11. A system (201, 210) according to any one of claims 1 to 9, wherein the at least one processor (205, 215) is configured to select the simulation model for each of the multiple elements of the digital twin (1) based on the minimum assessment accuracy (66) such that the simulation for the digital twin (1) satisfies the minimum assessment accuracy (66) and yields the shortest assessment period.

12. The system (201, 210) according to Claim 1, wherein the system (201, 210) is a system (210, 211) that generates utility and cost functions (61, 62) of a candidate digital twin of a telecommunications network, and the at least one processor (205, 215) provided in the system (210, 211) is - Assemble the above-mentioned multiple simulation models (13-15, 23-25, 33-35, 43-45) into different digital twin candidates (70-73) of the telecommunication network (200), - Multiple simulations are performed for each of the assembled different digital twin candidates (70-73) to determine the training samples. - For a plurality of digital twin candidates (70-73) including the assembled different digital twin candidates, a utility function (61) for one or more performance metrics is generated based on the training samples. - For the multiple digital twin candidates (70-73), a cost function (62) is generated based on the training samples. - Information specifying the cost and utility functions (61, 62) generated for the plurality of digital twin candidates (70-73) is stored in memory (207, 217). A system configured in such a way.

13. A computer-implemented method for performing a simulation on a digital twin of a telecommunications network, - A step (101) of determining the minimum assessment accuracy of the simulation with respect to one or more performance indicators that are indicators of the network performance of the telecommunications network (200), and / or determining the maximum assessment period required to run the simulation, - A step (103) of selecting a simulation model for each of the multiple elements of the digital twin based on at least one of the minimum assessment accuracy and the maximum assessment period, - The step of assembling the selected simulation model into the digital twin (105), - Step (107) of performing the simulation on the digital twin and A method that includes this.

14. The method according to claim 13, wherein the method is a computer-implemented method for generating utility and cost functions of candidate digital twins of a telecommunications network, - Step (175) of assembling the simulation model into different digital twin candidates of the remote communication network, - A step (177) of performing multiple simulations for each of the assembled different digital twin candidates in order to determine the training sample, - A step (179) of generating a utility function for one or more performance metrics based on the training samples for a plurality of digital twin candidates, including the assembled different digital twin candidates, - A step (181) of generating a cost function for the plurality of digital twin candidates based on the training samples and - Step (183) of storing in memory information specifying the cost and utility functions generated for the plurality of digital twin candidates. A method that includes this.

15. A computer program comprising at least one software code portion, wherein the software code portion is configured to perform the method described in claim 13 or 14 when it is executed on a computer system.

Images