AI model building platform, AI model building method and program

Abstract

To provide an AI model construction platform and an AI model construction method and program for constructing a smaller-scale verification network than commercial networks in a verification environment and constructing an AI model applied to commercial networks on the small-scale verification network.SOLUTION: The present invention automatically constructs a verification network NW2 from a commercial network NW1 on the basis of the resource states usable in a verification environment, dynamically creates an AI model from various test results carried out in the constructed verification network NW2, and finally makes the AI model reflected in the commercial network NW1. A network operation AI model manager 1 manages the construction information of the commercial network NW1 and verification network NW2 and applies the AI model. A verification network construction node 2 constructs the verification network. An AI model training node 3 trains and manages the AI model.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an AI model construction platform, an AI model construction method, and a program, and in particular to an AI model construction platform, an AI model construction method, and a program for constructing an AI model to be applied to a commercial network on a relatively small-scale verification network. [Background technology]

[0002] Non-Patent Document 1 discloses the concept of digital twin as a technology for collecting information in real space and simulating it in digital space, and consideration of its use in network areas such as 5G is also accelerating.

[0003] By using a digital twin to reproduce a commercial network in a verification network, it becomes easier to conduct tests that are difficult to carry out on a commercial network and it becomes possible to collect a large amount of data, which will enable the construction of AI and machine learning learning models that are essential for autonomous network operation. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] IETF Digital Twin Network: Concepts and Reference Architecture https: / / datatracker.ietf.org / doc / draft-zhou-nmrg-digitaltwin-network-concepts / Summary of the Invention [Problem to be solved by the invention]

[0005] However, reproducing a commercial network, which is a global communications network, on a verification network would, in principle, require server and network resources (e.g. CPU, memory, storage capacity, network bandwidth) equivalent to or greater than those of a commercial network, resulting in enormous capital costs. As a result, it would be impossible to build a verification network for building AI models.

[0006] In addition, since there is no integrated platform for commercial networks to request, train, and manage AI models for network operations, training must be carried out separately on each network, resulting in inefficient management of AI models.

[0007] AI-based network operations have been attracting a great deal of attention in recent years, from research to practical use. However, thanks to virtualization and containerization, network services can now be deployed at high speed, resulting in a wide variety of network conditions. Therefore, it is necessary to build AI models that are trained specifically for each of these diverse network environments.

[0008] There are two elements to constructing an AI model on a network: "network configuration" and "traffic applied to the network." Network configuration includes the CPU / Memory scale of each node that makes up the network, the amount of network bandwidth connected, etc., and represents the underlying network itself.

[0009] Regarding traffic, there is the total number of IP packets generated when users of the network make requests to the network (e.g., web browsing, connection to 5GC, handover). In order to build an AI model specialized for a commercial network, the above two elements must be prepared in the same environment as the commercial network.

[0010] However, in order to build a network configuration and traffic volume that is exactly the same as a commercial network, it is necessary to have facilities of exactly the same scale as the commercial network, which doubles the equipment costs. In addition, in recent years, a concept called chaos engineering has emerged in which random failures are intentionally generated on a commercial network to check the reliability of the system and build an AI model. However, this concept makes it difficult to build an AI model before the start of commercial services, and there is a possibility that the telecommunications carrier may intentionally drop emergency calls that users are currently making, making it difficult to implement from a legal perspective.

[0011] The object of the present invention is to solve the above-mentioned technical problems, and to provide an AI model construction platform, an AI model construction method, and a program for constructing a verification network that is smaller than a commercial network in a verification environment, and constructing an AI model to be applied to the commercial network on the small-scale verification network. [Means for solving the problem]

[0012] In order to achieve the above-mentioned objective, the present invention provides an AI model construction platform that constructs an AI model to be applied to a commercial network on a verification network, comprising: a means for acquiring network information of the commercial network; a means for acquiring computational resource information available in the verification environment; a means for constructing a verification network in the verification environment based on the network information and the computational resource information; a means for determining test scenario information that needs to be implemented to construct an AI model based on the network information; and a means for constructing an AI model based on results of testing on the verification network using the test scenario information. Effect of the Invention

[0013] According to the present invention, the following effects can be achieved.

[0014] (1) It will be possible to build a platform that dynamically manages AI models related to network operations, enabling autonomous network operations of commercial networks.

[0015] (2) Building a platform that dynamically manages AI models related to network operations makes it possible to manage AI models and apply AI models that take a long time to train to other similar networks, thereby reducing the time required to build AI models and enabling more efficient use of the verification network being used.

[0016] (3) By dynamically constructing a verification network for building AI models, it becomes unnecessary to simulate failures on a commercial network, which is essential for building AI models. This makes it possible to build AI models without affecting users of the commercial network. [Brief description of the drawings]

[0017] [Figure 1] 1 is a functional block diagram showing a configuration of a network verification system according to an embodiment of the present invention. [Diagram 2] 13 is a sequence flow showing a procedure for constructing a verification network NW2. [Diagram 3] FIG. 1 is a functional block diagram of a network operation AI model manager. [Figure 4] 13 is a sequence flow showing the operation of a network operation AI model manager. [Diagram 5] FIG. 2 is a functional block diagram showing the configuration of a verification network construction node. [Figure 6] 13 is a sequence flow showing the operation of a verification network construction node. [Figure 7] FIG. 1 is a functional block diagram showing the configuration of the main parts of an AI model training node. [Figure 8] 1 is a sequence flow illustrating the operation of an AI model training node. [Figure 9] FIG. 1 is a diagram illustrating an example of a relationship between a commercial network and a verification network. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Fig. 1 is a functional block diagram showing the configuration of an AI model construction platform according to one embodiment of the present invention. In this embodiment, a verification network NW2 is automatically constructed from a commercial network NW1 based on the resource status available in the verification environment, an AI model is dynamically created from the results of various tests performed on the constructed verification network NW2, and the AI ​​model is finally reflected in the commercial network NW1.

[0019] In this embodiment, we focus on cloud-native architecture, which has been adopted in recent Web applications and mobile cores (5GC). This architecture does not launch a small number of huge monolithic network instances to process requests from a large number of users, but adopts a scale-out configuration in which a large number of uniform network instances are arranged in parallel and requests from a large number of users are uniformly load-balanced to the parallelized network instances.

[0020] For example, if the commercial network NW1 uses 100 instances with 16 CPU cores and 160 GB of memory to process 1 million users, then the verification network NW2 can be configured to run one instance with 16 CPU cores and 160 GB of memory and run simulated traffic of 1 million / 100 = 10,000 users to reproduce an environment equivalent to the commercial network NW1.

[0021] The network operation AI model manager 1 manages the configuration information of the commercial network NW1 and the verification network NW2 and applies the AI ​​model. The verification network construction node 2 constructs the verification network. The AI ​​model training node 3 trains and manages the AI ​​model.

[0022] Such an AI model construction platform can be configured by implementing applications (programs) that realize the functions of the network operation AI model manager 1, the verification network construction node 2, and the AI ​​model training node 3 on at least one general-purpose computer or server equipped with a CPU, ROM, RAM, bus, interface, etc. Alternatively, it can be configured as a dedicated machine or a single-function machine in which part of the application is implemented as hardware or software.

[0023] Figure 2 is a sequence flow showing the procedure for constructing the verification network NW2. At time t1, the commercial network NW1 sends its own network information to the network operation AI model manager 1 to request the construction of an AI model.

[0024] The network information of the commercial network NW1 includes information necessary for constructing an AI model, such as (1) network configuration information (information on individual network instances, total number of network instances, configuration software information (name of software used, version)), (2) accommodated user information (user type, type of service used by user, number of accommodated users), (3) network statistical information (traffic volume, number of requests, number of sessions, number of handovers), and (4) required AI model information (AI type, required accuracy).

[0025] The network operation AI model manager 1 checks whether an AI model that matches the requested AI model already exists in its database, and if not, requests the verification network construction node 2 to construct a verification network at time t2. This request includes network information about the commercial network NW1.

[0026] At time t3, the verification network construction node 2 requests the verification environment (NW2) that constructs the verification network NW2 for computational resource information that can be used to construct the verification network NW2. At time t4, in response to the request, the verification environment (NW2) transmits computational resource information that can be used in the verification environment (NW2) to the verification network construction node 2.

[0027] When the verification network construction node 2 acquires the computational resource information from the verification environment (NW2), at time t5, it determines network information of the verification network NW2 for reproducing the commercial network NW1 in constructing the requested AI model. At time t6, it requests the verification environment (NW2) to construct the verification network NW2 for constructing the AI ​​model.

[0028] In this embodiment, it is required to construct a verification network NW2 that is relatively smaller than the commercial network NW1. For example, if the commercial network NW1 is configured by arranging multiple uniform network instances in parallel, it is required to construct a verification network NW2 having a smaller number of network instances than the commercial network NW1.

[0029] The verification environment (NW2) constructs the requested relatively small-scale verification network NW2, and at time t7 sends a completion notification to the verification network construction node 2. At time t8, the verification network construction node 2 notifies the network operation AI model manager 1 that construction of the verification network NW2 for building the AI ​​model has been completed. At time t9, the network operation AI model manager 1 requests the AI ​​model training node 3 to train the AI ​​model on the verification network NW2.

[0030] The AI ​​model training node 3 determines test scenario information that needs to be implemented to build the requested AI model, and transmits the test scenario information for creating the AI ​​model to the verification network NW2 at time t10. This test scenario information includes (a) test traffic information (e.g., the amount of transmitted traffic and the number of transmitted requests) and (b) simulated failure information (e.g., the type of simulated failure event, the time when the simulated failure occurred, and the frequency of occurrence of the simulated failure).

[0031] The test traffic information is obtained based on the accommodated user information and network statistical information deflated at a ratio according to the scale of the verification network NW2 relative to the commercial network NW1 when the network operations AI model manager 1 requests training of the AI ​​model at the time t9. The simulated failure information is determined when the AI ​​model training node 3 requests execution of a test at the time t10. For example, if the requested AI model information includes a statement that "IF failures are to be detected," simulated failure information is determined such that IF failures are to be executed 100 times.

[0032] The verification network NW2 performs the requested test based on the test scenario information, and transmits the test result to the AI ​​model training node 3 at time t11. The test result includes (c) network statistical information (e.g., resource utilization rate and number of events of each device and network instance) and (d) test scenario information (e.g., amount of transmitted and received traffic and number of successful / failed requests) as information necessary for constructing an AI model.

[0033] At time t12, the AI ​​model training node 3 creates an AI model using the test results received from the verification network NW2, and when it confirms that it meets the AI ​​type and accuracy required by the commercial network NW1, it sends information about the created AI model to the network operation AI model manager 1 at time t13.

[0034] The network operation AI model manager 1 transmits the AI ​​model received from the AI ​​model training node 3 to the commercial network NW1 at time t14. The commercial network NW1 applies the AI ​​model received from the network operation AI model manager 1 to each instance of the commercial network NW1.

[0035] At time t15, the commercial network NW1 starts network operation using an AI model for predicting future network metric values ​​(e.g., CPU utilization rate) and detecting network anomalies. If the AI ​​model needs to be improved after operation starts due to reasons such as increasing the required accuracy, the AI ​​model is updated using data actually obtained by the commercial network NW1. The commercial network NW1 sends the AI ​​model updated at time t15 to the network operation AI model manager 1 at time t16.

[0036] Figure 3 is a functional block diagram of the network operations AI model manager 1, whose main components are a request receiving unit 101, an AI model management unit 102, and an AI model database (DB) 103, and it manages the configuration information of the commercial network NW1 and the verification network NW2, as well as AI model requests from the commercial network NW1.

[0037] The request receiving unit 101 accepts network configuration information and request contents received from the commercial network NW 1. The AI ​​model DB 103 stores the AI ​​model created by the verification network NW 2. The AI ​​model management unit 102 manages the overall processing of the network operation AI model manager 1, and requests the verification network construction node 2 and the AI ​​model training node 3 to create an AI model.

[0038] Figure 4 is a sequence flow showing the operation of the network operation AI model manager 1 in the sequence of Figure 2. When the network operation AI model manager 1 receives a request to build an AI model including network information from the commercial network NW1 at time t1, the request receiving unit 101 accepts the build request at time t1_1 and notifies the AI ​​model management unit 102 of the contents of the request.

[0039] The AI ​​model management unit 102 checks the network information of the requested commercial network NW1, and at time t1_2, queries the AI ​​model DB 103 as to whether an AI model related to the requested network already exists. The AI ​​model DB 103 checks its own database, and returns the query result to the AI ​​model management unit 102 at time t1_3.

[0040] If an AI model already exists, the AI ​​model management unit 102 sends it to the commercial network NW1, but if the AI ​​model does not exist, it requests the verification network construction node 2 to construct the verification network NW2 at time t1_4 ​​(corresponding to the time t2), and further requests the AI ​​model training node 3 to create an AI model in the verification network NW2 at the time t9.

[0041] At time t1_5 (corresponding to t13 above), the AI ​​model training node 3 transmits the created AI model to the AI ​​model management unit 102 of the network operations AI model manager 1. At time t1_6, the AI ​​model management unit 102 stores the received AI model in the AI ​​model DB 103 together with network information of the commercial network NW1 that uses the AI ​​model. At time t1_7, the AI ​​model management unit 102 transmits the created AI model to the commercial network NW1 for application.

[0042] When the AI ​​model is updated in the commercial network NW1, the commercial network NW1 transmits the updated AI model to the network operation AI model manager 1 at time t1_8. When the request receiving unit 101 receives the updated AI model from the commercial network NW1, it stores it in the AI ​​model DB 103 at time t1_9.

[0043] Figure 5 is a functional block diagram showing the configuration of the verification network construction node 2, whose main components are a verification network configuration management unit 201, a verification network information acquisition unit 202, and a verification network construction unit 203, and which constructs a verification network NW2 in the verification environment (NW2) to be used for constructing an AI model.

[0044] The verification network information acquisition unit 202 acquires configuration information of the verification environment (NW2). The verification network construction unit 203 constructs the verification network NW2 in the verification environment (NW2). The verification network configuration management unit 201 manages the overall processing in the verification network construction node 2 and determines the configuration information of the verification network NW2.

[0045] Figure 6 is a sequence flow showing the operation of the verification network construction node 2 in the sequence of Figure 2. At time t2, the network operation AI model manager 1 requests the verification network configuration management unit 201 of the verification network construction node 2 to construct a verification network. At time t2_1, the verification network configuration management unit 201 requests information about the computational resources available in the verification environment (NW2) from the verification network information acquisition unit 202.

[0046] At time t2_2 (corresponding to the above-mentioned time t3), the verification network information acquisition unit 202 requests the verification environment (NW2) for computational resource information available in the verification network NW2. At time t2_3 (corresponding to the above-mentioned t4), the verification environment (NW2) transmits computational resource information available in the verification environment (NW2) to the verification network information acquisition unit 202 of the verification network construction node 2.

[0047] At time t2_4, the verification network information acquisition unit 202 transmits computational resource information available in the verification environment (NW2) to the verification network configuration management unit 201. At time t2_5, the verification network configuration management unit 201 creates network configuration information of the verification network NW2 based on the requested network information of the commercial network NW1 and computational resource information available in the verification environment (NW2).

[0048] In this embodiment, as shown in an example in FIG. 9, the number of instances in the commercial network NW1 is reduced from 100 to 2 in the verification network NW2, making the verification network NW2 1 / 50 the size of the commercial network NW1.

[0049] At time t2_6, the verification network configuration management unit 201 transmits the network configuration information of the verification network NW2 to the verification network construction unit 203 to request construction of the verification network NW2. At time t2_7 (corresponding to the time t6), the verification network construction unit 203 constructs the verification network NW2 in the verification environment (NW2).

[0050] At time t2_8, the verification environment (NW2) constructs the verification network NW2 at 1 / 50 scale, and notifies the verification network construction unit 203 of the verification network construction node 2 at time t2_9 (the above-mentioned t7).

[0051] At time t2_10, the verification network construction unit 203 notifies the verification network configuration management unit 201 of the completion of construction of the verification network NW2. At time t2_11 (corresponding to the time t8), the verification network construction management unit 201 notifies the network operation AI model manager 1 of the completion of construction of the verification network NW2.

[0052] Figure 7 is a functional block diagram showing the configuration of the main parts of the AI ​​model training node 3, whose main components are an AI model training management unit 301, an AI model training unit 302, and a measurement data DB 303, and which performs training and evaluation of the AI ​​model in the verification network NW2.

[0053] The AI ​​model training unit 302 creates test scenarios and trains and evaluates the AI ​​model. The measurement data DB 303 stores the test results of the AI ​​model and the verification network. The AI ​​model training management unit 301 manages the entire AI model training node 3, receives requests from the network operation AI model manager 1, and transmits the created AI model.

[0054] Figure 8 is a sequence flow showing the operation of the AI ​​model training node 3 in the sequence of Figure 2. At time t9, the network operation AI model manager 1 requests the AI ​​model training node 3 to train the AI ​​model, and at time t9_1, the AI ​​model training management unit 301 requests the AI ​​model training unit 302 to train the AI ​​model on the verification network NW2.

[0055] At time t9_2, the AI ​​model training unit 302 determines and constructs test scenario information that needs to be implemented to construct the requested AI model, for example, as shown in an example in Fig. 9. In this embodiment, in accordance with the network being scaled down to 1 / 50, the traffic volume of the test scenario is reduced from 100 Gbps to 2 Gbps, the number of requests from 10,000 / sec to 200 / sec, the number of handovers from 50,000 / sec to 100 / sec, and the number of simultaneous sessions from 500,000 to 10,000.

[0056] At time t9_3 (corresponding to the time t10), the AI ​​model training unit 302 transmits test scenario information to the verification network NW2 to request the start of a test. The verification network NW2 performs the requested test and transmits the test result to the AI ​​model training unit 302 at time t9_4 (corresponding to the time t11).

[0057] At time t9_5, the AI ​​model training unit 302 stores the test results in the measurement data DB 303. At time t9_6, the AI ​​model training unit 302 trains the AI ​​model using the test results received from the verification network NW2. At time t9_7, the AI ​​model training unit 302 evaluates the accuracy of the trained AI model.

[0058] If the evaluation result does not satisfy the required accuracy of the AI ​​model included in the network information of the commercial network NW1, the processes at times t9_2 to t9_6 are repeated until the required accuracy is satisfied. If the required accuracy is satisfied, the created AI model is transmitted from the AI ​​model training unit 302 to the AI ​​model training management unit 301 at time t9_8. At time t9_9 (corresponding to the time t13), the AI ​​model training management unit 301 transmits information of the created AI model to the network operation AI model manager 1.

[0059] According to the above embodiment, a platform that dynamically manages AI models related to network operation can be constructed, enabling autonomous network operation of commercial networks, and providing a low-cost and good network environment. As a result, it is possible to contribute to Goal 9 "Build resilient infrastructure and promote inclusive and sustainable industrialization" and Goal 11 "Make cities inclusive, safe, resilient and sustainable" of the Sustainable Development Goals (SDGs) led by the United Nations. [Explanation of symbols]

[0060] 1...Network operation AI model manager, 2...Verification network construction node, 3...AI model training node, 101...Request receiving unit, 102...AI model management unit, 103...AI model database, 201...Verification network configuration management unit, 202...Verification network information acquisition unit, 203...Verification network construction unit, 301...AI model training management unit, 302...AI model training unit, 303...Measurement data database, NW1...Commercial network, NW2...Verification network

Claims

1. In an AI model construction platform that builds AI models to be applied to commercial networks on a verification network, A means for obtaining network information of a commercial network; A means for acquiring information about available computing resources in a network verification environment; A means for constructing a verification network in the verification environment based on the network information and the computational resource information; A means for determining test scenario information that needs to be implemented to build an AI model based on the network information; and a means for constructing an AI model based on a result of a test using the test scenario information in a verification network; The network information includes commercial network configuration information, accommodated user information, and network statistics information; The means for constructing the verification network constructs a verification network smaller than a commercial network based on the configuration information, The AI ​​model building platform is characterized in that the means for determining the test scenario information determines the test scenario information using accommodated user information and network statistical information that have been shrunk in proportion to the size of the verification network relative to the commercial network.

2. the commercial network is configured by arranging multiple uniform network instances in parallel; The means for constructing the verification network constructs a verification network having a smaller number of network instances than the commercial network; The AI ​​model building platform according to claim 1, characterized in that the means for determining the test scenario information determines the test scenario information using accommodated user information and network statistical information deflated at a ratio corresponding to the number of network instances of the verification network relative to the number of network instances of the commercial network.

3. 3. The AI ​​model building platform according to claim 1, wherein the means for building the AI ​​model determines whether the built AI model conforms to the type and accuracy required for the AI ​​model, and if not, rebuilds the AI ​​model.

4. 4. The AI ​​model construction platform according to any one of claims 1 to 3, further comprising: a means for storing the constructed AI model; and applying the existing AI model in response to an AI model request from a commercial network to which an existing AI model can be applied.

5. In an AI model construction method, a computer constructs an AI model to be applied to a commercial network on a verification network, Obtain network information of commercial networks, Obtaining information about available computing resources in the network verification environment; constructing a verification network in the verification environment based on the network information and the computational resource information; Determine test scenario information that needs to be implemented to build an AI model based on the network information; Constructing an AI model based on a result of a test using the test scenario information in a verification network; The network information includes commercial network configuration information, accommodated user information, and network statistics information; Constructing a verification network that is smaller than the commercial network based on the configuration information; An AI model construction method characterized by determining test scenario information using accommodated user information and network statistical information that have been shrunk in proportion to the scale of the verification network relative to the commercial network.

6. the commercial network is configured by arranging multiple uniform network instances in parallel; Construct a verification network with a smaller number of network instances than the commercial network; The AI ​​model construction method according to claim 5, characterized in that test scenario information is determined using accommodated user information and network statistical information that have been deflated in a ratio corresponding to the number of network instances in the verification network relative to the number of network instances in the commercial network.

7. In an AI model construction program that builds AI models to be applied to commercial networks on a verification network, A procedure for obtaining network information of a commercial network; obtaining information about available computing resources in a network verification environment; constructing a verification network in the verification environment based on the network information and the computational resource information; A step of determining test scenario information that needs to be implemented to build an AI model based on the network information; and constructing an AI model based on a result of a test using the test scenario information in a verification network. The network information includes commercial network configuration information, accommodated user information, and network statistics information; The step of constructing the verification network includes constructing a verification network smaller than a commercial network based on the configuration information; The AI ​​model construction program is characterized in that, in the step of determining the test scenario information, the test scenario information is determined using accommodated user information and network statistical information that have been shrunk in proportion to the scale of the verification network relative to the commercial network.

8. the commercial network is configured by arranging multiple uniform network instances in parallel; The step of constructing the verification network includes constructing a verification network having a smaller number of network instances than the commercial network; The AI ​​model construction program according to claim 7, characterized in that in the step of determining the test scenario information, the test scenario information is determined using accommodated user information and network statistical information that have been deflated at a ratio corresponding to the number of network instances in the verification network relative to the number of network instances in the commercial network.

Images