Graphically programmable 5GC fault dialing method, device, and computing equipment

Abstract

The embodiment of the present invention relates to the field of communication technology and discloses a graphically programmable 5GC fault dialing method, device and computing equipment. The method includes: performing simulation microservice design on 5GC key simulation network elements, determining the simulation interface corresponding to the key simulation network elements, wherein the key simulation network elements include g NB, AMF, SMF; determine the test network element and test samples related to the test network element based on the simulation interface; graphically arrange the test samples according to the preset service test process template; configure and issue test tasks according to the arranged test samples to perform tests and obtain test results; and analyze failure causes and provide alarm services based on the test results. Through the above methods, the embodiments of the present invention can implement dialing testing functions using graphical arrangement, achieve rapid early warning, and quickly iterate new services, avoiding duplicate development.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of communication technology, and specifically to a graphically programmable 5GC fault dialing method, device and computing equipment. Background Art

[0002] The core network of 5G standalone (SA) networking is based on the network function virtualization (NFV) cloud network construction and adopts a control plane / user plane (C / U) separation architecture. At the same time, 5G SA has the characteristics of a service-oriented architecture. Therefore, from the perspective of core network operation and maintenance, it not only requires operation and maintenance support under the traditional reference point model, but also requires monitoring and maintenance of the interfaces and protocol processes of the 5G service-oriented architecture.

[0003] Existing maintenance methods mainly focus on equipment network management, such as network management support or post-analysis through data collection, and lack proactive core network early warning tools. With the development of 5G, the operation and maintenance direction of 5G has gradually expanded from ToC to ToB business application operation and maintenance early warning. 5G SA is based on cloud native and SBA service-oriented architecture, which can agilely and efficiently create diverse 5G use cases for different network slices. Based on this, a microservice architecture can be adopted to adapt to the existing 5G SA network to meet the operation and maintenance support of various more complex business scenarios in the future. However, it does not have the ability to early warning on the existing network. The existing traditional fault early warning system lacks the ability to quickly iterate and arrange scenarios, making it difficult to adapt to the fault early warning requirements in the 5G SA network environment. Summary of the Invention

[0004] In view of the above problems, the embodiments of the present invention provide a graphically programmable 5GC fault dialing method, apparatus, and computing device, which overcome the above problems or at least partially solve the above problems.

[0005] According to one aspect of an embodiment of the present invention, a graphically orchestrated 5GC fault dialing method is provided, the method comprising: performing simulation microservice design on 5GC key simulation network elements, determining simulation interfaces corresponding to the key simulation network elements, wherein the key simulation network elements include gNB, AMF, and SMF; determining test network elements and test samples related to the test network elements according to the simulation interfaces; graphically orchestrating the test samples according to a preset business test process template; configuring and issuing test tasks according to the orchestrated test samples to perform tests and obtain test results; and performing failure cause analysis and alarm services based on the test results.

[0006] In an optional manner, the simulation microservice design is performed on the 5GC key simulation network element, and the simulation interface corresponding to the key simulation network element is determined, including: constructing a microservice design of a simulated gNB through simulation interfaces N1, N2, and N3; constructing a microservice design of a simulated AMF through simulation interfaces N8, N11, and N15; and constructing a microservice design of a simulated SMF through simulation interfaces N7 and N10.

[0007] In an optional manner, the graphically arranging the test sample according to the preset business test process template includes: logging into the dial test system through a browser, entering the test sample creation page, and creating a new test sample; graphically arranging the use case design of the newly created test sample according to the preset business test process template; setting parameters for each step status of the arranged test sample; and saving the test sample after completing the parameter setting.

[0008] In an optional method, before graphically arranging the test sample according to the preset business test process template, it includes: applying a business orchestration management tool to drag and drop the business test process template through the front-end visual drag-and-drop business process orchestration B / S interface and save the business test process template; and performing addition, modification, deletion, and query operations on the orchestrated business test process template.

[0009] In an optional manner, configuring and issuing a test task according to the arranged test sample to perform the test and obtain the test result includes: creating a new test task through a task setting interface, configuring relevant information of the test task according to the arranged test sample; saving the test task and issuing it for execution to obtain the test result.

[0010] In an optional method, obtaining the test result includes: if the test task is executed successfully, generating a test call record through test call record processing; if the test task fails, judging the number of failures, if the number of failures is less than 3, executing the redo process, if the number of failures is greater than 3, generating a test call record through call record processing according to the test result data.

[0011] In an optional manner, the failure cause analysis and alarm service based on the test results include: obtaining the failure ratio of the test task within a preset time; obtaining the failure cause and the corresponding proportion of each failure cause based on the test call record of the failed test; and triggering an alarm for the test result that exceeds a preset alarm threshold.

[0012] According to another aspect of an embodiment of the present invention, a graphically programmable 5GC fault dialing device is provided, which includes: a microservice design unit, which is used to perform simulation microservice design on 5GC key simulation network elements and determine the simulation interface corresponding to the key simulation network elements, wherein the key simulation network elements include gNB, AMF, and SMF; a test sample determination unit, which determines the test network element and the test samples related to the test network element according to the simulation interface; a test sample orchestration unit, which is used to graphically orchestrate the test samples according to a preset business test process template; a test result acquisition unit, which is used to configure and issue test tasks according to the orchestrated test samples to perform tests and obtain test results; and a result analysis unit, which performs failure cause analysis and alarm services based on the test results.

[0013] According to another aspect of an embodiment of the present invention, there is provided a computing device, comprising: a processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface communicate with each other via the communication bus;

[0014] The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute the steps of the above-mentioned graphically programmable 5GC fault dialing method.

[0015] According to another aspect of an embodiment of the present invention, a computer storage medium is provided, wherein the storage medium stores at least one executable instruction, and the executable instruction causes the processor to execute the steps of the above-mentioned graphically programmable 5GC fault dialing method.

[0016] The embodiment of the present invention determines the simulation interface corresponding to the key simulation network element by performing simulation microservice design on the 5GC key simulation network element, wherein the key simulation network element includes gNB, AMF, and SMF; determines the test network element and the test sample related to the test network element according to the simulation interface; graphically arranges the test sample according to the preset business test process template; configures and issues the test task according to the arranged test sample to perform the test and obtain the test result; performs failure cause analysis and alarm service according to the test result, and can implement the dialing test function by graphical arrangement, realize rapid early warning, and quickly iterate new business to avoid repeated development.

[0017] The above description is only an overview of the technical solutions of the embodiments of the present invention. In order to more clearly understand the technical means of the embodiments of the present invention, they can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiments of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are specifically listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Various other advantages and benefits will become apparent to those skilled in the art upon reading the detailed description of the preferred embodiment below. The accompanying drawings are for illustration purposes only and are not to be considered as limiting the present invention. The same reference symbols are used throughout the drawings to represent the same components. In the drawings:

[0019] Figure 1 A schematic diagram of a networking model of a 5GC fault warning and dialing system provided by an embodiment of the present invention is shown;

[0020] Figure 2 A schematic diagram of a distributed microservice framework of a 5GC fault warning and dialing system provided by an embodiment of the present invention is shown;

[0021] Figure 3 A schematic diagram of a fault warning service dialing method of a 5GC fault warning dialing system provided by an embodiment of the present invention is shown;

[0022] Figure 4 The figure shows a flow chart of a graphically programmable 5GC fault diagnosis method provided by an embodiment of the present invention;

[0023] Figure 5 A schematic diagram of a simulation model of a simulation network element of a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0024] Figure 6 A schematic diagram of the microservice design of a simulated gNB for the graphically programmable 5GC fault diagnosis method provided by an embodiment of the present invention is shown;

[0025] Figure 7 A schematic diagram of a control plane protocol stack model for a microservice design simulating a gNB in ​​a graphically programmable 5GC fault diagnosis method provided by an embodiment of the present invention is shown;

[0026] Figure 8 A schematic diagram of a user plane protocol stack model for a microservice design simulating a gNB in ​​a graphically programmable 5GC fault diagnosis method provided by an embodiment of the present invention is shown;

[0027] Figure 9 A schematic diagram of the microservice design of an emulated AMF for the graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0028] Figure 10 A schematic diagram of a microservice design of a simulated SMF for a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0029] Figure 11 A schematic diagram of a service orchestrator for a graphically programmable 5GC fault diagnosis method provided by an embodiment of the present invention is shown;

[0030] Figure 12 A schematic diagram illustrating the execution of test tasks for the graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0031] Figure 13 A schematic diagram of a test sample creation page for a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0032] Figure 14 A schematic diagram of defining a new test sample for the graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0033] Figure 15 A schematic diagram of a sample graphical arrangement design interface of a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0034] Figure 16 A schematic diagram of the test sample state configuration of the graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0035] Figure 17 A schematic diagram of a test example in which the graphically programmable 5GC fault dialing method provided by an embodiment of the present invention has been completed is shown;

[0036] Figure 18 A schematic diagram of testing and fault boundary location of a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0037] Figure 19 A schematic diagram of a task setting interface for a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0038] Figure 20 A schematic diagram of basic task information configuration of a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0039] Figure 21 A schematic diagram illustrating configuration of test number information for a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0040] Figure 22 A schematic diagram of test network element target information configuration for a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0041] Figure 23 A schematic diagram showing a detailed test result list of the graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0042] Figure 24A schematic diagram of a failed test call record of the graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0043] Figure 25 A schematic diagram showing the failure causes of the graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0044] Figure 26 A schematic diagram illustrating test result analysis of a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0045] Figure 27 A historical alarm diagram of a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0046] Figure 28 A schematic diagram of alarm parameter configuration for a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0047] Figure 29 A schematic diagram of an alarm strategy for a graphically programmable 5GC fault dialing method provided by an embodiment of the present invention is shown;

[0048] Figure 30 The figure shows a schematic diagram of the structure of a graphically programmable 5GC fault dialing device provided by an embodiment of the present invention;

[0049] Figure 31 A schematic structural diagram of a computing device provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0050] Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.

[0051] In the embodiment of the present invention, the network deployment model of the 5GC fault warning dialing system is designed based on the current China Mobile 5G SA core network architecture. Due to the current SPN / PTN networking mode of China Mobile in various provinces, combined with the basic architecture of 5G SA core network C / U separation, the 5GC fault warning dialing system of the embodiment of the present invention will adopt a distributed networking deployment. Its networking model is as follows: Figure 1As shown in the figure, the fault warning and dialing system is consistent with the 5G SA architecture and adopts a C / U separation architecture. The C-plane network element simulation and system platform are centrally deployed in a cloud resource pool and connected to the 5G SA C-plane network elements. Since the 5G SA U-plane network element user plane function (UPF) is deployed in various cities in each province and exchanges data with the C-plane through the SPN and IP bearer network, the deployment location of the simulated gNB (gNodeB) is consistent with the actual gNodeB. Using a city-level approach, the simulated gNB is deployed on a virtual machine or physical server and connected to the local SPN / PTN via IP.

[0052] The network deployment is consistent with the existing network architecture, and the service test path is consistent with the actual user service path, ensuring the authenticity of the test; the deployment of gNodeB simulation in prefecture-level cities is conducive to the expansion of system testing to network slicing, edge computing equipment monitoring and ToB vertical industry user monitoring.

[0053] like Figure 2 As shown, the 5GC fault warning and dialing system adopts a distributed microservices architecture, consisting of a presentation layer (web task management module), an interface layer, a service orchestration layer, a service implementation layer (including distributed microservices), a simulation test protocol layer, a call record storage layer, and a big data analysis layer. The presentation layer includes functional modules such as the web task management module, test management, business KPI monitoring and management, fault alarms, and data analysis. The interface layer includes management APIs, business APIs, alarm and statistical analysis APIs, and third-party APIs. The service orchestration and analysis layer includes service orchestration management and the service orchestrator execution engine. The service implementation layer includes business microservice management and distributed microservice clusters. The simulation protocol layer includes protocol stack management, gNB simulation, AMF simulation, SMF simulation, and other 5G network element simulations.

[0054] 5G fault warning service dial test system Figure 3In the fault dialing test shown in the figure, atomic microservices are first compiled. Because the system adopts a microservices architecture, the business process is decomposed into several atomic microservices, requiring the design and development of various atomic microservices. The operator then uses a graphical drag-and-drop method to orchestrate business scenario test cases. After the test case orchestration is complete, a test task or test task group is created in the system. Parameters such as the designated test network element, assigned test numbers, and configured alarm groups (if necessary) are configured for the test task. The test task is then sent to the simulated network element gateway program. The simulation module executes the test and exchanges test data with the live network. After the test task is completed, the test results are initially evaluated. If the task is successful, the system generates a test call record (CDR) through the CDR processing module (CDR processing module and data analysis module) and stores it in the database. The operator can query and analyze the test results through the web interface. If the test fails, the number of failures is determined. If the number is less than 3, the redo process is executed. If the number of failures is greater than 3, the system sends the test result data to the CDR processing module and the data analysis module for CDR processing, triggering an alarm and issuing it.

[0055] Figure 4 The flowchart of the graphically programmable 5GC fault dialing method provided by the embodiment of the present invention is shown. The graphically programmable 5GC fault dialing method is applied to the server side, such as Figure 1 As shown in the figure, the graphically programmable 5GC fault diagnosis method includes:

[0056] Step S11: Perform simulation microservice design on the 5GC key simulation network elements and determine the simulation interface corresponding to the key simulation network elements, wherein the key simulation network elements include gNB, AMF, and SMF.

[0057] In the embodiment of the present invention, in order to achieve comprehensive testing capabilities for the 5GC network, a microservice simulation network element design is performed on the key 5GC network elements. The overall simulation model is as follows: Figure 5 As shown in the figure, by simulating the gNodeB, AMF and SMF interfaces, using the simulation module single-point access method, specifying the AMF, UPF, SMF and other network elements under 5GC, real-time fault warning of the 5G SA core network, network elements and services is achieved.

[0058] For the simulation of the network element interfaces of gNB, Access and Mobility Management Function (AMF), and Session Management Function (SMF), the design and development are all based on the 5G standard protocol model published by 3GPP, such as the SBI Protocol Stack model in 3GPP TS 29.500v16.1.0. In the embodiment of the present invention, the N1 / N2 / N3 of gNodeB, the N11, N8, N15 of AMF, and the N10 and N7 interfaces of SMF are simulated and designed respectively, and the microservice design of the simulated network element is integrated. When constructing the microservice design of the simulated gNB through the simulation interfaces N1, N2, and N3, as shown in the following example: Figure 6 As shown in Figure 1, the simulation of 5GUE and 5G(R)AN is realized by simulating N1, N2, and N3 interfaces to build a simulated gNodeB microservice. Figure 7 and Figure 8 As shown, the 5G NAS protocol (N1 interface) is simulated according to TS 24.501, implementing user registration management, connection management, and user plane connection activation and deactivation operations, and responsible for the encryption and integrity of NAS messages. The N2 interface is simulated according to the NG-AP protocol defined in 38.413 and the SCTP protocol defined in RFC 4960. The N3 interface is simulated according to the GTP-U protocol defined in TS 29.281, implementing the user plane protocol stack functions of the 5G UE PDU session.

[0059] In the embodiment of the present invention, the microservice design of the simulated AMF is constructed by simulating interfaces N8, N11, and N15. Figure 9 As shown in the figure, the AMF simulation microservice requires N8, N11, and N15 interface simulation capabilities. The N8 interface is the interface between AMF and UDM, using HTTP / TCP and HTTP / 2 (referenced to RFC7540). The N11 interface is the interface between AMF and SMF, using HTTP2. The N15 interface is the interface between AMF and PCF, using HTTP / TCP and HTTP / 2 (referenced to RFC7540). Referring to the service-based interface (SBI) protocol reference model, N8, N11, and N15 all use HTTP / TCP and HTTP / 2 (referenced to RFC7540).

[0060] The embodiment of the present invention constructs a microservice design that simulates SMF through simulation interfaces N7 and N10. Figure 10As shown in the figure, the SMF simulation microservice needs to have N7 and N10 interface simulation capabilities. The N7 interface is the interface between SMF and the Policy Control Function (PCF), and the N10 interface is the interface between SMF and the Unified Data Management (UDM). Both use HTTP / TCP and HTTP / 2 (reference to RFC 7540) protocols.

[0061] Step S12: determining a test network element and a test sample related to the test network element according to the simulation interface.

[0062] In this embodiment of the present invention, gNB, AMF, and SMF simulation microservices are used to design various 5G service process test functions through a graphical drag-and-drop programmable approach to achieve early warning of 5GC C / U plane failures and service quality monitoring. Therefore, it is necessary to plan the functions of each simulation module. The test network elements obtained according to the simulation interface are shown in Table 1. The corresponding test examples can be obtained based on the test content in Table 1. For example, the test content corresponding to the test network element SMF is to realize the message transmission between the simulated AMF and SMF, and realize the PDU session establishment, modification, and release functions. For this test example, the PDU session establishment, modification, and release functions can be used.

[0063] Table 1 Test network elements

[0064]

[0065] Step S13: Graphically arrange the test samples according to a preset business test process template.

[0066] In the embodiment of the present invention, all 5GC dial tests are implemented in a graphical draggable and programmable manner. Before step S13, a graphical programmable dial test function design is performed. Figure 11 As shown, the application business orchestrator is used to design the dialing test function, wherein the application business orchestration management tool is used to drag and drop the business process orchestration B / S interface through the front-end visual drag-and-drop to orchestrate and save the business test process template. Specifically, the business test process orchestrator in the application business orchestration management tool drags and connects controls as needed according to the WEB interface controls to realize the orchestration of the business test process template. After completing the business process orchestration, it is saved as the corresponding business test process template, so that the corresponding number of templates can be orchestrated and saved as needed. The business test process management in the application business orchestration management tool is used to add, modify, delete, and query the business test process template after orchestration. Subsequently, the business execution process execution engine in the application business orchestration management tool is used to realize the process of loading, analyzing, interpreting, and executing the business test process template. Specifically, as Figure 12As shown, the user customizes the test task through the web page, and the task dispatching and task management interface sends the task information to the business orchestrator execution engine, which can be Figure 11 The service execution process execution engine in the service orchestrator loads, analyzes, interprets, and then executes the corresponding service test process template. During the execution of the service test process template, the microservice interfaces of various service microservice groups are called, and signaling interaction with the existing network elements and services is achieved through the simulation test protocol stack.

[0067] In step S13, first log in to the dial test system through the browser and enter Figure 13 Create a new test case on the test case creation page shown in the figure. Define the new test case, such as Figure 14 As shown, set the sample number, specifically expressed in pure numbers, fill in the test sample name, make relevant descriptions, and click "OK" to complete the test sample definition.

[0068] Then, according to the preset business test process template, the newly created test case is graphically arranged and designed. Specifically, click on the newly created blank use case template to enter the following Figure 15 In the sample graphical orchestration design interface shown, select an existing microservice use case from the state module library or select a state template to configure it yourself as needed. For example, select a custom state template and set the state name and code in the parameter column on the right, such as Figure 16 As shown. According to the business process, complete the design of the test sample arrangement. The completed test sample is as follows Figure 17 As shown, each step in the entire business process is Figure 11 It is composed of one or more business test process templates.

[0069] After the arrangement is completed, parameters are set for each step state of the arranged test sample; after the parameter setting is completed, the test sample is saved.

[0070] Step S14: Configure and issue test tasks according to the arranged test samples to perform tests and obtain test results.

[0071] The embodiment of the present invention provides 7×24 hours traversal test of 5GC network elements and services. Users can complete the fault warning setting of 5GC network elements by specifying the target network element to be tested. Specifically, the specified test and fault boundary location of 5GC network elements are realized through multi-network element simulation, such as Figure 18As shown, this embodiment of the present invention primarily tests and locates fault boundaries for the gNB, AMF, and SMF 5GC network elements. Of course, other embodiments of the present invention can also simulate other 5GC core network elements, without limitation. Real-time monitoring and early warning of 5G service quality are achieved through specific service testing. Each microservice generates a test call record and supports the presentation of test failure information. Users can directly determine the cause of the test failure and deduce the faulty network element or cause of the fault.

[0072] In this embodiment of the present invention, a new test task is created through a task setup interface, and relevant information for the test task is configured based on the organized test sample. The test task is saved and executed, and the test results are obtained. If the test task is successfully executed, a test call record is generated through test call record processing. If the test task fails, the number of failures is determined. If the number of failures is less than 3, a redo process is executed. If the number of failures is greater than 3, call record processing is performed based on the test result data to generate a test call record.

[0073] The following uses the simulated gNodeB HTTP browsing test as an example to illustrate the test task deployment process and execution:

[0074] First enter Figure 19 In the task setting interface shown, click New to enter the task creation interface, enter the task creation interface, and fill in the task basic information, number information and other configurations. Figure 20 Configure the basic information of the test task. Figure 21 Configure the test number information for the test task. Figure 22 Configure the target network element information for the test task. After completing the configuration of the relevant information for the test task, save the test task, issue and execute the test, obtain the test results, and generate the corresponding test call record.

[0075] Step S15: Analyze the cause of failure and provide alarm services based on the test results.

[0076] After the test is completed, click the test call record to view the test results. The failed dial test is handled in two parts: test result data analysis and alarm notification. When the test result exceeds the set KPI threshold or the test fails, an alarm is generated.

[0077] In the embodiment of the present invention, the failure ratio of the test task within the preset time is obtained; the failure reasons and the corresponding ratios of the failure reasons are obtained according to the test call list of the failed test; and an alarm is triggered for the test result that exceeds the preset alarm threshold. Specifically, the test result list is as follows: Figure 23 As shown, get the execution status of the test task and filter out Figure 24The failed test call record is shown in the figure. The failure reason is directly recorded in the failed test call record. The operator can directly view it by dragging the test call record. Figure 25 As shown. Figure 23 In the task analysis interface shown, users can display periodic test indicator changes by setting the time period of the task time period and the test result statistical period. The system supports graphical presentation (bar charts, curve charts) of distribution by hour, day, month and customized time period. For example, select one of the test tasks and click "Analyze". The web interface can directly present the test result analysis of the test task within the period, including: fishbone diagram, pie chart of failure cause ratio, bar chart analysis, path analysis, microservice analysis and other graphical analysis of failure causes. Figure 26 As shown in Figure 1, the total number of tests for this test task is 55151, with a success rate of 99.92%. Among them, the number of tests for UE registration is 27580, with a success rate of 99.91%, and the number of tests for UE deregistration is 27571, with a success rate of 99.94%. The reasons for the failure of this test task include UE registration failure and UE deregistration failure. The proportion of failure reasons is shown in Figure 1. Figure 26 Pie chart in .

[0078] The embodiment of the present invention triggers an alarm for the test result that exceeds a preset alarm threshold. Figure 27 This is a diagram of historical alarms that have occurred. The alarm notification message contains: fault network element name, fault failure reason, fault code and other fault details. The embodiment of the present invention uses the setting of alarm trigger threshold and alarm recovery threshold for the tasks that have been issued. The alarm thresholds are divided into minor alarms, general alarms and serious alarms. At the same time, single task alarms and task group alarms are also supported. Figure 28 As shown in the figure, you can configure alarms for single parameters such as the number of consecutive failures, success rate, delay, and test parameter thresholds, or configure alarms for multiple parameters in a logical combination to form associated alarms and alarm groups. Figure 29 As shown, in the alarm point (alarm strategy) management, alarm strategy configuration for each test task, test type, and test network element is provided, and alarm parameter settings by network element name and network element type are supported.

[0079] The embodiment of the present invention determines the simulation interface corresponding to the key simulation network element by performing simulation microservice design on the 5GC key simulation network element, wherein the key simulation network element includes gNB, AMF, and SMF; determines the test network element and the test sample related to the test network element according to the simulation interface; graphically arranges the test sample according to the preset business test process template; configures and issues the test task according to the arranged test sample to perform the test and obtain the test result; performs failure cause analysis and alarm service according to the test result, and can implement the dialing test function by graphical arrangement, realize rapid early warning, and quickly iterate new business to avoid repeated development.

[0080] Figure 30 FIG. 1 shows a schematic diagram of the structure of a graphically programmable 5GC fault dialing device according to an embodiment of the present invention. Figure 30 As shown, the graphically programmable 5GC fault dialing device includes: a microservice design unit 301, a test case determination unit 302, a test case arrangement unit 303, a test result acquisition unit 304 and a result analysis unit 305.

[0081] The microservice design unit 301 is used to perform simulation microservice design for 5GC key simulation network elements, and determine the simulation interface corresponding to the key simulation network elements, wherein the key simulation network elements include gNB, AMF, and SMF; the test sample determination unit 302 determines the test network element and the test samples related to the test network element according to the simulation interface; the test sample orchestration unit 303 is used to graphically orchestrate the test samples according to the preset business test process template; the test result acquisition unit 304 is used to configure and issue test tasks according to the orchestrated test samples to perform tests and obtain test results; the result analysis unit 305 performs failure cause analysis and alarm services based on the test results.

[0082] In an optional manner, the microservice design unit 301 is used to: construct a microservice design for simulating gNB through simulation interfaces N1, N2, and N3; construct a microservice design for simulating AMF through simulation interfaces N8, N11, and N15; and construct a microservice design for simulating SMF through simulation interfaces N7 and N10.

[0083] In an optional manner, the test sample orchestration unit 303 is used to: log in to the dialing test system through a browser, enter the test sample creation page, and create a new test sample; perform use case graphical orchestration design on the newly created test sample according to a preset business test process template; set parameters for each step status of the orchestrated test sample; and save the test sample after completing the parameter setting.

[0084] In an optional manner, the test sample orchestration unit 303 is used to: apply a business orchestration management tool to drag and drop the business test process template through the front-end visual drag-and-drop business process orchestration B / S interface and save the business test process template; and perform addition, modification, deletion, and query operations on the orchestrated business test process template.

[0085] In an optional manner, the test result acquisition unit 304 is used to: create the test task through the task setting interface, configure the relevant information of the test task according to the arranged test sample; save the test task and issue it for execution, and obtain the test result.

[0086] In an optional manner, the test result acquisition unit 304 is used to: if the test task is executed successfully, a test call record is generated through test call record processing; if the test task fails, the number of failures is judged, if the number of failures is less than 3, the redo process is executed, if the number of failures is greater than 3, call record processing is performed according to the test result data to generate a test call record.

[0087] In an optional manner, the result analysis unit 305 is used to: obtain the failure ratio of the test task within a preset time; obtain the failure reason and the corresponding proportion of each failure reason based on the test call record of the failed test; and trigger an alarm for the test result that exceeds the preset alarm threshold.

[0088] The embodiment of the present invention determines the simulation interface corresponding to the key simulation network element by performing simulation microservice design on the 5GC key simulation network element, wherein the key simulation network element includes gNB, AMF, and SMF; determines the test network element and the test sample related to the test network element according to the simulation interface; graphically arranges the test sample according to the preset business test process template; configures and issues the test task according to the arranged test sample to perform the test and obtain the test result; performs failure cause analysis and alarm service according to the test result, and can implement the dialing test function by graphical arrangement, realize rapid early warning, and quickly iterate new business to avoid repeated development.

[0089] An embodiment of the present invention provides a non-volatile computer storage medium, which stores at least one executable instruction. The computer executable instruction can execute the graphically programmable 5GC fault dialing method in any of the above method embodiments.

[0090] The executable instructions can be used to cause the processor to perform the following operations:

[0091] Design simulation microservices for 5GC key simulation network elements and determine the simulation interfaces corresponding to the key simulation network elements, including gNB, AMF, and SMF.

[0092] Determining a test network element and a test sample related to the test network element according to the simulation interface;

[0093] Graphically arrange the test samples according to a preset business test process template;

[0094] Configure and issue test tasks according to the arranged test samples to perform tests and obtain test results;

[0095] Perform failure cause analysis and alarm services based on the test results.

[0096] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0097] Build a microservice design for simulating gNB through simulation interfaces N1, N2, and N3;

[0098] Build a microservice design for simulating AMF through simulation interfaces N8, N11, and N15;

[0099] The microservice design of the simulated SMF is constructed through the simulation interfaces N7 and N10.

[0100] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0101] Log in to the dial test system through a browser, enter the test sample creation page, and create a new test sample;

[0102] Performing use case graphical layout design for the newly created test sample according to the preset business test process template;

[0103] Setting parameters for each step of the test sample after arrangement;

[0104] After completing the parameter setting, save the test sample.

[0105] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0106] Apply the business orchestration management tool to drag and drop the business process orchestration B / S interface on the front end to orchestrate and save the business test process template;

[0107] Perform add, modify, delete, and query operations on the arranged business test process template.

[0108] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0109] Create a new test task through the task setting interface, and configure the relevant information of the test task according to the arranged test sample;

[0110] Save the test task and execute it, and obtain the test result.

[0111] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0112] If the test task is successfully executed, a test call record is generated through test call record processing;

[0113] If the test task fails, the number of failures is determined. If the number of failures is less than 3, the redo process is executed. If the number of failures is greater than 3, the call record is processed according to the test result data to generate a test call record.

[0114] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0115] Obtain the failure rate of the test task within a preset time;

[0116] Obtaining the failure reasons and the corresponding proportions of the failure reasons according to the test call records of the failed tests;

[0117] An alarm is triggered for the test result that exceeds a preset alarm threshold.

[0118] The embodiment of the present invention determines the simulation interface corresponding to the key simulation network element by performing simulation microservice design on the 5GC key simulation network element, wherein the key simulation network element includes gNB, AMF, and SMF; determines the test network element and the test sample related to the test network element according to the simulation interface; graphically arranges the test sample according to the preset business test process template; configures and issues the test task according to the arranged test sample to perform the test and obtain the test result; performs failure cause analysis and alarm service according to the test result, and can implement the dialing test function by graphical arrangement, realize rapid early warning, and quickly iterate new business to avoid repeated development.

[0119] An embodiment of the present invention provides a computer program product, which includes a computer program stored on a computer storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the graphically programmable 5GC fault dialing method in any of the above method embodiments.

[0120] The executable instructions can be used to cause the processor to perform the following operations:

[0121] Design simulation microservices for 5GC key simulation network elements and determine the simulation interfaces corresponding to the key simulation network elements, including gNB, AMF, and SMF.

[0122] Determining a test network element and a test sample related to the test network element according to the simulation interface;

[0123] Graphically arrange the test samples according to a preset business test process template;

[0124] Configure and issue test tasks according to the arranged test samples to perform tests and obtain test results;

[0125] Perform failure cause analysis and alarm services based on the test results.

[0126] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0127] Build a microservice design for simulating gNB through simulation interfaces N1, N2, and N3;

[0128] Build a microservice design for simulating AMF through simulation interfaces N8, N11, and N15;

[0129] The microservice design of the simulated SMF is constructed through the simulation interfaces N7 and N10.

[0130] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0131] Log in to the dial test system through a browser, enter the test sample creation page, and create a new test sample;

[0132] Performing use case graphical layout design for the newly created test sample according to the preset business test process template;

[0133] Setting parameters for each step of the test sample after arrangement;

[0134] After completing the parameter setting, save the test sample.

[0135] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0136] Apply the business orchestration management tool to drag and drop the business process orchestration B / S interface on the front end to orchestrate and save the business test process template;

[0137] Perform add, modify, delete, and query operations on the arranged business test process template.

[0138] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0139] Create a new test task through the task setting interface, and configure the relevant information of the test task according to the arranged test sample;

[0140] Save the test task and execute it, and obtain the test result.

[0141] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0142] If the test task is successfully executed, a test call record is generated through test call record processing;

[0143] If the test task fails, the number of failures is determined. If the number of failures is less than 3, the redo process is executed. If the number of failures is greater than 3, the call record is processed according to the test result data to generate a test call record.

[0144] In an optional manner, the executable instruction causes the processor to perform the following operations:

[0145] Obtain the failure rate of the test task within a preset time;

[0146] Obtaining the failure reasons and the corresponding proportions of the failure reasons according to the test call records of the failed tests;

[0147] An alarm is triggered for the test result that exceeds a preset alarm threshold.

[0148] The embodiment of the present invention determines the simulation interface corresponding to the key simulation network element by performing simulation microservice design on the 5GC key simulation network element, wherein the key simulation network element includes gNB, AMF, and SMF; determines the test network element and the test sample related to the test network element according to the simulation interface; graphically arranges the test sample according to the preset business test process template; configures and issues the test task according to the arranged test sample to perform the test and obtain the test result; performs failure cause analysis and alarm service according to the test result, and can implement the dialing test function by graphical arrangement, realize rapid early warning, and quickly iterate new business to avoid repeated development.

[0149] Figure 31 The schematic diagram of the structure of the computing device provided by the embodiment of the present invention is shown. The specific embodiment of the present invention does not limit the specific implementation of the device.

[0150] like Figure 31As shown, the computing device may include: a processor 102 , a communications interface 104 , a memory 106 , and a communication bus 108 .

[0151] Processor 102, communication interface 104, and memory 106 communicate with each other via communication bus 108. Communication interface 104 is used to communicate with other devices, such as clients or other server network elements. Processor 102 is used to execute program 110, which may specifically perform the steps described in the aforementioned graphically programmable 1GC fault diagnosis method embodiment.

[0152] Specifically, the program 110 may include program codes, which include computer operating instructions.

[0153] Processor 102 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors included in the device may be processors of the same type, such as one or more CPUs, or may be processors of different types, such as one or more CPUs and one or more ASICs.

[0154] The memory 106 is used to store the program 110. The memory 106 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0155] The program 110 may be specifically configured to enable the processor 102 to perform the following operations:

[0156] Design simulation microservices for 5GC key simulation network elements and determine the simulation interfaces corresponding to the key simulation network elements, including gNB, AMF, and SMF.

[0157] Determining a test network element and a test sample related to the test network element according to the simulation interface;

[0158] Graphically arrange the test samples according to a preset business test process template;

[0159] Configure and issue test tasks according to the arranged test samples to perform tests and obtain test results;

[0160] Perform failure cause analysis and alarm services based on the test results.

[0161] In an optional manner, the program 110 enables the processor to perform the following operations:

[0162] Build a microservice design for simulating gNB through simulation interfaces N1, N2, and N3;

[0163] Build a microservice design for simulating AMF through simulation interfaces N8, N11, and N15;

[0164] The microservice design of the simulated SMF is constructed through the simulation interfaces N7 and N10.

[0165] In an optional manner, the program 110 enables the processor to perform the following operations:

[0166] Log in to the dial test system through a browser, enter the test sample creation page, and create a new test sample;

[0167] Performing use case graphical layout design for the newly created test sample according to the preset business test process template;

[0168] Setting parameters for each step of the test sample after arrangement;

[0169] After completing the parameter setting, save the test sample.

[0170] In an optional manner, the program 110 enables the processor to perform the following operations:

[0171] Apply the business orchestration management tool to drag and drop the business process orchestration B / S interface on the front end to orchestrate and save the business test process template;

[0172] Perform add, modify, delete, and query operations on the arranged business test process template.

[0173] In an optional manner, the program 110 enables the processor to perform the following operations:

[0174] Create a new test task through the task setting interface, and configure the relevant information of the test task according to the arranged test sample;

[0175] Save the test task and execute it, and obtain the test result.

[0176] In an optional manner, the program 110 enables the processor to perform the following operations:

[0177] If the test task is successfully executed, a test call record is generated through test call record processing;

[0178] If the test task fails, the number of failures is determined. If the number of failures is less than 3, the redo process is executed. If the number of failures is greater than 3, the call record is processed according to the test result data to generate a test call record.

[0179] In an optional manner, the program 110 enables the processor to perform the following operations:

[0180] Obtain the failure rate of the test task within a preset time;

[0181] Obtaining the failure reasons and the corresponding proportions of the failure reasons according to the test call records of the failed tests;

[0182] An alarm is triggered for the test result that exceeds a preset alarm threshold.

[0183] The embodiment of the present invention determines the simulation interface corresponding to the key simulation network element by performing simulation microservice design on the 5GC key simulation network element, wherein the key simulation network element includes gNB, AMF, and SMF; determines the test network element and the test sample related to the test network element according to the simulation interface; graphically arranges the test sample according to the preset business test process template; configures and issues the test task according to the arranged test sample to perform the test and obtain the test result; performs failure cause analysis and alarm service according to the test result, and can implement the dialing test function by graphical arrangement, realize rapid early warning, and quickly iterate new business to avoid repeated development.

[0184] The algorithm or demonstration provided herein are not inherently relevant to any particular computer, virtual system or other equipment. Various general-purpose systems may also be used together with the teachings based on this. According to the above description, it is apparent that the structure required for constructing this type of system. In addition, the embodiment of the present invention is not directed to any specific programming language yet. It should be understood that various programming languages ​​can be utilized to realize the content of the present invention described herein, and the above description of specific languages ​​is for the purpose of disclosing the best mode of the present invention.

[0185] In the description provided herein, numerous specific details are described. However, it is understood that embodiments of the present invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of this description.

[0186] Similarly, it should be understood that in order to streamline the present invention and facilitate understanding of one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, various features of the embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this method of disclosure should not be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim.

[0187] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition may be divided into multiple submodules or subunits or subcomponents. All features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed herein may be combined in any combination, except that at least some of such features and / or processes or units are mutually exclusive. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0188] It should be noted that the above embodiments illustrate rather than limit the invention, and that alternative embodiments may be devised by a person skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between brackets should not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising several different elements and by means of appropriately programmed computers. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names. The steps in the above embodiments should not be understood as limiting the order of execution unless otherwise specified.

Claims

1. A graphically programmable 5GC fault dialing method, characterized in that: The method comprises: Design simulation microservices for 5GC key simulation network elements and determine the simulation interfaces corresponding to the key simulation network elements, including gNB, AMF, and SMF. Determining a test network element and a test sample related to the test network element according to the simulation interface; Graphically arrange the test samples according to a preset business test process template; The application business orchestration management tool is used to drag and drop the business test process template through the front-end visual drag-and-drop business process orchestration B / S interface to drag and drop and save the business test process template; each step in the entire business process of the orchestrated test sample is composed of one or more business test process templates; Configure and issue test tasks according to the orchestrated test samples to perform tests and obtain test results; wherein, the task dispatching and task management interfaces issue task information to the service orchestrator execution engine, which loads, analyzes, and interprets the corresponding service test process templates and then executes them. During the execution of the service test process templates, the microservice interfaces of various service microservice groups are called, and signaling interaction with existing network elements and services is achieved through the simulation test protocol stack; Perform failure cause analysis and alarm services based on the test results.

2. The method according to claim 1, characterized in that The step of designing a simulation microservice for a 5GC key simulation network element and determining a simulation interface corresponding to the key simulation network element includes: Build a microservice design for simulating gNB through simulation interfaces N1, N2, and N3; Build a microservice design that simulates AMF through simulation interfaces N8, N11, and N15; The microservice design of the simulated SMF is constructed through the simulation interfaces N7 and N10.

3. The method according to claim 1, characterized in that The graphical arrangement of the test samples according to the preset business test process template includes: Log in to the dial test system through a browser, enter the test sample creation page, and create a new test sample; Performing use case graphical layout design for the newly created test sample according to the preset business test process template; Setting parameters for each step of the test sample after arrangement; After completing the parameter setting, save the test sample.

4. The method according to claim 1, wherein Before graphically arranging the test samples according to the preset business test process template, the following steps are included: Perform add, modify, delete, and query operations on the arranged business test process template.

5. The method according to claim 1, wherein Configuring and issuing test tasks according to the arranged test samples to perform tests and obtain test results includes: Create a new test task through the task setting interface, and configure the relevant information of the test task according to the arranged test sample; Save the test task and execute it, and obtain the test result.

6. The method according to claim 1, characterized in that The obtaining of the test result includes: If the test task is successfully executed, a test call record is generated through test call record processing; If the test task fails, the number of failures is determined. If the number of failures is less than 3, the redo process is executed. If the number of failures is greater than 3, the call record is processed according to the test result data to generate a test call record.

7. The method according to claim 6, characterized in that The failure cause analysis and alarm service based on the test results include: Obtain the failure rate of the test task within a preset time; Obtaining the failure reasons and the corresponding proportions of the failure reasons according to the test call records of the failed tests; An alarm is triggered for the test result that exceeds a preset alarm threshold.

8. A graphically programmable 5GC fault dialing device, characterized in that: The device comprises: A microservice design unit is configured to perform simulation microservice design for 5GC key simulation network elements and determine simulation interfaces corresponding to the key simulation network elements, wherein the key simulation network elements include gNB, AMF, and SMF; a test sample determining unit, configured to determine a test network element and a test sample related to the test network element according to the simulation interface; A test sample arrangement unit, configured to graphically arrange the test samples according to a preset business test process template; The application business orchestration management tool is used to drag and drop the business test process template through the front-end visual drag-and-drop business process orchestration B / S interface to drag and drop and save the business test process template; each step in the entire business process of the orchestrated test sample is composed of one or more business test process templates; A test result acquisition unit is configured to configure and issue test tasks according to the orchestrated test samples to perform tests and obtain test results. The task dispatching and task management interfaces issue task information to the service orchestrator execution engine, which loads, analyzes, and interprets the corresponding service test process templates and then executes them. During the execution of the service test process templates, the microservice interfaces of various service microservice groups are called, and signaling interactions with existing network elements and services are implemented through the simulation test protocol stack. The result analysis unit performs failure cause analysis and alarm services based on the test results.

9. A computing device, characterized in that include: A processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute the steps of the graphically programmable 5GC fault dialing method according to any one of claims 1 to 7.

10. A computer storage medium, characterized in that The storage medium stores at least one executable instruction, and the executable instruction enables the processor to execute the steps of the graphically programmable 5GC fault dialing method according to any one of claims 1 to 7.

Images