Automatic test method, platform and system of 5G core network management system

Abstract

The invention relates to the technical field of network communication, in particular to an automatic test method, platform and system for a 5G core network management system, and the method comprises the steps: checking whether a test environment state meets a test requirement or not through a test environment checking system; testing operation is executed on the 5GC core network and / or the 5G core network management system through a testing operation system according to actual testing case requirements; the test data processing and analysis system reads corresponding data from the 5GC core network and / or 5G core network management system for analysis and processing, an operation result is obtained, and then a test result is judged; and the test report generation system records the test instructions executed by the systems and the corresponding test results to generate log files, and finally a test report is generated. Therefore, the automatic test of the 5G core network management system can be realized, the test report is automatically generated, the test efficiency is improved, and the test cost is saved.

Description

Technical Field

[0001] This invention relates to the field of network communication technology, and specifically to an automated testing method, platform, and system for a 5G core network management system. Background Art

[0002] The 5G core network management system is used to centrally manage all network elements of the 5G core network, enabling data management, operation, and maintenance of these elements. This data includes network element configuration data, alarm data, performance data, and other types of stored data, such as user subscription data and user registration data. The 5G core network management system also needs the ability to report 5G core network data to the next higher-level network management system. Furthermore, the 5G core network management system also provides log management, signaling tracing management, and security management for its own core network elements.

[0003] As 5G networks are deployed more widely and in increasingly complex scenarios, the functions of the 5G core network are also increasing. This necessitates a greater number of network elements in the 5G core network, and consequently, an expansion of the network element management functions and capabilities of the 5G core network management system. In practical deployments, to save costs, the 5G core network management system needs to manage multiple different 5G core networks. This leads to an increase in the number of network elements of the same type, resulting in a greater amount of redundant functions and data that the management system must manage.

[0004] As the number of managed 5G core network elements increases, the network management system may experience situations where the same function is reused by different network elements. This results in a large number of repetitive tests in the 5G core network management system testing. Currently, these tests are all performed manually, which is costly in terms of manpower and time, and inefficient. In addition, the reliability and stability testing of the 5G core network management system functions requires triggering a large number of repetitive operations, such as repeated restarts and simultaneous import and export of large amounts of data. Manual testing is costly and has low accuracy. Summary of the Invention

[0005] In view of this, the purpose of this invention is to provide an automated testing method, platform and system for 5G core network management systems, so as to overcome the problems of high cost and low efficiency in current testing of 5G core network management systems.

[0006] To achieve the above objectives, the present invention adopts the following technical solution:

[0007] In a first aspect, embodiments of this application provide an automated testing method for a 5G core network management system, including:

[0008] Set up a test environment and an automated test platform, wherein the test environment includes the 5GC core network management system and the 5G core network it manages;

[0009] Generate a basic environment configuration data file and input it into the automated testing platform; wherein, the automated testing platform includes a test environment checking system, a test operating system, a test data processing and analysis system, and a test report generation system;

[0010] The test environment inspection system reads the basic environment configuration data file to enable the automated test platform to connect to the test environment and check whether the test environment status meets the test requirements.

[0011] The test operating system performs test operations on the 5GC core network and / or the 5G core network management system according to the actual test case requirements.

[0012] The test data processing and analysis system reads and analyzes the corresponding data in the 5GC core network and / or the 5G core network management system to obtain the operation results. The test results are then determined by combining the operation results with the expected results.

[0013] The test report generation system records the test instructions and corresponding test results executed by the test environment inspection system, the test operating system, and the test data processing and analysis system into a log file, and generates a test report based on the log file.

[0014] Furthermore, in some embodiments of this application, the basic environment configuration data file includes the login address and account of the 5G core network management system, the ID of each network element of the 5G core network, and the address and login account of each module of the network element.

[0015] Furthermore, in some embodiments of this application, it also includes:

[0016] When the test environment inspection system detects that the test environment does not meet the requirements for automated testing, it stops the test and directly activates the test report generation system to generate a problem test report.

[0017] The problem test report includes information on problems in the test environment.

[0018] Furthermore, in some embodiments of this application, the step of performing test operations on the 5GC core network and / or the 5G core network management system according to the actual test case requirements through the test operating system includes:

[0019] The test operating system calls and executes the specified automated test file to perform test operations on the 5GC core network and / or the 5G core network management system.

[0020] The automated test files are generated based on the test case requirements.

[0021] Furthermore, in some embodiments of this application, the step of reading corresponding data from the 5GC core network and / or the 5G core network management system through the test data processing and analysis system, analyzing and processing the data to obtain operation results, and determining the test results by combining the operation results and expected results, includes:

[0022] The test data processing and analysis system reads the data on the impact of test operations on the test environment, determines the operation result based on the data, and determines whether the test result is pass or fail based on the operation result and the expected result defined in the preset automated test file.

[0023] Secondly, embodiments of this application provide an automated testing platform for a 5G core network management system, used to test a test environment. The automated testing platform includes a test environment inspection system, a test operating system, a test data processing and analysis system, and a test report generation system. The test environment includes the 5G core network management system and the 5G core network it manages.

[0024] The test environment checking system is used to connect to the test environment and check whether the status of the test environment meets the test requirements.

[0025] The test operating system is used to execute test operations on the test environment according to the actual test case requirements;

[0026] The test data processing and analysis system is used to examine the data in the test environment after the test operation, and, in conjunction with the expected results, determine whether the test result is pass or fail.

[0027] The test report generation system is used to record the execution and results during the test process, generate log files, and output customized test reports.

[0028] Furthermore, in some embodiments of this application, in the test environment, one 5G core network management system can correspond to multiple different 5G core networks.

[0029] Furthermore, in some embodiments of this application, the 5G core network includes network elements, which include AMF network elements, SMF network elements, UPF network elements, UDM / AUSF network elements, NRF network elements, NSSF network elements, PCF network elements, and CHF network elements.

[0030] Furthermore, in some embodiments of this application, the network elements include GPU, GSU, and IPU modules.

[0031] Thirdly, embodiments of this application provide an automated testing system for a 5G core network management system, including the automated testing platform and testing environment for the 5G core network management system as described above.

[0032] This invention relates to the field of network communication technology, specifically to an automated testing method, platform, and system for a 5G core network management system. The method includes generating a basic environment configuration data file and inputting it into the automated testing platform. The automated testing platform includes a test environment checking system, a test operating system, a test data processing and analysis system, and a test report generation system. The test environment checking system reads the basic environment configuration data file to connect the automated testing platform to the test environment and checks whether the test environment status meets the test requirements. The test operating system executes test operations on the 5G core network and / or the 5G core network management system according to actual test case requirements. The test data processing and analysis system reads corresponding data from the 5G core network and / or the 5G core network management system, analyzes and processes the data to obtain operation results, and determines the test results based on the operation results and expected results. The test report generation system records the test instructions and corresponding test results executed by the test environment checking system, the test operating system, and the test data processing and analysis system into a log file, and generates a test report based on the log file. This enables automated testing of the 5G core network management system and automatic generation of test reports, improving testing efficiency and saving testing costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0034] Figure 1 This is a schematic diagram of the structure of the automated testing system for the core network management system provided in this embodiment of the invention;

[0035] Figure 2 This is a flowchart illustrating the automated testing method for the core network management system provided in this embodiment of the invention. DETAILED DESCRIPTION

[0036] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be described in detail below. Obviously, the described embodiments are merely some embodiments of this invention, and not all embodiments. Based on the embodiments of this invention, all other implementation methods obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0037] Figure 1 This is a schematic diagram of the structure of the automated testing system for the core network management system provided in an embodiment of the present invention. Figure 2 This is a flowchart illustrating the automated testing method for a core network management system provided in this embodiment of the invention. The automated testing platform and system for the core network management system provided in this application are used to execute the automated testing method for the core network management system. Specifically, as shown... Figure 1 and Figure 2 As shown:

[0038] First, the automated testing system for the 5G core network management system provided in this application mainly consists of two parts: an automated testing platform 101 and a testing environment 106.

[0039] Specifically, the test environment 106 includes the 5G core network management system 107 and the 5G core network 108.

[0040] In this embodiment, because the function of the 5G core network management system 107 is to centrally manage and maintain the 5G core network 108, the two will interact during the testing of the 5G core network management system 107. For example, when it is necessary to verify the function of the 5G core network management system 107 in modifying the configuration of the AMF of the network element of the 5G core network 108, the modification action needs to be performed on the management system first. Expectedly, the management system (i.e., the 5G core network management system 107) needs to distribute the modified configuration to the AMF of the network element. Therefore, during automated test data processing and analysis, it is necessary to read whether the configuration of the 5G core network element AMF has been modified to determine whether the configuration modification function of the test is correct. Conversely, when it is necessary to verify a certain management function on the management system, it is often necessary to trigger a certain behavior on the 5G core network element to verify whether the management system can recognize the behavior.

[0041] For example, when it is necessary to verify the alarm function on the 5G core network management system 107, it is necessary to first execute the alarm triggering behavior on the 5G core network element, and then read the alarm data of the network element on the network management system to verify that the alarm management function of the network management system is normal.

[0042] It should be noted that in some embodiments of this application, the test environment 106 includes a 5G core network management system 107 and the 5G core network 108 it manages. The number of 5G core networks 108 is not limited to one, but can be multiple, each corresponding to a 5G core network management system 107, that is, centrally managed and maintained by the 5G core network management system 107.

[0043] It is understandable that the above test environment is the test object, namely the 5G core network management system. Since the role and function of the network management system is to centrally manage and maintain the 5G core network, the 5G core network managed by the network management system is also part of the test environment.

[0044] In some embodiments of this invention, the automated testing platform 101 can integrate a test environment inspection system 102, a test operating system 103, a test data processing and analysis system 104, and a test report generation system 105 based on the Robot Framework. These systems can be automated test project files suitable for testing 5G core network management systems, written in the instruction and file formats supported by the Robot Framework, and run using the execution tools that come with the Robot Framework.

[0045] Furthermore, the test environment inspection system 102 is used to connect to and log in to the 5G core network management system 107 and the 5G core network 108 through preset basic environment configuration data, to check whether the environment status meets the requirements of automated testing and to further obtain other environment data, such as reading the unique identification data of each network element of the 5G core network 108 in the 5G core network management system 107 for use in subsequent test operations.

[0046] The test operating system 103 is activated when the test environment inspection system 102 detects that the environment is normal and meets the test requirements, and then performs test operations. Specifically, the test operations can be performed on the 5G core network management system 107, or on the 5G core network 108, or on both at the same time, depending on the actual test case requirements.

[0047] The test data processing and analysis system 104 is used to analyze the execution results of the operation itself according to the actual test case requirements after the test operation is completed. At the same time, it will read the relevant data after the test operation on the 5G core network management system 108 or 5G core network 107, process and analyze the data, and determine the test result based on the analysis results.

[0048] It should be noted that the activation of the test operating system 103 and the test data processing and analysis system 104 does not necessarily have to be in a specific order. When the test requires multiple test items to be executed in parallel, they can be activated simultaneously.

[0049] The test report generation system 105 records each test instruction executed by the test environment inspection system 102, the test operating system 103, and the test data processing and analysis system 104, along with the test results. At the end of the test, it generates a log file and, based on the log file, generates a customized test report to meet the requirements of the test project. The test report reflects the execution status of the automated test, including, but not limited to, the total number of test cases executed, failed test cases, passed test cases, and the test pass rate.

[0050] It should be noted that the test report generation system is enabled throughout the entire automated testing process, not at the end of the test.

[0051] In practical applications, the automated testing system for the 5G core network management system provided in this application, during actual testing, uses a test environment check system to connect to the test environment (i.e., the 5G core network management system and the 5G core network it manages) through preset basic environment configuration data. It checks whether the environment meets the requirements for automated testing and further acquires other environmental data. If the environment meets the requirements, the test operating system proceeds to the test environment for subsequent automated testing; otherwise, the test report reporting system is directly activated to record abnormal environmental information. The test operating system performs test operations directly on the 5G core network management system or the 5G core network according to the actual test case requirements, or it can operate on both simultaneously. The test data processing and analysis system analyzes the execution results of the test operations after each operation, and also reads relevant data from the 5G core network management system or the 5G core network after the test operations, processes and analyzes the data, and determines the test results based on the analysis results. The test report generation system records each test instruction executed by the test environment check system, the test operating system, and the test data processing and analysis system, along with the test results, and generates a test report file, thereby automating the entire testing process.

[0052] Based on this, the automated testing method for the 5G core network management system provided in this application specifically includes the following steps:

[0053] Step 201: Set up the 5GC core network and its network management system test environment and automated test platform, prepare the basic environment configuration data file, and put it into the test environment check system.

[0054] Step 202: Perform a test environment check to ensure that the environment meets the requirements for automated testing.

[0055] Step 203: Determine if the test environment meets the requirements for continuing the test.

[0056] Step 204: Perform test operations on the test environment.

[0057] Step 205: Read the data from the test environment, process and analyze it, and determine the test results.

[0058] Step 206: Determine whether the automated test has been completed.

[0059] Step 207: Generate a log file and a test report based on the recorded test process instructions and test results, and end the test.

[0060] The automated testing method for the 5G core network management system provided in this application embodiment can be fully automated from test environment check to test report generation and test completion. Once the test environment and automated testing platform are set up in step 201, and the environment configuration data file is correctly configured and integrated into the test environment check system, steps 202 to 205 can be completed by simply executing the corresponding commands on the automated testing platform. Figure 2 The logic in the flowchart shown is executed automatically, and no manual intervention is required if there are no environmental issues causing execution interruption.

[0061] Specifically, in some implementations of this application, in step 201 above, the automated testing platform needs to be able to connect to and access the 5G core network management system and the various network elements and modules of the 5G core network it manages. The environment configuration data file includes the login address and account of the 5G core network management system, the IDs of each network element in the 5G core network, and the addresses and login accounts of each module of the network element. This configuration data is written to a file in a fixed format, and this file serves as part of the test environment inspection system. The 5G core network elements include: AMF, SMF, UPF, UDM / AUSF, NRF, NSSF, PCF, and CHF. The network element modules all include GPU, GSU, and IPU modules; some network elements also include CDU and DBU modules.

[0062] Furthermore, in step 202 above, the test environment inspection system reads the 5G core network and network management system environment configuration data, connects to and logs into the 5G core network management system, checks the service status of the network management system, including obtaining the status and identifier of each network element in the 5G core network within the network management system, and simultaneously connects to and logs into each module of each network element in the 5G core network to check the corresponding process and interface status, so as to check the test environment status according to the specific test project requirements. And in step 203 above, when the test environment inspection system detects that the test environment meets the test requirements, it continues with subsequent test operations, i.e., step 204 and other subsequent steps; otherwise, it directly executes step 207 to generate a problem test report, which reflects the specific test environment problem for testers to troubleshoot.

[0063] It should be noted that continuing testing when the test environment does not meet the testing requirements will result in invalid testing; ending the test directly can save testing time and costs. The test environment check can be performed separately at the initial stage of environment setup to quickly check whether the newly set up environment meets the testing requirements; it can also be integrated into subsequent automated testing to ensure that each test execution is a valid test.

[0064] Furthermore, in steps 204 and 205 above, the test operating system will call the automated test file specified by the test execution according to the specific requirements of the test case to execute the test operation on the test environment; the test data processing and analysis system will read the data affected by the test operation on the test environment, and determine whether the test result is pass or fail based on the operation result and the expected result defined in the automated test file.

[0065] Specifically, based on the test case requirements, automated test files are created using custom keywords and a custom test library built into the Robot Framework. These automated test files are then executed to perform various test operations on the 5G core network management system and the 5G core network. Each test operation typically involves corresponding data changes. This data is read, processed, and analyzed to determine if the test results meet the expectations of the test cases. Steps 3 and 4 are executed repeatedly until all required test operations are completed.

[0066] Furthermore, in step 206 above, after a test item is completed, the Robot Framework platform's built-in function will determine whether all test items have been completed. If they have been completed, step 207 is executed to generate a test report for this test; if not, the process returns to step 204 and continues to execute subsequent test items until all test items have been completed.

[0067] Furthermore, in step 207 above, the test report generation system will generate corresponding log files based on each executed test instruction and test result recorded during this test, generate a test report based on these log files, and end this automated test.

[0068] For example, the Robot Framework API can be used to record every test instruction executed by the test environment inspection system, the test operating system, and the test data processing and analysis system, as well as the test results, into log files, and then generate customized test reports based on these log files.

[0069] The automated testing method and system for the 5G core network management system provided in this application are, firstly, easily portable, enabling deployment and testing on multiple 5G core network management system environments, thus improving testing efficiency. Secondly, they fully automate test execution, result judgment, and report output, eliminating the need for manual intervention and reducing labor costs. Furthermore, by creating automated test files, numerous repetitive test operations and result checks can be easily performed, with precise control over the timing of these operations and checks. For example, repeatedly restarting and switching the 5G core network management system over extended periods to observe whether network management recovery is abnormal can shorten testing time and improve test accuracy compared to manual testing.

[0070] It is understood that the same or similar parts in the above embodiments can be referred to each other, and the contents not described in detail in some embodiments can be referred to the same or similar contents in other embodiments.

[0071] It should be noted that in the description of this invention, the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance. Furthermore, in the description of this invention, unless otherwise stated, "a plurality of" means at least two.

[0072] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of the invention includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as will be understood by those skilled in the art to which embodiments of the invention pertain.

[0073] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0074] Those skilled in the art will understand that all or part of the steps in the method of the above embodiment can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

[0075] In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing module, or each unit may exist physically separately, or two or more units may be integrated into a single module. The aforementioned integrated modules may be implemented in the form of hardware or in the form of software functional modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

[0076] The storage media mentioned above can be read-only memory, disk, or optical disk, etc.

[0077] Throughout this specification, reference to terms such as "one embodiment," "some embodiments," "examples," "specific examples," or "some examples" means that a specific feature, structure, material, or characteristic described in conjunction with that embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

[0078] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. An automated testing method for a 5G core network management system, characterized in that: include: Build a test environment and an automated test platform, wherein the test environment includes a 5GC core network management system and the 5G core network it manages; Generate a basic environment configuration data file and input it into the automated test platform; wherein the automated test platform includes a test environment inspection system, a test operating system, a test data processing and analysis system, and a test report generation system; The basic environment configuration data file is read by the test environment checking system so that the automated test platform is connected to the test environment and checks whether the test environment status meets the test requirements; Performing test operations on the 5GC core network and / or the 5G core network network management system according to actual test case requirements through the test operating system; The test data processing and analysis system reads the corresponding data in the 5GC core network and / or the 5G core network network management system for analysis and processing to obtain the operation result, and determines the test result in combination with the operation result and the expected result; The test report generation system records the test instructions and corresponding test results executed by the test environment inspection system, the test operating system and the test data processing and analysis system to generate a log file, and generates a test report based on the log file.

2. The automated testing method for the 5G core network management system according to claim 1, characterized in that: The basic environment configuration data file includes the login address and account of the 5G core network network management system, the ID of each network element of the 5G core network, and the address and login account of each module of the network element.

3. The automated testing method for the 5G core network management system according to claim 1, characterized in that: Also includes: When the test environment checking system detects that the test environment does not meet the automated test requirements, the test is stopped and the test report generating system is directly enabled to generate a problem test report; Wherein, the problem test report includes test environment problem information.

4. The automated testing method for the 5G core network management system according to claim 1, characterized in that: The performing a test operation on the 5GC core network and / or the 5G core network network management system according to actual test case requirements through the test operating system includes: Calling and executing a specified automated test file through the test operating system to perform a test operation on the 5GC core network and / or the 5G core network network management system; Wherein, the automated test file is generated based on the test case requirements.

5. The automated testing method for the 5G core network management system according to claim 1, characterized in that: The test data processing and analysis system reads the corresponding data in the 5GC core network and / or the 5G core network network management system for analysis and processing to obtain an operation result, and determines the test result in combination with the operation result and the expected result, including: The test data processing and analysis system reads the data affected by the test operation on the test environment, determines the operation result based on the data, and determines whether the test result is passed or failed based on the operation result and the expected result defined in the preset automated test file.

6. An automated testing platform for a 5G core network management system, characterized in that: Used to test the test environment, wherein the automated test platform includes a test environment inspection system, a test operating system, a test data processing and analysis system, and a test report generation system, and the test environment includes a 5G core network network management system and the 5G core network managed by it; The test environment checking system is used to connect to the test environment and check whether the test environment status meets the test requirements; The test operating system is used to perform test operations on the test environment according to actual test case requirements; The test data processing and analysis system is used to check the data on the test environment after the test operation, and determine whether the test result is passed or failed in combination with the expected result; The test report generation system is used to generate a log file by recording the execution and results of the test process and output a customized test report.

7. The automated testing platform for the 5G core network management system according to claim 6, characterized in that: In the test environment, one 5G core network management system can correspond to multiple different 5G core networks.

8. The automated testing platform for the 5G core network management system according to claim 7, characterized in that: The 5G core network includes network elements, and the network elements include AMF network elements, SMF network elements, UPF network elements, UDM / AUSF network elements, NRF network elements, NSSF network elements, PCF network elements and CHF network elements.

9. The automated testing platform for the 5G core network management system according to claim 8, characterized in that: The network elements all include GPU, GSU, and IPU modules.

10. An automated testing system for a 5G core network management system, characterized in that: It includes an automated testing platform and testing environment for a 5G core network management system as described in any one of claims 6 to 9.

Images