Core network signaling plane test method and device, and storage medium

Abstract

The embodiment of the invention provides a core network signaling plane test method and device, and a storage medium. The method comprises: in response to a test start request, starting a 5G signaling simulation tool component, the 5G signaling simulation tool component being used for simulating a plurality of user equipment and a plurality of base stations; configuring an internal communication address of the 5G signaling simulation tool component and a corresponding tester bridging port so as to establish communication connection with the tested equipment; displaying a signaling management interface; obtaining test parameters configured by a user for the signaling plane through the signaling management interface; generating a test script according to the test parameters; and according to the 5G signaling simulation tool component, running the test script so as to test the signaling surface of the tested equipment.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a method, device and storage medium for testing a core network signaling plane. Background Art

[0002] With the rapid development of the fifth generation mobile communication technology (5G), the performance, security and stability of the 5G core network signaling plane have become the focus of attention of operators, equipment manufacturers and research institutions. The 5G core network signaling plane is responsible for processing the signaling interaction between the user equipment (UE) and the base station (the next generation Node B, gNB) and the core network. Its performance directly affects the operating efficiency and user experience of the entire network. At the same time, with the continuous advancement of satellite communication technology, it has become possible to combine 5G with satellite communication technology to achieve a global seamless coverage communication network. However, this combination also brings new challenges, such as high latency, low bandwidth, frequent switching, etc., which puts higher requirements on the adaptability and stability of the 5G core network signaling plane.

[0003] In related technologies, testing of the core network signaling plane is often based on actual physical equipment or existing simulation software. Testing based on physical equipment is mainly suitable for small-scale single communication scenarios. Existing simulation software is internally configured with some common network scenarios and can perform performance testing for common communication scenarios.

[0004] However, existing technologies cannot meet the testing requirements of the core network signaling plane in various and complex communication scenarios, and the test accuracy and efficiency are relatively low. Summary of the invention

[0005] The present application provides a testing method, device and storage medium for the core network signaling plane, which is used to solve the problem that the existing technology cannot meet the testing requirements of the core network signaling plane in various and complex communication scenarios, and the test accuracy and efficiency are relatively low.

[0006] In a first aspect, the present application provides a method for testing a core network signaling plane, including:

[0007] In response to the test start request, start a 5G signaling simulation tool component, wherein the 5G signaling simulation tool component is used to simulate multiple user equipments and multiple base stations;

[0008] Configuring the internal communication address of the 5G signaling simulation tool component and the corresponding tester bridge port to establish a communication connection with the device under test;

[0009] Display the signaling management interface;

[0010] Obtain test parameters configured by the user for the signaling plane through the signaling management interface;

[0011] Generate a test script according to the test parameters;

[0012] According to the 5G signaling simulation tool component, run the test script to implement signaling plane testing of the device under test.

[0013] Here, the present application provides a flexible and reliable method for testing the core network signaling plane, which can simulate multiple user devices and multiple base stations through a 5G signaling simulation tool component, simulate a large number of terminals and base stations through one test port, and establish a communication connection with the device under test, thereby simulating the communication network in various communication scenarios, and then through the signaling management interface, provide users with a visualization window to configure various test parameters, and then generate a test script to realize the testing of the core network signaling plane under different communication scenarios and different test requirements. Through the simulation port and the user-interactive visualization window, it can meet the testing requirements of the core network signaling plane in various and complex communication scenarios, and improve the accuracy and efficiency of the test.

[0014] Optionally, displaying the signaling management interface includes: dynamically loading a protocol to obtain the latest version of protocol stack information, wherein the protocol stack information is pre-configured by a user on the protocol stack information management interface; and generating and displaying the signaling management interface according to the protocol stack information.

[0015] Among them, this application supports dynamic loading of protocols, and can load and update the latest protocol version as needed. Users can flexibly edit protocol stack messages through the protocol stack information management interface, and then construct a variety of 5G signaling service processes, thereby improving the flexibility of core network signaling plane testing. The visual interface setting can save users' configuration time and further improve test efficiency.

[0016] Optionally, obtaining the test parameters configured by the user for the signaling plane through the signaling management interface includes: obtaining the user's configuration operation through the signaling management interface, wherein the configuration operation includes at least one of a drag operation, a click operation and an input operation; and obtaining the test parameters configured by the user for the signaling plane according to the configuration operation.

[0017] Here, this application provides users with a visual signaling management interface. Users can configure test parameters through simple drag operations, click operations, and input operations. The configuration method is intuitive and simple, which further improves the efficiency of the test and improves the user experience.

[0018] Optionally, the signaling management interface includes a node configuration interface and a process configuration interface;

[0019] Correspondingly, obtaining the test parameters configured by the user for the signaling plane through the signaling management interface includes: obtaining the base station side related test parameters configured by the user for the signaling plane through the node configuration interface; obtaining the user equipment related test parameters configured by the user for the signaling plane through the process configuration interface.

[0020] Among them, the present application provides a node configuration interface for configuring base station side related test parameters, and also provides a process configuration interface for configuring user equipment related test parameters. It can configure base station side related test parameters and user equipment related test parameters. Through the flexible configuration of the above parameters, during the testing process of the core network signaling plane, it helps to verify and optimize network performance, improve the flexibility and accuracy of the test, and improve the user experience.

[0021] Optionally, generating a test script according to the test parameters includes: determining a corresponding test scenario according to the test parameters; obtaining a preset test template corresponding to the test scenario; and generating a test script according to the preset test template.

[0022] Here, the present application can pre-configure test templates corresponding to a variety of test scenarios. After determining the test scenario through test parameters, the pre-configured test template can be directly called, which simplifies the test accuracy process and improves the efficiency of the core network signaling plane test.

[0023] Optionally, generating a test script according to the preset test template includes: outputting the preset test template; and generating a test script in response to a user's modification operation and / or confirmation operation on the preset test template.

[0024] Here, the user can modify or confirm the test template, further improving the flexibility of the test.

[0025] Optionally, before starting the 5G signaling simulation tool component in response to the test start request, it also includes: creating one or more nodes through the 5G signaling simulation tool component, wherein the nodes are used to simulate user equipment or base stations.

[0026] Among them, the present application can pre-create one or more nodes in the 5G signaling simulation tool component to simulate user equipment or base stations, thereby achieving the purpose of simulating a large number of user equipment and base stations with one test port, and can meet various communication scenarios, such as satellite communication scenarios, etc., thereby improving the flexibility of core network signaling plane testing.

[0027] Optionally, the 5G signaling simulation tool component is also used to simulate 5G signaling service processes; wherein the 5G signaling service processes include multiple of registration, session establishment, switching and service request.

[0028] Here, this application simulates the 5G signaling service process through the 5G signaling simulation tool component, which can realize a full-surround test of the core network under test, and can truly and standardly simulate the interoperability process and functional characteristics between each interface, thereby comprehensively verifying the performance of the core network signaling plane, and improving the flexibility and accuracy of the core network signaling plane test.

[0029] In a second aspect, the present application provides a test device for a core network signaling plane, including: a memory, a processor;

[0030] The memory stores computer-executable instructions;

[0031] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the above first aspect and / or various possible implementations of the first aspect.

[0032] In a third aspect, the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the above first aspect and / or various possible implementations of the first aspect.

[0033] The test method, device and storage medium for the core network signaling plane provided in the present application can simulate multiple user devices and multiple base stations through the 5G signaling simulation tool component. A large number of terminals and base stations can be simulated through one test port, and communication connections with the device under test can be established, thereby simulating communication networks in various communication scenarios. Through the signaling management interface, a visualization window is provided for users to configure various test parameters, and then a test script is generated to realize the testing of the core network signaling plane under different communication scenarios and different test requirements. Through the simulation port and the user-interactive visualization window, it can meet the testing requirements of the core network signaling plane in various and complex communication scenarios, thereby improving the accuracy and efficiency of the test. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0035] Figure 1 A schematic diagram of a test system architecture for a core network signaling plane provided in an embodiment of the present application;

[0036] Figure 2 A connection interaction diagram of a core network signaling plane test system provided in an embodiment of the present application;

[0037] Figure 3 A flowchart of a method for testing a core network signaling plane provided in an embodiment of the present application;

[0038] Figure 4 A schematic diagram of an interface for creating a test node provided in an embodiment of the present application;

[0039] Figure 5 A schematic diagram of an interface created for a test process provided in an embodiment of the present application;

[0040] Figure 6 A schematic diagram of the structure of a core network signaling plane test device provided in an embodiment of the present application;

[0041] Figure 7 A structural diagram of a core network signaling plane test device provided in an embodiment of the present application.

[0042] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0043] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0044] Satellite communication has the characteristics of high latency, low bandwidth, and frequent switching. In order to comprehensively evaluate and optimize the performance of the 5G core network signaling plane, and to verify its stability and reliability in the satellite communication environment, an efficient testing method is needed. Traditional testing methods often rely on actual network equipment, with high testing costs and long cycles, and it is difficult to cover all possible test scenarios. Existing simulation test devices still have shortcomings in efficiency and accuracy. Some physical devices can only simulate simple signaling interaction processes and cannot cover all complex scenarios of the 5G core network signaling plane. Although other software-based devices can simulate complex business processes, they perform poorly when dealing with special scenarios of satellite communications, such as high latency and low bandwidth. In addition, existing simulation test devices also have certain limitations in the writing of test scripts and the analysis of test results, which makes it difficult to meet users' needs for efficient and accurate testing. At present, there are two main methods for satellite signaling plane testing: one is to use a test method based on real equipment. However, these methods have many limitations. Although the test method based on real equipment can truly reflect the network performance, it is limited by the number of equipment and cost. With the expansion of network scale and the increase of business types, the test workload and complexity have increased significantly, which puts higher requirements on test efficiency and accuracy, and it is difficult to conduct large-scale, multi-scenario testing. One is a test solution based on simulation software to evaluate the performance of the satellite core network signaling plane. Although it provides relatively comprehensive testing functions, it often lacks flexibility. The 5G network introduces new architectures and protocols, such as the core network design based on service-oriented architecture, as well as more complex signaling processes and business scenarios, making it difficult for traditional test methods to fully cover and accurately verify, and it is difficult to customize test scripts and signaling process construction according to specific needs. Based on the above analysis, the existing technology cannot meet the testing requirements of the core network signaling plane under diverse and complex communication scenarios, and the test accuracy and efficiency are low.

[0045] In order to solve the above problems, the embodiments of the present application provide a test method, equipment, medium and product for the core network signaling plane, which simulate multiple user devices and multiple base stations. A large number of terminals and base stations can be simulated through one test port, and communication connections with the device under test can be established, thereby simulating communication networks under various communication scenarios. Through the signaling management interface, a visual window is provided for users to configure various test parameters, and then a test script is generated to realize the testing of the core network signaling plane under different communication scenarios and different test requirements.

[0046] Based on the above technical problems, there is an urgent need for an efficient, accurate and multi-scenario test device to fully simulate and verify the performance, security and stability of the satellite communication 5G core network. Optionally, in response to this demand, a 5G signaling simulation tool component based on a self-developed user-mode protocol stack simulation platform is introduced to provide a comprehensive solution for the testing of the satellite communication 5G core network.

[0047] Therefore, developing a simulation-based test method and test device that can simulate various business processes and signaling interactions of the 5G core network signaling plane and satellite communication system has become a practical solution.

[0048] Optional, Figure 1 A schematic diagram of a test system architecture for a core network signaling plane provided in an embodiment of the present application. Figure 1 In the above architecture, the test device Nova and the satellite-to-ground core network under test are included.

[0049] Specifically, Nova is the core component of the open source cloud computing management platform project (OpenStack), which is mainly responsible for computing resource management operations such as virtual machine creation, destruction, and migration. It supports multiple virtualization technologies and provides a rich application programming interface (API) interface, which facilitates users to manage through command line tools or API. As the main controller of computing resources, Nova is the key to achieving elastic scaling of cloud computing resources.

[0050] Among them, the test device Nova (also referred to as a test device in the embodiment of the present application) includes a user-mode protocol stack simulation platform and a 5G core network simulation tool component.

[0051] like Figure 1 As shown, the test device provided in the embodiment of the present application can be used to test the satellite-to-ground core network under test, and the satellite-to-ground core network under test includes an on-board core network and a ground core network.

[0052] Specifically, Figure 1 The Smart-gNB in ​​the figure represents the simulated base station. Figure 1 The Smart-UE in the figure represents a simulated user equipment. n in the figure is an arbitrary positive integer, representing the number of simulated base stations and the number of simulated user equipment.

[0053] Optionally, the test device can be connected to the user plane function (UPF) of the on-board core network through a bridge interface, and the UPF of the on-board core network is connected to the mobile edge computing (MEC) of the on-board core network, thereby realizing the test of the on-board core network.

[0054] Optionally, the test device can be connected to the ground access and mobility management function (Access and Mobility Management Function, AMF) through the bridge interface, and the test device can also be connected to the user plane function (User Plane Function, UPF) of the ground core network through the bridge interface. The AMF of the ground core network can also be connected to the session management function (Session Management Function, SMF) of the ground core network. The SMF of the ground core network can also be connected to the policy control function (Policy Control Function, PCF) of the ground core network and the unified data management (Unified Data Management, UDM) of the ground core network. The AMF of the ground core network is also connected to the UDM of the ground core network, thereby realizing the testing of the ground core network.

[0055] In a possible implementation, the user-mode protocol stack simulation platform includes a network (web) management interface and a control interface, which can interact with the user to facilitate the user to flexibly edit the protocol stack information. The user-mode protocol stack simulation platform also includes multiple Ethernet interfaces (Ethernet, eth port). Figure 1 In the example, two eth ports are used as in-band management interfaces. Management data and service data are transmitted in the same link to achieve network connection.

[0056] Optionally, the user-mode protocol stack simulation platform is an easy-to-operate and configure software tool that uses a visual graphical interface, so that users do not need to deeply understand the complex protocol stack structure. Through simple operations such as dragging and clicking, users can complete the editing of protocol stack messages and the selection of cells. The platform has built-in multiple parameter scenario templates. Users only need to select the required scenario to generate a complete signaling process parameter script, which greatly simplifies the parameter preparation process. In addition, users can also customize the relevant parameter content and manually click to generate the test script.

[0057] Optionally, the user-mode protocol stack simulation platform not only supports traditional 5G core network signaling simulation, but also integrates the simulation capabilities of satellite communication 5G core network. Users can flexibly edit protocol stack messages, freely select the cells carried in the messages, and construct a variety of 5G signaling service processes, including signaling processes unique to satellite communications.

[0058] Optionally, the tester provided in the embodiment of the present application provides the capability of simulating the signaling plane interfaces of each core network in compliance with the technical standards of the 3rd Generation Partnership Project (3GPP) and specific requirements of satellite communications.

[0059] In one possible implementation, the 5G signaling simulation tool component provided in the embodiment of the present application can realize the following three core functions: microservice architecture and resource deployment, protocol function modularization (lock-free stateful TCP / IP protocol) and test process management.

[0060] Specifically, a microservice architecture is adopted to split the complex 5G core network (including satellite communication module) signaling plane functions into multiple independent and scalable microservices. Each microservice is responsible for a specific function or process, achieving efficient and flexible resource scheduling and load balancing. This architecture not only improves the scalability and maintainability of the system, but also enables the satellite communication module to be easily integrated into the entire test environment.

[0061] Specifically, it supports dynamic loading of protocols. The module can load updated protocol versions as needed. In a test environment, when interacting through interface signaling, it can parse the received signaling messages in real time and verify them according to the protocol specification standards to ensure that the format and content of the signaling messages meet the standards.

[0062] Optionally, it provides lock-free stateful TCP / IP protocol support, which is a network protocol support solution that fully supports both IPv4 and IPv6 Internet protocol versions. In transparent mode, the protocol stack can forward data packets indiscriminately like a clear pipe, and is used in scenarios where network layer details need to be hidden and configuration simplified. In routing forwarding mode, the protocol stack can intelligently forward data packets according to the routing table to achieve complex network topology and flow control.

[0063] Optionally, the device also provides unlocked stateful TCP / IP protocol support, and fully supports both IPv4 and IPv6 Internet Protocol versions. In the non-terrestrial network transparent mode, terminal service process tests, base station connection tests, and data service flow tests are performed to evaluate basic network performance indicators such as latency and mobility management. In the non-terrestrial network regeneration forwarding mode, there will be more communication equipment on the satellite, such as gNB, UPF, and one or more network elements in the core network. In the inter-satellite link and terrestrial network environment, the device of the present invention will be deployed to perform terminal service process tests, base station connection tests, and data service flow tests. The embodiment of the present application has the function of simulating satellite terminals and base stations, and can generate highly complex traffic models based on signaling messages and set user traffic models. It is a complete set of 5G core network simulation test solutions.

[0064] Optionally, the embodiment of the present application supports simulating the N1 / N2 interface of gNB+UE according to the relevant protocol specifications of 3GPP, can flexibly edit protocol stack messages, flexibly select the information elements carried by the messages, flexibly construct business processes, and write a large number of test scripts. It can simulate the signaling business processes such as registration, session establishment, switching, service request initiated by UE, gNB and 5G core network and trigger corresponding test scenarios to complete the full surround test of the core network under test.

[0065] In a possible implementation, the core network signaling plane test system and the test system provided in the embodiment of the present application adopt a 3GPP end-to-end standardized interface. Figure 2 A connection interaction diagram of a core network signaling plane test system provided in an embodiment of the present application, such as Figure 2 As shown in the figure, the signaling plane process test uses the simulation of the signaling plane interfaces of the core network of the 3GPP technical standard, which can truly and standardly simulate the interoperability processes and functional characteristics between the interfaces. The signaling plane simulation test software simulates the signaling business processes such as registration, session establishment, switching, and service request initiated by UE, gNB and 5G core network and triggers the corresponding test scenarios to systematically evaluate the basic equipment and services of the ground core network, obtain the business process processing capability, latency, packet loss rate and other key parameters of 5G core data forwarding quality, and feedback the basic performance and processing capability of the core network equipment.

[0066] Optionally, the test device is a hardware-software integrated device, and the hardware part of the device includes a high-performance computing unit, a large-capacity storage device, a high-speed network interface, etc. These hardware resources provide a solid foundation for the operation of the software part. The software part includes a user-mode protocol stack simulation platform and a signaling simulation tool component, which are modularly designed through a microservice architecture and have the following characteristics:

[0067] 1.1. Users can configure hardware and software resources according to test requirements to meet the testing requirements of different scenarios.

[0068] 1.2. The user-mode protocol stack simulation platform simulates the N1 / N2 interfaces of terminals and base stations for the 5G core network signaling plane and satellite communication-specific signaling processes. The signaling simulation tool component can simulate various 5G signaling service processes, such as registration, session establishment, switching, service request, etc.

[0069] 1.3. The test device provides an intuitive visual operation interface. Through simple operations such as dragging and clicking, the editing of protocol stack messages, the selection of cells and the generation of test scripts can be completed.

[0070] 1.4. Define or select the information elements carried by the message according to the test template, graphically write the signaling service process test script, realize the simulation terminal, base station and 5G core network to initiate registration, session establishment, switching process, service request signaling business process and trigger the corresponding test scenario, and complete the full surround test of the core network under test.

[0071] Optionally, the 5G core network signaling plane simulation component may include the following modules:

[0072] 2.1. Microservice architecture: The signaling plane functions are divided into multiple independent microservices, including protocol functions, management modules, process script modules, and statistics modules.

[0073] 2.2. Protocol function module: Provide corresponding protocol types for selection, and the protocol types can be common protocol types such as UDP, TCP, etc.

[0074] 2.3. Management module: start, stop, interrupt and adjust the test process, manually adjust the corresponding configuration, control protocol function, process script module, report module and statistics module.

[0075] 2.4. Process script module: Modify according to the provided simulation scenario. The simulation scenario is a plane topology diagram, and the data on the diagram can be modified as needed.

[0076] 2.5. Statistics module: records the data flow statistics between the terminal and the base station during the test, and calculates the corresponding performance values: registration data display, session establishment statistics, Paging entry statistics, link uplink and downlink data throughput and link establishment statistics.

[0077] Optionally, when implementing the signaling plane function of the 5G core network (including the satellite communication module), the test device provided in the embodiment of the present application provides a test port to simulate a large number of terminal devices and base stations accessing the ground network + satellite network when using the single-arm mode. The device simulates the signaling interaction capabilities related to registration management, connection management and session management of the terminal and the core network AMF through the N1 interface, and the base station interacts with the core network AMF through the N2 interface. The signaling interaction capabilities related to terminal context management and PDU session / resource management; when using the dual-arm mode, one test port simulates a large number of terminals and base stations, and one test port simulates the data network, simulates data packets of various service types, and is responsible for counting key parameters such as packet loss rate and latency to measure the quality of UPF data forwarding. This provides verification of the stability and capacity elasticity of the satellite communication network after large-scale user access, can refine the service statistics of each satellite terminal, and accurately locate the shortcomings and differentiation reasons of service quality.

[0078] In addition, the network architecture and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0079] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0080] Optionally, Figure 3 A flowchart of a method for testing the signaling plane of a core network provided in an embodiment of the present application. The execution subject of the embodiment of the present application may be Figure 1 The specific execution entity of the test device can be determined according to the actual application scenario. Figure 3 As shown, the method comprises the following steps:

[0081] S301: In response to the test start request, start the 5G signaling simulation tool component.

[0082] Among them, the 5G signaling simulation tool component is used to simulate multiple user devices and multiple base stations.

[0083] Optionally, the test start request may be sent by a user through a terminal device, or may be initiated by a user through an interactive interface on a test device, or may be periodically initiated by the test device.

[0084] Optionally, start the test device, switch to the management interface, click to start the 5G signaling simulation tool component, and start the core network control component and protocol function separately.

[0085] Optionally, before starting the 5G signaling simulation tool component in response to the test start request, it also includes: creating one or more nodes through the 5G signaling simulation tool component.

[0086] The node is used to simulate user equipment or base station.

[0087] Optionally, each node corresponds to a Smart-Gnb virtual machine. After the initial installation or modification of the Smart-Gnb IP address, you need to create or modify node parameters. For example, Figure 4 A schematic diagram of an interface for creating a test node provided in an embodiment of the present application. The embodiment of the present application can simulate a gNB by creating a test node.

[0088] Optionally, after creating the test node, the node configuration parameters configure the relevant parameters of the simulated gNB. The configuration interface may include buttons such as save configuration, more configuration, export configuration file, import configuration file, and export parameter file.

[0089] Optionally, the embodiment of the present application may also create a test process to configure a simulated UE. Figure 5 A schematic diagram of an interface for creating a test process provided in an embodiment of the present application. The embodiment of the present application can configure a simulated UE by creating a test process.

[0090] Understandably, Figure 4 and Figure 5 This is for illustration only, and this application does not impose any specific restrictions on any interface diagram mentioned in the embodiments. Figure 4 and Figure 5 For illustration only, the parameter types and names in the figure are only examples and do not affect the protection scope of this application.

[0091] Optionally, the embodiment of the present application supports batch creation of test nodes and test processes, thereby improving test efficiency.

[0092] Among them, the embodiment of the present application can pre-create one or more nodes in the 5G signaling simulation tool component for simulating user equipment or base stations, thereby achieving the purpose of simulating a large number of user equipment and base stations with one test port, and can meet various communication scenarios, such as satellite communication scenarios, etc., thereby improving the flexibility of core network signaling plane testing.

[0093] Optionally, the 5G signaling simulation tool component is also used to simulate 5G signaling service processes; wherein the 5G signaling service processes include multiple of registration, session establishment, switching and service request.

[0094] Here, the embodiment of the present application simulates the 5G signaling service process through the 5G signaling simulation tool component, which can realize a full-surround test of the core network under test, and can truly and standardly simulate the interoperability processes and functional characteristics between various interfaces, thereby comprehensively verifying the performance of the core network signaling plane and improving the flexibility and accuracy of the core network signaling plane test.

[0095] S302: Configure the internal communication address of the 5G signaling simulation tool component and the corresponding tester bridge port to establish a communication connection with the device under test.

[0096] Among them, the internal communication address of the 5G signaling simulation tool component and the corresponding tester bridge port are configured to establish a communication connection with the device under test for transmitting service plane signaling messages.

[0097] Optionally, an internal communication Internet Protocol (IP) address and a corresponding tester bridge port are configured for use as an external access interface to perform network interaction with the core network under test.

[0098] S303: Display the signaling management interface.

[0099] Optionally, displaying the signaling management interface includes: dynamically loading a protocol to obtain the latest version of protocol stack information, wherein the protocol stack information is pre-configured by a user on the protocol stack information management interface; and generating and displaying the signaling management interface according to the protocol stack information.

[0100] Optionally, a visual graphical interface is used so that users do not need to deeply understand the complex protocol stack structure. Through simple operations such as dragging and clicking, users can complete the editing of protocol stack messages and the selection of cells. The platform has built-in multiple parameter scenario templates. Users only need to select the required scenario to generate a complete signaling process parameter script, thereby simplifying the parameter preparation process.

[0101] Among them, the embodiment of the present application supports dynamic loading of protocols, and can load and update the latest protocol version as needed. Users can flexibly edit protocol stack messages through the protocol stack information management interface, and then construct a variety of 5G signaling service processes, thereby improving the flexibility of core network signaling plane testing. The visual interface setting can save users' configuration time and further improve the efficiency of the test.

[0102] S304: Obtain test parameters configured by the user for the signaling plane through the signaling management interface.

[0103] Optionally, enter the signaling management interface and configure the UE, gNB, and Nova tables in the Database based on user operations.

[0104] Optionally, this can be done by Figure 4 or Figure 5 In the interface diagram, configure the UE, gNB, and Nova tables in the Database.

[0105] The UE configuration related parameters are as follows:

[0106] Without using the existing case entry data, create a new data entry and modify the signaling-related parameters, such as SUCI, DNN, UE_Key, and OP / OPC.

[0107] By modifying the CallType parameter, you can select the signaling plane process test, providing common signaling plane processes such as connection establishment, registration, mobility management process, session management, and XN switching process.

[0108] gNB configuration related parameters are as follows:

[0109] Without using the existing case entry data, create a new data entry, configure the N1 / N2 interface IP address, gateway address and mask, and modify the mobile country code (MCC), tracking area code (TAC) and other related gNB base station side signaling parameters.

[0110] Nova configuration related parameters: If you do not perform business process testing, you do not need to configure this table and use the existing configuration template.

[0111] S305: Generate a test script according to the test parameters.

[0112] Optionally, generating a test script according to the test parameters includes: determining a corresponding test scenario according to the test parameters; obtaining a preset test template corresponding to the test scenario; and generating a test script according to the preset test template.

[0113] Here, the embodiment of the present application can pre-configure test templates corresponding to various test scenarios. After determining the test scenario through test parameters, the pre-configured test template can be directly called, which simplifies the test accuracy process and improves the efficiency of the core network signaling plane test.

[0114] Optionally, generating a test script according to a preset test template includes: outputting the preset test template; and generating a test script in response to a user's modification operation and / or confirmation operation on the preset test template.

[0115] Here, the user can modify or confirm the test template, further improving the flexibility of the test.

[0116] In one possible implementation, configure the test script and run the test. In the signaling management interface, click Create or use an existing template to load, select the corresponding statistical log level, start the test script, and the statistics will show the link building process in real time, and the error will be recorded in the log.

[0117] S306: Run the test script according to the 5G signaling simulation tool component to implement signaling plane testing of the device under test.

[0118] In a possible implementation, a log is printed, or a packet is captured during the execution of a script to view the signaling link establishment process.

[0119] Exemplarily, on the signaling management interface, user-selectable log level operation options are provided, including trace, debug, info, warn, error, fatal, and panic levels, allowing users to set statistical log levels, with each level representing a different degree of log detail.

[0120] Among them, the level type of the log can be determined according to actual conditions, and the embodiment of the present application does not impose specific restrictions on this.

[0121] Specifically, when the user chooses to use an existing template to load the statistical log configuration, the system loads the template selected by the user from the preset template library, and the template contains the predefined statistical log levels;

[0122] Start a test script that collects and processes signaling data according to the statistical log level set by the user or defined in the template;

[0123] Allows users to modify the statistical log level before or after starting the test script to increase configuration flexibility.

[0124] The signaling plane service process test provided by the embodiment of the present application complies with the 3GPP technical standard of each core network signaling plane interface simulation capability, and can truly and standardly simulate the interoperability process and functional characteristics between each interface. It can construct the star network service load content, unify the service intercommunication between any two terminals under the star network, or the service intercommunication between multiple terminals, and count the service data of individual terminals and the total service data of all terminals, so as to verify the service quality of the direct service intercommunication between nodes in the entire network.

[0125] Here, the embodiment of the present application provides a flexible and reliable method for testing the core network signaling plane, which can simulate multiple user devices and multiple base stations through a 5G signaling simulation tool component. A large number of terminals and base stations can be simulated through one test port, and a communication connection with the device under test can be established, thereby simulating the communication network in various communication scenarios. Through the signaling management interface, a visualization window is provided for the user to configure various test parameters, and then a test script is generated to realize the testing of the core network signaling plane under different communication scenarios and different test requirements. Through the simulation port and the user-interactive visualization window, it can meet the testing requirements of the core network signaling plane in various and complex communication scenarios, and improve the accuracy and efficiency of the test.

[0126] Specifically, step S304 is explained as follows:

[0127] Optionally, obtaining test parameters configured by the user for the signaling plane through the signaling management interface includes: obtaining configuration operations of the user through the signaling management interface.

[0128] The configuration operation includes at least one of a drag operation, a click operation and an input operation; and according to the configuration operation, the test parameters configured by the user for the signaling plane are obtained.

[0129] Optionally, the signaling management interface can be Figure 4 or Figure 5interface, or based on Figure 4 or Figure 5 The editing interface generated by the interface, the signaling management interface can pre-configure test parameter templates or test parameter corresponding types for users to choose.

[0130] Here, the embodiment of the present application provides users with a visual signaling management interface. Users can configure test parameters through simple drag operations, click operations, and input operations. The configuration method is intuitive and simple, which further improves the efficiency of the test and improves the user experience.

[0131] Optionally, the signaling management interface includes a node configuration interface and a process configuration interface; accordingly, through the signaling management interface, the test parameters configured by the user for the signaling plane are obtained, including: through the node configuration interface, obtaining the base station side related test parameters configured by the user for the signaling plane; through the process configuration interface, obtaining the user equipment related test parameters configured by the user for the signaling plane.

[0132] Optionally, the test system for the core network signaling plane provided in the embodiment of the present application is configured with a node creation module, which is used to create and configure N1 / N2 interface nodes of the simulation terminal and the base station in the simulation environment, and the nodes can simulate the actual communication process in the 5G network;

[0133] Optionally, the test system for the core network signaling plane provided in the embodiment of the present application is configured with a signaling service process simulation module, which can simulate various 5G signaling service processes based on the N1 / N2 interface node, including but not limited to a registration process, a session establishment process, a switching process, and a service request process;

[0134] Optionally, the core network signaling plane test system provided in the embodiment of the present application is configured with a test prerequisite configuration module, which is used to configure necessary test prerequisites before simulating the signaling service process, including but not limited to the network topology, connection relationships between nodes, signaling parameters, and test scenarios, etc., to ensure the accuracy and effectiveness of the simulation test.

[0135] Among them, the embodiment of the present application provides a node configuration interface for configuring base station side related test parameters, and also provides a process configuration interface for configuring user equipment related test parameters. It is capable of configuring base station side related test parameters and user equipment related test parameters. Through the flexible configuration of the above parameters, during the testing process of the core network signaling plane, it is helpful to verify and optimize network performance, improve the flexibility and accuracy of the test, and improve the user experience.

[0136] The embodiment of the present application can be used to simulate the signaling plane of the 5G core network and the satellite communication 5G core network, provide a visual graphical interface for editing protocol stack messages and selecting cells in messages, and construct a variety of 5G signaling service processes, including signaling processes unique to satellite communications. Provide a test port to simulate a large number of terminals and base stations, a test port to simulate the data network, simulate data packets of various service types, and be responsible for counting key parameters such as packet loss rate and latency to measure data forwarding quality. This provides verification of the stability and capacity elasticity of the satellite communication network after large-scale user access, can refine the service statistics of each satellite terminal, and accurately locate the shortcomings and differentiation reasons of service quality.

[0137] The core advantages of the test device provided in the embodiment of the present application lie in its high efficiency, accuracy and multi-scenario adaptability. It is designed to ensure the stable operation of the satellite communication system, conduct comprehensive, safety and stability tests, and evaluate the satellite-to-ground performance and processing capabilities of the satellite communication equipment.

[0138] To achieve this goal, the test device of the embodiment of the present application adopts a user-mode protocol stack simulation platform and a 5G signaling simulation tool component based on independent research and development, which can easily edit protocol stack messages, freely select the information elements carried in the message, and flexibly construct various business processes. Through a large number of carefully written test scripts, the device simulates the simulation terminal, base station, UPF, authentication system, cryptographic machine and data network to form a partial encirclement test environment for the core network under test, simulates the initiation of various business processes, and completes the partial encirclement function test of the core network under test. In the test environment, the Internet of Things platform and the navigation enhancement data system are configured to connect to the core network under test, and cooperate to complete the Internet of Things business and navigation function tests.

[0139] Optionally, at each key node of signaling interaction, the test device will deeply analyze the signaling messages responded by the core network and satellite communication system, and strictly verify and judge the signaling process according to the protocol specifications. This function not only ensures the accuracy of the test results, but also greatly improves the test efficiency, and can quickly discover and repair potential problems, thereby further ensuring the stability and reliability of the 5G core network signaling plane and satellite communication system.

[0140] The embodiment of the present application provides an efficient, accurate and multi-scenario solution for satellite communication testing through an innovative 5G signaling simulation tool component and an independently developed user-mode protocol stack simulation platform.

[0141] Figure 6 A schematic diagram of the structure of a core network signaling plane test device provided in an embodiment of the present application, such as Figure 6As shown, the test device of the core network signaling plane provided in this embodiment includes: a startup module 601, a connection module 602, a display module 603, an acquisition module 604, a generation module 605 and an operation module 606. The test device of the core network signaling plane here can be a processing device, a processor, a server itself, or a chip or an integrated circuit that implements the function of the processor. It should be noted here that the division of the startup module 601, the connection module 602, the display module 603, the acquisition module 604, the generation module 605 and the operation module 606 is only a division of logical functions, and the two can be physically integrated or independent.

[0142] A starting module, used to start a 5G signaling simulation tool component in response to a test start request, wherein the 5G signaling simulation tool component is used to simulate multiple user equipments and multiple base stations;

[0143] A connection module, used to configure the internal communication address of the 5G signaling simulation tool component and the corresponding tester bridge port to establish a communication connection with the device under test;

[0144] Display module, used to display the signaling management interface;

[0145] The acquisition module is used to obtain the test parameters configured by the user for the signaling plane through the signaling management interface;

[0146] A generation module is used to generate a test script according to the test parameters;

[0147] The running module is used to run the test script according to the 5G signaling simulation tool component to implement the signaling plane test of the device under test.

[0148] Optionally, the display module is specifically used to: dynamically load the protocol to obtain the latest version of protocol stack information, wherein the protocol stack information is pre-configured by the user on the protocol stack information management interface; generate and display the signaling management interface according to the protocol stack information.

[0149] Optionally, the acquisition module is specifically used to: obtain the user's configuration operation through the signaling management interface, wherein the configuration operation includes at least one of a drag operation, a click operation and an input operation; and obtain the test parameters configured by the user for the signaling plane according to the configuration operation.

[0150] Optionally, the signaling management interface includes a node configuration interface and a process configuration interface; accordingly, the acquisition module is specifically used to: obtain the base station side related test parameters configured by the user for the signaling plane through the node configuration interface; obtain the user equipment related test parameters configured by the user for the signaling plane through the process configuration interface.

[0151] Optionally, the generation module is specifically used to: determine a corresponding test scenario according to the test parameters; obtain a preset test template corresponding to the test scenario; and generate a test script according to the preset test template.

[0152] Optionally, the generation module is further specifically used to: output a preset test template; and generate a test script in response to a user's modification operation and / or confirmation operation on the preset test template.

[0153] Optionally, before the startup module responds to the test startup request and starts the 5G signaling simulation tool component, the above-mentioned device also includes a creation module for: creating one or more nodes through the 5G signaling simulation tool component, wherein the node is used to simulate a user device or a base station.

[0154] Optionally, the 5G signaling simulation tool component is also used to simulate a 5G signaling service process;

[0155] Among them, the 5G signaling service process includes multiple ones of registration, session establishment, switching and service request.

[0156] refer to Figure 7 , which shows a schematic diagram of the structure of a test 700 of the core network signaling plane suitable for implementing the embodiment of the present disclosure, and the test 700 of the core network signaling plane can be a terminal device or a server. The terminal device can include but is not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The test of the core network signaling plane shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0157] like Figure 7As shown, the test 700 of the core network signaling plane may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 to a random access memory (RAM) 703. Various programs and data required for the operation of the test 700 of the core network signaling plane are also stored in RAM 703. The processing device 701, ROM 702 and RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0158] Typically, the following devices may be connected to the I / O interface 705: input devices 706 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 708 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 709. The communication devices 709 may allow the core network signaling plane test 700 to communicate wirelessly or wired with other devices to exchange data. Although Figure 7 The test 700 of the core network signaling plane with various devices is shown, but it should be understood that it is not required to implement or have all the devices shown. More or fewer devices may be implemented or have instead.

[0159] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 709, or installed from a storage device 708, or installed from a ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0160] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0161] The above-mentioned computer-readable medium may be included in the above-mentioned test of the core network signaling plane; or it may exist independently without being assembled into the test of the core network signaling plane.

[0162] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the test of the core network signaling plane, the test of the core network signaling plane executes the method shown in the above-mentioned embodiment.

[0163] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0164] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0165] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0166] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0167] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0168] The testing method of the core network signaling plane of the embodiment of the present application can be used to execute the technical solutions in the above-mentioned method embodiments of the present application. Its implementation principles and technical effects are similar and will not be repeated here.

[0169] An embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are executed by a processor, they are used to implement any of the above-mentioned core network signaling plane testing methods.

[0170] An embodiment of the present application also provides a computer program product, including a computer program, which, when executed by a processor, is used to implement any of the above-mentioned core network signaling plane testing methods.

[0171] Finally, it should be noted that those skilled in the art will readily conceive of other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention, which follow the general principles of the present invention and include common knowledge or customary technical means in the art not disclosed by the present invention, are not limited to the precise structure described above and shown in the drawings, and may be modified and changed in various ways without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A method for testing a core network signaling plane, characterized in that: include: In response to the test start request, start a 5G signaling simulation tool component, wherein the 5G signaling simulation tool component is used to simulate multiple user equipments and multiple base stations; Configuring the internal communication address of the 5G signaling simulation tool component and the corresponding tester bridge port to establish a communication connection with the device under test; Display the signaling management interface; Obtain test parameters configured by the user for the signaling plane through the signaling management interface; Generate a test script according to the test parameters; According to the 5G signaling simulation tool component, run the test script to implement signaling plane testing of the device under test.

2. The method according to claim 1, characterized in that The display signaling management interface includes: Dynamically load the protocol to obtain the latest version of the protocol stack information, wherein the protocol stack information is pre-configured by the user on the protocol stack information management interface; A signaling management interface is generated and displayed according to the protocol stack information.

3. The method according to claim 1, characterized in that The obtaining, through the signaling management interface, test parameters configured by the user for the signaling plane includes: Obtaining, through the signaling management interface, a configuration operation of the user, wherein the configuration operation includes at least one of a drag operation, a click operation, and an input operation; According to the configuration operation, the test parameters configured by the user for the signaling plane are obtained.

4. The method according to claim 1, characterized in that The signaling management interface includes a node configuration interface and a process configuration interface; Correspondingly, obtaining the test parameters configured by the user for the signaling plane through the signaling management interface includes: Obtaining the base station side related test parameters configured by the user for the signaling plane through the node configuration interface; Through the process configuration interface, the user equipment related test parameters configured by the user for the signaling plane are obtained.

5. The method according to claim 4, characterized in that Generating a test script according to the test parameters includes: Determine a corresponding test scenario according to the test parameters; Obtaining a preset test template corresponding to the test scenario; Generate a test script based on the preset test template.

6. The method according to claim 5, characterized in that Generating a test script according to the preset test template includes: Outputting the preset test template; In response to the user's modification operation and / or confirmation operation on the preset test template, a test script is generated.

7. The method according to any one of claims 1 to 6, characterized in that: Before starting the 5G signaling simulation tool component in response to the test start request, the method further includes: Through the 5G signaling simulation tool component, one or more nodes are created, wherein the nodes are used to simulate user equipment or base stations.

8. The method according to any one of claims 1 to 6, characterized in that: The 5G signaling simulation tool component is also used to simulate the 5G signaling service process; Among them, the 5G signaling service process includes multiple of registration, session establishment, switching and service request.

9. A test device for the core network signaling plane, characterized in that: include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 8 when executed by a processor.

Images