Mobile communication protocol conformance test method
By setting three-level flags and adapter layer simulation networks, the flexibility and accuracy of mobile communication protocol consistency testing is achieved, and the problems of high test complexity and insufficient information in the existing technology are solved, which improves the testing efficiency and comprehensiveness. .
Patent Information
- Application Number
- CN202411126173.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-16
- Publication Date
- 2024-11-08
AI Technical Summary
The existing mobile communication protocol consistency test is poor, has low automation, and has high complexity. It is difficult to simulate the real situation in multi-cell and multi-beam environments, resulting in insufficient information and difficult problem detection, and the test process is complex and resource consumption is large. .
By setting the three-level flag and the adapter layer simulation network, the test and measurement software sends the test script to the adapter layer of the test system. The adapter layer enables the corresponding protocol layer function, the physical layer processes the protocol stack data, and transmits it to the test via an air interface Equipment, test and measurement software analyzes the output, realizing precise control of modules on each layer of the protocol stack and flexibility in the test process.
It improves the flexibility and accuracy of testing, simplifies maintenance work, enhances control over the test process, improves testing efficiency, better discovers potential problems and room for improvement, and ensures the comprehensiveness and effectiveness of testing.
Smart Images

Figure CN118921306A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of wireless communications, and in particular relates to a mobile communication protocol consistency testing method. Background Art
[0002] Mobile communication protocol is a series of communication standards and procedures stipulated in mobile communication system. It covers two major areas: terrestrial communication and satellite communication, to ensure that mobile devices can communicate effectively in different network environments.
[0003] In the field of terrestrial communications, with the continuous development of mobile communication protocols, common protocols include 2G, 3G, and 4G. 2G (second-generation mobile communications) uses digital technology to greatly improve communication quality, and also introduces the GSM (Global System for Mobile Communications) standard; 3G (third-generation mobile communications) further improves data transmission rate and network performance, and introduces standards such as WCDMA (Wideband Code Division Multiple Access), TD-SCDMA, and CDMA2000; 4G (fourth-generation mobile communications) further improves data transmission rate and network performance, and uses the LTE (Long Term Evolution) standard. The emergence of each generation of protocols represents a major advancement in mobile communication technology, from simple voice communications to high-speed data transmission and multimedia service support, continuously improving user experience and communication efficiency, and meeting people's demand for faster, more reliable, and smarter communications.
[0004] In satellite communications, satellites usually operate in geosynchronous orbit or low earth orbit and communicate with ground base stations. Satellite communications use technologies and standards similar to those of ground communications, such as 2G, 3G, and 4G. However, compared to ground communications, satellite communications have a wider coverage area, can achieve global coverage, and can provide mobile communication services in areas far from land, such as oceans and deserts.
[0005] Protocol consistency means that in a communication system, the same or compatible communication protocols are used between various components (such as terminal equipment, access network, core network, etc.) to ensure that they can communicate and interact normally. The communication protocol specifies the format, rules and process of data transmission, and is the basis for the normal operation of the communication system. Protocol consistency is one of the important factors to ensure the normal operation of the system. Its importance lies in ensuring the interoperability between different devices and networks, so that users can communicate and access services smoothly in different network environments.
[0006] In a typical communication system, there are multiple components, including terminal equipment, access network and core network. If the communication protocols between them are inconsistent or incompatible, it will lead to communication failure, service interruption and even system crash. For example, if the communication protocol used by the user's mobile phone is inconsistent with the operator's core network, then it will not be possible to make calls, send text messages or use data services normally. Therefore, ensuring the consistency of protocols between various parts is one of the important considerations in the design and operation of communication systems. Only through protocol consistency can the various components work together effectively to provide stable and efficient communication services.
[0007] Protocol testing is the process of verifying and confirming various protocols in the communication system, aiming to ensure that the communication system can exchange data and communicate normally according to the expected protocol standards. The content of protocol testing covers various objects and different levels of testing, including single module, multi-module, single function, multi-function, subsystem and protocol stack system.
[0008] In single module testing, a single module in the communication system is tested to verify whether it complies with the protocol specifications and check whether its functions are normal. In multi-module testing, multiple modules are tested together to ensure that they work together smoothly as expected.
[0009] Single-function testing focuses on verifying whether the various functions in the communication system are operating normally according to the protocol, such as data transmission, call establishment, etc. Multi-function testing takes into account the interaction between multiple functions in the system and the ability to cope with complex situations.
[0010] Subsystem testing and protocol stack system testing are more comprehensive, involving the interaction and integration between various subsystems or protocol stacks in the system to ensure the stability and consistency of the entire system.
[0011] When performing protocol testing, the test process can be simple, such as verifying input and output for a specific function; or it can be complex, including simulation and testing of various scenarios throughout the communication process to verify the stability and reliability of the system.
[0012] However, the mobile communication protocol consistency test in the prior art still has the following problems:
[0013] Existing protocol conformance tests have poor flexibility and a relatively low degree of automation;
[0014] Existing protocol consistency testing is complex and time-consuming;
[0015] Protocol conformance testing is actually a black box test, so some existing information is not sufficiently output, or the coupling is too high, resulting in insufficient information or difficulty in troubleshooting when anomalies occur;
[0016] Protocol conformance testing requires multiple layers and a large number of functions, and the test and measurement software, architecture building and implementation are relatively complex.
[0017] In addition, the existing technology has the following problems in multi-cell and multi-beam testing:
[0018] Multi-cell and multi-beam testing involves interactions between multiple base stations and mobile devices, including complex handovers, interference, and cooperative transmission. It is difficult to fully simulate various situations in the real environment.
[0019] The combination of various situations will increase the complexity and difficulty of designing test cases, making it difficult to ensure comprehensiveness and effectiveness;
[0020] It requires the joint processing of multiple devices and requires a lot of resources;
[0021] Usually a large amount of data is generated, which needs to be analyzed and verified correctly and effectively. Summary of the invention
[0022] In view of the problems existing in the prior art, the present invention proposes a mobile communication protocol consistency test method, wherein the test measurement software sends test information to the adaptation layer of the test system according to the test script, the adaptation layer activates the function of the corresponding protocol layer according to the test information, and processes the data of the protocol stack through the physical layer, the physical layer transmits the processed output to the device under test through the air interface, and the test measurement software analyzes the output of the test system, which specifically includes the following steps:
[0023] The user writes a test script according to the content to be tested. The test script includes the test module flag and test case flag that need to be enabled.
[0024] When the system simulation software runs the test script, that is, when the system simulation software enters the test mode, the general flag testMode is turned on;
[0025] When the general flag testMode is turned on and when the object under test completes the specified action, the object under test needs to send an instruction message of completing the specified action to the test measurement software. If the completion message of the specified action is not received, the test fails.
[0026] The test measurement software turns on the module test flags of each layer of the protocol stack in turn through the adaptation layer according to the test script requirements, and runs the test cases in the test script;
[0027] Each time a test case is run, the corresponding test flag is turned on.
[0028] In particular, the function of the indication information for completing the specified action in the present invention is to inform the test measurement software of the result of the test system completing the test script. For example, in the RRC connection release test case, after the test measurement software receives the completion of voice registration, the test measurement software sends a connection release command to the test system; for another example, in the RLC AM data segmentation and reassembly verification test case, the test measurement software needs to send the data to the test system after receiving the loopback activation completion indication, and then the test system processes and sends it to the terminal, the terminal will loop the data back to the test system, and then the test system will send the data to the test measurement software (including the test point), and the test measurement software will check the test point and judge the test result.
[0029] Furthermore, the general flag testMode is valid for all modules of the protocol stack, and the protocol stack can only use the general flag testMode and cannot change it.
[0030] Furthermore, the process of turning on the testMode flag includes: when the system simulation software is started and the test measurement software is started, the system simulation software enters the initialization phase, a timer is set in the initialization phase, and within the time range specified by the timer, the test measurement software initiates a test mode start notification message. If the system simulation software receives the test mode start notification message within the time range specified by the timer, the testMode flag is successfully turned on, and the value of the start flag testMode is set to true. If the test mode start notification message is not received within the time range specified by the timer, the value of the testMode flag is set to false.
[0031] Furthermore, when the general flag testMode is turned on, the specified actions completed by the object under test include RRC connection establishment request and voice registration.
[0032] Furthermore, the protocol stack includes at least a NAS protocol module, an RRC protocol module, an SDAP protocol module, a PDCP / RLC protocol module and a MAC protocol module.
[0033] Furthermore, the test case executed by the object under test is a test of the object under test, and the RRC connection is rejected. Then, after the object under test sends the first RRC connection establishment request to the test measurement software, the test measurement software sends a rejection instruction. When the object under test receives the rejection instruction, it sends a connection request again. After the test measurement software receives the RRC connection establishment request for the second time, the test is successful. In any other case, the test is considered to have failed.
[0034] Furthermore, when the loopback activation is completed and the RRC connection is released, the object under test needs to send an indication message of completing the specified action to the test measurement software, where:
[0035] Loopback activation requires that the general flag testMode is set to true and the test flag of the PDCP / RLC protocol module is set to true and the test flag of the PDCP / RLC protocol module is set to true in the test case where there is loopback activation. After the loopback activation operation is completed, the object under test sends an indication message of the completion of loopback activation to the test measurement software;
[0036] For RRC connection release, the general flag testMode needs to be set to true and the test flag of the RRC protocol module needs to be set to true. When the object under test completes the RRC connection release, the object under test sends an indication of the completion of the RRC connection release to the test measurement software.
[0037] Furthermore, when the test case is executed, if the upper layer protocol module of the protocol module that needs to execute the test case is triggered, the test measurement software sends an instruction to the adaptation layer, and the adaptation layer dynamically turns on the test case flag to call back the corresponding upper layer function to trigger the corresponding upper layer protocol module.
[0038] The present invention aims at the protocol consistency test in mobile communication technology and proposes a new scheme to enhance the test flexibility and accuracy. In this scheme, through a series of improvement measures such as setting three-level flags and adaption layer simulation network, accurate control of test process, objects and simulation functions is achieved, providing favorable support for the research and development and testing of wireless communications. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 A structural block diagram of a mobile communication protocol consistency testing method of the present invention;
[0040] Figure 2 A schematic diagram of a test flow of a mobile communication protocol consistency test method according to the present invention;
[0041] Figure 3 A structural block diagram of a multi-beam or multi-cell in a mobile communication protocol consistency test method of the present invention;
[0042] Figure 4 A schematic diagram of a three-level marking application process in a mobile communication protocol consistency test method of the present invention;
[0043] Figure 5 The present invention is a flowchart of a key indication test example in a mobile communication protocol consistency test method. DETAILED DESCRIPTION
[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0045] The present invention proposes a mobile communication protocol consistency test method, in which the test measurement software sends the test script to the adaptation layer of the test system, the adaptation layer starts the function of the corresponding protocol layer according to the test script, and processes the data of the protocol stack through the physical layer, the physical layer transmits the processed output to the device under test through the air interface, and the test measurement software analyzes the output of the test system. Specifically, the following steps are included:
[0046] The user writes a test script according to the content to be tested. The test script includes the test module flag and test case flag that need to be enabled.
[0047] When the test measurement software runs the test script, that is, when the system simulation software enters the test mode, the general flag testMode is turned on;
[0048] When the general flag testMode is turned on and when the object under test completes the specified action, the object under test needs to send an instruction message of completing the specified action to the test measurement software. If the completion message of the specified action is not received, the test fails.
[0049] The test measurement software turns on the module test flags of each layer of the protocol stack in turn through the adaptation layer according to the test script requirements, and runs the test cases in the test script;
[0050] Each time a test case is run, the corresponding test flag is turned on.
[0051] The connection diagram of the test method provided by the present invention is as follows Figure 1 As shown, the test and measurement software controls the object under test through the test script. The test system includes an adaptation layer, a protocol stack and a physical layer. The test and measurement software sends the test data to the adaptation layer, and the adaptation layer opens the corresponding protocol module in the protocol stack. The data processed by the protocol module is converted into analog data through the physical layer and sent to the object under test through the air interface. After the object under test executes the corresponding data, the execution result is fed back to the test system through the air interface, and the test system reports the execution result to the test and measurement software. The test and measurement software determines whether the requirements are met based on the execution result.
[0052] In this embodiment, the test measurement software tests the consistency of the mobile communication protocol of the tested mobile terminal through the system simulation software, and the system simulation software is divided into the physical layer, the protocol stack and the adaptation layer. This embodiment takes the communication between the base station and the mobile terminal as an example. Both the base station and the mobile terminal have a protocol stack and a physical layer. The base station first receives data through the radio frequency and then sends it to the physical layer for processing, and then sends it to the protocol stack after processing; when the base station or mobile terminal sends data, it will first pass through the protocol stack and then enter the physical layer for processing, that is, the physical layer processes the data into waveform data and then sends it out from the air interface through the radio frequency. Other mobile terminals or base stations as receiving ends receive data through the radio frequency.
[0053] When the communication protocol consistency test is performed in this embodiment, the base station or mobile terminal of the object under test is used as the system simulation software to test whether the object under test can strictly execute the corresponding protocol. When a certain communication protocol is actually executed, the base station or terminal is in accordance with the received signaling or a certain data. In the present invention, the corresponding signaling or a certain data is replaced by the data with the three-level mark of the present invention through the system simulation software to facilitate the observation of whether the object under test strictly executes the corresponding protocol at the key point. The application of the three-level mark is as follows: Figure 4 As shown, the specific steps include:
[0054] When the test measurement software is started and enters the test scenario, the adaptation layer ADP is started;
[0055] Apply the flag testMode. If the flag is false (i.e. the value of the flag is 0), the test fails and ends.
[0056] When the flag testMode is true (ie, the value of the flag is 1), the test measurement software continues to send test data, and continues to apply the level 2 flag and the level 3 flag to perform testing in the protocol stack.
[0057] The test and measurement software in the present invention has two main functions: one is to simulate and generate test data and send it to the object under test through the test system; the other is to receive key process and test point information, judge the test points, and obtain test results. After the test data is sent to the terminal through the test system, the terminal will make corresponding configurations and actions based on the test data, and then reply with corresponding data and signaling. After receiving these messages, the test system will organize the reporting of test point information, and the test and measurement software will judge the test point information to obtain test results.
[0058] Due to the large number of test cases, it is necessary to ensure that each module can be tested correctly and effectively and to ensure the independence, flexibility and convenience of a single test case. This operation can help simplify maintenance work and obtain more information during software testing, thereby better controlling the entire process. For this purpose, this solution introduces three levels of flags in the protocol stack to ensure the flexibility, accuracy and comprehensiveness of the test. Such a setting not only improves the test efficiency, but also helps to discover potential problems and room for improvement. The three levels of flags involved in the present invention include:
[0059] (I) First-level mark
[0060] The protocol stack part of the system simulation software enters the test mode with the general flag testMode. When the test measurement software is started for the test scenario, the test measurement software sets the testMode flag to true through the adaptation layer. This flag is valid for all protocol stack modules, and the protocol stack can only be used and cannot be changed.
[0061] In the present embodiment, two modes are included, namely, normal mode and test mode. In the normal mode, the object under test communicates normally, while in the test mode, the signaling or control data involved in the test range needs to be replaced with the data with the three-level flag in the present invention. After entering the test mode, the general flag testMode is turned on, and the value of the general flag testMode is set to true. Whenever an RRC connection establishment request, loopback activation completion, RRC connection release completion, and voice registration completion are requested, an indication message is sent to the test measurement software. The RRC connection establishment request and voice registration completion are necessary (only testMode needs to be set to true, that is, it will be sent), the loopback activation completion and the RRC connection release completion are only based on the corresponding Module testing or corresponding test case testing needs to be dynamically enabled, among which loopback activation completion is dynamically enabled only during RLC / PDCP testing (equivalent to the test condition of the RLC / PDCP layer test case must have loopback activation completion). The dynamic enabling method is: triggered when the general flag testMode and the flag of the RLC protocol module are both true. Therefore, when the test case is executed in the RLC protocol module, the condition for sending the loopback activation completion indication is met; RRC connection release completion is the test condition of most test cases, covering multiple levels, and its sending condition is: triggered when the general flag testMode and TC_Id_flag (third-level flag, that is, the flag distinguished by the test case ID) flag are both true.
[0062] (II) Secondary signs
[0063] The second-level flag includes the flag corresponding to each protocol stack module, that is, the flag bit of each test module. After the second-level flag is started, the corresponding module enters the test mode. The processing logic of other modules will not be affected unless special processing is performed (special processing, such as setting the corresponding process instructions according to the third-level test case flag, that is, other modules need to call other protocol stack modules when executing the test case. At this time, the protocol module to be called needs to be turned on, that is, the flag bit of the module is set to true). The promotion of air interface interaction of the module entering the test mode is all carried out through the script of the test measurement software.
[0064] (III) Level 3 Sign
[0065] The third-level flag refers to the test case executed in a specific protocol module. Each test case corresponds to a test flag. The test case flag is dynamically turned on and off after the module test flag is turned on. This flag can be used to distinguish the differences between different test cases, and this flag can be used to flexibly set the protocol stack to report key information points of the test and measurement software.
[0066] In the present invention, the test measurement software determines whether the corresponding protocol module is turned on and the corresponding test case is running by whether the flag bit is set to true, and determines whether the test case is accurately executed by the information fed back by the general flag.
[0067] This embodiment provides a test flow of a mobile communication protocol consistency test method, such as Figure 2 , specifically including the following steps:
[0068] After entering the test mode, the test measurement software determines whether the test is completed. If it is completed, it gives the protocol consistency test result. Otherwise, it continues to send test data to the adaptation layer.
[0069] When the adaptation layer receives data, it needs to determine whether the received data is control data or valid data. Control data means that the flag corresponding to the protocol module or test case needs to be set to true or false, that is, the corresponding test module or test case is turned on or off through valid data, and the information of the protocol module set to true is reported to the test measurement module to determine whether the test is completed;
[0070] If it is valid data, the valid data will be sent to the corresponding protocol module, the protocol module will process the valid data, report the key process of the processing to the test measurement software, and determine whether the test is completed.
[0071] It can flexibly simulate the dual-cell and multi-cell of the ground system and the dual-beam and multi-beam of the satellite system for testing. During the test, you only need to communicate with the cell or beam through the test measurement software, such as Figure 3As shown, when processing dual cells or dual beams, each beam or cell corresponds to a test system, and each test system controls the timing through the test measurement software to ensure that the control timing of each cell or beam remains consistent.
[0072] This embodiment also provides a three-level mark application process, such as Figure 3 As shown, the specific steps include:
[0073] When the test and measurement software is turned on, it enters the test mode, and the test and measurement software controls the adaptation layer to enable and flag, that is, the general flag testMode;
[0074] When the general flag testMode is set to true, the test and measurement software turns on the protocol module flag corresponding to the protocol stack through the adaptation layer control, and the module with the protocol module flag set to true enters the test mode;
[0075] The protocol module entering the test mode sets the corresponding test case flag to true according to the corresponding test case information in the data sent by the adaptation layer.
[0076] In this embodiment, it is possible to determine which protocol modules are in an enabled state according to the value of the flag bit and determine the test case executed by the protocol module through the test case flag running under the protocol module, which is convenient for testers to analyze.
[0077] In the present invention, each beam corresponds to a system simulation software, and each time a system simulation software is started, it is equivalent to starting a beam. Multiple beams interact with the radio frequency at the same time. Since the radio frequency transmits a relative frame number to the system simulation software, if interaction between beams occurs, the timing consistency may be affected. In order to avoid this situation, different beams are directly controlled by the test measurement software to ensure that the timing consistency between each system simulation software is not affected, thereby improving the accuracy and reliability of the test.
[0078] like Figure 5 As shown, in addition to general test cases, the test process also includes some special test cases. These test cases need to trigger certain functions in the upper layer of the specified test module during the operation of the specified test module, such as release, paging, etc. At this time, the adaptation layer is used to cooperate and control the corresponding protocol module to implement these functions. At this time, the protocol module that implements these functions does not need to set its flag bit to true to implement the function, so as to avoid confusion caused by switching between protocol modules.
[0079] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. A mobile communication protocol consistency testing method, characterized in that: The test measurement software sends the test script to the adaptation layer of the test system. The adaptation layer starts the function of the corresponding protocol layer according to the test script and processes the data of the protocol stack through the physical layer. The physical layer transmits the processed output to the device under test through the air interface. The test measurement software analyzes the output of the test system, which specifically includes the following steps: The user writes a test script according to the content to be tested. The test script includes the test module flag and test case flag that need to be enabled. When the test measurement software runs the test script, that is, when the system simulation software enters the test mode, the general flag testMode is turned on; When the general flag testMode is turned on and when the object under test completes the specified action, the object under test needs to send an instruction message of completing the specified action to the test measurement software. If the completion message of the specified action is not received, the test fails. The test measurement software turns on the module test flags of each layer of the protocol stack in turn through the adaptation layer according to the test script requirements, and runs the test cases in the test script; Each time a test case is run, the corresponding test flag is turned on.
2. A mobile communication protocol consistency testing method according to claim 1, characterized in that: The general flag testMode is valid for all modules of the protocol stack, and the protocol stack can only use the general flag testMode and cannot change it.
3. A mobile communication protocol consistency testing method according to claim 1, characterized in that: The process of turning on the testMode flag includes: when the system simulation software is started and the test measurement software is started, the system simulation software enters the initialization phase, a timer is set in the initialization phase, and within the time range specified by the timer, the test measurement software initiates a test mode start notification message. If the system simulation software receives the test mode start notification message within the time range specified by the timer, the testMode flag is successfully turned on and the value of the start flag testMode is set to true. If the test mode start notification message is not received within the time range specified by the timer, the value of the testMode flag is set to false.
4. A mobile communication protocol consistency testing method according to claim 3, characterized in that: When the general flag testMode is turned on, the specified actions completed by the tested object include RRC connection establishment request and voice registration.
5. A mobile communication protocol consistency testing method according to claim 1, characterized in that: The protocol stack includes at least a NAS protocol module, an RRC protocol module, an SDAP protocol module, a PDCP / RLC protocol module and a MAC protocol module.
6. A mobile communication protocol consistency testing method according to claim 5, characterized in that: The test case executed by the object under test is a test of the object under test, and the RRC connection is rejected. After the object under test sends the first RRC connection establishment request to the test measurement software, the test measurement software sends a rejection instruction. When the object under test receives the rejection instruction, it sends a connection request again. After the test measurement software receives the RRC connection establishment request for the second time, the test is successful. In any other case, the test is considered to have failed.
7. A mobile communication protocol consistency testing method according to claim 5, characterized in that: When the loopback activation is completed and the RRC connection is released, the object under test needs to send an indication message of completing the specified action to the test and measurement software, where: Loopback activation requires that the general flag testMode is set to true and the test flag of the PDCP / RLC protocol module is set to true and there is loopback activation in the test case under the PDCP / RLC protocol module. After the loopback activation operation is completed, the object under test sends an indication of the completion of loopback activation to the test measurement software; For RRC connection release, the general flag testMode needs to be set to true and the test flag of the RRC protocol module needs to be set to true. When the object under test completes the RRC connection release, the object under test sends an indication of the completion of the RRC connection release to the test measurement software.
8. A mobile communication protocol consistency testing method according to claim 1, characterized in that: When the test case is executed, if the upper layer protocol module of the protocol module that needs to execute the test case is triggered, the test measurement software sends an instruction to the adaptation layer, and the adaptation layer dynamically turns on the test case flag to call back the corresponding upper layer function to trigger the corresponding upper layer protocol module.
