An automated testing method for a communication module

Abstract

The present application provides an automated testing method for a communication module, which relates to the technical field of communication module testing. It obtains test response information fed back by the communication module under test; determines the configuration permission level of the communication module under test when receiving test connection information in the current network mode according to the communication response log and the test response information; dynamically reconstructs a channel switching instruction for the communication module under test to perform testing in the current network mode according to the communication quality identification code, and adjusts the frequency band switching interval of the communication module under test during communication through the channel switching instruction to obtain a dynamic response sequence of the communication module under test during frequency band switching; and performs an automated test on the network switching process of the communication module under test according to the configuration permission level and the dynamic response sequence. The present application can perform intelligent verification on the network switching process of the communication module during the automated testing process to improve the test coverage rate of the communication module in a complex network environment.

Description

Technical Field

[0001] This application relates to the technical field of communication module testing. More specifically, this application relates to an automated testing method for communication modules. Background Art

[0002] Communication module testing refers to the process of comprehensively verifying and evaluating the connection performance, communication quality, signal processing ability, and network switching behavior of a communication module in different network environments. As an important component for a terminal device to connect to a cellular network or a wireless local area network, the performance of a communication module is directly related to the data transmission stability, response speed, and network compatibility of the device. With the development of technologies such as 5G and the Internet of Things, communication modules need to support more complex frequency band combinations, higher data rates, and more flexible network switching capabilities.

[0003] However, existing automated testing methods for communication modules mainly rely on fixed script control and static testing strategies, making it impossible for the testing process to be dynamically adjusted according to the setting information and real-time communication status of the communication module under test. This results in insufficient test coverage, lagging response capabilities, and an inability to accurately reflect the true behavioral characteristics of the communication module in a complex network environment, thus limiting the comprehensiveness of communication module performance evaluation and the reliability of test results. Therefore, how to intelligently verify the network switching process of a communication module during the automated testing process to improve the test coverage rate of the communication module in a complex network environment has become an urgent problem to be solved. Summary of the Invention

[0004] This application provides an automated testing method for communication modules, which can intelligently verify the network switching process of a communication module during the automated testing process to improve the test coverage rate of the communication module in a complex network environment.

[0005] This application provides an automated testing method for communication modules. The testing method includes the following steps:

[0006] According to the setting information of the communication module under test, control the communication module under test in the target test type and target test mode, and obtain the test response information fed back by the communication module under test;

[0007] During the automated testing process, identify the communication response logs on different channels in the communication module under test, and determine the configuration permission level of the communication module under test when receiving test connection information in the current network mode according to the communication response logs and the test response information;

[0008] Collect the communication quality identification code of the communication module under test in real time, dynamically reconstruct the channel switching instruction for testing the communication module under test in the current network mode according to the communication quality identification code, adjust the frequency band switching interval of the communication module under test during communication through the channel switching instruction, and obtain the dynamic response sequence of the communication module under test during frequency band switching;

[0009] Automatically test the network switching process of the communication module under test according to the configuration permission level and the dynamic response sequence.

[0010] In this embodiment, the test response information refers to the data of the status confirmation, execution result, and exception report returned by the communication module under test after receiving the test control instruction.

[0011] In this embodiment, identifying the communication response logs on different channels in the communication module under test specifically includes:

[0012] Determine the communication interaction records of the communication module under test on different channels;

[0013] Extract the connection response characteristics corresponding to each channel from the communication interaction records;

[0014] Determine the communication response logs on different channels in the communication module under test according to the connection response characteristics.

[0015] In this embodiment, determining the configuration permission level of the communication module under test when receiving the test connection information in the current network mode according to the communication response log and the test response information specifically includes:

[0016] Establish a timing correlation mapping table between the communication response log and the test response information;

[0017] Extract the permission trigger condition of the communication module under test when receiving the test connection information in the current network mode from the timing correlation mapping table;

[0018] Determine the permission evaluation index of the communication module under test when receiving the test connection information in the current network mode according to the permission trigger condition;

[0019] Determine the configuration permission level of the communication module under test when receiving the test connection information in the current network mode through the permission evaluation index.

[0020] In this embodiment, the configuration permission level represents a grading standard divided by the actual capabilities of the communication module when receiving the test connection information.

[0021] In this embodiment, collecting the communication quality identification code of the communication module under test in real time specifically includes:

[0022] Activate the real-time data stream interface of the communication module under test;

[0023] Determine the dynamic quantization encoding of the original metric data through the sampling frequency of the target test mode;

[0024] Generate a communication quality identification code for the communication module under test according to the dynamic quantization encoding.

[0025] In this embodiment, the communication quality identification code is an identifier representing the communication quality status of the communication module.

[0026] In this embodiment, the channel switching instruction is a command for controlling the communication module to perform a channel switching operation.

[0027] In this embodiment, adjusting the frequency band switching interval of the communication module under test during communication through the channel switching instruction to obtain the dynamic response sequence of the communication module under test during frequency band switching specifically includes:

[0028] Determine the initial switching parameters of the communication module under test during communication according to the channel switching instruction;

[0029] Set the frequency band switching interval according to the initial switching parameters, and output the switching response data of the communication module under test during frequency band switching;

[0030] Extract the dynamic frequency band switching characteristics from the switching response data;

[0031] Generate a dynamic response sequence of the communication module under test during frequency band switching according to the dynamic frequency band switching characteristics.

[0032] In this embodiment, automatically testing the network switching process of the communication module under test according to the configuration permission level and the dynamic response sequence specifically includes:

[0033] Match and verify the configuration permission level with the network switching operation permission in the dynamic response sequence to obtain a switching verification request;

[0034] Generate a switching test case set for the communication module under test during the network switching process according to the switching verification request;

[0035] Verify the network switching performance of the communication module under test during the network switching process through the switching test case set, and output an automated test result.

[0036] The technical solution provided by the disclosed embodiments of the present application has the following beneficial effects:

[0037] According to the setting information of the communication module under test, control the communication module under test in the target test type and target test mode, and obtain the test response information fed back by the communication module under test; during the automated test process, identify the communication response logs on different channels in the communication module under test, and determine the configuration permission level of the communication module under test when receiving test connection information in the current network mode according to the communication response logs and the test response information; collect the communication quality identification code of the communication module under test in real time, dynamically reconstruct the channel switching instruction for the communication module under test to perform tests in the current network mode according to the communication quality identification code, and adjust the frequency band switching interval of the communication module under test during communication through the channel switching instruction to obtain the dynamic response sequence of the communication module under test during frequency band switching; perform automated testing on the network switching process of the communication module under test according to the configuration permission level and the dynamic response sequence.

[0038] It can be seen from this application that accurate automated testing is performed on the network switching process of the communication module; among them, by collecting the test response information fed back by the module, the test process can be accurately adapted to the actual configuration state of the module, improving the accuracy of test instruction control and the real-time nature of test data acquisition, thereby ensuring that the test results can truly reflect the configuration performance and interaction capabilities of the communication module; by determining the configuration permission level, the actual state of the connection capabilities and access permissions of each channel of the communication module in the current network mode can be accurately reflected, improving the recognition accuracy of the behavior characteristics of the module in a complex network environment with multiple channels and multiple permissions; by collecting the communication quality identification code in real time and dynamically reconstructing the channel switching instruction, the frequency band switching interval can be flexibly adjusted according to the communication quality change of the communication module under test, thereby effectively capturing the dynamic response behavior of the communication module during the frequency band switching process and improving the comprehensive evaluation ability of the test system for the communication anti-interference ability and switching sensitivity of the module; by comprehensively matching and verifying the network switching process of the communication module through the configuration permission level and the dynamic response sequence, the permission management, switching stability, and connection recovery performance of the module in a complex network switching scenario can be comprehensively detected, realizing efficient, accurate, and automated testing of the network switching process of the communication module.

[0039] In summary, the technical solution adopted in this application can perform intelligent verification on the network switching process of the communication module during the automated test process to improve the test coverage rate of the communication module in a complex network environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only the embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0041] Figure 1 is an exemplary flowchart of the automated testing method for a communication module provided according to the present application;

[0042] Figure 2 is a schematic flowchart of the process for determining the configuration permission level provided according to the present application;

[0043] Figure 3 is a schematic flowchart of the process for reconstructing a channel switching instruction provided according to the present application. Detailed implementation manners

[0044] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present application.

[0045] The embodiments of the present application provide an automated testing method for a communication module. The core is to control the communication module under test according to the setting information of the communication module under test in a target test type and a target test mode, and obtain the test response information fed back by the communication module under test; during the automated testing process, identify the communication response logs on different channels in the communication module under test, and determine the configuration permission level of the communication module under test when receiving test connection information in the current network mode according to the communication response logs and the test response information; collect the communication quality identification codes of the communication module under test in real time, dynamically reconstruct the channel switching instruction for the communication module under test to perform testing in the current network mode according to the communication quality identification codes, adjust the frequency band switching interval of the communication module under test during communication through the channel switching instruction, and obtain the dynamic response sequence of the communication module under test during frequency band switching; perform automated testing on the network switching process of the communication module under test according to the configuration permission level and the dynamic response sequence. Adopting the above solution can perform intelligent verification on the network switching process of the communication module during the automated testing process to improve the test coverage rate of the communication module in a complex network environment.

[0046] To better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings of the specification and specific implementation manners. Refer to Figure 1 As shown, this figure is an exemplary flowchart of the automated testing method for a communication module shown in the embodiments of the present application. The testing method includes the following steps:

[0047] In step S1, according to the setting information of the communication module under test, control the communication module under test in the target test type and target test mode, and obtain the test response information fed back by the communication module under test.

[0048] Specifically, when implemented, according to the setting information of the communication module under test, controlling the communication module under test in the target test type and target test mode can be implemented in the following manner: In the test initialization stage, first, through a standard communication interface, where the standard communication interface can be a serial port, USB, or Ethernet to connect to the communication module under test, and use a preset instruction, which can be a basic query instruction in the AT command set, to read the setting information of the communication module under test, including the supported communication standards, frequency band ranges, and test mode lists. Match the read setting information with the requirements of the test case to determine the target test type (such as residence test, handover test) and target test mode (such as air interface access mode or specific frequency band locking mode). Subsequently, construct a control instruction, encapsulate the specific parameters of the target test type and test mode, and send it to the communication module under test, and the communication module under test performs mode switching and returns an acknowledgment message for execution confirmation.

[0049] It should be noted that in this application, the setting information of the communication module under test represents the comprehensive configuration data of the current capability parameters, supported network standards, frequency band ranges, and available test modes of the communication module under test; the target test type represents the communication module function verification category set according to the test requirements; the target test mode represents the specific communication working state that the communication module under test needs to enter during the test.

[0050] In addition, when implemented specifically, obtaining the test response information fed back by the communication module under test can be implemented in the following manner: After controlling the communication module under test to enter the target test type and mode, continuously listen to the communication interface of the module to receive the feedback data returned in real time. Use an AT command parser or a dedicated driver library to classify and parse the received data, and extract the response content corresponding to the control instruction. The response content usually includes key information such as execution status indication (such as success or failure), confirmation of the current module working mode, and exception error code, and use the response content as the test response information fed back by the communication module under test.

[0051] It should be noted that in this application, the test response information refers to the data of status confirmation, execution result, and exception report returned by the communication module under test after receiving the test control instruction.

[0052] In step S2, during the automated test process, identify the communication response logs on different channels in the communication module under test, and determine the configuration permission level of the communication module under test when receiving test connection information in the current network mode according to the communication response logs and the test response information.

[0053] In this embodiment, the communication response logs on different channels in the communication module under test can be identified by the following steps:

[0054] Determine the communication interaction records of the communication module under test on different channels;

[0055] Extract the connection response features corresponding to each channel from the communication interaction records;

[0056] Determine the communication response logs on different channels in the communication module under test according to the connection response features.

[0057] Specifically, first, during the automated test process, through the log collection interface opened by the communication module, the communication interaction records generated by the module at the physical layer, MAC layer, RLC layer, PDCP layer, RRC layer, and NAS layer are collected in real time. The communication interaction records include various message interaction data, such as RRC connection establishment requests, connection completions, handover requests, cell reselection indications, NAS layer attachment process information, etc.; and a timestamp, channel identifier, and message direction information are attached to each message in the communication interaction records. Then, based on the 3GPP standard, a commercial parsing tool is developed or used, such as the QCAT / QXDM analyzer, to parse the message content of different channels one by one. For control channels (such as SRB0, SRB1), specific response messages such as RRC Connection Setup and RRCConnection Reconfiguration are extracted; for data channels (such as DRB1, DRB2), confirmation messages such as PDCP configuration completion and data bearer establishment completion are extracted; a set of typical connection response features is defined for each channel, including message type, message direction, and response timing relationship. The message pairs that meet the above features in the communication interaction records are screened out as the connection response features corresponding to the channel. Finally, the complete communication interaction records are traversed. For each message in the communication interaction records, according to its message type, direction, timestamp, and associated information, it is matched to see if it meets the connection response features of any channel. If a set of messages meets the response features of a certain channel, these messages are marked and classified into the communication response logs corresponding to the channel. At the same time, indicators such as the feature hit rate and the integrity of the matching order during the matching process are recorded. If an abnormality is found (such as message loss, incorrect order), the log is marked as an abnormal log; after scanning and classifying all the communication interaction records, independent communication response logs for each channel are generated.

[0058] It should be noted that in this application, a channel refers to a logical link for transmitting different types of data between a module and a network; a communication interaction record represents a set of message data generated and exchanged at each level during the communication process of the communication module under test; a connection response feature represents a typical message combination for the communication module to complete the connection and configuration process on a specific channel; a communication response log represents a message sequence for recording the communication process of the module on a specific channel divided according to the connection response feature.

[0059] Preferably, in this embodiment, the configuration permission level of the communication module under test when receiving test connection information in the current network mode is determined according to the communication response log and the test response information. Refer to Figure 2 As shown, this figure is a schematic flowchart of determining the configuration permission level in some embodiments of this application. The determination of the configuration permission level in this embodiment can be implemented by the following steps:

[0060] In step S21, establish a timing correlation mapping table between the communication response log and the test response information;

[0061] In step S22, extract the permission trigger condition of the communication module under test when receiving test connection information in the current network mode from the timing correlation mapping table;

[0062] In step S23, determine the permission evaluation index of the communication module under test when receiving test connection information in the current network mode according to the permission trigger condition;

[0063] In step S24, determine the configuration permission level of the communication module under test when receiving test connection information in the current network mode through the permission evaluation index.

[0064] In specific implementation, first, extract the timestamp, channel number, message type, and key fields (such as connection status code, configuration instruction) of each message from the classified communication response logs; synchronously extract the timestamp, instruction category, and execution result from the test response information, and construct a timing correlation mapping table with the timestamp as the primary key, that is, associate and bind the communication response messages and test response results occurring within the same time period (for example, with a 50ms window). The association and binding method can adopt a sliding time window matching mechanism, cross-compare the communication response logs and test response information appearing within the corresponding window, and mark the corresponding relationship. Then, based on the timing correlation mapping table, analyze the specific communication behavior of the module after each test instruction is triggered, and extract the key response events that occur when the module receives test connection information, such as: successfully completing cell reselection, successful RRC reconfiguration, successful establishment of uplink and downlink bearers, authentication acceptance, etc. Based on the sequence, completion status, and whether there are exceptions (such as rejection, timeout) of the events, summarize a set of permission trigger conditions, which include: whether a specific RRC Connection Reconfiguration message is received, whether the SRB1 and DRB1 channels are successfully established, and whether the authentication process is completed. Then, set a weight value for each permission trigger condition, calculate the comprehensive score according to the situation where the tested communication module meets each permission trigger condition during the test process, and use the comprehensive score as the permission evaluation index. The comprehensive score can be calculated using the weighted score method, that is, for each condition met, add the corresponding weight score, otherwise do not add points or deduct points. For example: adding 30 points for successfully establishing the SRB1 channel; adding 40 points for successfully completing NAS Attach; adding 20 points for receiving a cell reselection command; deducting 10 points for a connection failure. Finally, accumulate all the scores to obtain the permission evaluation index of the module in this test scenario, and normalize the permission evaluation index to between 0 and 100. Among them, the setting of the comprehensive score value can be obtained based on expert experience or simulation experiments, which is not limited here. Finally, preset the permission level standard, where the permission level standard can be: defining 0 - 40 points as low permission, 41 - 70 points as medium permission, and 71 - 100 points as high permission, which is not limited here. Map the permission evaluation index to the corresponding configured permission level to obtain the configured permission level of the tested communication module when receiving test connection information in the current network mode. After determining the configured permission level, mark it in the test record for guiding the selection of the test process. For example: a low-permission module only performs basic access tests; a medium-permission module adds handover tests; a high-permission module performs complete bearer configuration and handover tests.

[0065] It should be noted that in this application, the test connection information refers to the configuration signaling and control messages during the network access, maintenance, and handover processes for verifying the connection ability of the communication module; the timing correlation mapping table is a data table representing the relationships between test response information; the permission trigger condition represents a set of basic communication behaviors used to determine whether a certain permission level is met during the process of the communication module receiving the test connection information; the permission evaluation index represents the ability to evaluate the communication module under test to receive the test connection information; the configuration permission level represents a grading standard divided according to the actual ability of the communication module when receiving the test connection information.

[0066] In step S3, the communication quality identification code of the communication module under test is collected in real time, and according to the communication quality identification code, a channel switching instruction for the communication module under test to perform a test in the current network mode is dynamically reconstructed. The frequency band switching interval during the communication of the communication module under test is adjusted through the channel switching instruction, and a dynamic response sequence during the frequency band switching of the communication module under test is obtained.

[0067] In this embodiment, the real-time collection of the communication quality identification code of the communication module under test can be achieved through the following steps:

[0068] Activate the real-time data stream interface of the communication module under test;

[0069] Determine the dynamic quantization coding of the original index data through the sampling frequency of the target test mode;

[0070] Generate the communication quality identification code of the communication module under test according to the dynamic quantization coding.

[0071] In specific implementation, first, establish a connection using a communication protocol compatible with the communication module under test to ensure the availability of the real-time data stream interface of the communication module under test. According to the test requirements, send initialization commands through AT commands, device management tools, or dedicated APIs to activate the real-time data stream interface. Then, determine the sampling frequency according to the requirements of the target test mode (such as signal strength monitoring, frequency hopping). The sampling frequency can be once per second, ten times per minute, etc. The sampling frequency depends on the accuracy and real-time performance required by the test and is not limited here. After determining the sampling frequency, encode the data using a dynamic quantization algorithm based on the original metric data (such as signal quality, access delay, etc.) obtained from the real-time data stream. For example, the signal strength can be quantified using a segmented dynamic range, and each signal range corresponds to a specific quantization value. For example, a signal strength from -90 dBm to -80 dBm is quantified as 1, -80 dBm to -70 dBm is quantified as 2, and so on. The quantization value is used as the dynamic quantization code. Finally, preset dynamic quantization rules through communication test experiments. After converting each original metric data into the corresponding quantization code, further generate a communication quality identification code according to the quantization code. The communication quality identification code can be a 32-bit binary number or a 64-bit binary number, which is used to represent the overall state of the communication quality. The specific generation method can be to combine different quantization codes (such as signal strength, packet loss rate, delay, etc.) in a predetermined order to form a comprehensive code. For example, if the signal quality quantization value is 2, the packet loss rate quantization value is 1, and the delay quantization value is 3, the comprehensive identification code can be expressed as "2-1-3".

[0072] It should be noted that in this application, the real-time data stream interface refers to the interface used to transmit the communication quality and status information of the module in real time; the original metric data refers to the data related to the communication quality of the module collected in real time; the dynamic quantization code refers to dynamically grading or quantifying according to the characteristics of the real-time data and converting it into coded data that meets specific standards; the communication quality identification code refers to the identifier of the communication quality status of the communication module.

[0073] Preferably, in this embodiment, according to the communication quality identification code, dynamically reconstruct the channel switching instruction for the communication module under test to perform tests in the current network mode, as shown in Figure 3 The figure is a schematic flow chart of reconstructing the channel switching instruction in some embodiments of this application. The channel switching instruction in this embodiment can be implemented by the following steps:

[0074] In step S31, parse the communication anti-interference index in the communication quality identification code;

[0075] In step S32, generate a dynamic switching strategy in combination with the channel switching rules of the current network mode;

[0076] In step S33, determine the channel switching efficiency according to the communication anti-interference index and the dynamic switching strategy;

[0077] In step S34, generate a channel switching instruction for testing the communication module under test in the current network mode according to the channel switching efficiency.

[0078] In specific implementation, first, by parsing the communication quality identification code, the communication anti-interference indicators in the communication quality identification code are extracted. The communication anti-interference indicators reflect the anti-interference ability of the measured communication module in the current channel environment, including signal-to-noise ratio, interference degree in the channel, and error ratio in data transmission. The communication anti-interference indicators can be represented by different fields in the communication quality identification code. For example, signal strength and bit error rate can be mapped to the high or low bits of the communication quality identification code through quantization values, while the channel interference index can be identified by a special field, and algorithms are used to parse the binary identification code or a developed communication decoding module to extract the communication anti-interference indicators, which will not be elaborated here. Then, combining the standard protocol of the current network mode and the channel switching rules, a corresponding dynamic switching strategy is generated based on the communication anti-interference indicators. Specifically, it includes: according to different communication anti-interference indicators, selecting appropriate channel switching conditions. For example, if the signal-to-noise ratio is lower than a certain threshold (such as -95 dBm), then trigger frequency band switching; if the interference index is relatively high, consider switching to other cells or frequency bands to avoid interference; and combining the limitations and capabilities of the network mode, setting the switching frequency and delay requirements. For example, in the 5G NR mode, if the bearing capacity is relatively high, the switching frequency can be increased and the channel switching delay can be reduced; mapping the channel switching conditions and channel switching rules into a dynamic switching strategy to form a decision tree or a set of conditional judgment rules. Each combination of network mode and communication anti-interference indicators corresponds to a dynamic switching strategy to adapt to different network environments and channel qualities. Then, combining the communication anti-interference indicators and the dynamic switching strategy, the channel switching efficiency is evaluated. The evaluation of channel switching efficiency includes: switching success rate (evaluating the success probability of the switching operation under given anti-interference conditions. For example, if the signal quality is poor, the success probability of switching may be low), switching delay (evaluating the time required from triggering the switch to completing the switch. A higher interference index may lead to a longer switching delay), and network performance after switching (evaluating the stability and data throughput of the connection after switching. For example, indicators such as packet loss rate and delay after switching); and based on the evaluation results of channel switching efficiency, a channel switching efficiency score (such as 0 - 100 points) is generated to determine whether the current dynamic switching strategy is effective and whether adjustment is needed. Finally, if the channel switching efficiency is high, a channel switching instruction is generated to perform operations such as frequency band switching, network switching, or cell switching; if the switching efficiency is low or does not meet the requirements, the switching strategy is adjusted or the switching operation is postponed to avoid performing failed switches. The generated channel switching instruction can be sent to the measured communication module through the control interface of the measured communication module to notify the measured communication module to perform corresponding network switching or channel adjustment operations.

[0079] It should be noted that in this application, the communication anti-interference index represents a parameter reflecting the anti-interference ability of the communication module in the current channel; the channel switching rule refers to the standard protocol and process that defines how to perform channel switching based on communication quality and network conditions in a specific network mode; the dynamic switching strategy represents a switching decision-making scheme generated based on real-time communication quality and network status; the channel switching efficiency represents a comprehensive score for evaluating the channel switching effect; the channel switching instruction represents a command for controlling the communication module to perform the channel switching operation.

[0080] In this embodiment, adjusting the frequency band switching interval of the communication module under test during communication through the channel switching instruction, and obtaining the dynamic response sequence during the frequency band switching of the communication module under test can be achieved by the following steps:

[0081] Determine the initial switching parameters of the communication module under test during communication according to the channel switching instruction;

[0082] Set the frequency band switching interval according to the initial switching parameters, and output the switching response data of the communication module under test during the frequency band switching;

[0083] Extract the dynamic frequency band switching characteristics from the switching response data;

[0084] Generate the dynamic response sequence of the communication module under test during the frequency band switching according to the dynamic frequency band switching characteristics.

[0085] In specific implementation, first, according to the channel switching instruction, extract the information related to frequency band switching in the channel switching instruction, and determine the initial switching parameters when the communication module under test performs frequency band switching. The initial switching parameters include the frequency band switching time (the time required from issuing the switching instruction to completing the frequency band switching); the frequency band switching threshold (under what circumstances to initiate frequency band switching, for example, triggering when the signal quality is lower than a certain threshold); the maximum number of switches (the maximum number of frequency band switches allowed within a specified time window, used to avoid network instability caused by frequent switching). Then, using the extracted initial switching parameters, set the frequency band switching interval. The frequency band switching interval determines the time interval between switching operations and can affect the switching frequency and network stability. The set frequency band switching interval includes: in the case of high load, the frequency band switching interval needs to be increased to avoid the additional network pressure brought by frequent switching; if the signal quality is poor, the switching interval needs to be shortened to quickly adjust the frequency band to improve the connection quality; according to the maximum number of switches, set the switching interval to avoid exceeding the set number of switches. After setting the frequency band switching interval, the communication module under test will perform frequency band switching according to the set parameters and generate switching response data. Then, extract the key features of dynamic frequency band switching from the switching response data, that is, the dynamic frequency band switching features. The dynamic frequency band switching features include: switching success rate, change in signal strength after switching, switching delay, change in inter-band interference, and the dynamic frequency band switching features can be extracted through time series analysis and data mining. Finally, based on the dynamic frequency band switching features extracted from the switching response data, generate the dynamic response sequence of the communication module under test during frequency band switching. The dynamic response sequence is an instruction set or data sequence arranged in chronological order, representing the response behavior of the communication module during the frequency band switching process. The generation process includes: first, organize the extracted frequency band switching features (such as switching success, change in signal strength, etc.) into a series of response events in chronological order, then map each switching response to a specific state (such as before and after switching, change in signal quality, etc.) to generate a clear response sequence, and adjust the generation rules of the response sequence to optimize the response time and switching success rate during the switching process, and finally generate the dynamic response sequence.

[0086] It should be noted that in this application, the initial switching parameters represent the basic parameters required during the frequency band switching process; the frequency band switching interval refers to the time interval between two frequency band switches; the switching response data represents the data feedback by the communication module under test during the frequency band switching process; the dynamic frequency band switching features represent the key data features reflecting the switching effect during the frequency band switching process; the dynamic response sequence represents the response data sequence generated by the communication module under test during the frequency band switching process.

[0087] In step S4, automate the test of the network switching process of the communication module under test according to the configured permission level and the dynamic response sequence.

[0088] In this embodiment, the automated test of the network switching process of the communication module under test according to the configured permission level and the dynamic response sequence can be implemented by the following steps:

[0089] Match and verify the configured permission level with the network switching operation permission in the dynamic response sequence to obtain a switching verification request;

[0090] Generate a switching test case set for the communication module under test during the network switching process according to the switching verification request;

[0091] Verify the network switching performance of the communication module under test during the network switching process through the switching test case set, and output the automated test result.

[0092] In specific implementation, first, extract various permission information in the configured permission level, including the allowed channel switching types, switching trigger conditions, switching limit parameters, etc.; at the same time, identify the specific execution situations of each network switching action from the dynamic response sequence, including the permission call records and switching operation behaviors when the switching is initiated. Adopt a permission matching and verification mechanism, that is: compare each permission call involved in each network switching action in the dynamic response sequence with the permission items in the configured permission level one by one. If the dynamic response behavior conforms to the configured permission regulations, mark it as legal; if not, mark it as abnormal. The matching result is output in the form of structured data to form a handover verification request. The handover verification request includes content such as handover action identification, corresponding permission verification status, and abnormal mark. Then, taking the handover verification request as the input, generate a handover test case set. The process of generating the handover test case set includes: for the legally matched handover requests, generate standard handover test cases and record the normal handover process; for the handover requests marked as abnormal, generate abnormal handover test cases to focus on testing the response behavior of the module in the case of unauthorized handover; classify and organize the test cases according to the network mode (such as LTE, 5G NSA, 5G SA, etc.) and handover scenarios (such as idle state handover, connected state handover, cross-band handover). Each test case defines detailed test inputs (such as start frequency band, target frequency band, trigger condition), expected outputs (such as handover completion status, signal quality change), and abnormal handling mechanisms. Use all test cases as the handover test case set for the communication module under test during network handover. Finally, load the generated handover test case set and automatically execute each test case. During the execution process, the system records in real time: handover success rate (whether the handover can be successfully completed as expected after the handover request is initiated), handover delay (the time consumed from initiating the handover instruction to the completion of the handover), connection quality after handover (the change of signal quality indicators after the handover is completed), and handover process exceptions (abnormal events such as handover failure, interruption and reconnection, connection loss, etc.). After the execution is completed, the automated test framework scores each test case according to the preset judgment rules and outputs a detailed test report, including success rate statistics, delay analysis, and details of abnormal items.

[0093] It should be noted that in this application, the network switching operation permission represents the operation scope and control conditions for the communication module under test to perform specific type of frequency band or system switching in a specific network mode; the handover verification request represents the verification task unit generated during the permission matching process; the handover test case set represents a set composed of a group of standardized test cases for different network handover scenarios; the network handover performance represents the comprehensive ability of the communication module under test to complete the handover operation in different network environments, including the success rate, delay performance, and connection stability.

[0094] It can be seen that in this application, an accurate automated test is performed on the network switching process of the communication module. Among them, by collecting the test response information fed back by the acquisition module, the test process can be accurately adapted to the actual configuration state of the module, improving the accuracy of test instruction control and the real-time performance of test data acquisition, so as to ensure that the test results can truly reflect the configuration performance and interaction ability of the communication module. By determining the configuration permission level, the actual state of the channel connection ability and access permission of the communication module in the current network mode can be accurately reflected, improving the recognition accuracy of the behavior characteristics of the module in a complex network environment with multiple channels and multiple permissions. By collecting the communication quality identification code in real time and dynamically reconstructing the channel switching instruction, the frequency band switching interval can be flexibly adjusted according to the communication quality change of the communication module under test, so as to effectively capture the dynamic response behavior of the communication module during the frequency band switching process and improve the comprehensive evaluation ability of the test system for the communication anti-interference ability and switching sensitivity of the module. By comprehensively configuring the permission level and the dynamic response sequence to perform intelligent matching verification on the network switching process of the communication module, the permission management, switching stability and connection recovery performance of the module in a complex network switching scenario can be comprehensively detected, realizing an efficient, accurate and automated test of the network switching process of the communication module. In summary, the technical solution adopted in this application can perform intelligent verification on the network switching process of the communication module during the automated test process to improve the test coverage rate of the communication module in a complex network environment.

[0095] This application is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to embodiments of the present application. It should be understood that each process and / or block in the flowcharts and / or block diagrams can be implemented by computer program instructions, and the combination of processes and / or blocks in the flowcharts and / or block diagrams can also be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for realizing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0096] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium includes read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc memories, magnetic disk memories, tape memories, or any other medium that can be used to carry or store data and is computer-readable.

[0097] It should also be noted that the term "including", "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or also includes elements inherent in such a process, method, commodity or device. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of another identical element in the process, method, commodity or device including the element.

Claims

1. An automated testing method for a communication module, characterized in that, The described test method includes the following steps: According to the setting information of the communication module under test, control the communication module under test in the target test type and target test mode, and obtain the test response information fed back by the communication module under test; During the automated test process, identify the communication response logs on different channels in the communication module under test, and determine the configuration permission level of the communication module under test when receiving test connection information in the current network mode according to the communication response logs and the test response information; Collect the communication quality identification code of the communication module under test in real time, dynamically reconstruct the channel switching instruction for the communication module under test to perform the test in the current network mode according to the communication quality identification code, and adjust the frequency band switching interval of the communication module under test during communication through the channel switching instruction to obtain the dynamic response sequence of the communication module under test during frequency band switching; Automatically test the network switching process of the communication module under test according to the configuration permission level and the dynamic response sequence.

2. The automated test method for a communication module according to claim 1, characterized in that The described test response information refers to the data of status confirmation, execution result, and exception report returned by the communication module under test after receiving the test control instruction.

3. An automated test method for a communication module according to claim 1, characterized in that, Identifying the communication response logs on different channels in the communication module under test specifically includes: Determine the communication interaction records of the communication module under test on different channels; Extract the connection response characteristics corresponding to each channel from the communication interaction records; Determine the communication response logs on different channels in the communication module under test according to the connection response characteristics.

4. The automated test method for a communication module according to claim 1, characterized in that, Determining the configuration permission level of the communication module under test when receiving test connection information in the current network mode according to the communication response logs and the test response information specifically includes: Establish a timing correlation mapping table between the communication response logs and the test response information; Extract the permission trigger conditions of the communication module under test when receiving test connection information in the current network mode from the timing correlation mapping table; Determine the permission evaluation index of the communication module under test when receiving test connection information in the current network mode according to the permission trigger conditions; Determine the configuration permission level of the communication module under test when receiving test connection information in the current network mode through the permission evaluation index.

5. An automated test method for a communication module according to claim 1, characterized in that, The described configuration permission level represents the grading standard divided by the actual capabilities of the communication module when receiving test connection information.

6. The automated test method for a communication module according to claim 1, wherein, Collecting the communication quality identification code of the communication module under test in real time specifically includes: Activate the real-time data stream interface of the communication module under test; Determine the dynamic quantization coding of the original index data through the sampling frequency of the target test mode; Generate the communication quality identification code of the communication module under test according to the dynamic quantization coding.

7. The automated test method for a communication module according to claim 1, characterized in that, The described communication quality identification code represents the identifier of the communication quality status of the communication module.

8. The automated test method for a communication module according to claim 1, characterized in that The described channel switching instruction represents the command to control the communication module to perform the channel switching operation.

9. The automated test method for a communication module according to claim 1, wherein Adjusting the frequency band switching interval of the communication module under test during communication through the channel switching instruction to obtain the dynamic response sequence of the communication module under test during frequency band switching specifically includes: Determine the initial switching parameters of the communication module under test during communication according to the channel switching instruction; Set the frequency band switching interval according to the initial switching parameters, and output the switching response data of the communication module under test during frequency band switching; Extract dynamic frequency band switching features from the switching response data; Generate a dynamic response sequence of the communication module under test during frequency band switching according to the dynamic frequency band switching features.

10. The automated test method for a communication module according to claim 1, wherein, Automatically testing the network switching process of the communication module under test according to the configured permission level and the dynamic response sequence specifically includes: Match and verify the configured permission level with the network switching operation permission in the dynamic response sequence to obtain a switching verification request; Generate a switching test case set of the communication module under test during the network switching process according to the switching verification request; Verify the network switching performance of the communication module under test during the network switching process through the switching test case set and output the automated test result.

Images