A WLAN Interoperability Testing Method and Device

Abstract

The present invention relates to the technical field of WLAN, and provides a WLAN interoperability testing method and apparatus. By configuring a test case database, analyzing the WLAN product testing requirements based on the WLAN product information and the test case database to obtain the test cases to be tested, analyzing the test cases to be tested to determine the test instructions required for each test case, and starting the test execution of the test cases to be tested on the WLAN interoperability testing platform, automatically collecting test logs from the WLAN interoperability testing platform, analyzing and judging the test logs to obtain the test results, key performance indicators and potential problems of the WLAN product. When the test cases to be tested are being tested on the WLAN interoperability testing platform, the running state of the WLAN interoperability testing platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring results, thereby reducing the execution cost and difficulty of the testing.

Description

Technical Field

[0001] The present invention relates to the technical field of WLAN, and in particular to a method and device for WLAN interoperability testing. Background Art

[0002] Mainstream WLAN products are intelligent devices such as mobile phones, routers and APs, tablet computers and PCs. With the wide deployment of various WLAN standards and various WLAN devices, ensuring the interoperability between different protocols and different WLAN devices, as well as ensuring the reliability, integrity and security of WLAN communication, has become an issue of great concern in the industry. However, the requirements for WLAN interoperability testing are complex, involving the interoperability between different devices, different WLAN standards and protocols. Engineers need to have a professional technical background to be able to analyze the test requirements of WLAN products, design test cases, install test tools on WLAN products, and conduct corresponding tests. In addition, the automation level of the original WLAN interoperability test platform is relatively low. The execution of each test case requires engineers to manually input test instructions to start the test, resulting in a relatively high execution cost for WLAN interoperability testing. In addition, the original WLAN interoperability test platform cannot judge the test results. Professional engineers need to analyze each test log item by item to obtain the test results, resulting in great difficulty in sorting out the WLAN interoperability test results. When the test cases are executed, if there is no real-time monitoring by engineers, the test system may be in an idle state, resulting in waste of resources and relatively high management and maintenance costs for the WLAN interoperability test platform.

[0003] In summary, the existing WLAN interoperability testing technology has technical problems such as high professional requirements for testers, relatively high execution costs for WLAN interoperability testing, great difficulty in sorting out WLAN interoperability test results, and relatively high management and maintenance costs for the WLAN interoperability test platform. Summary of the Invention

[0004] In view of the above deficiencies in the prior art, the present invention provides a method and device for WLAN interoperability testing to reduce the professional requirements for testers, reduce the execution costs, management and maintenance costs of WLAN interoperability testing, and reduce the difficulty of sorting out WLAN interoperability test results.

[0005] In a first aspect, the present invention provides a method for WLAN interoperability testing, including:

[0006] Configuring a test case database, and analyzing the test requirements of the WLAN product according to the WLAN product information and the test case database to obtain the test cases to be tested;

[0007] Analyze the test cases to be tested, determine the test instructions required for each test case, and initiate the test execution of the test cases to be tested on the WLAN interoperability test platform;

[0008] Automatically collect the test logs generated after the execution of the test cases from the WLAN interoperability test platform, analyze and judge the test logs to obtain the test results, key performance indicators, and potential problems of the WLAN product;

[0009] When the test cases to be tested are being tested on the WLAN interoperability test platform, monitor the running status of the WLAN interoperability test platform in real time and automatically, and perform corresponding processing according to the monitoring results.

[0010] Furthermore, conduct an analysis of the WLAN product test requirements based on the WLAN product information and the test case database to obtain the test cases to be tested, including:

[0011] Enter the WLAN product information into the local computing system through the WLAN product information entry module;

[0012] Through the information database comparison module, compare the entered real-time WLAN product information with the test cases in the test case database to determine the test cases to be tested.

[0013] Furthermore, after determining the test cases to be tested, read the completed test cases from the local computing system through the test case reading module.

[0014] Furthermore, after determining the test cases to be tested, classify and export the test cases to be tested through the test case classification module to obtain the grouped test cases to be tested, and the grouped test cases to be tested are the test case groups.

[0015] Furthermore, when analyzing the test cases to be tested to determine the test instructions required for each test case, it includes: importing the test cases to be tested into the local computing system through the test case import module, and analyzing the imported test cases through the test case analysis module to determine the test instructions required for each test case.

[0016] Furthermore, when initiating the test execution of the test cases to be tested on the WLAN interoperability test platform, it includes: initiating the test execution of the test cases to be tested on the WLAN interoperability test platform through the test case test module. When the test cases are being tested on the WLAN interoperability test platform, the test instructions required for each test case are running on the WLAN interoperability test platform.

[0017] Furthermore, after each test case is completed, the test case testing module automatically determines whether there are subsequent test cases that need to be tested and executed.

[0018] Furthermore, when automatically collecting the test logs generated after the execution of the test cases from the WLAN interoperability test platform, it includes: automatically collecting the test logs generated after the execution of the test cases from the WLAN interoperability test platform through the log collection module.

[0019] Furthermore, when analyzing and judging the test logs, it includes: automatically analyzing the test logs through the log analysis module to identify the key performance indicators and potential problems of the WLAN product; based on the analysis results of the log analysis module, the result judgment module automatically determines whether the test passes or fails and identifies the key problems in the test.

[0020] In a second aspect, the present invention provides a WLAN interoperability test device. The WLAN interoperability test device uses the WLAN interoperability test method described in any one of the above, and the WLAN interoperability test device includes:

[0021] A product requirement analysis module, configured to configure a test case database, and perform WLAN product test requirement analysis based on the WLAN product information and the test case database to obtain the test cases that need to be tested;

[0022] An automatic test module, configured to analyze the test cases that need to be tested, determine the test instructions required for each test case, and start the test execution of the test cases that need to be tested on the WLAN interoperability test platform;

[0023] A result analysis module, configured to automatically collect the test logs generated after the execution of the test cases from the WLAN interoperability test platform, analyze and judge the test logs to obtain the test results, key performance indicators and potential problems of the WLAN product;

[0024] A monitoring module, configured to, when the test cases that need to be tested are being tested on the WLAN interoperability test platform, perform real-time automatic monitoring on the running state of the WLAN interoperability test platform and perform corresponding processing according to the monitoring results.

[0025] Compared with the prior art, the present invention has the following beneficial effects:

[0026] The present invention provides a WLAN interoperability testing method and apparatus. By configuring a test case database, analyzing the WLAN product testing requirements based on the WLAN product information and the test case database to obtain the test cases to be tested, analyzing the test cases to be tested to determine the test instructions required for each test case, and starting the test execution of the test cases to be tested on the WLAN interoperability testing platform, automatically collecting the test logs generated after the execution of the test cases from the WLAN interoperability testing platform, analyzing and judging the test logs to obtain the test results, the key performance indicators and potential problems of the WLAN product. When the test cases to be tested are being tested on the WLAN interoperability testing platform, the running state of the WLAN interoperability testing platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring results, thereby reducing the professional requirements for testers, reducing the execution cost, management and maintenance cost of the WLAN interoperability testing, and reducing the difficulty of sorting out the WLAN interoperability test results. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The drawings described herein are used to provide a further understanding of the present invention and form a part of the present invention. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation to the present invention. Some specific embodiments of the present invention will be described in detail hereinafter with reference to the drawings in an exemplary rather than restrictive manner. The same reference numerals in the drawings denote the same or similar components or parts. Those skilled in the art should understand that these drawings are not necessarily drawn to scale. In the drawings:

[0028] Figure 1 is a flowchart of a WLAN interoperability testing method according to an embodiment of the present invention;

[0029] Figure 2 is a schematic architecture diagram of a WLAN interoperability testing apparatus according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0030] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments will be clearly and completely described below with reference to the drawings in the embodiments. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of protection of the present invention.

[0031] Embodiment 1

[0032] See Figure 1, this embodiment provides a WLAN interoperability test method, and the WLAN interoperability test method includes the following steps:

[0033] S101. Configure a test case database, and perform WLAN product test requirement analysis based on the WLAN product information and the test case database to obtain the test cases that need to be tested; wherein, the WLAN product information can be an Excel data sheet of the WLAN product. When performing WLAN product test requirement analysis, it can be determined which test cases are mandatory, and NotTested can be selected.

[0034] S102. Analyze the test cases that need to be tested, determine the test instructions required for each test case, and start the test execution of the test cases that need to be tested on the WLAN interoperability test platform;

[0035] S103. Automatically collect the test logs generated after the execution of the test cases from the WLAN interoperability test platform, and analyze and judge the test logs to obtain the test results, the key performance indicators and potential problems of the WLAN product; wherein, the key performance indicator of the WLAN product can be the extracted throughput.

[0036] S104. When the test cases that need to be tested are being tested on the WLAN interoperability test platform, perform real-time automatic monitoring on the running state of the WLAN interoperability test platform, and perform corresponding processing according to the monitoring results. For example, notify the test results to the tester.

[0037] It should be noted that in this embodiment, the WLAN products include, but are not limited to, intelligent devices such as mobile phones, routers and APs, tablet computers and PCs. Different WLAN products support different protocols, standards and functions, and it is necessary to conduct test requirement analysis to determine which test cases need to be executed. In step S101, by configuring the test case database, WLAN product test requirement analysis is carried out according to the WLAN product information and the test case database to obtain the test cases to be tested, so that the test requirements of different devices, standards and protocols can be modularized and standardized, reducing the complexity of manual analysis and lowering the professional requirements for testers. In addition, each test case needs to execute a series of specific instructions, and manual input is error-prone and inefficient. In step S102, by analyzing the test cases to be tested, the test instructions required for each test case are determined, and the test execution of the test cases to be tested is started on the WLAN interoperability test platform, which can improve the execution efficiency, reduce human intervention, reduce the time-consuming work of manual input, and reduce errors and test interruptions caused by manual operations. In addition, a large amount of log data is generated after the test execution, and the manual analysis process is cumbersome and prone to missing key information. In step S103, by automatically collecting the test logs generated after the execution of the test cases from the WLAN interoperability test platform and analyzing and judging the test logs, the test results, key performance indicators and potential problems of the WLAN products can be obtained, so that potential problems can be discovered faster, and the test coverage and accuracy can be improved. In step S104, by automatically monitoring the running state of the WLAN interoperability test platform in real time during the test and performing corresponding processing according to the monitoring results, the need for manual monitoring can be reduced, the dependence on continuous monitoring of engineers can be lowered, and through real-time monitoring and dynamic processing, situations such as resource idleness can be minimized.

[0038] In some preferred embodiments, WLAN product test requirement analysis is carried out according to the WLAN product information and the test case database to obtain the test cases to be tested, including: inputting the WLAN product information into the local computing system through the WLAN product information input module; through the information database comparison module, comparing the input real-time WLAN product information with the test cases in the test case database to judge the test cases to be tested. It should be noted that there are many types of WLAN products, and different products may support different protocols, standards and functions. Therefore, a unified entry is needed to collect this information. In this embodiment, through the dedicated WLAN product information input module, the accuracy and consistency of information input can be ensured, providing reliable data for subsequent comparison. In addition, through the information database comparison module, the test cases related to the WLAN products can be quickly located, reducing the time-consuming and inefficient problems of manual analysis, eliminating the need for engineers to match test cases one by one, and reducing the dependence on professional knowledge.

[0039] In some preferred embodiments, after determining the test cases to be tested, the test case reading module reads the completed test cases from the local computing system. Among them, the test case reading module can be a filling tool. It should be noted that there may be partial repetitions in test cases, especially in multi-round tests or tests for different products. By reading the completed test cases, the repeated execution of the tested scenarios can be reduced. The records of the completed use cases are directly obtained from the local system, and the untested use cases are quickly screened out, reducing repetitive work and saving test time. In this embodiment, through the test case reading module, it is possible to automatically identify which use cases are completed and which are not, realizing real-time tracking and management of the test case status, without manually marking the use case status, without continuously loading and processing all use cases, reducing the overload of the system due to processing redundant information, and reducing the storage and computing burden.

[0040] In some preferred embodiments, after determining the test cases to be tested, the test case classification module classifies and exports the test cases to be tested to obtain grouped test cases to be tested, and the grouped test cases to be tested are test case groups. Among them, the classification can be divided into pass and fail, and can be divided into 2.4GHz, 5GHz, and 6GHz.

[0041] It should be noted that WLAN product testing involves multiple standards, protocols, and devices. Test case classification can decompose complex test scenarios into more manageable modules. Through grouping, test cases can be divided according to dimensions such as function, performance, and interoperability, making the test process more systematic and organized, thereby improving the test execution efficiency.

[0042] In some preferred embodiments, when analyzing the test cases to be tested and determining the test instructions required for each test case, it includes: importing the test cases to be tested into the local computing system through the test case import module, and analyzing the imported test cases through the test case analysis module to determine the test instructions required for each test case. Specifically, different startup instructions can be written according to different platforms, such as 11n VHT EHT etc. Additionally, during the import process, the test case data can be normalized to ensure that all cases can be correctly loaded and adapted to the system. Additionally, WLAN test cases usually correspond to different devices, protocols, and functions. Through the test case analysis module, the case content can be automatically parsed and test instructions can be generated, reducing manual input and configuration. Further, the test case analysis module can identify the priorities and dependencies of the test cases, thereby optimizing the generation order of the test instructions to ensure efficient use of resources. Further, for test cases containing multiple test steps or dependencies, the test case analysis module automatically splits the above test cases and generates multiple instructions, thereby reducing manual intervention. For example, a DPP test case is split into ABCD, and split into 2.4GHz and 5GHz.

[0043] In some preferred embodiments, when starting the test execution of the test cases to be tested on the WLAN interoperability test platform, it includes: starting the test execution of the test cases to be tested on the WLAN interoperability test platform through the test case test module. When the test cases are tested on the WLAN interoperability test platform, the test instructions required for each test case run on the WLAN interoperability test platform. It should be noted that automatically starting the test through the test case test module can reduce the cumbersome steps for engineers to start test cases one by one and improve efficiency. The automation from test case loading to instruction execution in this embodiment can reduce human intervention, achieve a more efficient test process, reduce the time and operation complexity required for manual input of test instructions, and reduce omissions or errors that may be caused by manual operations.

[0044] In some preferred embodiments, after each test case is completed, the test case test module automatically determines whether there are subsequent test cases that need to be tested. For example, the start group test. It should be noted that the test case test module automatically determining whether there are subsequent test cases can eliminate the need for manual inspection and starting of subsequent tests, ensuring the smooth progress of the test process. Immediately judging and starting subsequent tests after the test case is completed, thereby reducing the time interval during the test, reducing the complexity and interference of human participation, eliminating waiting time, and improving the test execution efficiency.

[0045] In some preferred embodiments, when automatically collecting the test logs generated after the execution of test cases from the WLAN interoperability test platform, it includes: automatically collecting the test logs generated after the execution of test cases from the WLAN interoperability test platform through a log collection module. It should be noted that test log collection is an important part of the test process. Manual collection is prone to low efficiency and may miss key logs. In this embodiment, by automatically collecting the test logs generated after the execution of test cases from the WLAN interoperability test platform through the log collection module, the logs can be obtained quickly and accurately, meeting the requirements of efficient testing, ensuring that all relevant logs are completely collected, and facilitating real-time analysis and problem location.

[0046] In some preferred embodiments, when analyzing and judging the test logs, it includes: automatically analyzing the test logs through a log analysis module to identify the key performance indicators and potential problems of the WLAN product; automatically judging whether the test passes or fails based on the analysis results of the log analysis module through a result judgment module, and identifying the key problems in the test. It should be noted that manual analysis of test logs is time-consuming and laborious and is prone to missing key information. In this embodiment, by automatically analyzing the test logs through the log analysis module, the key performance indicators and potential problems can be quickly and comprehensively extracted. In addition, in this embodiment, by automatically judging whether the test passes or fails based on the analysis results of the log analysis module through the result judgment module, and identifying the key problems in the test, the subjectivity of manual evaluation can be reduced, and the results of multiple test cases can be processed quickly, improving the test reliability and meeting the requirements of batch testing.

[0047] In some further preferred embodiments, when performing corresponding processing according to the monitoring results, it may include: after detecting that the test case has been executed, automatically allocating resources to other test cases to be executed, or releasing the resources back to the resource pool to reduce resource waste; storing the test results and monitoring logs for subsequent analysis, and sending the test results to the tester. It should be noted that after the test case is executed, resources are automatically allocated to other test cases to be executed according to the resource requirements to ensure the efficient execution of the test tasks. After the test is completed, the idle resources are promptly released back to the resource pool to reduce the long-term idleness of resources. In this embodiment, by dynamically allocating and releasing resources, it is ensured that the hardware and software resources of the test platform are maximally utilized, which can meet the requirements of parallel operation of multiple test cases, shorten the test cycle, reduce unnecessary resource waste, and lower the operating cost of the test platform. In addition, storing the test results and monitoring logs can provide data support for subsequent analysis, problem tracing, and optimization. Among them, the stored test results and logs can be used to observe the performance changes of the product during long-term testing and provide a basis for performance optimization. In addition, sending the test results to the tester in real time enables them to quickly understand the test progress and results, and the tester can obtain test feedback faster and immediately start problem troubleshooting or subsequent testing.

[0048] Embodiment 2

[0049] See Figure 2 , this embodiment provides a WLAN interoperability test device, and the WLAN interoperability test device uses the WLAN interoperability test method described in any one of the above, and the WLAN interoperability test device includes:

[0050] A product requirement analysis module, configured to configure a test case database, and perform WLAN product test requirement analysis based on the WLAN product information and the test case database to obtain test cases to be tested;

[0051] An automatic test module, configured to analyze the test cases to be tested, determine the test instructions required for each test case, and start the test execution of the test cases to be tested on the WLAN interoperability test platform;

[0052] A result analysis module, configured to automatically collect the test logs generated after the execution of the test cases from the WLAN interoperability test platform, and analyze and judge the test logs to obtain the test results, key performance indicators, and potential problems of the WLAN product;

[0053] A monitoring module, configured to, when the test cases to be tested are tested on the WLAN interoperability test platform, perform real-time automatic monitoring on the operating state of the WLAN interoperability test platform, and perform corresponding processing according to the monitoring results.

[0054] It should be noted that in this embodiment, by configuring the test case database, analyzing the WLAN product testing requirements based on the WLAN product information and the test case database to obtain the test cases to be tested, analyzing the test cases to be tested to determine the test instructions required for each test case, starting the test execution of the test cases to be tested on the WLAN interoperability test platform, automatically collecting the test logs generated after the execution of the test cases from the WLAN interoperability test platform, analyzing and judging the test logs to obtain the test results, key performance indicators and potential problems of the WLAN product. When the test cases to be tested are tested on the WLAN interoperability test platform, the running state of the WLAN interoperability test platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring results, thereby reducing the professional requirements for testers, reducing the execution cost, management and maintenance cost of the WLAN interoperability test, and reducing the difficulty of sorting out the WLAN interoperability test results.

[0055] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A WLAN interoperability testing method, comprising: Configure a test case database, and perform WLAN product test requirement analysis according to the WLAN product information and the test case database to obtain test cases that need to be tested; Analyze the test cases to be tested, determine the test instructions required for each test case, and start the test execution of the test cases to be tested on the WLAN interoperability test platform; Automatically collect test logs generated after the test cases are executed from the WLAN interoperability test platform, and analyze and judge the test logs to obtain test results and key performance indicators and potential problems of WLAN products; When the test case to be tested is tested on the WLAN interoperability test platform, the running state of the WLAN interoperability test platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring result; When analyzing the test cases to be tested and determining the test instructions required for each test case, the method comprises: importing the test cases to be tested into a local computing system through a test case import module, analyzing the imported test cases through a test analysis module, and determining the test instructions required for each test case; when starting the test execution of the test cases to be tested on a WLAN interoperability test platform, the method comprises: starting the test execution of the test cases to be tested on a WLAN interoperability test platform through a test case test module, when the test cases are tested and executed on the WLAN interoperability test platform, the test instructions required for each test case are run on the WLAN interoperability test platform; after each test case is tested, the test case test module automatically determines whether there are subsequent test cases that need to be tested and executed; Corresponding processing is performed according to the monitoring results, including: after detecting that the test case has been executed, automatically allocating resources to other test cases to be executed, or releasing resources back to the resource pool to reduce resource waste; storing test results and monitoring logs for subsequent analysis, and sending test results to testers.

2. The WLAN interoperability testing method according to claim 1, wherein: Perform WLAN product test requirement analysis based on the WLAN product information and the test case database to obtain test cases that need to be tested, including: Entering WLAN product information into the local computing system through the WLAN product information entry module; The entered real-time WLAN product information is compared with the test cases in the test case database through the information database comparison module to determine the test cases that need to be tested.

3. The WLAN interoperability testing method according to claim 2, wherein: After determining the test cases that need to be tested, the completed test cases are read from the local computing system through the test case reading module.

4. The WLAN interoperability testing method according to claim 2, wherein: After determining the test cases that need to be tested, the test cases that need to be tested are classified and exported through a test case classification module to obtain grouped test cases that need to be tested, and the grouped test cases that need to be tested are test case groups.

5. The WLAN interoperability testing method according to any one of claims 1 to 4, characterized in that: When the test logs generated after the test cases are executed are automatically collected to the WLAN interoperability test platform, the method includes: automatically collecting the test logs generated after the test cases are executed from the WLAN interoperability test platform through a log collection module.

6. The WLAN interoperability testing method according to claim 5, characterized in that: When analyzing and judging the test log, it includes: automatically analyzing the test log through a log analysis module to identify key performance indicators and potential problems of the WLAN product; automatically judging whether the test passes or fails based on the analysis result of the log analysis module through a result judgment module, and identifying key problems in the test.

7. A WLAN interoperability testing device, characterized in that: The WLAN interoperability testing device uses the WLAN interoperability testing method according to any one of claims 1 to 6, and the WLAN interoperability testing device includes: A product requirement analysis module, used to configure a test case database, and perform WLAN product test requirement analysis according to WLAN product information and the test case database to obtain test cases that need to be tested; An automatic testing module, used for analyzing the test cases to be tested, determining the test instructions required for each test case, and starting the test execution of the test cases to be tested on the WLAN interoperability testing platform; A result analysis module, used to automatically collect test logs generated after the test cases are executed from the WLAN interoperability test platform, and analyze and judge the test logs to obtain test results and key performance indicators and potential problems of WLAN products; The monitoring module is used to automatically monitor the running status of the WLAN interoperability test platform in real time when the test case to be tested is tested on the WLAN interoperability test platform, and perform corresponding processing according to the monitoring result.

Images