WLAN interoperability test method and device

Abstract

The invention relates to the technical field of WLAN, and provides a WLAN interoperability test method and device, and the method comprises the steps: configuring a test case database, carrying out WLAN product test demand analysis according to WLAN product information and the test case database to obtain a test case needing to be tested, carrying out the analysis of the test case needing to be tested, and carrying out the analysis of the test case needing to be tested. The method comprises the steps of determining a test instruction required by each test case, starting test execution of the test cases needing to be tested on a WLAN interoperability test platform, automatically collecting test logs from the WLAN interoperability test platform, and analyzing and judging the test logs to obtain a test result and key performance indexes and potential problems of a WLAN product. When the test case needing to be tested is tested on the WLAN interoperability test platform, the running state of the WLAN interoperability test platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring result, so that the execution cost and difficulty of the test are reduced.

Description

Technical Field

[0001] The present invention relates to the field of WLAN technology, and in particular to a WLAN interoperability testing method and device. Background Art

[0002] Mainstream WLAN products are smart devices such as mobile phones, routers and APs, tablets and PCs. With the widespread deployment of multiple WLAN standards and various types of WLAN devices, ensuring the interoperability between different protocols and different WLAN devices, as well as ensuring the reliability, integrity and security of WLAN communications, has become a highly concerned issue in the industry. However, the requirements for WLAN interoperability testing are complex, involving the interoperability between different devices, different WLAN standards and protocols. Engineers are required to have professional technical backgrounds, be able to analyze the test requirements of WLAN products, design test cases, install test tools on WLAN products, and conduct corresponding tests. In addition, the original WLAN interoperability test platform has a low degree of automation. The execution of each test case requires engineers to manually enter test instructions to start the test, resulting in a high cost for the execution of WLAN interoperability testing. In addition, the original WLAN interoperability test platform cannot judge the test results. Professional engineers are required to analyze the test logs one by one to obtain the test results, which makes it difficult to sort out the WLAN interoperability test results. When the test case is executed, if there is no real-time monitoring by engineers, the test system may be idle, resulting in a waste of resources, making the management and maintenance costs of the WLAN interoperability test platform high.

[0003] In summary, the existing WLAN interoperability testing technology has technical problems such as high professional requirements for testers, high execution costs of WLAN interoperability testing, difficulty in sorting out WLAN interoperability testing results, and high management and maintenance costs of WLAN interoperability testing platforms. Summary of the invention

[0004] In view of the above-mentioned deficiencies in the prior art, the present invention provides a WLAN interoperability testing method and device to reduce the professional requirements for testers, reduce the execution cost, management and maintenance cost of WLAN interoperability testing, and reduce the difficulty of sorting out WLAN interoperability testing results.

[0005] In a first aspect, the present invention provides a WLAN interoperability testing method, comprising: Configure a test case database, and perform WLAN product test requirement analysis according to the WLAN product information and the test case database to obtain test cases that need to be tested; Analyze the test cases to be tested, determine the test instructions required for each test case, and start the test execution of the test cases to be tested on the WLAN interoperability test platform; Automatically collect test logs generated after the test cases are executed from the WLAN interoperability test platform, and analyze and judge the test logs to obtain test results and key performance indicators and potential problems of WLAN products; When the test case to be tested is tested on the WLAN interoperability test platform, the running status of the WLAN interoperability test platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring result.

[0006] Further, a WLAN product test requirement analysis is performed according to the WLAN product information and the test case database to obtain test cases that need to be tested, including: Entering WLAN product information into the local computing system through the WLAN product information entry module; The entered real-time WLAN product information is compared with the test cases in the test case database through the information database comparison module to determine the test cases that need to be tested.

[0007] Further, after determining the test cases that need to be tested, the completed test cases are read from the local computing system through the test case reading module.

[0008] Further, after determining the test cases that need to be tested, the test cases that need to be tested are classified and exported through a test case classification module to obtain grouped test cases that need to be tested, and the grouped test cases that need to be tested are test case groups.

[0009] Furthermore, when analyzing the test cases to be tested and determining the test instructions required for each test case, it includes: importing the test cases to be tested into the local computing system through a test case import module, analyzing the imported test cases through a test analysis module, and determining the test instructions required for each test case.

[0010] Further, starting the test execution of the test case that needs to be tested on the WLAN interoperability test platform includes: starting the test execution of the test case that needs to be tested on the WLAN interoperability test platform through the test case test module, when the test case is tested on the WLAN interoperability test platform, the test instructions required by each test case are run on the WLAN interoperability test platform.

[0011] Furthermore, the test case testing module automatically determines whether there are subsequent test cases that need to be tested and executed after each test case is tested.

[0012] Furthermore, when the test logs generated after the test cases are executed are automatically collected to the WLAN interoperability test platform, the method includes: automatically collecting the test logs generated after the test cases are executed from the WLAN interoperability test platform through a log collection module.

[0013] Furthermore, when analyzing and judging the test log, it includes: automatically analyzing the test log through a log analysis module to identify key performance indicators and potential problems of the WLAN product; automatically judging whether the test passes or fails based on the analysis results of the log analysis module through a result judgment module, and identifying key problems in the test.

[0014] In a second aspect, the present invention provides a WLAN interoperability testing device, wherein the WLAN interoperability testing device uses any one of the above WLAN interoperability testing methods, and the WLAN interoperability testing device includes: A product requirement analysis module, used to configure a test case database, and perform WLAN product test requirement analysis according to WLAN product information and the test case database to obtain test cases that need to be tested; An automatic testing module, used for analyzing the test cases to be tested, determining the test instructions required for each test case, and starting the test execution of the test cases to be tested on the WLAN interoperability testing platform; A result analysis module, used to automatically collect test logs generated after the test cases are executed from the WLAN interoperability test platform, and analyze and judge the test logs to obtain test results and key performance indicators and potential problems of WLAN products; The monitoring module is used to automatically monitor the running status of the WLAN interoperability test platform in real time when the test case to be tested is tested on the WLAN interoperability test platform, and perform corresponding processing according to the monitoring result.

[0015] Compared with the prior art, the present invention has the following beneficial effects: The present invention provides a WLAN interoperability test method and device. By configuring a test case database, WLAN product test demand analysis is performed according to WLAN product information and the test case database to obtain test cases that need to be tested, the test cases that need to be tested are analyzed to determine the test instructions required for each test case, and the test execution of the test cases that need to be tested on a WLAN interoperability test platform is started, and test logs generated after the test cases are executed are automatically collected from the WLAN interoperability test platform, and the test logs are analyzed and judged to obtain test results and key performance indicators and potential problems of WLAN products. When the test cases that need to be tested are tested on the WLAN interoperability test platform, the running state of the WLAN interoperability test platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring results, thereby reducing the professional requirements for testers, reducing the execution cost, management and maintenance cost of the WLAN interoperability test, and reducing the difficulty of sorting out the WLAN interoperability test results. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their description are used to explain the present invention and do not constitute an improper limitation of the present invention. Some specific embodiments of the present invention will be described in detail in an exemplary and non-restrictive manner with reference to the drawings. The same reference numerals in the drawings indicate the same or similar components or parts. It should be understood by those skilled in the art that these drawings are not necessarily drawn to scale. In the drawings: Figure 1 It is a flow chart of a WLAN interoperability testing method according to an embodiment of the present invention; Figure 2 The present invention is a schematic diagram of the architecture of a WLAN interoperability testing device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0017] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solution in this embodiment will be clearly and completely described below in conjunction with the drawings in this embodiment. Obviously, the described embodiment is only a part of the embodiment of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work should fall within the scope of protection of the present invention.

[0018] Embodiment 1 See also Figure 1 This embodiment provides a WLAN interoperability testing method, and the WLAN interoperability testing method includes the following steps: S101, configure a test case database, and perform a WLAN product test requirement analysis based on the WLAN product information and the test case database to obtain test cases that need to be tested; wherein the WLAN product information can be an Excel data sheet of the WLAN product. When performing the WLAN product test requirement analysis, it can be determined which test cases must be tested, and NotTested can be selected.

[0019] S102, analyzing the test cases to be tested, determining the test instructions required for each test case, and starting the test execution of the test cases to be tested on the WLAN interoperability test platform; S103. Automatically collect test logs generated after the test cases are executed from the WLAN interoperability test platform, and analyze and judge the test logs to obtain test results and key performance indicators and potential problems of WLAN products; wherein the key performance indicator of the WLAN product may be the extracted throughput.

[0020] S104: When the test case to be tested is tested on the WLAN interoperability test platform, the running state of the WLAN interoperability test platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring result, for example, the monitoring result is notified to the tester.

[0021] It should be noted that, in this embodiment, WLAN products include but are not limited to smart devices such as mobile phones, routers and APs, tablet computers and PCs. Different WLAN products support different protocols, standards and functions, and test requirements analysis is required to determine which use cases need to be executed. In step S101, by configuring a test case database, WLAN product test requirements analysis is performed according to WLAN product information and the test case database to obtain test cases that need to be tested, and the test requirements of different devices, standards and protocols can be modularized and standardized, reducing the complexity of manual analysis and reducing the professional requirements for testers. In addition, each test case needs to execute a series of specific instructions, and manual input is prone to errors and inefficiency. In step S102, by analyzing the test cases that need to be tested, determining the test instructions required for each test case, and starting the test execution of the test cases that need to be tested on the WLAN interoperability test platform, the execution efficiency can be improved, human intervention can be reduced, the time-consuming work of manual input can be reduced, and errors and test interruptions caused by manual operation can be reduced. In addition, a large amount of log data is generated after the test is executed. The manual analysis process is cumbersome and easy to miss key information. In step S103, the test logs generated after the test case is executed are automatically collected from the WLAN interoperability test platform, and the test logs are analyzed and judged to obtain the test results and the key performance indicators and potential problems of the WLAN product, so that potential problems can be discovered more quickly and the test coverage and accuracy can be improved. In step S104, the operating status of the WLAN interoperability test platform is automatically monitored in real time during the test, and corresponding processing is performed according to the monitoring results, thereby reducing the need for manual monitoring and reducing the dependence on continuous monitoring by engineers. Through real-time monitoring and dynamic processing, idle resources can be minimized.

[0022] In some preferred embodiments, a WLAN product test demand analysis is performed based on the WLAN product information and the test case database to obtain the test cases that need to be tested, including: entering the WLAN product information into the local computing system through the WLAN product information entry module; comparing the entered real-time WLAN product information with the test cases in the test case database through the information database comparison module to determine the test cases that need to be tested. It should be noted that there are many types of WLAN products, and different products may support different protocols, standards and functions, so a unified entry is required to collect this information. In this embodiment, through a dedicated WLAN product information entry module, the accuracy and consistency of the information entry can be ensured, and reliable data can be provided for subsequent comparisons. In addition, through the information database comparison module, test cases related to WLAN products can be quickly located, reducing the time-consuming and inefficient problems of manual analysis, without the need for engineers to match test cases one by one, and reducing dependence on professional knowledge.

[0023] In some preferred embodiments, after determining the test cases that need to be tested, the completed test cases are read from the local computing system through the test case reading module. Among them, the test case reading module can be a number-filling tool. It should be noted that there may be partial duplication of test cases, especially in multiple rounds of testing or testing of different products. By reading the completed test cases, the repeated execution of tested scenarios can be reduced. The records of completed use cases are obtained directly from the local system, and the untested use cases are quickly screened out, which reduces duplication of work and saves testing time. In this embodiment, through the test case reading module, it is possible to automatically identify which use cases are completed and which are not completed, and to achieve real-time tracking and management of the test case status, without the need to manually mark the use case status, and without the need to continuously load and process all use cases, reducing the system overload due to processing redundant information, and reducing the storage and computing burden.

[0024] In some preferred embodiments, after determining the test cases that need to be tested, the test cases that need to be tested are classified and exported through the test case classification module to obtain grouped test cases that need to be tested, and the grouped test cases that need to be tested are test case groups. The classification can be divided into pass and fail, and can be divided into 2.4GHz, 5GHz, and 6GHz.

[0025] It should be noted that WLAN product testing involves multiple standards, protocols and devices. Test case classification can decompose complex test scenarios into more manageable modules. Through grouping, test cases can be divided according to dimensions such as function, performance, and interoperability, making the test process more systematic and organized, thereby improving test execution efficiency.

[0026] In some preferred embodiments, when analyzing the test cases to be tested and determining the test instructions required for each test case, the method includes: importing the test cases to be tested into the local computing system through the test case import module, analyzing the imported test cases through the test analysis module, and determining the test instructions required for each test case. Specifically, different startup instructions can be written according to different platforms, such as 11n VHT EHT etc. In addition, the test case data can be standardized during the import process to ensure that all test cases can be correctly loaded and adapted to the system. In addition, WLAN test cases usually correspond to different devices, protocols and functions. Through the test analysis module, the case content can be automatically parsed and test instructions can be generated, reducing manual input and configuration. Further, the test analysis module can identify the priority and dependency of the test case, thereby optimizing the generation order of the test instructions and ensuring that resources are efficiently used. Further, for test cases containing multiple test steps or dependencies, the test analysis module automatically splits the above test cases and generates multiple instructions, thereby reducing manual intervention. For example, a DPP test case splits ABCD into one test case, splitting 2.4GHz and 5GHz.

[0027] In some preferred embodiments, starting the test case that needs to be tested when executing the test on the WLAN interoperability test platform includes: starting the test case that needs to be tested on the WLAN interoperability test platform through the test case test module, and when the test case is tested on the WLAN interoperability test platform, the test instructions required for each test case are run on the WLAN interoperability test platform. It should be noted that automatically starting the test through the test case test module can reduce the tedious steps of engineers starting the test cases one by one, thereby improving efficiency. The automated connection from test case loading to instruction execution in this embodiment can reduce human intervention, achieve a more efficient test process, reduce the time and operation complexity required for manually inputting test instructions, and reduce omissions or errors that may be caused by manual operations.

[0028] In some preferred embodiments, the test case testing module automatically determines whether there are subsequent test cases that need to be tested and executed after each test case is completed. For example, group testing. It should be noted that the test case testing module automatically determines whether there are subsequent test cases, which can eliminate the need for manual inspection and initiation of subsequent tests, ensuring a smooth test process. After the test case is completed, the subsequent test is immediately judged and initiated, thereby reducing the time interval in the test process, reducing the complexity and interference of human participation, eliminating waiting time, and improving the efficiency of test execution.

[0029] In some preferred embodiments, when the test logs generated after the test cases are executed are automatically collected to the WLAN interoperability test platform, it includes: automatically collecting the test logs generated after the test cases are executed from the WLAN interoperability test platform through the log collection module. It should be noted that test log collection is an important part of the test process. Manual collection is prone to inefficiency and may miss key logs. In this embodiment, the test logs generated after the test cases are executed are automatically collected from the WLAN interoperability test platform through the log collection module, so that the logs can be obtained quickly and accurately, meeting the requirements of efficient testing, ensuring that all relevant logs are fully collected, and facilitating real-time analysis and problem location.

[0030] In some preferred embodiments, when analyzing and judging the test log, it includes: automatically analyzing the test log through a log analysis module to identify key performance indicators and potential problems of the WLAN product; automatically judging whether the test has passed or failed based on the analysis results of the log analysis module through a result judgment module, and identifying key problems in the test. It should be noted that manual analysis of test logs is time-consuming and labor-intensive and is prone to missing key information. In this embodiment, the test log is automatically analyzed through the log analysis module, which can quickly and comprehensively extract key performance indicators and potential problems. In addition, in this embodiment, the result judgment module automatically judges whether the test has passed or failed based on the analysis results of the log analysis module, and identifies key problems in the test, which can reduce the subjectivity of manual evaluation, and can quickly process the results of multiple test cases, improve test reliability, and meet the needs of batch testing.

[0031] In some further preferred embodiments, when corresponding processing is performed according to the monitoring results, it may include: after detecting that the test case has been executed, automatically allocating resources to other test cases to be executed, or releasing resources back to the resource pool to reduce resource waste; storing test results and monitoring logs for subsequent analysis, and sending the test results to the tester. It should be noted that after the test case is executed, resources are automatically allocated to other test cases to be executed according to resource requirements to ensure efficient execution of the test task. After the test is completed, the idle resources are released back to the resource pool in time to reduce the long-term idleness of resources. In this embodiment, by dynamically allocating and releasing resources, it is ensured that the hardware and software resources of the test platform are maximized, the requirements of multiple test cases running in parallel can be met, the test cycle can be shortened, unnecessary resource waste can be reduced, and the operating cost of the test platform can be reduced. In addition, the test results and monitoring logs are stored, which can provide data support for subsequent analysis, problem tracing and optimization. Among them, the stored test results and logs can be used to observe the performance changes of the product in long-term testing and provide a basis for performance optimization. In addition, the test results are sent to the testers in real time, so that they can quickly understand the test progress and results. The testers can get test feedback faster and start troubleshooting or follow-up testing immediately.

[0032] Embodiment 2 See also Figure 2 This embodiment provides a WLAN interoperability testing device, the WLAN interoperability testing device uses any one of the above WLAN interoperability testing methods, and the WLAN interoperability testing device includes: A product requirement analysis module, used to configure a test case database, and perform WLAN product test requirement analysis according to WLAN product information and the test case database to obtain test cases that need to be tested; An automatic testing module, used for analyzing the test cases to be tested, determining the test instructions required for each test case, and starting the test execution of the test cases to be tested on the WLAN interoperability testing platform; A result analysis module, used to automatically collect test logs generated after the test cases are executed from the WLAN interoperability test platform, and analyze and judge the test logs to obtain test results and key performance indicators and potential problems of WLAN products; The monitoring module is used to automatically monitor the running status of the WLAN interoperability test platform in real time when the test case to be tested is tested on the WLAN interoperability test platform, and perform corresponding processing according to the monitoring result.

[0033] It should be noted that, in this embodiment, by configuring a test case database, a WLAN product test demand analysis is performed according to the WLAN product information and the test case database to obtain test cases that need to be tested, the test cases that need to be tested are analyzed, the test instructions required for each test case are determined, and the test execution of the test cases that need to be tested on the WLAN interoperability test platform is started, and the test logs generated after the test cases are executed are automatically collected from the WLAN interoperability test platform, and the test logs are analyzed and judged to obtain test results and key performance indicators and potential problems of WLAN products. When the test cases that need to be tested are tested on the WLAN interoperability test platform, the running status of the WLAN interoperability test platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring results, thereby reducing the professional requirements for testers, reducing the execution cost, management and maintenance cost of WLAN interoperability testing, and reducing the difficulty of sorting out WLAN interoperability test results.

[0034] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A WLAN interoperability testing method, comprising: Configure a test case database, and perform WLAN product test requirement analysis according to the WLAN product information and the test case database to obtain test cases that need to be tested; Analyze the test cases to be tested, determine the test instructions required for each test case, and start the test execution of the test cases to be tested on the WLAN interoperability test platform; Automatically collect test logs generated after the test cases are executed from the WLAN interoperability test platform, and analyze and judge the test logs to obtain test results and key performance indicators and potential problems of WLAN products; When the test case to be tested is tested on the WLAN interoperability test platform, the running status of the WLAN interoperability test platform is automatically monitored in real time, and corresponding processing is performed according to the monitoring result.

2. The WLAN interoperability testing method according to claim 1, wherein: Perform WLAN product test requirement analysis based on the WLAN product information and the test case database to obtain test cases that need to be tested, including: Entering WLAN product information into the local computing system through the WLAN product information entry module; The entered real-time WLAN product information is compared with the test cases in the test case database through the information database comparison module to determine the test cases that need to be tested.

3. The WLAN interoperability testing method according to claim 2, wherein: After determining the test cases that need to be tested, the completed test cases are read from the local computing system through the test case reading module.

4. The WLAN interoperability testing method according to claim 2, wherein: After determining the test cases that need to be tested, the test cases that need to be tested are classified and exported through a test case classification module to obtain grouped test cases that need to be tested, and the grouped test cases that need to be tested are test case groups.

5. The WLAN interoperability testing method according to claim 1, wherein: Analyzing the test cases to be tested and determining the test instructions required for each test case includes: importing the test cases to be tested into a local computing system through a test case import module, analyzing the imported test cases through a test analysis module, and determining the test instructions required for each test case.

6. The WLAN interoperability testing method according to claim 5, characterized in that: Starting the test execution of the test case that needs to be tested on the WLAN interoperability test platform includes: starting the test execution of the test case that needs to be tested on the WLAN interoperability test platform through a test case test module, when the test case is tested on the WLAN interoperability test platform, the test instructions required by each test case are run on the WLAN interoperability test platform.

7. The WLAN interoperability testing method according to claim 6, wherein: The test case testing module automatically determines whether there are subsequent test cases that need to be tested and executed after each test case is tested.

8. The WLAN interoperability testing method according to any one of claims 1 to 7, characterized in that: When the test logs generated after the test cases are executed are automatically collected to the WLAN interoperability test platform, the method includes: automatically collecting the test logs generated after the test cases are executed from the WLAN interoperability test platform through a log collection module.

9. The WLAN interoperability testing method according to claim 8, wherein: When analyzing and judging the test log, it includes: automatically analyzing the test log through a log analysis module to identify key performance indicators and potential problems of the WLAN product; automatically judging whether the test passes or fails based on the analysis result of the log analysis module through a result judgment module, and identifying key problems in the test.

10. A WLAN interoperability testing device, characterized in that: The WLAN interoperability testing device uses the WLAN interoperability testing method according to any one of claims 1 to 9, and the WLAN interoperability testing device includes: A product requirement analysis module, used to configure a test case database, and perform WLAN product test requirement analysis according to WLAN product information and the test case database to obtain test cases that need to be tested; An automatic testing module, used for analyzing the test cases to be tested, determining the test instructions required for each test case, and starting the test execution of the test cases to be tested on the WLAN interoperability testing platform; A result analysis module, used to automatically collect test logs generated after the test cases are executed from the WLAN interoperability test platform, and analyze and judge the test logs to obtain test results and key performance indicators and potential problems of WLAN products; The monitoring module is used to automatically monitor the running status of the WLAN interoperability test platform in real time when the test case to be tested is tested on the WLAN interoperability test platform, and perform corresponding processing according to the monitoring result.

Images