Certification test suite testing methods, apparatus, storage media and systems

Abstract

This application relates to a certification test suite testing method, apparatus, storage medium, and system. It receives task information input on a user terminal's task configuration interface, including the target test item, corresponding configuration parameters, task parameters, and a target quantity threshold. Based on this task information, it automatically generates configuration tasks and test tasks. Executing the configuration tasks configures the test equipment for the target test device, eliminating the need for manual user operation and reducing test preparation time. When the number of test equipment that has completed configuration tasks reaches the target quantity threshold, it automatically utilizes these configured test equipment to execute the test tasks, without waiting for other test equipment to complete their configuration tasks, thus improving testing efficiency.

Description

Technical Field

[0001] This invention relates to the field of equipment testing, and in particular to a certification test kit testing method, apparatus, storage medium, and system. Background Technology

[0002] Google Certification refers to a comprehensive testing system launched by Google for Android devices, their applications, and services. It aims to ensure that Android devices comply with Google's technical specifications and standards. All existing Android devices are required to undergo Google's Certification Test Suite (XTS) testing. XTS testing assesses the compatibility, functionality, and performance of Android device software, ensuring that the software functions correctly in different environments, operating systems, and versions.

[0003] Because certification test suites involve large amounts of data and long testing times, existing technologies utilize multiple testing devices to reduce testing time. However, before conducting certification test suite tests, each testing device needs to be manually upgraded and permissions granted, which is time-consuming, labor-intensive, and inefficient. Summary of the Invention

[0004] This application provides a method, apparatus, storage medium, and system for testing certification test suites, which can improve the testing efficiency of certification test suites.

[0005] In a first aspect, embodiments of this application provide a certification test suite testing method, applied to a testing system, the testing system including a server and at least one testing device; the server is communicatively connected to at least one testing device and a terminal respectively; at least one testing device is communicatively connected to the device under test, each testing device corresponding to a test item of the certification test suite, and the testing device includes at least one testing device; the method includes:

[0006] The task configuration interface is displayed in the terminal;

[0007] Receive task information entered in the task configuration interface; the task information includes the target test item, the configuration parameters corresponding to the target test item, task parameters, and the target quantity threshold; the target test item is a test item tested by the certification test suite;

[0008] Generate configuration tasks based on configuration parameters, and generate test tasks based on task parameters;

[0009] Configure at least one test device of the target test apparatus according to the configuration task;

[0010] Determine the number of test devices that have completed the configuration task. If the number of test devices that have completed the configuration task is greater than or equal to the target threshold, control the test devices that have completed the configuration task to execute the test task.

[0011] Optional methods include:

[0012] If the number of test devices that have completed the configuration task is less than the target number threshold, wait for the target time, then reacquire the number of test devices that have completed the configuration task, and determine whether the reacquired number of test devices that have completed the configuration task is greater than or equal to the target number threshold.

[0013] In this embodiment of the application, when the number of test devices that have completed the configuration task is less than the target number threshold, the system waits for a target time to allow other devices that have not completed the configuration task to continue to perform the configuration within the target time. After the target time, the system re-acquires the number of test devices that have completed the configuration task and determines whether the test task execution conditions are met based on the re-acquired number of devices. This continuous monitoring of the configuration status of the test devices allows for timely execution of the test task, thereby improving the efficiency of test task execution.

[0014] Optionally, the test task includes test data, and controlling the test device that has completed the configuration task to execute the test task includes:

[0015] The test data is fragmented and then distributed to the test devices that have completed the configuration tasks, so that the test devices that have completed the configuration tasks can execute the test tasks based on the fragmented test data.

[0016] In this embodiment of the application, by segmenting the test data of the test task, each test device can execute the test task according to the segmented test data, thereby improving the execution efficiency of the test task.

[0017] Optionally, the method also includes:

[0018] The terminal displays a task progress interface; the task progress interface includes task execution progress information for configuration tasks and / or test tasks.

[0019] In this embodiment of the application, a task progress interface is displayed on the terminal. The task progress interface displays the task execution progress information of the configuration task and / or test task. Thus, the execution progress and execution status of the configuration task and test task are displayed through the task progress interface, which makes it convenient for users to understand the task execution status of the configuration task and test task.

[0020] Optionally, the test system includes a first power control module and a second power control module. The first power control module is disposed between the power supply and the device under test; the second power control module is disposed between the power supply and at least one test device.

[0021] The first power control module is used to control the power supply to the device under test;

[0022] The second power control module is used to control the power supply to provide power to at least one test device.

[0023] In this embodiment, a first power control module is used to control the power supply of the device under test, and a second power control module is used to control the power supply of the test equipment, thereby avoiding energy waste, improving energy utilization efficiency, and saving energy.

[0024] Optionally, the testing system also includes a data acquisition module and a video capture card; the data acquisition module acquires data from the device under test through the video capture card; the data includes audio data, image data, and video data.

[0025] In this embodiment, a video capture card is used to establish data communication between the data acquisition module and the video capture card, thereby enabling data exchange between the data acquisition module and the device under test and achieving data management of the device under test.

[0026] Optionally, the certification test suite includes tests for compatibility, GSON, Google Mobile Services, security, TV, and vendor testing; and test equipment includes a compatibility test equipment for compatibility testing, a GSON test equipment for GSON testing, a Google Mobile Services test equipment for Google Mobile Services testing, a security test equipment for security testing, a TV test equipment for TV testing, and a vendor test equipment for vendor testing.

[0027] In this embodiment of the application, the compatibility test, GSON test, Google Mobile Services test, security test, TV test and supplier test of the certification test suite are performed on the device under test by a compatibility test device, a GSON test device 1, a Google Mobile Services test device, a security test device, a TV test device and a supplier test device.

[0028] Secondly, embodiments of this application provide a testing apparatus applied to a testing system, the testing system including a server and at least one testing device; the server is communicatively connected to at least one testing device and a terminal respectively; at least one testing device is communicatively connected to a device under test, each testing device corresponding to a test item tested by a certification test suite, and the testing apparatus includes at least one testing device; the apparatus includes:

[0029] The task configuration interface display module is used to display the task configuration interface in the terminal.

[0030] The task information receiving module is used to receive task information entered in the task configuration interface; the task information includes the target test item, the configuration parameters corresponding to the target test item, the task parameters, and the target quantity threshold; the target test item is a test item tested by the certification test suite;

[0031] The task generation module is used to generate configuration tasks based on configuration parameters and test tasks based on task parameters.

[0032] A configuration module is used to configure at least one test device of the target test apparatus according to a configuration task.

[0033] The testing module is used to determine the number of test devices that have completed the configuration task. If the number of test devices that have completed the configuration task is greater than or equal to the target threshold, the module controls the test devices that have completed the configuration task to execute the test task.

[0034] Thirdly, embodiments of this application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the certification test suite testing method as described above.

[0035] Fourthly, embodiments of this application provide a testing system, including a server and at least one testing device; the server is communicatively connected to at least one testing device and a terminal respectively; at least one testing device is communicatively connected to the device under test, each testing device corresponds to a test item tested by a certification test suite, and the testing device includes at least one testing device;

[0036] The server executes any of the authentication test suite test methods described above.

[0037] In this embodiment, a task configuration interface is received, which receives task information such as the target test item, the corresponding configuration parameters, task parameters, and the target quantity threshold input on the user terminal's task configuration interface. Based on the task information, configuration tasks and test tasks are automatically generated. The configuration tasks are executed to configure the test equipment of the target test device, eliminating the need for manual operation by the user and reducing test preparation time. When the number of test equipment that has completed the configuration tasks reaches the target quantity threshold, the test equipment that has completed the configuration tasks is automatically used to execute the test tasks without waiting for other test equipment to complete the configuration tasks, thus improving test efficiency.

[0038] To better understand and implement this invention, the following detailed description is provided in conjunction with the accompanying drawings. Attached Figure Description

[0039] Figure 1 This is a schematic diagram of a testing system according to one embodiment of the present invention;

[0040] Figure 2 This is a flowchart of a certification test suite testing method in one embodiment of the present invention;

[0041] Figure 3 This is a schematic diagram of a testing system according to another embodiment of the present invention;

[0042] Figure 4 This is a schematic diagram of a task configuration interface in one embodiment of the present invention;

[0043] Figure 5 This is a schematic diagram of a task progress interface in one embodiment of the present invention;

[0044] Figure 6 This is a schematic diagram of a testing device in one embodiment of the present invention;

[0045] Figure 7 This is a schematic diagram of a testing system according to one embodiment of the present invention. Detailed Implementation

[0046] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0047] It should be understood that the described embodiments are merely some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of the embodiments of this application.

[0048] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the embodiments of this application. The singular forms “a” and “the” as used in the embodiments of this application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0049] In the following description, when referring to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims. In the description of this application, it should be understood that the terms "first," "second," "third," etc., are used only to distinguish similar objects and are not necessarily used to describe a specific order or sequence, nor should they be construed as indicating or implying relative importance. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances.

[0050] Furthermore, in the description of this application, unless otherwise stated, "several" refers to two or more. "And / or" describes the correspondence between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0051] Google Certification refers to a comprehensive testing system launched by Google for Android devices, their applications, and services. It aims to ensure that Android devices comply with Google's technical specifications and standards. All existing Android devices are required to undergo Google's Certification Test Suite (XTS) testing. XTS testing assesses the compatibility, functionality, and performance of Android device software, ensuring that the software functions correctly in different environments, operating systems, and versions.

[0052] The Certification Test Suite (XTS) includes tests such as Compatibility Test (CTS), Vendor Test (VTS), and Google Mobile Services Test (GTS), which are important guarantees for the compatibility and standardization of the Android system.

[0053] Because certification test suites involve large amounts of data and long testing times, existing technologies utilize multiple testing devices to reduce testing time. However, before conducting certification test suite tests, each testing device needs to be manually upgraded and permissions granted, which is time-consuming, labor-intensive, and inefficient.

[0054] Therefore, to address the aforementioned issues, this application provides a method for testing certification test suites. This method allows users to automatically generate configuration tasks and test tasks based on the input task information on the user terminal's task configuration interface. The configuration tasks are used to configure the test equipment for the target test device, eliminating the need for manual user intervention and reducing test preparation time. Furthermore, when the number of test equipment that has completed configuration tasks reaches the target threshold, the system automatically utilizes these devices to execute the test tasks, without waiting for other test equipment to complete their configuration tasks, thus improving testing efficiency.

[0055] Please see Figure 1 This is a schematic diagram of the test system 100 in one embodiment; as shown Figure 1 As shown, the test system 100 includes at least one test device 110 and a server 120; at least one test device 110 can be communicatively connected to the device under test.

[0056] Each test apparatus 110 corresponds to one test item tested by the certification test suite, and each test apparatus 110 includes at least one test device 111.

[0057] Test device 111 can communicate with the device under test (DUT) using a USB-ADB cable, which is an Android Debug Bridge (ADB) cable connected via a Universal Serial Bus (USB) interface. Alternatively, in other embodiments, test device 111 can also establish an Android Debug Bridge connection with the DUT via wireless communication technology.

[0058] The number of test devices in the test apparatus 110 can be determined based on the time and computing resources required for the test project, for example, based on the number of test cases and the time required.

[0059] The number of test devices in each test device 110 can be the same or different.

[0060] Please see Figure 2 The authentication test suite testing method of this application embodiment can be applied to a test system, specifically to the server of the test system, and includes:

[0061] S110: Displays the task configuration interface in the terminal;

[0062] The task configuration interface can be a web page on the terminal. The task configuration interface is used for users to input task information in order to configure test tasks and configuration tasks.

[0063] The terminal can be a computer, tablet, mobile phone, or other terminal device.

[0064] The task configuration interface can respond to task configuration commands displayed on the terminal. These commands can be generated based on user actions on the terminal and may include triggering task configuration controls or accessing links in the task configuration interface.

[0065] S120: Receives task information entered in the task configuration interface; the task information includes the target test item, the configuration parameters corresponding to the target test item, task parameters, and the target quantity threshold; the target test item is a test item tested by the certification test suite.

[0066] The target test items are used to identify the specific items that need to be tested. For example, when the test system is used to implement the Certification Test Suite (XTS) tests, the target test items can be any one or more of the following: compatibility testing, GSON testing, Google Mobile Services testing, security testing, TV testing, and vendor testing.

[0067] The target quantity threshold can be determined based on the time and / or computing resources required for the target test item; the more time and / or computing resources the target test item requires, the larger the target quantity threshold.

[0068] S130: Generate configuration tasks based on configuration parameters, and generate test tasks based on task parameters;

[0069] The configuration task is used to configure the test environment, parameters, status, etc. of the test equipment of the target test device, so that the test equipment of the target test device can have the conditions to execute the test task and meet the execution requirements of the test task.

[0070] Configuration tasks can include software upgrade tasks, firmware flashing tasks, and initialization tasks. Software upgrade tasks are used to upgrade the test software on the test equipment, such as upgrading it to the latest version or the version corresponding to the device under test. Firmware flashing tasks are used to update the version of the test equipment.

[0071] The test task is used to perform the target test items of the device under test.

[0072] S140: Configure at least one test device of the target test apparatus according to the configuration task;

[0073] Optionally, the device status of the test equipment in the target test device can be identified, and the test equipment can be controlled to perform tasks based on the device status. For example, if the device status of the test equipment is identified as idle, the test equipment can be controlled to perform a configuration task to configure the test equipment. For test equipment that is not idle, the device status can be re-detected after a target time until the device status is identified as idle, and then the test equipment can be controlled to perform a configuration task to configure the test equipment.

[0074] By configuring tasks, all test devices of the target test equipment can be configured, thereby improving the configuration efficiency of the test equipment.

[0075] S150: Determine the number of test devices that have completed the configuration task. If the number of test devices that have completed the configuration task is greater than or equal to the target number threshold, control the test devices that have completed the configuration task to execute the test task.

[0076] To determine whether a test device has completed its configuration task, you can check its device status. If the device status is detected as idle, it means that the test device has completed its configuration task and is capable of executing test tasks.

[0077] The number of test devices configured to perform the test task being greater than or equal to the target number threshold can be used as a test task execution condition for the target test device, to determine whether the target test device has the ability to perform the test task, that is, whether the target test device can perform the test task.

[0078] If the number of test devices that have completed the configuration task is less than the target number threshold, it is determined that the target test device does not have the ability to execute the test task, and the test task will not be executed.

[0079] In this embodiment of the application, when the number of test devices that have completed the configuration task is greater than or equal to the target number threshold, the test devices that have completed the configuration are automatically controlled to execute the test task, thereby realizing the test of the target item of the device under test and improving the test efficiency.

[0080] For example, such as Figure 3As shown, the testing system 100 of this application embodiment can be used to implement the Authentication Test Suite (XTS) test. The device under test can be a TV board or TV device with an Android system. The testing system 100 is used to perform Authentication Test Suite (XTS) tests on the TV board or TV device. The test items can include compatibility testing, GSON testing, Google Mobile Services testing, security testing, TV testing, and vendor testing. The testing system 100 can include a compatibility testing device 1101, a GSON testing device 1102, a Google Mobile Services testing device 1103, a security testing device 1104, a TV testing device 1105, and a vendor testing device 1106.

[0081] The compatibility testing device 1101 is used to test the compatibility of Android devices and the applications they run, thereby ensuring that Android devices comply with Google's compatibility definitions and guaranteeing that applications run consistently on different devices.

[0082] The GSON test fixture 1102 is used to verify the serialization and deserialization functions of a device, ensuring that the Gson library can correctly convert Java objects into JSON strings and convert JSON strings back into Java objects.

[0083] The Google Mobile Services Test Device 1103 is used to verify the compatibility of Android devices with Google Mobile Services (GMS).

[0084] The security testing device 1104 is used to test the installation status of security patches in the Android system. It can identify vulnerabilities and weaknesses in the Android system, protect Android devices from potential threats, and improve security.

[0085] The TV testing device 1105 is used to test the functionality and compatibility of Android TV boards or TV devices.

[0086] The supplier testing device 1106 is used to test whether the implementation of the Android kernel and hardware abstraction layer meets expectations, ensuring the compatibility between the core components and framework of the Android device, which helps to improve the stability and user experience of the Android device.

[0087] The number of test devices for compatibility test device 1101, GSON test device 1102, Google Mobile Services test device 1103, security test device 1104, TV test device 1105, and vendor test device 1106 can be determined based on the time spent, the number of test cases, or the computing resources required for testing.

[0088] The device under test is subjected to certification test suite testing using the compatibility test apparatus, GSON test apparatus 1, Google Mobile Services test apparatus, security test apparatus, TV test apparatus, and vendor test apparatus.

[0089] In this embodiment of the application, the compatibility testing device 1101 may include 9 testing devices, the GSON testing device 1102 may include 5 testing devices, the Google Mobile Services testing device 1103 may include 1 testing device, the security testing device 1104 may include 1 testing device, the TV testing device 1105 may include 1 testing device, and the supplier testing device 1106 may include 1 testing device.

[0090] When the target test item is a compatibility test, the nine test devices of the compatibility test device 1101 are configured using a configuration task, so that one or more test devices of the compatibility test device 1101 can meet the requirements for executing the test task. When the test devices of the compatibility test device 1101 that have completed the configuration task meet the conditions for executing the test task, the test devices that have completed the configuration task are controlled to execute the test task, thereby improving the test task execution efficiency and test efficiency.

[0091] In this embodiment, the system receives task information such as the target test item, configuration parameters corresponding to the target test item, task parameters, and target quantity threshold input on the user terminal's task configuration interface. Based on the task information, the system automatically generates configuration tasks and test tasks. By executing the configuration tasks, the system configures the test equipment of the target test device. The system then uses the test equipment that has completed the configuration tasks to execute the test tasks. Users do not need to manually configure each test device, which can reduce test preparation time and improve test efficiency.

[0092] In step S110, the task configuration interface may include an input area for task information such as the target test item, the configuration parameters corresponding to the target test item, task parameters, and the target quantity threshold.

[0093] like Figure 4 As shown, it is a schematic diagram of a task configuration interface 200 in one embodiment; the task configuration interface 200 includes a selection module 210, a global configuration module 220 and a task configuration module 230.

[0094] Selection module 210 is used to select the target test item to be tested. Selection module 210 may include CTS control, CTS-ON-GSI control, STS control, TVTS control and VTS control.

[0095] You can select the target test item to be tested by triggering the corresponding control. For example, you can select the target test item to be tested as CTS test by triggering the CTS control.

[0096] The global configuration module 220 is used to input global configuration information, which may include software link, software upgrade name, debug software link, debug software upgrade name, system image file (system img), debug image (debugimg), boot verification image (vbmeta img), and custom parameters (custom arg).

[0097] The global configuration module 220 may include multiple input boxes 221 and corresponding prompts for each input box. The prompts are used to indicate the global configuration information that needs to be entered for each input box, and each input box can be used to enter one piece of global configuration information.

[0098] like Figure 4 As shown, input box 221 may include a software link input box, a software upgrade name input box, a debug software link input box, a debug software upgrade name input box, a system image file input box, a debug image input box, a startup verification image input box, and a custom parameter input box.

[0099] The software link input box is used to enter software links.

[0100] The software upgrade name input box is used to enter the software upgrade name.

[0101] The debug software link input box is used to enter the debug software link.

[0102] The debug software upgrade name input box is used to enter the debug software upgrade name.

[0103] The system image input box is used to enter the system image file.

[0104] The debug image input box is used to input the debug image.

[0105] The Startup Verification Image input box is used to enter the startup verification image.

[0106] The custom parameter input box is used to enter custom parameters.

[0107] It should be noted that the number of input boxes in the global configuration module 220 and the global configuration information input can be set according to specific testing requirements, and this application does not impose any specific limitations.

[0108] The task configuration module 230 can be used to input configuration parameters and task parameters.

[0109] The task configuration module 230 may include a configuration task input control 231 and a test task input control 232;

[0110] The configuration task input control 231 is used to input configuration parameters related to the configuration task, such as the configuration task name, package version, and other information.

[0111] The test task input control 232 is used to input task parameters related to the test task, such as the test task name and media version.

[0112] In this embodiment of the application, the configuration task input control 231 and the test task input control 232 may include at least one input box, and the configuration task and test task can be configured by inputting configuration parameters and task parameters in at least one input box.

[0113] In one embodiment, the task configuration interface 200 may further include a start control and a stop control. The start control is used to begin executing the task, and the stop control is used to terminate executing the task. Users can control the start and stop of task execution through the start and stop controls to meet task execution control needs under different circumstances.

[0114] In this embodiment of the application, each testing device includes at least one testing equipment. When the testing equipment performs a testing task, it can segment the test data and send the segmented data to the corresponding testing equipment, thereby improving the execution efficiency of the testing task.

[0115] In one embodiment, the test task includes test data, and controlling the test device that has completed the configuration task to execute the test task includes:

[0116] The test data is fragmented and then distributed to the test devices that have completed the configuration tasks, so that the test devices that have completed the configuration tasks can execute the test tasks based on the fragmented test data.

[0117] Test data is used to perform tests on the device under test. Test data can include test cases and other data.

[0118] When sharding test data, the sharding can be based on the number of test devices configured for the task, the amount of test data, and the performance of the test devices.

[0119] like Figure 4 As shown, in an optional embodiment, the task configuration interface further includes a fragmentation information input control 233, which is used to input fragmentation information; the fragmentation information is used to fragment the test data.

[0120] The test data is then split based on the splitting information entered in the task configuration interface.

[0121] Sharding information may include the number of shards, shard key (Customer Key), etc. The shard key can be used to determine the sharding method of the data, such as dividing test data with the same shard key into the same shard, so as to facilitate querying and management.

[0122] In this embodiment of the application, by segmenting the test data of the test task, each test device can execute the test task according to the segmented test data, thereby improving the execution efficiency of the test task.

[0123] In one embodiment, the target quantity threshold can be the minimum number of test devices required to perform the test task.

[0124] The target quantity threshold can be determined based on the performance of the test equipment and the amount of test data in the test task. The target quantity threshold can be less than or equal to the number of test equipment in the target test device.

[0125] Taking a compatibility testing device as an example, if the compatibility testing device includes 9 test devices, the target number threshold can be set to be less than the number of test devices in the compatibility testing device. For example, the target number threshold can be 7. When the number of test devices that have completed the configuration task is greater than or equal to 7, it is determined that the test task execution condition is met, and the 7 test devices that have completed the configuration task are controlled to execute the test task.

[0126] Preferably, the target quantity threshold can be set to be less than the number of test devices in the compatibility testing device. This can avoid the failure of a test device to complete its configuration task or the failure of a test device to complete its configuration task for a long time, which would prevent the test task from being executed and thus affect the execution of the test task. At the same time, using multiple test devices that have completed their configuration tasks first to execute the test task can improve the execution efficiency of the test task.

[0127] In this embodiment of the application, by determining whether the number of test devices that have completed the configuration task is greater than the target number threshold, it is determined whether the target test device can meet the test task execution conditions for executing the test task. When the test task execution conditions are met, the test task is executed, thereby improving the test task execution efficiency.

[0128] If the conditions for executing a test task are not met, the system can wait for a period of time until other test devices that have not yet completed their configuration tasks finish their configuration tasks. Alternatively, an alarm can be issued to alert the user that the current situation does not meet the conditions for executing the test task. This allows the user to configure the test device manually, replace the test device, or use other processing methods to improve the efficiency of test device configuration.

[0129] In one embodiment, the method further includes:

[0130] If the number of test devices that have completed the configuration task is less than the target number threshold, wait for the target time, then reacquire the number of test devices that have completed the configuration task, and determine whether the reacquired number of test devices that have completed the configuration task is greater than or equal to the target number threshold.

[0131] The target time can be set according to application requirements, for example, it can be set to 30 seconds.

[0132] If the test task execution conditions are not met, the number of test devices that have completed the configuration task can be re-acquired at target time intervals and it can be determined whether the target number threshold has been reached, until the number of test devices that have completed the configuration task meets the test task execution conditions.

[0133] In this embodiment of the application, when the number of test devices that have completed the configuration task is less than the target number threshold, the other devices that have not completed the configuration task can continue to perform configuration within the target time by waiting for the target time. After the target time, the number of devices is reacquired, and the test task execution conditions are determined based on the reacquired number of devices. Thus, by continuously monitoring the configuration status of the test devices, the test task can be executed in a timely manner, thereby improving the efficiency of test task execution.

[0134] In one embodiment, the method further includes:

[0135] The terminal displays a task progress interface; the task progress interface includes task execution progress information for configuration tasks and / or test tasks.

[0136] like Figure 5 As shown, this is a schematic diagram of a task progress interface 300 in one embodiment; the task progress interface 300 may include task information such as the task name, task status, task duration, task start time, and test device identifier for each configuration task and / or test task.

[0137] Optionally, the task progress interface 300 may also include a task viewing control 310, a task deletion control 320, and a task re-execution control 330.

[0138] The task viewing control 310 can be used to view the task information of the current task; the task deletion control 320 is used to delete the current task; and the task re-execution control 330 is used to re-execute the current task.

[0139] The above tasks can be configuration tasks or test tasks.

[0140] In this embodiment of the application, a task progress interface is displayed on the terminal. The task progress interface displays the task execution progress information of the configuration task and / or test task. Thus, the execution progress and execution status of the configuration task and test task are displayed through the task progress interface, which makes it convenient for users to understand the task execution status of the configuration task and test task.

[0141] The authentication test suite testing method of this application embodiment can be executed on the server of the test system. The server can be a single server or a server cluster composed of multiple servers.

[0142] In an optional embodiment, the testing system may include a user editing server, a test resource storage server, and a progress management server. The test resource storage server stores test resources such as test data. The user editing server receives task information input from the task configuration interface, retrieves test resources from the test resource storage server based on the task information, and generates configuration tasks and test tasks. The progress management server manages the progress of test tasks and configuration tasks and displays the task progress interface on the terminal.

[0143] In this embodiment of the application, by utilizing a user editing server, a test resource storage server, and a progress management server with different functions to execute the certification test suite test method, the execution efficiency of the certification test suite test method can be improved, thereby improving the test efficiency.

[0144] In one embodiment, the test system includes a first power control module and a second power control module. The first power control module is disposed between the power supply and the device under test; the second power control module is disposed between the power supply and at least one test device.

[0145] The first power control module is used to control the power supply to the device under test;

[0146] The second power control module is used to control the power supply to provide power to at least one test device.

[0147] The first power control module can control whether to supply power to the device under test based on the first control command from the server.

[0148] The second power control module can control whether to supply power to the test equipment based on the second control command from the server. The second control command can include the device identifier of the test equipment that needs power. After receiving the second control command, the second power control module will supply power to the corresponding test equipment according to the device identifier and stop supplying power to other test equipment, thereby saving energy.

[0149] Specifically, the first power control module can control the power supply to the device under test by controlling the on / off state of the power supply circuit between the power supply and the device under test, and the second power control module can control the power supply to the device under test by controlling the on / off state of the power supply circuit between the power supply and the test device.

[0150] Optionally, the first power control module may include a switching element, which controls the connection and disconnection of the power supply circuit between the power supply and the device under test by controlling the opening and closing of the switching element.

[0151] The first power control module may include multiple switching elements, and the power supply circuit between the power supply and the corresponding test equipment is controlled by controlling the opening and closing of the corresponding switching elements.

[0152] Switching elements can be switches, relays, or other switching components.

[0153] In this embodiment, a first power control module is used to control the power supply of the device under test, and a second power control module is used to control the power supply of the test equipment, thereby avoiding energy waste, improving energy utilization efficiency, and saving energy.

[0154] In one embodiment, the testing system further includes a data acquisition module and a video capture card; the data acquisition module acquires data from the device under test through the video capture card; the data includes audio data, image data, and video data.

[0155] A video capture card can be used to enable data communication between a data acquisition module and the device under test (DUT), allowing the DUT to acquire its own data. Alternatively, the data acquisition module can also send audio, image, and video data to the DUT via the video capture card.

[0156] Data acquisition modules, video capture cards, and devices under test can transmit data via data cables such as HDMI cables.

[0157] In this embodiment, a video capture card is used to establish data communication between the data acquisition module and the video capture card, thereby enabling data exchange between the data acquisition module and the device under test and achieving data management of the device under test.

[0158] In an optional embodiment, the first power control module, the second power control module, and the data acquisition module described above can be integrated on a single control board.

[0159] The control board can communicate with the server via wireless communication technologies such as WiFi or Bluetooth.

[0160] Alternatively, the control board can be connected to a microcomputer, which then communicates with the server via wireless communication technologies such as WiFi or Bluetooth.

[0161] The control board can be connected to the device under test via a USB cable or other operating control cable to control the device under test.

[0162] like Figure 6 As shown in the figure, this application embodiment also provides a testing device, which is applied on the server of the testing system. The server is communicatively connected to at least one testing device and a terminal respectively. Each testing device corresponds to a test item tested by the certification test suite. At least one testing device is communicatively connected to the device under test. The testing device includes at least one testing device.

[0163] The task configuration interface display module 410 is used to display the task configuration interface on the terminal;

[0164] The task information receiving module 420 is used to receive task information entered in the task configuration interface; the task information includes the target test item, the configuration parameters corresponding to the target test item, task parameters, and the target quantity threshold; the target test item is a test item tested by the certification test suite.

[0165] The task generation module 430 is used to generate configuration tasks based on configuration parameters and test tasks based on task parameters.

[0166] Configuration module 440 is used to configure at least one test device of the target test apparatus according to the configuration task;

[0167] Test module 450 is used to determine the number of test devices that have completed the configuration task. If the number of test devices that have completed the configuration task is greater than or equal to the target number threshold, the test devices that have completed the configuration task are controlled to execute the test task.

[0168] Optionally, the device includes:

[0169] The device information reacquisition module is used to reacquire the number of test devices that have completed the configuration task if the number of test devices that have completed the configuration task is less than the target number threshold. After waiting for the target time, the module reacquires the number of test devices that have completed the configuration task and determines whether the number of reacquired test devices that have completed the configuration task is greater than or equal to the target number threshold.

[0170] Optionally, the certification test suite includes tests for compatibility, GSON, Google Mobile Services, security, TV, and vendor testing; and test equipment includes a compatibility test equipment for compatibility testing, a GSON test equipment for GSON testing, a Google Mobile Services test equipment for Google Mobile Services testing, a security test equipment for security testing, a TV test equipment for TV testing, and a vendor test equipment for vendor testing.

[0171] Optionally, the test task includes test data, and test module 450 includes:

[0172] The sharding unit is used to shard the test data and distribute the sharded test data to the test devices that have completed the configuration task, so that the test devices that have completed the configuration task can execute the test task based on the sharded test data.

[0173] Optionally, the device also includes:

[0174] The task progress interface display module is used to display the task progress interface on the terminal; the task progress interface includes task execution progress information for configuration tasks and / or test tasks.

[0175] Optionally, the test system includes a first power control module and a second power control module. The first power control module is disposed between the power supply and the device under test; the second power control module is disposed between the power supply and at least one test device.

[0176] The first power control module is used to control the power supply to the device under test;

[0177] The second power control module is used to control the power supply to provide power to at least one test device.

[0178] Optionally, the testing system also includes a data acquisition module and a video capture card; the data acquisition module acquires data from the device under test through the video capture card; the data includes audio data, image data, and video data.

[0179] It should be noted that the testing device provided in the above embodiments is only illustrated by the division of the above functional modules when executing the certification test suite testing method. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the testing device provided in the above embodiments and the certification test suite testing method in the above embodiments belong to the same concept, and the implementation process is detailed in the method embodiments, which will not be repeated here.

[0180] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the certification test suite test method as described above.

[0181] The embodiments of this application may take the form of a computer program product implemented on one or more storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing program code. Computer-readable storage media include permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information may be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to: phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transfer medium that can be used to store information accessible by a computing device.

[0182] like Figure 7 As shown, this application embodiment also provides a testing system 500, including a server 510 and at least one testing device 520; the server 510 is communicatively connected to at least one testing device 520 and a terminal respectively; at least one testing device 520 is communicatively connected to the device under test, each testing device 520 corresponds to a test item tested by the certification test suite, and the testing device 520 includes at least one testing device;

[0183] Server 510 executes any of the authentication test suite test methods described above.

[0184] Server 510 can be a single server or a server cluster consisting of multiple servers.

[0185] In an optional embodiment, server 510 may include a user editing server, a test resource storage server, and a progress management server. The test resource storage server stores test resources such as test data. The user editing server is used to receive task information input from the task configuration interface, retrieve test resources from the test resource storage server based on the task information, and generate configuration tasks and test tasks. The progress management server is used to manage the progress of test tasks and configuration tasks and display the task progress interface on the terminal.

[0186] In one embodiment, the test system 500 may further include a first power control module and a second power control module, wherein the first power control module is disposed between the power supply and the device under test; and the second power control module is disposed between the power supply and at least one test device.

[0187] The first power control module is used to control the power supply to the device under test.

[0188] The second power control module is used to control the power supply to provide power to at least one test device.

[0189] In one embodiment, the test system 500 may further include a data acquisition module and a video capture card; the data acquisition module acquires data from the device under test through the video capture card; the data includes audio data, image data, and video data.

[0190] In an optional embodiment, the first power control module, the second power control module, and the data acquisition module can be integrated on a single control board.

[0191] The control board can communicate with the server 510 via wireless communication technologies such as WiFi or Bluetooth.

[0192] Alternatively, the control board can be connected to a microcomputer, which can then communicate with the server 510 via wireless communication technologies such as WiFi or Bluetooth.

[0193] The control board can be connected to the device under test via a USB cable or other operating control cable to control the device under test.

[0194] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0195] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A testing method for an authentication test suite, characterized in that, The application is in a testing system, which includes a server and at least one testing device; the server is communicatively connected to at least one testing device and a terminal; the at least one testing device is communicatively connected to the device under test, and each testing device corresponds to a test item tested by a certification test suite, wherein each testing device includes at least one testing device; the method includes: The terminal displays a task configuration interface; The system receives task information input on the task configuration interface; the task information includes a target test item, configuration parameters corresponding to the target test item, task parameters, and a target quantity threshold; the target test item is a test item tested by the certification test suite. A configuration task is generated based on the configuration parameters, and a test task is generated based on the task parameters. Configure at least one test device of the target test apparatus according to the configuration task; Determine the number of test devices that have completed the configuration task. If the number of test devices that have completed the configuration task is greater than or equal to the target number threshold, control the test devices that have completed the configuration task to execute the test task.

2. The certification test suite testing method according to claim 1, characterized in that, The method includes: If the number of test devices that have completed the configuration task is less than the target number threshold, after waiting for the target time, the number of test devices that have completed the configuration task is retrieved again, and it is determined whether the number of test devices that have completed the configuration task retrieved again is greater than or equal to the target number threshold.

3. The testing method for the certification test suite according to claim 1, characterized in that, The test task includes test data, and controlling the test device that has completed the configuration task to execute the test task includes: The test data is fragmented, and the fragmented test data is distributed to the test devices that have completed the configuration task, so that the test devices that have completed the configuration task can execute the test task based on the fragmented test data.

4. The testing method for the certification test suite according to claim 1, characterized in that, The method further includes: The terminal displays a task progress interface; the task progress interface includes task execution progress information for the configuration task and / or the test task.

5. The testing method for the certification test suite according to claim 1, characterized in that, The test system includes a first power control module and a second power control module. The first power control module is disposed between the power supply and the device under test. The second power control module is disposed between the power supply and the at least one test device. The first power control module is used to control the power supply to provide power to the device under test; The second power control module is used to control the power supply to provide power to the at least one test device.

6. The testing method for the certification test suite according to claim 1, characterized in that, The testing system also includes a data acquisition module and a video acquisition card; the data acquisition module acquires data from the device under test through the video acquisition card; the data includes audio data, image data, and video data.

7. The certification test suite testing method according to claim 1, characterized in that, The certification test suite includes tests for compatibility, GSON, Google Mobile Services, security, TV, and vendor testing. The testing equipment includes a compatibility testing device for the compatibility test, a GSON testing device for the GSON test, a Google Mobile Services testing device for the Google Mobile Services test, a security testing device for the security test, a TV testing device for the TV test, and a vendor testing device for the vendor test.

8. A testing device, characterized in that, The application is used in a testing system, which includes a server and at least one testing device; the server is communicatively connected to at least one testing device and a terminal; the at least one testing device is communicatively connected to the device under test, and each testing device corresponds to a test item tested by a certification test suite; the testing device includes at least one testing apparatus; the apparatus includes: A task configuration interface display module is used to display the task configuration interface on the terminal. The task information receiving module is used to receive task information input on the task configuration interface; the task information includes a target test item, configuration parameters corresponding to the target test item, task parameters, and a target quantity threshold; the target test item is a test item tested by the certification test suite. The task generation module is used to generate configuration tasks based on the configuration parameters and to generate test tasks based on the task parameters. A configuration module is used to configure at least one test device of the target test apparatus according to the configuration task; The testing module is used to determine the number of test devices that have completed the configuration task. If the number of test devices that have completed the configuration task is greater than or equal to the target number threshold, the module controls the test devices that have completed the configuration task to execute the test task.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When executed by a processor, the computer program implements the steps of the certification test suite testing method as described in any one of claims 1-7.

10. A testing system, characterized in that: The system includes a server and at least one testing device; the server is communicatively connected to at least one testing device and a terminal respectively; the at least one testing device is communicatively connected to the device under test, and each testing device corresponds to a test item tested by the certification test suite, and the testing device includes at least one testing device. The server performs the authentication test suite test method as described in any one of claims 1-7.

Images