Automatic test system

Through the automated test system, the host server and test control module are used to execute test scripts and image recognition module to monitor the status, solving the problem of manual synchronization control in computer system testing, realizing automated testing of multiple machines, improving efficiency and saving costs.

CN119088667APending Publication Date: 2024-12-06INVENTEC PUDONG TECH CORPOARTION +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310664981.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-06-06
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

In the computer system testing, the prior art requires manual operation, which makes it difficult for testers to control multiple machines to be tested simultaneously, and it is easy to miss time-limited instructions, resulting in idleness of machines to be tested and delayed testing process, and consumes a lot of labor costs. Reduce testing efficiency.

Method used

Design an automated test system, including a host server and multiple test control modules, by executing test scripts and monitoring test status, using image capture devices and image identification modules, to realize automated control and status judgment of the machine to be tested, and reduce manual intervention .

Benefits of technology

It realizes automated control and monitoring of multiple machines to be tested, saves labor costs, reduces idle time of machines to be tested, improves testing efficiency, avoids manual input errors, and realizes automation of testing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119088667A_ABST
    Figure CN119088667A_ABST
Patent Text Reader

Abstract

The invention provides an automatic testing system. The automatic test system comprises a host server and a plurality of test control modules. The host server is used for generating a test selection signal and a test process setting signal. The plurality of test control modules are coupled to the host server. Each test control module is coupled to a machine to be tested, and each test control module comprises a test control device and an image acquisition device. The test control device is used for executing a test script according to the test selection signal and the test process setting signal so as to control the machine to be tested to execute a test program. The image capturing device is used for capturing a picture displayed on a display screen of the to-be-tested machine to generate an image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an automated testing system, and more particularly to an automated testing system capable of executing a test script and monitoring a test status in real time. Background Art

[0002] In response to the more frequent and compact update speed of computer operating systems, computer manufacturers often install different versions of image files to test the operating performance of image files for the performance requirements and stability of computer systems. In the test process, all steps usually require manual operation by testers, so testers can hardly leave the machine to be tested. Moreover, when multiple machines to be tested are processed simultaneously, testers are prone to miss some instructions that must be input within the time limit due to interoperation. For example, after setting the Basic Input / Output System (BIOS) and restarting, the function key F12 must be pressed immediately to enter the watchdog timer (WDT) control mode, but testers sometimes fail to complete the operation in time, causing the machine to be idle and delaying the running time of the overall test process. However, when the operating system update speed becomes more and more frequent and the testers must manually perform each stage of control input to implement the installation and test procedures in the image file installation and test procedures, it will cost a lot of manpower costs. Furthermore, when the tester cannot synchronously control multiple machines under test, the machines under test are likely to be idle, which will greatly reduce the efficiency of the overall test program. In view of this, the prior art needs to be improved. Summary of the invention

[0003] In order to solve the above problems, the present invention provides an automated testing system that can execute test scripts and monitor test status in real time to solve the above problems.

[0004] The present invention provides an automated testing system, comprising: a host server, used to generate a test selection signal and a test process setting signal; and a plurality of test control modules, coupled to the host server, each test control module is coupled to a machine to be tested, and each test control module comprises: a test control device, used to execute a test script according to the test selection signal and the test process setting signal to control the machine to be tested to execute a test program; and an image capture device, used to capture a picture displayed on a display screen of the machine to be tested to generate an image.

[0005] The host server further comprises: a user interface for receiving a request or input from a user end, so that the processing circuit generates the test selection signal and the test flow setting signal accordingly.

[0006] The test control device executes the test script according to the test selection signal and the test flow setting signal to generate a human-machine interface device signal to control the machine under test to execute the test program.

[0007] The image capture device transmits the captured image to the host server, so that the host server determines the execution status of the test program according to the image.

[0008] The image capture device transmits the captured image to the test control device, and the test control device transmits the image to the host server, so that the host server determines the execution status of the test program according to the image.

[0009] An image recognition module of the host server utilizes an open source computer vision library, an artificial intelligence model or an optical character recognition algorithm to analyze the image captured by the image capture device to identify the image displayed on a display screen of the machine under test and determine the execution status of the test program accordingly.

[0010] The test selection signal is used to indicate a selected test control module among the plurality of test control modules, and the test flow setting signal is used to indicate the test program to be executed.

[0011] The test control device is a Raspberry Pie development board.

[0012] The test control device is a notebook computer. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 Schematic diagram of an automated testing system according to an embodiment of the present invention.

[0014] Figure 2 FIG. 4 is a schematic diagram of the operation of the user interface of the automated testing system according to an embodiment of the present invention.

[0015] Figure 3 It is a schematic diagram of the operation of the image capture device of the automatic testing system according to an embodiment of the present invention.

[0016] Explanation of symbols:

[0017] 1: Automated testing system

[0018] 10: Host Server

[0019] 100: Processing circuit

[0020] 102: User Interface

[0021] 104: Image recognition module

[0022] 20_1-20_3: Test control module

[0023] 200_1-200_3: Test control device

[0024] 202_1-202_3: Image capture device

[0025] 30_1-30_3: Machines to be tested

[0026] 300_1: Display screen

[0027] 400: Network

[0028] UE:Computer Device DETAILED DESCRIPTION

[0029] Certain words are used in the specification and claims to refer to specific components. Those with ordinary knowledge in the field should understand that manufacturers may use different terms to refer to the same component. This specification and the subsequent patent application scope do not use differences in names as a way to distinguish components, but use differences in the functions of components as the basis for distinction. The "include" or "comprising" mentioned throughout the specification and the subsequent patent application scope is an open-ended term and should be interpreted as "including but not limited to". In addition, the word "coupled" here includes any direct and indirect electrical connection means. Therefore, if the text describes a first device coupled to a second device, it means that the first device can be directly electrically connected to the second device, or indirectly electrically connected to the second device through other devices or connection means.

[0030] Please refer to Figure 1 , Figure 1 Schematic diagram of an automated testing system 1 according to an embodiment of the present invention. The automated testing system 1 includes a host server 10, test control modules 20_1-20_3, and machines to be tested 30_1-30_3. The automated testing system 1 can be applied to the production test stage, and the host server 10 is coupled to the test control modules 20_1-20_3. Each test control module is coupled to a corresponding machine to be tested to control the corresponding machine to be tested to execute a test program. In this embodiment, the number of machines to be tested can be adjusted in different designs according to actual application requirements. In this embodiment, for ease of explanation and to avoid overly complicated diagrams, Figure 1 Only three groups of machines under test are shown in the figure, but the present embodiment is not limited thereto. The host server 10 can generate a test selection signal and a test flow setting signal to control each test control module, so that each test control module executes a test script according to the test selection signal and the test flow setting signal generated by the host server 10 to control the corresponding machine under test to execute the test program.

[0031] The host server 10 includes a processing circuit 100, a user interface 102, and an image recognition module 104. The processing circuit 100 can be used to generate a test selection signal and a test process setting signal. The test selection signal is used to indicate the selection of a test control module to select which test control module is to perform the control of the test program. The test process setting signal is used to indicate the selection of a test process to select the test process to be executed. The user interface 102 can be used to receive a request or input from the user end, so that the processing circuit 100 generates a test selection signal and a test process setting signal accordingly. For example, the user interface 102 can use the Vue framework component technology to set up an operation webpage and a user interface, but is not limited thereto. In this way, a user (e.g., a tester) can log in to the user interface 102 of the host server 10 through a network link, and then use the user interface 102 to input and select the test control module to be set, so that the processing circuit 100 generates a corresponding test selection signal, and use the user interface 102 to set the test process to be executed, so that the processing circuit 100 generates a corresponding test process setting signal. For example, please refer to Figure 2 , Figure 2 The figure is an operation diagram of the user interface of the automated test system 1 of the embodiment of the present invention. For example, the user end can use a computer device UE to log in to the user interface 102 of the host server 10 via a network 400, and input and select the designated test control module and the type of test process to be performed in the user interface 102, so that the processing circuit 100 generates the corresponding test selection signal and the test process setting signal accordingly. In this way, as long as the tester has a computer device that can be connected to the user interface 102, he can operate the host server 10 to control the corresponding test control module to execute the test script to control the machine under test to perform the test work. The tester can control and monitor multiple machines under test at the same time through the input settings of the user interface 102.

[0032] Each test control module includes a test control module device and an image capture device. For example, the test control module 20_1 includes a test control device 200_1 and an image capture device 202_1. The test control module 20_2 includes a test control device 200_2 and an image capture device 202_2. The test control module 20_3 includes a test control device 200_3 and an image capture device 202_3. The host server 10 can be coupled to the test control devices 200_1-200_3 and the image capture devices 202_1-202_3. The test control module device of each test control module can be used to execute a test script according to the test selection signal and the test process setting signal generated by the host server 10 to control the corresponding machine under test to execute a test program. For example, the test control device 200_1 executes a corresponding test script to control the machine under test 30_1 to execute a test program, the test control device 200_2 executes a corresponding test script to control the machine under test 30_2 to execute a test program, and the test control device 200_3 executes a corresponding test script to control the machine under test 30_3 to execute a test program. The test control devices 200_1-200_3 may be Raspberry Pi development boards. The test control devices 200_1-200_3 may communicate with the machines under test 30_1-30_3 via a Universal Serial Bus (USB) transmission interface for data transmission, but are not limited thereto. The test control devices 200_1-200_3 may be Raspberry Pi development boards that support USB OTG (On-To-GO) functions. After executing the test script, the test control devices 200_1-200_3 can respectively transmit corresponding human interface device (HID) signals to the machines under test 30_1-30_3 to simulate the input of real USB keyboard and mouse devices, so as to control the machines under test 30_1-30_3 to perform corresponding test flow procedures. The test flow includes the installation of the test image file of the machine under test and the verification test of the image file operation. In this way, the test control devices 200_1-200_3 can simulate a real person pressing the keyboard to input text or selecting items in a drop-down menu by transmitting corresponding human interface device signals.

[0033] Each test control module may include a plurality of test scripts corresponding to a plurality of test processes, and each test control device may select to execute a corresponding test script according to a test selection signal and a test process setting signal generated by the host server 10. The test script includes a series of action steps required in the test process written into an automatically executed program script. When executing the test script, the test control device will play the role of the original tester's manual input operation and send a corresponding human-machine interface device signal according to the instruction sequence in the test script to control the machine under test to perform the corresponding test process program. For example, the test process may include a complete image file verification process, and the complete image file verification process may include confirming the power-on self-test (POST) information, updating the BIOS of the machine under test to the corresponding version, changing the boot settings in the BIOS, entering the monitoring program timer control mode, unlocking all manufacturing program modes (ManufactureProgram Mode), executing an installation tool (such as Dash) to install the image file to the machine under test, performing an out-of-box experience (OOBE) test, and testing the contents of the installed image file (for example, the start menu, browser settings, etc.). Various test processes can be modified or added as needed without being restricted to the complete execution of the traditional full test process. For example, the test process can be to execute Dash to install the image file to the machine under test, the test process can be to perform OOBE testing, or the test process can be to press the function key F12 to enter the WDT control mode when restarting after setting the BIOS. The test process can also include repeatedly executing test steps, such as repeatedly executing Dash to install the image file to the machine under test for testing. In other words, when the user uses the user interface 102 of the host server 10 to set the order of the test control device to be executed and the test process to be executed in the form of a sequence, the automated testing system 1 can automatically complete the automatic installation of the image file to the machine under test and execute related tests of the image file by taking over without manual intervention.

[0034] Each image capture device can be used to capture a picture displayed on a display screen of the corresponding machine under test to generate an image. For example, the image capture device 202_1 is used to capture a picture displayed on a display screen of the machine under test 30_1 to generate an image. The image capture device 202_2 is used to capture a picture displayed on a display screen of the machine under test 30_2 to generate an image. The image capture device 202_3 is used to capture a picture displayed on a display screen of the machine under test 30_3 to generate an image. Each image capture device can transmit the captured image to the host server 10. The image capture devices 202_1-202_3 can be cameras or any other devices that can capture images. Each image capture device can also be integrated into the corresponding test control device. For example, the camera lens module on the Strawberry Pie development board of each test control device can be used to implement the image capture device. For example, please refer to Figure 3 , Figure 3 FIG. 1 is a schematic diagram of an operation of an image capture device of an automated testing system 1 according to an embodiment of the present invention. Figure 3 As shown, the machine under test 30_1 may be a laptop computer, and the image capture device 202_1 may be a camera. The image capture device 202_1 may be disposed near a display screen 300_1 of the machine under test 30_1. The image capture device 202_1 may be set to aim at the display screen 300_1 of the machine under test 30_1 to shoot. In this case, Figure 3 As shown, when an image is being displayed on the display screen 300_1 of the machine under test 30_1, the image capture device 202_1 can capture the image being displayed on the display screen 300_1 of the machine under test 30_1 to generate a corresponding image. Therefore, the image capture device 202_1 can record the content currently displayed on the display screen 300_1 of the machine under test 30_1. The captured image generated by the image capture device 202_1 can be provided to the host server 10.

[0035] The images captured by the image capture device can be provided to the host server 10, and the host server 10 can then determine the execution status of the test process based on the returned images and generate a test report and a process record file. In one embodiment, each image capture device can directly transmit the captured images to the host server 10, so that the host server 10 can determine the execution status of the test process based on the returned images. In one embodiment, each image capture device can transmit the captured images to the test control module device in the corresponding test control module, and then transmit the captured images to the host server 10 through the image capture device. In this way, when each test control device executes the corresponding test script to control the machine under test to perform the test according to the test selection signal and the test process setting signal, the host server 10 can also determine the current execution status of the machine under test based on the images captured by each image capture device to control the test control module device to continue to execute the corresponding test script. When the images captured by each image capture device can be transmitted back to the host server 10, they can also be displayed through the user interface 102 so that the user can remotely monitor the current screen status content displayed on the display screen of each machine under test.

[0036] Furthermore, the image recognition module 104 of the host server 10 can determine the current execution status of the machine under test based on the images captured by each image capture device and generate a test report and a process record file. For fixed, simple, and regular screens that do not differ much on various models of machines under test, the image recognition module 104 can use the technology of the Open Source Computer Vision Library (OpenCV) to analyze the images captured by the image capture device to identify the screen displayed on the display screen of the machine under test to determine the current execution status of the test process. For example, the image recognition module 104 can use an image recognition algorithm based on feature comparison, such as ORB and SIFT image recognition algorithms, to analyze the images captured by the image capture device to compare the screen displayed on the display screen of the machine under test and determine the current execution status of the test process. For complex situations where different models of machines to be tested may have different display screens, the image recognition module 104 can use artificial intelligence technology to analyze the images captured by the image capture device to identify the screen displayed on the display screen of the machine to be tested and determine the current execution status of the test process. For example, the image recognition module 104 can use the artificial intelligence model TensorFlow to perform deep learning image recognition training, and use the images captured by each image capture device collected in advance (i.e., the screen displayed on the display screen of the machine to be tested) as a data set to train the image recognition model for determining the screen state, so as to determine the screen displayed on the display screen of the machine to be tested and determine the current execution status of the test process. In addition, when some display screens need to identify the text in the screen, for example, when clearing the secure key, it is necessary to enter numbers according to the screen to pass the security verification. The image recognition module 104 can use the optical character recognition (OCR) algorithm to determine the text and numbers in the display screen, so as to assist in determining the current execution status of the test process.

[0037] In other words, by using the image recognition module 104 to determine the current execution status of the machine under test based on the images captured by each image capture device, the host server 10 can monitor the test process status displayed on the display screen of the machine under test to confirm whether the test process execution is interrupted or has been completed, and can generate a test report and process record file for subsequent processing. At the same time, the user can observe the state of the test control executed by the set test control module and the display screen captured by the image capture device on the display screen of the machine under test at any time through the user interface 102.

[0038] On the other hand, when the number of test machines increases, it means that the number of corresponding test control modules needs to be increased. It also means that the connection and operation of the test control modules that the host server 10 has to bear also increases. In order to avoid the need to perform tedious setup procedures every time a new test control module and test machine are added, the host server 10 can use the Docker image, a rapid deployment software based on the container technology architecture, to package the application, related libraries and configuration files into corresponding Docker image files. Whenever a new test control module and test machine need to be added, the Docker image file is used to build it on the newly added host server 10 or test control module, and only one line of instruction is required to complete the automatic construction.

[0039] In summary, the automated testing system of the embodiment of the present invention can control multiple test control modules through the host server to operate and monitor multiple machines to be tested at the same time. After the tester uses the user interface 102 of the host server 10 to set the order of the test control devices to be executed and the test processes to be executed, the test scripts are automatically executed through each test control device, and the automated testing system 1 can automatically complete the automatic installation of the image file to the machine to be tested and execute the related test processes of the image file without human intervention. At the same time, the screen image on the display screen of the machine to be tested is transmitted back through each image capture device to generate a test report and a process record file. In this way, the automated testing system of the embodiment of the present invention can effectively save labor costs, reduce the idle time of the machine to be tested, and avoid manual input errors by personnel to achieve complete test automation. At the same time, automated testing will also greatly improve the efficiency of the production test process.

[0040] The above description is only a preferred embodiment of the present invention. All equivalent changes and modifications made according to the claims of the present invention should fall within the scope of the present invention.

Claims

1. An automated testing system, characterized in that: include︰ A host server, including: a processing circuit for generating a test selection signal and a test flow setting signal; as well as A plurality of test control modules are coupled to the host server, each test control module is coupled to a machine to be tested, and each test control module includes: a test control device, used to execute a test script according to the test selection signal and the test flow setting signal, so as to control the machine under test to execute a test program; and An image capture device is used to capture the picture displayed on a display screen of the machine to be tested to generate an image.

2. The automated testing system according to claim 1, wherein: The host server further comprises: a user interface for receiving a request or input from a user end, so that the processing circuit generates the test selection signal and the test flow setting signal accordingly.

3. The automated testing system according to claim 1, wherein: The test control device executes the test script according to the test selection signal and the test flow setting signal to generate a human-machine interface device signal to control the machine under test to execute the test program.

4. The automated testing system according to claim 1, wherein: The image capture device transmits the captured image to the host server, so that the host server determines the execution status of the test program according to the image.

5. The automated testing system according to claim 1, wherein: The image capture device transmits the captured image to the test control device, and the test control device transmits the image to the host server, so that the host server determines the execution status of the test program according to the image.

6. The automated testing system as claimed in claim 1, wherein: An image recognition module of the host server utilizes an open source computer vision library, an artificial intelligence model or an optical character recognition algorithm to analyze the image captured by the image capture device to identify the image displayed on a display screen of the machine under test and determine the execution status of the test program accordingly.

7. The automated testing system according to claim 1, wherein: The test selection signal is used to indicate a selected test control module among the plurality of test control modules, and the test flow setting signal is used to indicate the test program to be executed.

8. The automated testing system according to claim 1, wherein: The test control device is a Raspberry Pie development board.

9. The automated testing system according to claim 1, wherein: The test control device is a notebook computer.