An automated testing system and method for operating systems in multi-chip scenarios

Abstract

This invention discloses an automated operating system testing system and method for multi-chip scenarios, including a host computer, a CI / CD compilation module, and a target hardware board. The CI / CD compilation module is electrically connected to the target hardware board, and the target hardware board is electrically connected to the host computer. The method comprises: S1) configuring test tasks through the host computer; S2) the CI / CD compilation module automatically compiles and generates operating system images adapted to different hardware platforms according to the test task requirements; S3) distributing the compiled operating system images to the corresponding target hardware boards; S4) the target hardware board loads the operating system image, executes automated tests, and returns the test results to the host computer; S5) the host computer statistically analyzes the test results and generates a test report; S6) after the test is completed, the image can be automatically reset or reloaded as needed to improve test efficiency and adapt to the parallel verification requirements of operating systems on multiple hardware platforms.

Description

Technical Field

[0001] This invention belongs to the field of automated testing technology, specifically relating to an automated testing system and method for operating systems in multi-chip scenarios. Background Technology

[0002] Automated system testing refers to simulating the manual testing process using tools and scripts to improve testing efficiency and accuracy. Automated testing can reduce human error, improve testing efficiency, and reduce testing costs.

[0003] In the prior art, CN119829419A discloses a scalable embedded operating system automated testing system with a C / S architecture, which includes the following functions: (1) The client and the server establish a local area network through the network to form a distributed network system with C / S architecture. The client connects to the restart control box via USB and connects to the target hardware platform via serial port and network. The restart control box and the target hardware platform are connected via signal line. Under the control of system software, an automated testing environment is realized that multiple testers can use at the same time. (2) The client works with the restart control box to realize personnel login, test case compilation, test case download, execution monitoring, process management, automatic reset, exception statistics, and report generation; (3) The server includes a database and a file server to implement test case storage management, test result storage management, and user history record storage; (4) The target hardware platform includes hardware platforms supported by the embedded operating system; (5) The server installs and configures the database system, while the client installs the automated testing system software.

[0004] The system described in CN119829419A is mainly for testing the overall functionality of the embedded operating system and general hardware platforms. The test objects are concentrated on the "target processor platform" and do not distinguish the functional characteristics of different types of chips. In embedded systems, different chips (such as communication, control, and display chips) have different interface and driver requirements. In addition, CN119829419A is mainly for operating system function testing and system stability testing, but does not cover the following automated testing areas: (1) peripheral driver loading and function verification; (2) communication protocol stack interaction testing; (3) display interface frame rate and refresh response verification. Summary of the Invention

[0005] To address the aforementioned technical problems, this invention provides an automated testing system and method for operating systems in multi-chip scenarios.

[0006] The specific plan is as follows: An automated operating system testing system for multi-chip scenarios includes a host computer, a CI / CD compilation module, and target hardware boards. The CI / CD compilation module is electrically connected to the target hardware boards, and the target hardware boards are electrically connected to the host computer. The host computer is used to configure test tasks, manage test processes, collect test results, and generate test reports. The target hardware boards are used to execute different types of automated tests. The CI / CD compilation module is used to automatically compile and generate operating system images adapted to different hardware platforms according to the test task requirements; and distribute the compiled operating system images to the corresponding target hardware boards. After loading the operating system images, the target hardware boards execute automated tests and return the test results to the host computer.

[0007] The system also includes an automated testing chassis with slots. The target hardware boards are inserted into these slots. The target hardware boards include control boards, communication boards, and display boards. The control boards integrate MCU, GPIO, PWM, and ADC acquisition chips. The communication boards integrate a network module, CAN controller, serial port chip, and voltage / current acquisition chip. The display boards integrate an LCD display and an audio module. Each control board, communication board, and display board runs an independent operating system image for functional self-testing and automated testing. The CI / CD compilation module includes a server and a CI / CD automated compilation and download tool, and the server is communicatively connected to the CI / CD automated compilation and download tool.

[0008] The system also includes a network communication and control module, which is used for communication between boards via a local area network, supports parallel testing of multiple boards, and performs driver loading verification, communication protocol interaction testing, and display refresh rate detection at the operating system level.

[0009] An automated testing method for operating systems in multi-chip scenarios includes the following steps: S1): Configure the test task through the host computer to determine the type of chip and operating system version to be tested; S2): The CI / CD compilation module automatically compiles and generates operating system images adapted to different hardware platforms according to the test task requirements; S3): Distribute the compiled operating system image to the corresponding target hardware board, which includes control board, communication board and display board; S4): After the target hardware board loads the operating system image, it performs automated tests and returns the test results to the host computer. S5): The host computer collects the test results, performs statistical analysis, and generates a test report; S6): After the test is completed, the image can be automatically reset or reloaded as needed, supporting multiple rounds of regression testing.

[0010] The operating system image is downloaded and distributed to the corresponding target hardware board via the network.

[0011] In S4), the control board and the communication board send the test results to the display board via the network. The display board displays the test status in real time through the display screen and uploads the test data to the host computer.

[0012] This invention discloses an automated operating system testing system and method for multi-chip scenarios. It distributes the system image to each target board through a CI / CD automated compilation module, achieving automated system deployment. This system offers the following advantages: 1. Supports scalable testing for various types of chips. The system can perform differentiated testing for control, communication, and display chips, covering the functional adaptation and driver verification of the operating system in various chip environments. For new chips or boards, they can be quickly integrated by adding corresponding test boards without modifying the overall system architecture, thus achieving flexible scalability of testing.

[0013] 2. Full-process automated testing The operating system image is automatically compiled using CI / CD and automatically distributed to each target board; The complete testing process includes driver loading detection, functional verification, communication and display testing, and result summarization, all of which can be executed automatically, significantly reducing manual intervention and improving testing efficiency and reliability.

[0014] 3. High-concurrency parallel testing capability The system supports multiple boards to execute test tasks in parallel at the same time. The test processes between boards are isolated from each other and do not interfere with each other. While ensuring data accuracy, it can significantly improve testing efficiency and coverage, and adapt to the parallel verification needs of multiple hardware platforms of the operating system. Attached Figure Description

[0015] Figure 1 This is a system structure diagram of the present invention. Detailed Implementation

[0016] The technical solutions in the embodiments of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the implementation of the present invention, and not all of it. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0017] like Figure 1 As shown, an automated operating system testing system for multi-chip scenarios includes a host computer 1, a CI / CD compilation module 2, and a target hardware board 3. The CI / CD compilation module 2 is electrically connected to the target hardware board 3, and the target hardware board 3 is electrically connected to the host computer 1. The host computer 1 is used to configure test tasks, manage test processes, collect test results, and generate test reports. The target hardware board 3 is used to execute different types of automated tests. The CI / CD compilation module 2 is used to automatically compile and generate operating system images adapted to different hardware platforms according to the test task requirements, and distribute the compiled operating system images to the corresponding target hardware board 3. After loading the operating system image, the target hardware board 3 executes automated tests and returns the test results to the host computer 1. The system can automatically complete operating system function verification, driver loading verification, communication protocol interaction testing, and display interface performance testing in various chip environments, and output test results.

[0018] The system is also equipped with an automated testing chassis, which has slots. The target hardware board 3 is inserted into the automated testing chassis through the slots. The target hardware board 3 includes a control board 31, a communication board 32, and a display board 33.

[0019] The control board 31 is used to test the driver compatibility and functional stability of the operating system on the control chip, including sensor data acquisition and actuator control function testing. The control board 31 integrates MCU, GPIO, PWM and ADC acquisition chips.

[0020] The communication board 32 is used to test the driver compatibility and communication protocol functions of the operating system on the communication chip, including network communication and CAN bus communication function testing. The communication board 32 integrates a network module, a CAN controller, a serial port chip, and a voltage and current acquisition chip.

[0021] The display board 33 is used to test the driver compatibility and display performance of the operating system on the display chip, including graphics rendering, audio playback, and frame rate performance testing. The display board 33 integrates an LCD display and an audio module. The control board 31, communication board 32, and display board 33 each run the operating system image independently to perform functional self-tests and automated tests.

[0022] The CI / CD compilation module 2 supports automatically configuring compilation parameters and generating adapted image files based on different chip types and operating system versions. CI (Continuous Integration) and CD (Continuous Delivery) enable automated building, automatically compiling and packaging the code after it is obtained.

[0023] The CI / CD compilation module 2 includes a server and a CI / CD automated compilation and download tool. The server is communicatively connected to the CI / CD automated compilation and download tool, which is Jenkins. Jenkins is an open-source automated deployment tool widely used in continuous integration (CI) and continuous delivery (CD) processes. It supports automated building, testing, and deployment of applications.

[0024] The CI / CD compilation module 2 automatically generates the corresponding system image based on the operating system version and target hardware type, and distributes the image to each target board to achieve automatic system deployment. The server stores the source code, test case library, and test task queue of the operating system to be tested. The CI / CD automated compilation and download tool receives server instructions, automatically completes the compilation, generates operating system images adapted to different boards, and deploys the images to the corresponding test boards.

[0025] The system also includes a network communication and control module, which is used for communication between boards via a local area network, supports parallel testing of multiple boards, and performs driver loading verification, communication protocol interaction testing, and display refresh rate detection at the operating system level.

[0026] The multi-board parallel testing refers to multiple boards, or even multiple types of boards, starting and executing their respective test tasks simultaneously. For example, one control board is testing PWM output, while another communication board is simultaneously testing network bandwidth; these processes occur concurrently without interference. The driver loading verification is performed during the operating system startup process. The network communication and control module monitors and confirms whether the drivers of various chips, such as CAN controllers, network cards and display chips, are correctly recognized, loaded and initialized by the operating system, so as to avoid hardware failure caused by driver problems. The communication protocol interaction test simulates a real network communication scenario, testing whether the protocol stack on the test board, such as TCP, UDP, and CAN protocols, can correctly handle data encapsulation, transmission, reception, and decapsulation; The performance testing, such as the display refresh rate, is performed by using a built-in script to quantitatively measure performance indicators such as the frame rate (FPS) and response latency of graphics rendering on the display board, ensuring that the display system meets the smoothness requirements. The network communication and control module connects the control board 31, communication board 32, display board 33, host computer, and CI / CD compilation module 2 within the system via a local area network, creating a stable and high-speed internal communication environment. Command issuance, status reporting, and test data transmission between boards and between boards and the host computer are all based on standard network protocols (such as TCP / IP), providing a physical foundation for distributed testing.

[0027] The display board 33 displays the test results of the control, communication and display boards in real time through the display screen; the test data can be transmitted to the host computer 1 through the network or serial port to realize centralized management of test results and report generation; the host computer 1 can perform statistics, anomaly analysis and output standardized test reports on the test results.

[0028] An automated testing method for operating systems in multi-chip scenarios includes the following steps: S1): Configure the test task through the host computer to determine the type of chip and operating system version to be tested; S2): The CI / CD compilation module automatically compiles and generates operating system images adapted to different hardware platforms according to the requirements of the test task; S3): Distribute the compiled operating system image to the corresponding target hardware board. The operating system image is downloaded and distributed to the corresponding target hardware board via the network. The target hardware board includes control board, communication board and display board. S4): After the target hardware board loads the operating system image, each board automatically loads the driver, performs automated tests of the corresponding functions, and returns the test results to the host computer. The control and communication boards send the test results to the display board via the network. The display board displays the test status in real time on the screen and uploads the test data to the host computer.

[0029] S5): The host computer collects the test results, performs statistical analysis, and generates a test report; S6): After the test is completed, the image can be automatically reset or reloaded as needed, supporting multiple rounds of regression testing.

[0030] This invention discloses an automated operating system testing system and method for multi-chip scenarios. Through a CI / CD automated compilation module, the system distributes the operating system image to various target boards. It can automatically complete operating system function verification, driver loading verification, communication protocol interaction testing, and display interface performance testing in various chip environments, outputting test results and achieving automatic system deployment. It has the following beneficial effects: 1. Supports scalable testing for various types of chips. The system can perform differentiated testing for control, communication, and display chips, covering the functional adaptation and driver verification of the operating system in various chip environments. For new chips or boards, they can be quickly integrated by adding corresponding test boards without modifying the overall system architecture, thus achieving flexible scalability of testing.

[0031] 2. Full-process automated testing The operating system image is automatically compiled using CI / CD and automatically distributed to each target board; The complete testing process includes driver loading detection, functional verification, communication and display testing, and result summarization, all of which can be executed automatically, significantly reducing manual intervention and improving testing efficiency and reliability.

[0032] 3. High-concurrency parallel testing capability The system supports multiple boards to execute test tasks in parallel at the same time. The test processes between boards are isolated from each other and do not interfere with each other. While ensuring data accuracy, it can significantly improve testing efficiency and coverage, and adapt to the parallel verification needs of multiple hardware platforms of the operating system.

[0033] The technical means disclosed in this invention are not limited to those disclosed in the above embodiments, but also include technical solutions composed of any combination of the above technical features. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of this invention, and these improvements and modifications are also considered within the scope of protection of this invention.

Claims

1. An automated testing system for operating systems in multi-chip scenarios, characterized in that: The system includes a host computer (1), a CI / CD compilation module (2), and a target hardware board (3). The CI / CD compilation module (2) is electrically connected to the target hardware board (3), and the target hardware board (3) is electrically connected to the host computer (1). The host computer (1) is used to configure test tasks, manage test processes, collect test results, and generate test reports. The target hardware board (3) is used to execute different types of automated tests. The CI / CD compilation module (2) is used to automatically compile and generate operating system images adapted to different hardware platforms according to the test task requirements and distribute the compiled operating system images to the corresponding target hardware board (3). After loading the operating system image, the target hardware board (3) executes automated tests and returns the test results to the host computer (1).

2. The automated operating system testing system for multi-chip scenarios according to claim 1, characterized in that: The system is also equipped with an automated test chassis, which has slots. The target hardware board (3) is inserted into the automated test chassis through the slots. The target hardware board (3) includes a control board (31), a communication board (32), and a display board (33). The control board (31) integrates MCU, GPIO, PWM, and ADC acquisition chips. The communication board (32) integrates a network module, a CAN controller, a serial port chip, and a voltage and current acquisition chip. The display board (33) integrates an LCD display and an audio module. The control board (31), the communication board (32), and the display board (33) each run an operating system image independently to perform functional self-testing and automated testing.

3. The automated operating system testing system for multi-chip scenarios according to claim 1, characterized in that: The CI / CD compilation module (2) includes a server and a CI / CD automated compilation and download tool, and the server is communicatively connected to the CI / CD automated compilation and download tool.

4. The automated operating system testing system for multi-chip scenarios according to claim 1, characterized in that: The system also includes a network communication and control module, which is used for communication between boards via a local area network, supports parallel testing of multiple boards, and performs driver loading verification, communication protocol interaction testing, and display refresh rate detection at the operating system level.

5. An automated testing method for operating systems in multi-chip scenarios, wherein the method is applied to the system described in any one of claims 1 to 4, characterized in that: Includes the following steps: S1): Configure the test task through the host computer to determine the type of chip and operating system version to be tested; S2): The CI / CD compilation module automatically compiles and generates operating system images adapted to different hardware platforms according to the test task requirements; S3): Distribute the compiled operating system image to the corresponding target hardware board, which includes control board, communication board and display board; S4): After the target hardware board loads the operating system image, it performs automated tests and returns the test results to the host computer. S5): The host computer collects the test results, performs statistical analysis, and generates a test report; S6): After the test is completed, the image can be automatically reset or reloaded as needed, supporting multiple rounds of regression testing.

6. The automated testing method for operating systems in multi-chip scenarios according to claim 5, characterized in that: The operating system image is downloaded and distributed to the corresponding target hardware board via the network.

7. The automated testing method for operating systems in multi-chip scenarios according to claim 5, characterized in that: In S4), the control board and the communication board send the test results to the display board via the network. The display board displays the test status in real time through the display screen and uploads the test data to the host computer.

Images