A human-machine interface testing method and device

Through the combination of a three-dimensional motion platform and a test host, automated testing of the human-machine interface is achieved, solving the problem of low testing efficiency in the existing technology, and ensuring the functional verification and security of DMI.

CN114546735BActive Publication Date: 2025-08-12CRSC RESEARCH & DESIGN INSTITUTE GROUP CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210023635.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-01-10
Publication Date
2025-08-12
Estimated Expiration
2042-01-10

AI Technical Summary

Technical Problem

The prior art cannot effectively verify peripheral functions in the testing of human-computer interface DMI, especially in complex environments, with low testing efficiency and long operating time.

Method used

The three-dimensional motion platform and the test host are used to test and display the DMI. By obtaining the screen display image of the DMI, we determine whether the key function and display function are normal, and we conduct automated testing with the servo motor and camera.

Benefits of technology

It realizes the basic functional testing of efficient hardware equipment of the human-computer interface, improves the testing efficiency, and ensures the safety and reliability of DMI.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114546735B_ABST
    Figure CN114546735B_ABST
Patent Text Reader

Abstract

The present invention provides a method and apparatus for testing a human-machine interface (DMI). The method comprises: using a test host to perform external device testing on the DMI, including key and display testing; obtaining a screen display image of the DMI; and determining whether the DMI's key and display functions are functioning properly based on the screen display image. This method can efficiently perform basic functional testing on various hardware devices of the HMI, facilitating automated factory inspection of the HMI.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of human-machine interface testing, and in particular relates to a method and device for testing a human-machine interface. Background Art

[0002] The Driver Machine Interface (DMI) is a key component of the onboard Automatic Train Protection (ATP) system. Installed at the front of the EMU driver's cab, it accepts driver-input of train-related data and operations, displays driving information such as the train's current speed, maximum speed limit, target speed, and target distance, and controls the train's operating status.

[0003] The human-machine interface structure consists of a TFT (Thin Film Transistor) display, a main board (including a CPU and peripheral communication modules), an external speaker and buttons.

[0004] Because this product is closely related to driving safety, functional testing of this product is particularly important. Currently, two methods are usually used in the production testing of DMI products. One is to run the basic program of its operating system (excluding applications) after powering on the product. At this time, the product display can display the welcome interface, which can confirm that the software environment is normal and the hardware display is normal, but other peripheral functions cannot be verified. The other is to download the application program inside the product. At this time, the product can perform the normal functions of the ATP system, but this test method must be connected to an external ATP host, and in the formal application scenario, ATP needs to run multiple scenarios to traverse all peripheral functions. The operation time is long and the environment setup is complex.

[0005] Based on the above situation, there is an urgent need to develop an automatic testing device only for the human-machine interface to fully verify the product peripheral functions and improve testing efficiency. Summary of the Invention

[0006] In view of the above problems, the present invention provides a method for testing a human-machine interface, comprising: performing external device testing on the human-machine interface, i.e., DMI, through a test host, including key testing and display testing;

[0007] Get the DMI screen display image;

[0008] The test host determines whether the key functions and display functions of the DMI are normal based on the images displayed on the screen.

[0009] Furthermore, the key test includes:

[0010] The test host tests the DMI buttons through a three-dimensional motion platform.

[0011] Furthermore, the three-dimensional motion platform is provided with multiple groups of moving parts and pressing parts corresponding to the multiple groups of buttons of the DMI, respectively used to press each group of buttons of the DMI for testing; the moving parts are used to drive the pressing parts to move to a specified position, and the pressing parts are used to press the buttons of the DMI;

[0012] The test host tests the DMI buttons through a three-dimensional motion platform, including:

[0013] The test host controls the moving component to move to a specified position and controls the pressing component to perform a pressing test on the DMI button.

[0014] Further, the lower side buttons of the DMI are tested by the first group of moving components and the first group of pressing components corresponding to the lower side buttons of the DMI; and / or

[0015] The right button of the DMI is tested by the second group of moving components and the second group of pressing components corresponding to the right button of the DMI.

[0016] Furthermore, the buttons on the bottom of the DMI are tested by setting up an independent button test structure on the bottom of the DMI, including: a screw, a slide rail and two servo motors; the two servo motors respectively control the horizontal movement of the slide rail and the screw to press the button; and / or

[0017] The buttons on the right side of the DMI are tested by setting up an independent button test structure on the right side of the DMI, including: a screw rod, a slide rail and two servo motors; the two servo motors respectively control the vertical movement of the slide rail and the screw rod to press the button.

[0018] Furthermore, the method includes: performing a jitter test on the DMI buttons using a three-dimensional motion platform:

[0019] Control the 3D motion platform to continuously click the same button at a frequency of less than 100ms;

[0020] The acquired screen display image is used to determine whether the DMI screen image is switched. If not, the test for the button passes.

[0021] Furthermore, the method includes: performing a combination test on the DMI buttons through a three-dimensional motion platform:

[0022] Control the 3D motion platform motor by pressing two buttons in sequence. Confirm that if any one button is pressed and the screen does not change after the other buttons are pressed, the button combination test passes.

[0023] Furthermore, when performing the key test, the background color of the DMI screen is controlled to change alternately, thereby performing a bad pixel test on the screen.

[0024] Furthermore, the method also includes image testing:

[0025] The test host controls DMI to modify the image in the video memory;

[0026] Afterwards, whether the image display function of the DMI is normal is determined based on the acquired DMI screen display image.

[0027] Furthermore, image testing includes:

[0028] The test host sends the data packet of the deviation frame test to DMI;

[0029] DMI obtains the specified test image from the DMI hard disk according to the received data packet;

[0030] Modify the specified test image so that the pixel deviation between the modified image and the test image is greater than a specified threshold;

[0031] Store the modified image in video memory;

[0032] Get the DMI screen display image;

[0033] Determine whether the DMI screen is black based on the screen display image. If so, the DMI image display function is normal.

[0034] Furthermore, the test host starts the DMI test program through the remote control software;

[0035] Afterwards, the test host communicates with the DMI through the communication interface, and the DMI test program and the test software of the test host implement the test of the DMI.

[0036] Furthermore, the method also includes a communication interface test:

[0037] The test host continuously sends data packets with increasing values to the DMI through the communication board;

[0038] The DMI test program forwards the received data packets back to the test host through the corresponding communication module;

[0039] If the test host receives a specified number of consecutive data packets through the test software and the data packet return time is less than the specified time, it is determined that the communication interface test corresponding to the communication board has passed.

[0040] The present invention also provides a testing device for a human-machine interface, comprising:

[0041] Test host, 3D motion platform and camera,

[0042] The test host is used to perform external device tests on the human-machine interface (DMI), including key testing and display testing;

[0043] The camera is used to obtain the screen display image of the DMI;

[0044] The test host is also used to determine whether the key functions and display functions of the DMI are normal based on the screen display image.

[0045] Furthermore, the three-dimensional motion platform includes multiple groups of moving components and pressing components corresponding to the multiple groups of buttons of the DMI, and is used to press each group of buttons of the DMI for testing;

[0046] The moving component is used to drive the pressing component to move to a specified position, and the pressing component is used to press the button of the DMI.

[0047] Furthermore, the three-dimensional motion platform includes:

[0048] A first set of moving components and a first set of pressing components corresponding to the lower side buttons of the DMI, for testing the lower side buttons; and / or

[0049] The second group of moving parts and the second group of pressing parts corresponding to the right side buttons of the DMI are used to test the right side buttons.

[0050] Furthermore, the three-dimensional motion platform includes:

[0051] An independent key test structure is provided on the bottom side of the DMI, which is used to test the keys on the bottom side of the DMI, including: a screw, a slide rail and two servo motors; the two servo motors respectively control the horizontal movement of the slide rail and the key pressing of the screw; and / or

[0052] An independent button test structure is set up on the right side of the DMI to test the buttons on the right side of the DMI, including: a screw rod, a slide rail and two servo motors; the two servo motors respectively control the vertical movement of the slide rail and the screw rod to press the button.

[0053] Furthermore, the test host also includes a CPU board, a sound card, a network card, an MVB communication board, a CAN communication board, an RS422 communication board and test software.

[0054] The test host can call each hardware driver API interface through the test software to implement the test logic.

[0055] The human-machine interface (HMI) testing method and device of the present invention can efficiently test the basic functions of various HMI hardware devices, facilitating automated HMI factory inspection. Keystroke testing utilizes a three-dimensional motion platform, which offers fast movement without screen obstruction and enables jitter and combination testing. The image testing process can also test the display anomaly monitoring function of the DMI, thereby improving DMI security.

[0056] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0058] Figure 1 A schematic structural diagram of a testing device for a human-machine interface according to an embodiment of the present invention is shown;

[0059] Figure 2 A schematic structural diagram of a test host of a human-machine interface test device according to an embodiment of the present invention is shown;

[0060] Figure 3 A schematic diagram of the three-dimensional structure of a testing device for a human-machine interface according to an embodiment of the present invention is shown;

[0061] Figure 4 A schematic diagram of an image testing process of a human-machine interface testing device according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0062] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0063] The embodiments of the present invention provide a method and apparatus for testing a human-machine interface (DMI).

[0064] like Figure 1 As shown, the test setup includes a 3D motion platform, a test host, a switch, and a power supply. The 3D motion platform includes four servo motors, a motor control board, an industrial camera, and supporting screws and guide rails, which are used to automatically press DMI buttons and monitor the DMI display.

[0065] The test device can realize fully automatic hardware function testing of DMI equipment, including DMI screen display test, DMI button test, DMI communication test, DMI sound output test, and DMI USB interface test.

[0066] The various components of the test device are described below.

[0067] like Figure 2 As shown, the test host uses an industrial computer. The test host includes a CPU board, sound card, network card, MVB communication board, CAN communication board, and RS422 communication board. The test software calls the API (Application Programming Interface) interface of each hardware driver to implement the test logic, which can realize automatic execution of the test process, real-time display of the test status, and automatic evaluation of the test results. It solves the problems of incomplete test items or cumbersome test processes and long test times in the past. Specifically, the CPU board provides a USB communication interface for communicating with the USB communication interface of the DMI; the CAN communication board provides a CAN communication interface for communicating with the CAN communication interface of the DMI; the 422 communication board provides an RS422 communication interface for communicating with the RS422 communication interface of the DMI; the MVB communication board provides an MVB communication interface for communicating with the MVB communication interface of the DMI; and the network card provides an Ethernet communication interface for communicating with the Ethernet communication interface of the DMI through a switch. The test host also controls the three-dimensional motion platform through the Ethernet communication interface to press the DMI buttons, performs image recognition and analysis on the screen images captured by the camera, and collects the DMI sound output through the microphone to confirm whether the DMI functions are normal.

[0068] The test host is powered by AC 220 V. The DC power supply is used to provide 110 V power to the DMI, which receives power through the power interface.

[0069] The test host controls test execution, manages the test process, and generates test results. The test host connects to the DMI via NFS (Network File System). Using SecureCRT software, the host accesses the DMI operating system and runs the test program within the host, enabling communication between the DMI peripherals and the test host. DMI peripherals are external devices, including buttons, screens, speakers, and communication interfaces.

[0070] During testing, the CPU board runs the Windows operating system and manages the bus hardware. The USB interface retrieves the log stored on the DMI's USB interface after testing, allowing the test host to verify the log. The MVB communication board connects to the DMI's MVB communication interface for data transmission and reception testing. The CAN communication board connects to the DMI's CAN communication interface for data transmission and reception testing. The RS422 communication interface connects to the DMI's RS422 communication interface, logs into the DMI's operating system, and remotely runs test programs on the test host. The Ethernet card connects to a switch and communicates with other Ethernet interface devices. The sound card connects to the test host's external microphone to monitor the DMI's sound output.

[0071] like Figure 3 As shown, the three-dimensional motion platform includes a moving part and a pressing part connected to the moving part. The moving part is used to drive the pressing part to move to a specified position, and the pressing part is used to press the buttons of the DMI. The DMI of an embodiment of the present invention includes two groups of buttons arranged in different directions, and each group of buttons is arranged in a straight line in a certain direction. For example, the buttons on the lower side of the screen and the buttons on the right side. In an embodiment of the present invention, the three-dimensional motion platform is provided with multiple groups of moving parts and pressing parts, which are respectively used to press each group of buttons of the DMI. Specifically, a first group of moving parts and a first group of pressing parts corresponding to the lower side buttons are provided, and a second group of moving parts and a second group of pressing parts corresponding to the right side buttons are provided.

[0072] Exemplarily, the moving part includes a slide rail, and the pressing part includes a screw rod. The slide rail is distributed according to the button positions of the DMI, and can drive the screw rod to slide along the slide rail. An independent button test structure is set on the lower side of the DMI, including: a screw rod, a slide rail, and two servo motors. The two servo motors respectively realize the horizontal movement of the screw rod along the slide rail and the screw rod pressing the button. The screw rod is used for pressing up and down, and the slide rail is used to drive the screw rod to move horizontally and fix the structure. Similarly, another independent button test structure is set on the right side of the DMI, including: a screw rod, a slide rail, and two servo motors. The two servo motors respectively realize the vertical movement of the screw rod along the slide rail and the screw rod pressing. The screw rod is used for pressing up and down, and the slide rail is used to drive the screw rod to move up and down and fix the structure.

[0073] The use of this three-dimensional motion platform can simulate the point-pressing speed during manual operation to the greatest extent, solving the problems of long reset time, long movement distance, and single point-pressing speed unable to achieve a pressing interval of less than 1s after pressing a button using a traditional robotic arm structure. Not only that, the three-dimensional motion platform will not block the screen during the pressing process, facilitating continuous image capture for image recognition. Moreover, during the key jitter test, the servo motor controls the lead screw to achieve a continuous clicking action of less than 100ms, verifying the key anti-shake function.

[0074] The switch is used to expand the Ethernet interface of the test host, connect to the three-dimensional motion platform to realize the pressing control of the DMI button, connect to the DMI Ethernet interface to realize data transmission and reception testing, and connect to the camera to capture the DMI screen image.

[0075] An embodiment of the present invention further provides a method for testing a human-machine interface. Without loss of generality, the testing method can be implemented by the testing device in the above embodiment.

[0076] For example, the test method steps include: software environment preparation, RS422 communication test, MVB communication test, CAN communication test, Ethernet communication test, button and display test, USB copy test, and speaker sound test. The specific method is as follows:

[0077] Software environment preparation

[0078] Enter the Linux environment on the test host and configure the Linux network to connect to the DMI. Then, use SecureCRT, a remote control software, to execute commands in SecureCRT to remotely launch the DMI test program. The test software and the DMI test program on the test host then run independently. The test host and DMI interact through the communication interface to perform functional testing of the DMI peripheral.

[0079] Step 1: On the test host, launch VMware Workstation, load the Ubuntu12.vmx virtual machine, select Network Adapter in Virtual Machine Settings, select Bridged Mode, and click Start This Virtual Machine. In this embodiment, the test host's primary operating system is Windows. Therefore, VMware Workstation allows you to run a Linux virtual machine on Windows. For example, an Ubuntu 12 Linux virtual environment is used to run the remote control software. In other embodiments, other Linux virtual machines may also be used.

[0080] Step 2: After entering the Linux operating system, enter the password honor and press the Ctrl+Alt+t key combination to bring up the command prompt. Enter "ifconfig" in the command prompt to view the IP address of the eth0 network card and configure the network address of eth0. Specifically, enter "sudo ifconfig eth0 192.168.1.65 netmask 255.255.255.0" and press Enter. The password is honor. Enter "ifconfig" again to view the IP address of the eth0 network card, which should be "192.168.1.65."

[0081] Step 3: Start the SecureCRT software. For example, start the "SecureCRT7.3" software, create a new serial connection, select "UTF-8" for "Character encoding", "New Songti 14pt" for "Normal font", "Linux" for "Terminal", and the device number of the RS422 serial port card identified by the test host, such as "COM4" for "Serial Port". Select "115200" for "Baud rate".

[0082] Step 4: After the DMI is powered on, observe the "SecureCRT7.3" software print window. When the output log appears, click the "Enter" button. When the input prompt appears, enter:

[0083] "setenv netargs setenv bootargs console=${console}${optargs}root= / dev / nfs

[0084] nfsroot=${serverip}: / home / honor / ti-sdk-am335x-evm-06.00.00.00 / targetNFS,${nfsopts}rwip=${ipaddr}:${serverip}:${gatewayip}:${netmask}:${hostname}:eth0:off” (The test host connects to DMI in NFS mode) and press Enter. Then enter "run netboot" and press Enter to start DMI. After DMI connects to the test host normally, enter the password "root" to enter the DMI operating system.

[0085] Step 4: Modify the DMI environment variable, enter "vi / etc / profile" - open and edit the profile configuration file, and add

[0086] export QTDIR= / home / root root / / Set the directory for test execution

[0087] export LD_LIBRARY_PATH=$QTDIR / lib:$QTDIR / plugins / imageformats:$LD_LIBRARY_PATH / / Set the dynamic link library path

[0088] export QT_PLUGIN_PATH=$QTDIR / plugins / / Set the plug-in path

[0089] export QT_QWS_FONTDIR= / usr / lib / fonts / / Set font library

[0090] export QWS_MOUSE_PROTO= / dev / input / mice" / / Set mouse input

[0091] Save and exit.

[0092] Step 5: Switch to the test project directory and start the test program. Enter "cd" and press Enter, then enter "cd QT / DMI / test" and enter ". / test-qws-nomouse" to start the test program.

[0093] After the above five steps, DMI starts running the test program and waits for the test response. It then starts the test host test software and performs automatic testing.

[0094] Because this configuration process uses RS422 communication, you can confirm that the RS422 communication test item has passed after the software environment is successfully configured.

[0095] Communication interface test

[0096] The test host continuously sends data packets with increasing values to the DMI through the communication board;

[0097] The DMI test program forwards the received data packets back to the test host through the corresponding communication board;

[0098] If the test host receives a specified number of consecutive data packets through the test software and the data packet return time is less than the specified time, it is determined that the communication interface test corresponding to the communication board has passed.

[0099] Specifically, the communication interface test includes: Ethernet communication test, MVB communication test, CAN communication test, and may also include RS422 communication test. However, since RS422 communication is used to start the DMI test program in the embodiment of the present invention, a separate RS422 communication test may not be performed.

[0100] Ethernet communication test

[0101] The test host continuously sends data packets with increasing values through the Ethernet interface. After receiving the data packets, the DMI forwards them back to the test host. The test host passes the test if the test software receives 100 consecutive data packets, and the data return time is less than 2.5 times the communication period. Specifically, the data packet contains N (N>1) bytes, such as 16 bytes. During the test, the value of each byte in each data packet sent is increased by 1 compared to the previous data packet.

[0102] MVB communication test

[0103] The test host continuously sends 32-byte incremental data packets to the DMI through the MVB communication board. The test host receives 100 consecutive packets of data through the test software, and the data return time is less than 2.5 times the communication cycle to determine that the test has passed. For example,

[0104] The sending port address of the MVB communication board is: pd_source_address = 0x38B

[0105] The receiving port address of the MVB communication board is: pd_sink_address = 0x398

[0106] Port send and receive data packet size (bytes) port_size: 32

[0107] Communication cycle (milliseconds) port_cycleTime: 64

[0108] CAN communication test

[0109] The test host continuously sends incremental data in extended frame format to the DMI through the CAN communication board. The test software of the test host receives 100 frames of continuous data and the data return time is less than 2.5 times the communication cycle, which determines that the test has passed.

[0110] The CAN extended frame consists of a 28-bit CAN ID and 8 bytes of data. The following table shows the CAN ID values for the test host and DMI. The test host sends data as A0E00100 (left-aligned) plus 8 bytes of data (each frame increases by 1 compared to the previous frame), and the DMI sends data as E0A00100 (left-aligned) plus 8 bytes of data (each frame increases by 1 compared to the previous frame). The CAN address, or CAN ID node, consists of 28 bits: 8 bits for the target identifier, 8 bits for the source, 8 bits for the type, and 5 bits for the parameters. The remaining 3 bits are padded with 0s at the beginning or end.

[0111]

[0112] CAN communication baud rate: 1Mbps

[0113] Button test

[0114] Key testing includes: key and display testing, key jitter testing, and combination pressing testing.

[0115] Key and Display Test: The test host sends key coordinates to the 3D motion platform via an Ethernet interface. Upon receiving these coordinates, the 3D motion platform uses servo motors to move the moving components and press the target key within 2-3 seconds. Simultaneously, the test host continuously captures the DMI screen image via Ethernet. Pressing the eight buttons on the right side and the 11 buttons on the bottom side of the DMI sequentially displays the corresponding characters. The DMI test program controls the screen background color to alternate in a 1-second cycle to identify bad pixels. For example, the screen background color alternates between red and blue. The test host determines whether the key passes the test by verifying the consistency between the sent press command and the displayed characters. If all keys are functioning correctly, the screen display is considered normal and the test passes. Screen images are continuously captured during the key press process to confirm that there are no black or flickering screens during the transitions. Specifically, a character is displayed at a designated location on the screen, such as the center. This character changes with each key press, and the screen background color alternates periodically. A bad pixel test is performed simultaneously with the key test. A bad pixel is a malfunctioning display point on the screen, which can cause pixel switching to fail during image switching.

[0116] Key jitter test: Control the 3D motion platform to repeatedly click a designated key at a certain frequency. Verify that the screen does not switch to pass the jitter test. For example, repeatedly click the same key 10 times at a speed of <100ms to verify that the screen does not switch. This test is repeated for the 8 keys on the right side and 11 keys on the bottom side of the DMI.

[0117] Combination press test: Control the 3D motion platform motor to press two buttons in sequence. Confirm that when any button is pressed, the screen does not change after the other buttons are pressed. Test any two button combinations in sequence, for a total of 88 combinations.

[0118] Image Test

[0119] The test host sends a data packet of the image deviation frame test to the DMI through the MVB. After receiving the data packet, the DMI modifies the current image in the video memory and adjusts the deviation between the image pixels and the original value to be greater than the specified threshold, such as 5%. The camera image recognition is used to determine whether the screen displays a black screen. If so, the test passes.

[0120] like Figure 4 As shown, the image testing process is as follows:

[0121] Step 1: DMI obtains and processes MVB bus data. When the type of the MVB bus data is a deviation frame test, the DMI obtains the test picture ID specified in the MVB bus data.

[0122] Specifically, the DMI obtains MVB bus data from the test device through the MVB hardware interface. The DMI consists of both software and hardware. The hardware includes the MCU (Microcontroller Unit), hard drive, and video memory. The software includes the application and underlying drivers. The application, or test program, includes communication control, key control, and display control. The test program on the DMI runs through the MCU to obtain and analyze MVB bus data.

[0123] The test device sends MVB bus data to the DMI in the form of data packets. The test program processes the MVB data. If the test type field in the data packet indicates a deviation frame test, the test program retrieves the test picture ID value at a specified position in the data packet. Specifically, the test type field occupies one byte at a specified position, and the test picture ID value occupies four bytes at a specified position.

[0124] The test image ID value is the image ID value stored on the DMI hard drive. As a security device, the DMI displays and updates its screen by calling images pre-stored on the hard drive. The DMI hard drive stores hundreds or thousands of images for on-screen display, including speed curve images.

[0125] Step 2: The DMI test program retrieves the test image corresponding to the test image ID value from the hard disk.

[0126] Step 3: Modify the pixel values in the test image that are larger than a specified ratio, such as larger than 5%, and write the modified image into the video memory.

[0127] The DMI underlying driver executes the image detection steps in the video memory every cycle, namely steps 4 and 5:

[0128] Step 4: Get the image with the corresponding ID value from the hard disk every cycle. The DMI low-level driver can obtain the ID value of the image currently in the video memory from the upper-level application through the software interface.

[0129] Step 5: Get the current image in the video memory every cycle and compare it with the image data obtained from the hard disk in step 4. When the deviation is greater than 5%, a black screen is output.

[0130] In the embodiment of the present invention, after sending the MVB bus data for the deviation frame test, the test device determines whether the screen displays a black screen through camera image recognition. If so, the test passes.

[0131] The image testing process of the embodiment of the present invention tests the monitoring function of the DMI itself on the screen display function through the deviation frame test, thereby avoiding the failure to timely feedback a black screen when a DMI display fails, thereby improving the display security of the DMI.

[0132] Speaker sound test

[0133] When the DMI test program is running, it continuously emits a 440Hz single-frequency sound signal. The test host continuously monitors the DMI working output sound through the microphone connected to the sound card. When it is confirmed that the sound is continuously output for 1 minute and the sound frequency range is 440Hz±20Hz, the test is confirmed to have passed.

[0134] Sound sampling rate: 22050S / s, S stands for Sample (sample), such as byte or bit. That is, the sound sampling frequency is per second

[0135] USB copy test

[0136] Insert a USB flash drive containing a first file with a first name and first content into the DMI's USB port. The DMI test program reads the contents of the first file based on the first name. After determining that the read content is the first file's content, the DMI test program creates a second file on the USB flash drive and stores the second content in the second file with the second name. After the read and write test, the USB flash drive is removed and verified to contain the second file name and content. If so, the USB copy test passes. The first and second file names are different. The first and second contents are different.

[0137] Before starting the test, insert a USB flash drive containing a test file named "test" (the string "1234567890") into the DMI's USB port. The DMI test program will read the test file from the flash drive. Once the file's contents are "1234567890," it will create a new file called "check" with the contents "ABCDEFGH." After the test is complete, manually remove the flash drive from the USB port and use the test host to check the "check" file. Open it with Notepad and confirm that the file contains the string "ABCDEFGH." This confirms that the DMI test item has passed.

[0138] Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for testing a human-machine interface, characterized in that: include: Use the test host to test the human-machine interface (DMI) for external equipment, including key testing and display testing; Get the DMI screen display image; The test host determines whether the key functions and display functions of the DMI are normal based on the images displayed on the screen; The human-machine interface testing method further includes image testing: The test host sends the data packet of the deviation frame test to DMI; DMI obtains the specified test image from the DMI hard disk according to the received data packet; Modify the specified test image so that the pixel deviation between the modified image and the test image is greater than a specified threshold; The modified image is stored in the video memory. The underlying driver of the DMI performs image detection in the video memory every cycle, performs the monitoring function of the DMI itself on the screen display function, obtains the current image in the video memory, and compares it with the specified test image obtained from the hard disk. When the deviation is greater than the specified threshold, a black screen is output. Get the DMI screen display image; Determine whether the DMI screen is black based on the screen display image. If so, the DMI image display function is normal.

2. The method for testing a human-machine interface according to claim 1, wherein: The button test includes: The test host tests the DMI buttons through a three-dimensional motion platform.

3. The method for testing a human-machine interface according to claim 2, wherein: The three-dimensional motion platform is provided with multiple groups of moving parts and pressing parts corresponding to the multiple groups of buttons of the DMI, which are respectively used to press each group of buttons of the DMI for testing; the moving parts are used to drive the pressing parts to move to the specified position, and the pressing parts are used to press the buttons of the DMI; The test host tests the DMI buttons through a three-dimensional motion platform, including: The test host controls the moving component to move to a specified position and controls the pressing component to perform a pressing test on the DMI button.

4. The method for testing a human-machine interface according to claim 3, wherein: Testing the lower side buttons of the DMI by using the first set of moving components and the first set of pressing components corresponding to the lower side buttons of the DMI; and / or The right button of the DMI is tested by the second group of moving components and the second group of pressing components corresponding to the right button of the DMI.

5. The method for testing a human-machine interface according to claim 3, wherein: Test the buttons on the bottom of the DMI by setting up an independent button test structure on the bottom of the DMI, including: a screw, a slide rail and two servo motors; the two servo motors respectively control the horizontal movement of the slide rail and the screw to press the button; and / or The buttons on the right side of the DMI are tested by setting up an independent button test structure on the right side of the DMI, including: a screw rod, a slide rail and two servo motors; the two servo motors respectively control the vertical movement of the slide rail and the screw rod to press the button.

6. The method for testing a human-machine interface according to claim 2, wherein: include: Perform jitter testing on DMI buttons using a three-dimensional motion platform: Control the 3D motion platform to continuously click the same button at a frequency of less than 100ms; The acquired screen display image is used to determine whether the DMI screen image is switched. If not, the test for the button passes.

7. The method for testing a human-machine interface according to claim 3, wherein: include: Perform a combination test on the DMI buttons using a three-dimensional motion platform: Control the 3D motion platform motor by pressing two buttons in sequence. Confirm that if any one button is pressed and the screen does not change after the other buttons are pressed, the button combination test passes.

8. The method for testing a human-machine interface according to any one of claims 1 to 7, characterized in that: When the key test is performed, the background color of the DMI screen is controlled to change alternately, thereby performing a bad pixel test on the screen.

9. The method for testing a human-machine interface according to any one of claims 1 to 7, characterized in that: The test host starts the DMI test program through the remote control software; Afterwards, the test host communicates with the DMI through the communication interface, and the DMI test program and the test software of the test host implement the test of the DMI.

10. The method for testing a human-machine interface according to any one of claims 1 to 7, characterized in that: Also includes communication interface testing: The test host continuously sends data packets with increasing values to the DMI through the communication board; The DMI test program forwards the received data packets back to the test host through the corresponding communication module; If the test host receives a specified number of consecutive data packets through the test software and the data packet return time is less than the specified time, it is determined that the communication interface test corresponding to the communication board has passed.

11. A testing device for a human-machine interface, characterized in that: include: Test host, 3D motion platform and camera, The test host is used to perform external device tests on the human-machine interface (DMI), including key testing and display testing; The camera is used to obtain the screen display image of the DMI; The test host is also used to determine whether the key functions and display functions of the DMI are normal based on the screen display image; The human-machine interface test device is also used for image testing: The test host sends the data packet of the deviation frame test to DMI; DMI obtains the specified test image from the DMI hard disk according to the received data packet; Modify the specified test image so that the pixel deviation between the modified image and the test image is greater than a specified threshold; The modified image is stored in the video memory. The underlying driver of the DMI performs image detection in each cycle, performs the monitoring function of the DMI itself on the screen display function, obtains the current image in the video memory, and compares it with the specified test image obtained from the hard disk. When the deviation is greater than the specified threshold, a black screen is output. Get the DMI screen display image; Determine whether the DMI screen is black based on the screen display image. If so, the DMI image display function is normal.

12. The human-machine interface testing device according to claim 11, characterized in that: The three-dimensional motion platform includes multiple groups of moving parts and pressing parts corresponding to the multiple groups of buttons of the DMI, which are respectively used to press each group of buttons of the DMI for testing; The moving component is used to drive the pressing component to move to a specified position, and the pressing component is used to press the button of the DMI.

13. The human-machine interface testing device according to claim 12, characterized in that: The 3D motion platform includes: A first set of moving parts and a first set of pressing parts corresponding to the lower side buttons of the DMI, used to test the lower side buttons; and / or The second group of moving parts and the second group of pressing parts corresponding to the right side buttons of the DMI are used to test the right side buttons.

14. The human-machine interface testing device according to claim 12, characterized in that: The 3D motion platform includes: An independent key test structure is provided on the bottom side of the DMI, which is used to test the keys on the bottom side of the DMI, including: a screw, a slide rail and two servo motors; the two servo motors respectively control the horizontal movement of the slide rail and the key pressing of the screw; and / or An independent button test structure is set up on the right side of the DMI to test the buttons on the right side of the DMI, including: a screw rod, a slide rail and two servo motors; the two servo motors respectively control the vertical movement of the slide rail and the screw rod to press the button.

15. The human-machine interface testing device according to any one of claims 11 to 14, characterized in that: The test host also includes a CPU board, sound card, network card, MVB communication board, CAN communication board, RS422 communication board and test software. The test host can call each hardware driver API interface through the test software to implement the test logic.

Citation Information

Patent Citations

  • Vehicle-mounted display automatic test device and test method

    CN113702726A