Hardware-in-the-loop-based driver state monitoring simulation test system

By building a hardware-in-ring HIL test bench and video injection module in the driver's status monitoring system, the inaccurate identification problem caused by differences in different vehicle models and camera positions is solved, and more accurate driver's status monitoring and testing efficiency is achieved. Improve the reliability of alternative real-life vehicle testing.

CN118915694APending Publication Date: 2024-11-08ANHUI JIANGHUAI AUTOMOBILE GRP CORP LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410992021.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-23
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The existing simulation test solution for driver status monitoring systems lacks the difference in position of different vehicles and cameras, resulting in inaccurate identification and the testing process is cumbersome and time-consuming, making it difficult to reliably replace actual vehicle testing.

Method used

Using a hardware-in-ring driver status monitoring simulation test system, the DMS controller HIL test bench is built, combining the real driver and cockpit layout to ensure that the camera installation position is consistent with the actual vehicle, and video injection is added to the test bench The module directly exports and analyzes video signals and synchronizes the interactive logic.

Benefits of technology

It realizes more accurate driver status monitoring, reduces test calibration items, improves problem rectification efficiency, reduces test costs, and ensures the reliability and consistency of test results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118915694A_ABST
    Figure CN118915694A_ABST
Patent Text Reader

Abstract

The invention discloses a driver state monitoring simulation test system based on hardware-in-the-loop, which is characterized in that an HIL test bench is built, and the layout of a real driver and a real cabin is combined in the test bench to ensure that the installation position of a DMS device is consistent with that of a real vehicle, so that the test result is closer to that of the real vehicle test, and the test efficiency is improved. All target sites possibly causing driver analysis are reproduced on the rack, so that it is ensured that the monitored driver action video is more accurate; in addition, a video injection module is additionally arranged in the test bench, and a problem video during testing is exported at any time and injected into the vehicle machine for verification and analysis. According to the method, a DMS real vehicle test can be reliably replaced, test calibration items can be effectively reduced in the test process, the traceability of the driver state problem can be established, the problem rectification efficiency is improved, and the test cost is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the field of driver monitoring systems, and in particular to a driver state monitoring simulation test system based on hardware in the loop. Background Art

[0002] Driver Monitoring System (DMS) is a key component of modern automotive safety technology, designed to improve road safety by monitoring the driver's behavior and status in real time. The system can detect driver fatigue, distraction or other behaviors that may affect driving safety, and issue warnings or take other measures to prevent potential accidents.

[0003] With the development of automotive electronic technology, driver status monitoring systems are becoming more and more popular. At the same time, the testing requirements for driver status monitoring systems are becoming higher and higher. In addition to real vehicle testing, the industry is also exploring alternatives to real vehicle testing for DMS functional testing, as described in the following technical routes:

[0004] The video darkbox is used to simulate and output a virtual scene of the driver's status during the actual vehicle driving process. The driver monitoring system camera in the darkbox is used to obtain the virtual scene image in real time, monitor the driving status and driver status of the vehicle in the virtual scene according to the acquired image, and feed back the monitoring result to the upper computer. The test management system is used to compare the detection result with the real state of the simulated scene, calculate the missed detection rate, false alarm rate and system response time of the driver monitoring system in monitoring the driving status and driver status; through practice and analysis, it is found that different models will have significantly different positions and angles of DMS camera layout according to different cockpit layout requirements. Common installation positions include A-pillars, steering wheels, etc., and the facial features recognized by DMS cameras in different positions are different. If a technical solution similar to the prior art is used to simply use a video darkbox to identify the virtual driver status, false alarms are likely to occur.

[0005] The above analysis shows that one of the main problems of existing DMS simulation test schemes is that they are all based on virtual scenes and virtual drivers to identify the driver's status. They lack consideration of the differences in driver feature points captured by DMS cameras of different models and locations, and only rely on the accuracy of DMS single recognition in the virtual position. This makes it impossible to reliably cover the configuration requirements of different models. Therefore, the above alternative ideas are difficult to implement reliably.

[0006] Furthermore, there is another problem with the current DMS system testing: inaccurate recognition is inevitable during the DMS testing process, so the videos corresponding to the inaccurately identified points need to be analyzed and rectified. However, due to storage space limitations, the commonly used methods in the industry require that each actual vehicle test process require each test item to export a test video that requires subsequent analysis and rectification. This operation mode is very cumbersome, time-consuming and labor-intensive. Summary of the invention

[0007] In view of the above, the present invention aims to provide a driver status monitoring simulation test system based on hardware-in-the-loop to solve the above-mentioned technical problems.

[0008] The technical solution adopted by the present invention is as follows:

[0009] The present invention provides a driver state monitoring simulation test system based on hardware in the loop, comprising: a host computer, a hardware in the loop simulation cabinet, and a test bench;

[0010] The host computer is used to drive the I / O board of the hardware-in-the-loop simulation cabinet to work after importing the model of the test bench into the real-time machine of the hardware-in-the-loop simulation cabinet; the real-time machine processes the data and then feeds it back to the host computer;

[0011] The host computer is also used to configure the signal input and acquisition channels of the I / O board, the signal input and acquisition channels of the CAN bus simulation and acquisition board of the hardware-in-the-loop simulation cabinet, and set the types and parameters of the input signals and the acquisition signals;

[0012] The test bench is connected to the I / O board channel and the CAN bus simulation and acquisition board channel respectively;

[0013] A camera for monitoring the driver's status and a plurality of preset automobile parts positions are installed on the test bench in equal proportion according to the model of the current test vehicle model; and a plurality of marking plates are also arranged on the test bench corresponding to the plurality of preset points that cause the driver's distraction;

[0014] The host computer displays the simulated road scene on the display screen of the test bench through a video line, and the camera in the test bench collects the state of the driver when operating on the bench;

[0015] The test bench also includes a video injection module, which is used to convert the corresponding video signal into a data format and directly inject it into the MP5 preset test algorithm in the test bench for analysis and processing when a video of an abnormal driver state is collected.

[0016] In at least one possible implementation manner, a label for indicating a predetermined order is provided on the marking plate.

[0017] In at least one possible implementation manner, the method of constructing the model of the test bench includes: a host computer establishes a model for processing signals of the test bench through Simulink.

[0018] In at least one possible implementation, the host computer compiles the model and imports it into the real-time machine in the hardware-in-the-loop simulation cabinet via Ethernet.

[0019] In at least one possible implementation manner, the host computer is also used to simulate the battery output voltage as the power signal input.

[0020] In at least one possible implementation, the I / O board channel and the CAN bus simulation and acquisition board channel in the hardware-in-the-loop simulation cabinet are connected to the test bench via a power line and a CAN line, respectively.

[0021] Compared with the prior art, the main design concept of the present invention is to build a DMS controller HIL test bench, and combine the layout of the real driver and the real cockpit in the DMS test bench to ensure that the installation position of the DMS device is consistent with the real vehicle, so that the test results are closer to the real vehicle test, and all the target locations that may cause the driver to analyze are reproduced on the bench, thereby ensuring that the driver's action video monitored by the DMS camera during the test is more accurate; in addition, a DMS video injection module is added to the test bench, and the driver's distraction problem video of the above target location can be directly exported from the DMS camera and injected into the vehicle computer for multiple rounds of verification and analysis at any time during the test, and the interaction logic between the DMS device, vehicle computer, instrument and other components can also be synchronously detected. The present invention can reliably replace the DMS real vehicle test (it can also be used for the verification and calibration of the real vehicle DMS test), and can not only effectively reduce the test calibration items during the test process, but also establish the traceability of the driver's status problems, and improve the efficiency of problem rectification and reduce the test cost.

[0022] To elaborate, the relevant components can be installed at the corresponding positions on the test bench based on the positional relationship between the vehicle digital model points and the DMS camera, instrument panel, steering wheel, MP5, passenger seat, glove box, rearview mirror and other components in the cab. This ensures that the positional relationship of the DMS camera on the test bench relative to the driver and the components in the cab is consistent with the digital model, thereby completely restoring the position of the real vehicle cab and the real vehicle DMS camera, and having a real driver perform real driving operations in the test bench simulated road scene. This ensures the consistency between the DMS system bench test and the real vehicle DMS system test, and ensures the accuracy of the DMS camera's capture of the driver's status, thereby reliably replacing the real vehicle test.

[0023] A video injection module is added to the test bench of the present invention, and the video recorded in real time by the DMS is transmitted to the MP5 controller algorithm through a video line to analyze the driver's status. At the same time, it is also transmitted to the video injection module to be converted into video data for separate storage, and the entire test process video can be stored at one time; since the present invention is not conceived to directly inject the video into the DMS system, it can also avoid to a certain extent the situation where the driver's status is incorrectly recognized due to factors such as blur, distortion, and noise of the simulated camera lens. Even if the DMS recognition is inaccurate, the video data in the video injection module can be injected into the MP5 controller algorithm to quickly find the cause of the problem, so that the rectification can be completed with convenient and fast operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described below with reference to the accompanying drawings, in which:

[0025] Figure 1 A schematic diagram of a driver status monitoring simulation test system based on hardware-in-the-loop provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0026] Embodiments of the present invention are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be interpreted as limiting the present invention.

[0027] The present invention proposes an embodiment of a driver state monitoring simulation test system based on hardware in the loop. Specifically, Figure 1 As shown, it includes: a host computer, a hardware-in-the-loop (HIL) simulation cabinet (DSPACE test cabinet), and a DMS test bench.

[0028] The host computer is configured with a simulation model, which can be provided by the supplier of the equipment used. Specifically, the host computer establishes a model for processing the DMS test bench signal through simulink, and imports it into the real-time machine in the hardware-in-the-loop simulation cabinet through Ethernet. After the simulink model is compiled and imported into the real-time machine in the hardware-in-the-loop simulation cabinet, the host computer can be used to send instructions to drive the I / O board in the hardware-in-the-loop simulation cabinet to work, and the real-time machine processes the data and then feeds it back to the host computer.

[0029] At the same time, the actual pin definition can be performed according to the DMS test bench, and the host computer configures the signal input and acquisition channels of the I / O board, the signal input and acquisition channels of the CAN bus simulation and acquisition board, and sets the types and parameters of the input signal and the acquisition signal through the hardware-in-the-loop simulation cabinet application software. It can be supplemented that the host computer in this system is also used to simulate the vehicle battery output 12V voltage as the power signal input.

[0030] The I / O board channels and CAN board channels in the hardware-in-the-loop simulation cabinet can be connected to the DMS test bench through power cables and CAN cables (the power cables are connected to the DSPACE cabinet I / O boards, and the CAN cables are connected to the DSPACE cabinet CAN boards). The analog signals are input by setting the signal input channels, and the acquisition channels obtain the return signals.

[0031] The scene simulation software in the host computer plays the simulated road scene on the display screen of the DMS test bench through the video line, and the driver can perform driving operations according to the virtual road scene, and the DMS camera in the DMS test bench collects the driver's status. Furthermore, the DMS test bench also includes a video injection module (such as a video injection dark box). If a video with an unqualified state is collected, the video signal can be converted into a video data format through a video injection method (with the help of a video line), and directly injected into the preset algorithm of the MP5 for analysis to find a solution to the problem.

[0032] The DMS camera and preset automobile parts positions involved in the DMS test bench (which may mainly include ICM controller and instrument display screen, MP5, steering wheel, seat, etc.) are installed on the DMS test bench in a one-to-one ratio according to the digital-analog three-coordinate parameters of the current test vehicle model combined with the R point position (installation); in addition, the remaining multiple distraction-inducing points required by regulations and standards are achieved by setting multiple marking plates in sequence (labels representing the sequence can be affixed) at corresponding positions on the DMS test bench.

[0033] In summary, the main design concept of the present invention is to build a DMS controller HIL test bench, and combine the layout of the real driver and the real cockpit in the DMS test bench to ensure that the installation position of the DMS device is consistent with the real vehicle, so that the test results are closer to the real vehicle test, and all the target locations that may cause the driver to analyze are reproduced on the bench, thereby ensuring that the driver's action video monitored by the DMS camera during the test is more accurate; in addition, a DMS video injection module is added to the test bench, and the driver's distraction problem video of the above target location can be directly exported from the DMS camera and injected into the vehicle computer for multiple rounds of verification and analysis during the test, and the interaction logic between the DMS device, vehicle computer, instrument and other components can also be synchronously detected. The present invention can reliably replace the DMS real vehicle test (it can also be used for verification and calibration of the real vehicle DMS test), and can not only effectively reduce the test calibration items during the test process, but also establish the traceability of the driver's status problems, and improve the efficiency of problem rectification and reduce the testing cost.

[0034] If the expressions expressing orientation are mentioned in the embodiments of the present invention, they are relative concepts based on the embodiments. In addition, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, a and b, a and c, b and c, or a and b and c, wherein a, b, c can be single or multiple.

[0035] The above describes in detail the structure, features and effects of the present invention based on the embodiments shown in the drawings, but the above is only a preferred embodiment of the present invention. It should be noted that the technical features involved in the above embodiments and their preferred methods can be reasonably combined and matched into a variety of equivalent schemes by those skilled in the art without departing from or changing the design ideas and technical effects of the present invention; therefore, the present invention is not limited to the scope of implementation shown in the drawings, and all changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments with equivalent changes, which still do not exceed the spirit covered by the specification and drawings, should be within the protection scope of the present invention.

Claims

1. A driver status monitoring simulation test system based on hardware in the loop, characterized in that: include: Host computer, hardware-in-the-loop simulation cabinet, test bench; The host computer is used to drive the I / O board of the hardware-in-the-loop simulation cabinet to work after importing the model of the test bench into the real-time machine of the hardware-in-the-loop simulation cabinet; The real-time machine processes the data and then feeds it back to the host computer; The host computer is also used to configure the signal input and acquisition channels of the I / O board, the signal input and acquisition channels of the CAN bus simulation and acquisition board of the hardware-in-the-loop simulation cabinet, and set the types and parameters of the input signals and the acquisition signals; The test bench is connected to the I / O board channel and the CAN bus simulation and acquisition board channel respectively; A camera for monitoring the driver's status and a plurality of preset automobile parts positions are installed on the test bench in equal proportion according to the model of the current test vehicle model; and a plurality of marking plates are also arranged on the test bench corresponding to the plurality of preset points that cause the driver's distraction; The host computer displays the simulated road scene on the display screen of the test bench through a video line, and the camera in the test bench collects the state of the driver when operating on the bench; The test bench also includes a video injection module, which is used to convert the corresponding video signal into a data format and directly inject it into the MP5 preset test algorithm in the test bench for analysis and processing when a video of an abnormal driver state is collected.

2. The driver status monitoring simulation test system based on hardware in the loop according to claim 1 is characterized in that: The marking plate is provided with labels for indicating a predetermined sequence.

3. The driver status monitoring simulation test system based on hardware in the loop according to claim 1 is characterized in that: The method of constructing the model of the test bench includes: a host computer establishes a model for processing signals of the test bench through simulink.

4. The driver status monitoring simulation test system based on hardware in the loop according to claim 1 is characterized in that: The host computer compiles the model and imports it into the real-time machine in the hardware-in-the-loop simulation cabinet via Ethernet.

5. The driver status monitoring simulation test system based on hardware in the loop according to claim 1 is characterized in that: The host computer is also used to simulate the battery output voltage as a power signal input.

6. The driver status monitoring simulation test system based on hardware in the loop according to any one of claims 1 to 5, characterized in that: The I / O board channel and the CAN bus simulation and acquisition board channel in the hardware-in-the-loop simulation cabinet are connected to the test bench through power lines and CAN lines respectively.