A real vehicle driving simulation system for HMI testing

By combining visual simulation, steering force feedback, pedal signal acquisition, scene simulation and physiological data acquisition systems, the problem that HMI tests in the prior art cannot accurately reproduce the road conditions in the environment of mass-produced vehicle models, and accurate testing of HMI performance is achieved.

CN119200428BActive Publication Date: 2025-08-05IAE SUZHOU TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411239760.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-05
Publication Date
2025-08-05
Estimated Expiration
2044-09-05

AI Technical Summary

Technical Problem

The existing driving simulation system cannot fully reproduce the road driving conditions in the environment of mass-produced models, resulting in inaccurate HMI human-machine interface performance testing.

Method used

The visual simulation system, steering force feedback simulation system, real vehicle pedal signal acquisition system, scene simulation system, physiological data acquisition system and data synchronization system are used to conduct HMI tests in combination with actual vehicles. The road driving conditions are reproduced through the visual simulation and scene simulation system, and the actual data is feedbacked by the steering force feedback and pedal signal acquisition system. The physiological data acquisition system obtains the driver's status, and the data synchronization system relates to the actual behavior and the simulation environment.

Benefits of technology

It realizes the real reproduction of road driving conditions in the environment of mass-produced models, can accurately identify and test the performance of the HMI human-machine interface, and provides effective data conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119200428B_ABST
    Figure CN119200428B_ABST
Patent Text Reader

Abstract

The present invention relates to the technical field of simulated driving, and specifically to a real-vehicle driving simulation system for HMI testing, comprising a visual simulation system, a steering force feedback simulation system, a real-vehicle pedal signal acquisition system, a scene simulation system, a physiological data acquisition system, and a data synchronization system. The real-vehicle driving simulation system for HMI testing proposed by the present invention can more realistically reproduce road driving conditions due to the provision of the visual simulation system and the scene simulation system. Furthermore, the steering force feedback simulation system and the real-vehicle pedal signal acquisition system can feedback test data of the actual vehicle being tested. The physiological data acquisition system and the data synchronization system can be used to associate the driver's actual behavior and actions with specific environments and events in the simulation environment, providing effective data conditions for HMI testing, thereby effectively identifying and testing the performance of the HMI human-machine interface.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of simulated driving, and in particular to a real vehicle driving simulation system for HMI testing. Background Art

[0002] Driving simulation systems are used in the development and testing of intelligent driving and human-machine interfaces (HMIs). They address the need to study and evaluate HMI human-machine interaction characteristics in the early stages of R&D and design. They can test and evaluate usability, comfort, and system-level performance, including driver sensory input, driver operation, and driver fatigue and mental state detection. However, traditional test environments are often based on prototype driving simulation cockpits rather than on actual production vehicle environments. As a result, HMI testing cannot fully replicate road driving conditions, making it difficult to effectively identify and test the performance of the HMI human-machine interface. Summary of the Invention

[0003] The purpose of the present invention is to provide a real vehicle driving simulation system for HMI testing to solve the problems raised in the above background technology.

[0004] To achieve the above objectives, the present invention provides the following technical solutions: a real vehicle driving simulation system for HMI testing, comprising a visual simulation system, a steering force feedback simulation system, a real vehicle pedal signal acquisition system, a scene simulation system, a physiological data acquisition system, and a data synchronization system;

[0005] The visual simulation system includes a forward visual simulation system and a rearward visual simulation system, which are respectively used to present the forward and rearward visual images rendered in the simulation environment;

[0006] The steering force feedback simulation system is characterized in that the vehicle under test is fixed on the steering force feedback simulation system, and the front wheels of the vehicle under test are mechanically clamped to the steering simulation rotating table by mechanical fixation. When the front wheels of the vehicle under test rotate, the steering force feedback simulation system can collect the front wheel angle and apply the calculated steering load force to the front wheels, thereby achieving a force feedback effect;

[0007] The real vehicle pedal signal acquisition system installs pedal travel sensors on the accelerator and brake pedals of the real vehicle. The driver of the tested vehicle can operate the actual pedals. When the pedal position deviates from the initial idle travel position, the pedal travel signal collected by the sensor is sent to the vehicle model in the simulation environment, thereby controlling the acceleration and deceleration of the simulated vehicle.

[0008] The scenario simulation system uses professional intelligent driving simulation software to build the test environment for testing, including roads, weather, and surrounding buildings, and presents them on the front and rear view simulation systems through graphical rendering. After obtaining these visual inputs, the driver of the tested vehicle performs actual driving operations;

[0009] The physiological data acquisition system is installed on the actual vehicle being tested and can collect the eye movements, head movements, and physiological indicators of the driver of the vehicle being tested, providing objective evaluation indicators for HMI testing;

[0010] The data synchronization system synchronously records data from the scene simulation system and the physiological data acquisition system, associates the driver's actual behavior and actions with specific environments and events in the simulation environment, and provides effective data conditions for HMI testing.

[0011] Preferably, the forward vision simulation system uses five projectors to receive images rendered by scene simulation software, and projects multiple images onto the ring screen structure through software fusion technology. The software fusion technology can process the fusion bands between the images of the multiple projectors, on the one hand, to achieve matching of the geometric curvature of the images with the ring screen system, and on the other hand, to eliminate overlap between the images, ensuring that the projected images have no gaps and uniform brightness;

[0012] The rearview scene simulation system uses three small monitors to display the rearview mirror images rendered by scene simulation software. These monitors include two exterior mirrors and one interior mirror. The rearview mirror images include renderings of the vehicle's exterior body surfaces and interior, ensuring that the driver's view closely resembles real-world conditions.

[0013] Preferably, the steering force feedback simulation system needs to collect the front wheel turning angle of the actual vehicle under test. This part is mechanically fixed to the front wheel and the force feedback simulation system by mechanical clamping. At this time, when the front wheel turns, it will drive the steering simulation mechanism gear to rotate, and the rotation angle is collected by the force feedback simulation system. Afterwards, the collected turning angle will be sent to the vehicle dynamics model of the scene simulation software to calculate the load resistance between the virtual vehicle and the virtual environment road surface at this time, and the resistance target value will be sent to the force feedback simulation motor for applying the load force. The simulated load force is finally reflected on the steering wheel through the real vehicle steering system.

[0014] Preferably, the real vehicle pedal signal acquisition system collects pedal stroke changes caused by driver operation through sensors installed on the accelerator and brake pedals of the real vehicle. The pedal stroke information will be sent to the vehicle dynamics model of the scenario simulation software, resulting in acceleration and deceleration behavior of the virtual vehicle.

[0015] Preferably, the physiological data acquisition system detects the head movements, expressions, eye contacts, etc. of the driver through the eye tracker and head tracker devices installed on the center console of the actual vehicle to obtain the driving state of the driver. At the same time, the physiological detector can also collect information such as the driver's pulse, heartbeat, electroencephalogram, and galvanic skin response through the sensors installed on the driver's body to obtain the physiological characteristics of the driver, and then determine whether the driver has characteristics such as nervousness and anger.

[0016] Preferably, the data synchronization system sends the environment and events of the scenario simulation software and the eye movement, head movement, and physiological data of the physiological data acquisition system to the synchronization platform through the Ethernet communication protocol, so as to support the association of the actual behaviors and actions of the driver with the specific environment and events in the simulation environment, providing effective data conditions for the HMI test.

[0017] Preferably, the forward view vision simulation system includes a projection board. A central column is connected to the back of the projection board. The central column is movably connected to an installation crossbeam. A support rod is arranged on one side surface of the installation crossbeam. A spherical sleeve is arranged in the middle of the central column. The end of the support rod is of a spherical structure and is rotatably connected in the spherical sleeve. A set of connecting columns is arranged at each end of the installation crossbeam. The end of the connecting column is connected to a side column. An adjusting push rod is movably installed at each of the upper and lower ends of the side column. The end of the adjusting push rod is fixedly installed with a connecting rod. The end of the connecting rod is movably connected to the frame of the projection board. The installation crossbeam is movably installed in a fixed frame. A lifting push rod is installed at the bottom of the fixed frame. The upper end of the lifting push rod is fixed on the bottom surface of the installation crossbeam.

[0018] Preferably, the forward view vision simulation system further includes a first installation frame. The first installation frame is of a U-shaped structure. Five projection devices are arranged at one end inside the first installation frame. An installation rotating shaft is arranged at one end of the projection device. The installation rotating shaft is rotatably installed in the first installation frame. A first friction wheel is arranged on the installation rotating shaft. A first adjusting motor is arranged in the first installation frame. A motor fixing frame is arranged outside the first adjusting motor. The output end of the first adjusting motor is connected to a telescopic driving shaft. The telescopic driving shaft is of a two-section structure. The front section of the telescopic driving shaft is of a cross structure. The front section of the telescopic driving shaft is movably inserted into the rear section. A second friction wheel is fixedly installed at the end of the front section of the telescopic driving shaft. A bearing sleeve is sleeved on the second friction wheel. Two side plates are arranged on the side wall of the bearing sleeve. A set of first push rods is arranged between the side plates and the motor fixing frame.

[0019] A mounting swivel is provided at the bottom of the first mounting frame, and a group of second push rods are fixedly connected at both ends of the mounting swivel, and the top of the second push rod is fixedly connected to the bottom surface of the first mounting frame, and a mounting inner plate is rotatably provided inside the mounting swivel, and a second adjusting motor is installed in the middle of the mounting inner plate, and the output end of the second adjusting motor passes through the square hole on the bottom surface of the first mounting frame and the top is connected to a mounting bracket, and an upper fixing rod is provided at each end of the mounting bracket, and the upper end of the upper fixing rod is correspondingly inserted into the plug hole on the motor fixing frame, and a group of positioning holes are opened on the bottom surface of the first mounting frame, and the positioning holes correspond to the upper fixing rods, and a lower fixing rod is provided on each side of the second adjusting motor on the upper surface of the mounting inner plate, and the lower fixing rods and the positioning holes correspond one to one.

[0020] Preferably, the first adjusting motor is rotatably connected to the top surface of the first installation frame via a vertical shaft.

[0021] Preferably, the bottom surface of the second adjusting motor is connected to a third friction wheel, the first mounting frame is fixedly installed in the second mounting frame by several bolts, and the fourth friction wheel is rotatably installed in the second mounting frame, the fourth friction wheel and the third friction wheel correspond to each other, and both ends of the bottom shaft pass through the side walls of the second mounting frame and are rotatably connected to the second mounting frame. A first gear is provided on one end of the bottom shaft, and a third mounting frame is provided on the outside of the second mounting frame. The third mounting frame and the second mounting frame are rotatably connected through a docking shaft, and a second gear is provided on the docking shaft, and the second gear is meshed with the first gear.

[0022] Compared with the prior art, the present invention has the following beneficial effects:

[0023] The present invention proposes a real-vehicle driving simulation system for HMI testing. Due to the provision of a visual simulation system and a scene simulation system, it can more realistically reproduce road driving conditions. Furthermore, the steering force feedback simulation system and the real-vehicle pedal signal acquisition system can feed back test data of the actual vehicle under test. Through the physiological data acquisition system and the data synchronization system, the driver's actual behavior and actions can be associated with the specific environment and events in the simulation environment, providing effective data conditions for HMI testing, thereby effectively identifying and testing the performance of the HMI human-machine interface. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a schematic diagram of the principle structure of the present invention.

[0025] Figure 2 It is a structural diagram of the forward vision simulation system of the present invention.

[0026] Figure 3 This is the connection diagram of the projection plate structure of the present invention.

[0027] Figure 4 This is a second viewing angle diagram of the projection plate of the present invention.

[0028] Figure 5 This is a third viewing angle view of the projection board of the present invention.

[0029] Figure 6 This is a diagram of the connection structure of the first installation frame of the present invention.

[0030] Figure 7 for Figure 6 Another perspective of the structure.

[0031] Figure 8 This is a diagram showing the internal structure of the first installation frame of the present invention.

[0032] Figure 9 This is the structural connection diagram of the first regulating motor of the present invention.

[0033] Figure 10 for Figure 9 Enlarged view of point A in the middle.

[0034] Figure 11 This is a connection diagram of the bottom shaft end portion of the present invention.

[0035] In the figure: projection board 1, central column 2, mounting beam 3, connecting column 4, side column 5, adjusting push rod 6, connecting rod 7, fixing frame 8, lifting push rod 9, first mounting frame 10, projection device 11, mounting shaft 12, first friction wheel 13, first adjusting motor 14, motor fixing frame 15, telescopic drive shaft 16, second friction wheel 17, bearing sleeve 18, side plate 19, first push rod 20, second push rod 21, mounting swivel 22, mounting inner plate 23, second adjusting motor 24, mounting frame 25, upper fixing rod 26, lower fixing rod 27, positioning hole 28, third friction wheel 29, second mounting frame 30, bottom shaft 31, first gear 3101, fourth friction wheel 32, third mounting frame 33, docking shaft 34, second gear 3401. DETAILED DESCRIPTION

[0036] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0037] See also Figures 1 to 11 The present invention provides a technical solution: a real vehicle driving simulation system for HMI testing, including a visual simulation system, a steering force feedback simulation system, a real vehicle pedal signal acquisition system, a scene simulation system, a physiological data acquisition system, and a data synchronization system.

[0038] The visual simulation system includes a forward-view and rear-view systems, respectively used to present the forward and rear-view images rendered in the simulated environment. The forward-view system uses five projectors to receive images rendered by the scene simulation software and, through software fusion technology, projects these multiple images onto a circular screen structure. This software fusion process combines the fusion bands between the multiple projector images, matching the geometric curvature of the images with the circular screen system while eliminating overlap between images, ensuring that the projected images are seamless and uniform in brightness. The rear-view system uses three small-sized monitors to receive rearview mirror images rendered by the scene simulation software. These monitors include two exterior mirrors and one interior mirror. The rearview mirror images include renderings of the exterior body surface and interior interior, ensuring that the driver's view closely matches the real-world image.

[0039] Steering force feedback simulation system, the vehicle under test is fixed on the steering force feedback simulation system, and the front wheels of the vehicle under test are mechanically clamped to the steering simulation turntable through mechanical fixation. When the front wheels of the vehicle under test rotate, the steering force feedback simulation system can collect the front wheel angle and apply the calculated steering load force to the front wheels, thereby achieving a force feedback effect; the steering force feedback simulation system needs to collect the front wheel angle of the actual vehicle under test. This part mechanically fixes the front wheels to the force feedback simulation system through mechanical clamping. At this time, when the front wheel turns, it will drive the steering simulation mechanism gear to rotate, and the rotation angle is collected by the force feedback simulation system. Afterwards, the collected angle will be sent to the vehicle dynamics model of the scene simulation software to calculate the load resistance between the virtual vehicle and the virtual environment road surface at this time, and the resistance target value will be sent to the force feedback simulation motor for applying the load force. The simulated load force is finally reflected on the steering wheel through the real vehicle steering system.

[0040] The real vehicle pedal signal acquisition system installs pedal travel sensors on the accelerator and brake pedals of the real vehicle. The driver of the tested vehicle can operate the actual pedal. When the pedal position deviates from the initial empty travel position, the pedal travel signal collected by the sensor will be sent to the vehicle model in the simulation environment, thereby controlling the acceleration and deceleration of the simulated vehicle; the real vehicle pedal signal acquisition system collects the pedal travel changes caused by the driver's operation through sensors installed on the accelerator and brake pedals of the real vehicle. The pedal travel information will be sent to the vehicle dynamics model of the scenario simulation software, resulting in the acceleration and deceleration behavior of the virtual vehicle.

[0041] The scenario simulation system uses professional intelligent driving simulation software to build the test environment, including roads, weather, surrounding buildings, etc., and presents them on the front and rear view simulation systems through graphical rendering. After obtaining these visual inputs, the driver of the tested vehicle performs actual driving operations;

[0042] The physiological data acquisition system, installed on the actual vehicle being tested, can collect the driver's eye movements, head movements, and physiological indicators (such as blood pressure, pulse, EEG, and skin charge) to provide objective evaluation indicators for HMI testing. The physiological data acquisition system uses eye trackers and head trackers installed on the center console of the actual vehicle to detect the driver's head movements, expressions, and eye contact, and obtain the driver's driving status, whether he is driving fatigued, etc. At the same time, the physiological detector can also collect the driver's pulse, heartbeat, EEG, skin charge and other information through sensors installed on the driver's body to obtain the driver's physiological characteristics, and then determine whether the driver has characteristics such as tension and anger.

[0043] The data synchronization system synchronously records data from the scenario simulation system and the physiological data acquisition system, associates the driver's actual behavior and actions with the specific environment and events in the simulation environment, and provides effective data conditions for HMI testing. The data synchronization system sends the environment and events of the scenario simulation software and the eye movement, head movement, and physiological data of the physiological data acquisition system to the synchronization platform via the Ethernet communication protocol, thereby supporting the association of the driver's actual behavior and actions with the specific environment and events in the simulation environment, providing effective data conditions for HMI testing.

[0044] Because of the visual simulation system and scene simulation system, the road driving conditions can be reproduced more realistically. In addition, the steering force feedback simulation system and the real vehicle pedal signal acquisition system can feedback the test data of the actual vehicle under test. Through the physiological data acquisition system and data synchronization system, the driver's actual behavior and actions can be associated with the specific environment and events in the simulation environment, providing effective data conditions for HMI testing, thereby effectively identifying and testing the performance of the HMI human-machine interface.

[0045] The front view vision simulation system includes a projection board 1. A central column 2 is connected to the back surface of the projection board 1. The central column 2 is movably connected to an installation cross beam 3. A support rod is provided on one side surface of the installation cross beam 3. A spherical sleeve is provided in the middle of the central column 2. The end of the support rod is of a spherical structure and is rotatably connected in the spherical sleeve. A set of connecting columns 4 are provided at both ends of the installation cross beam 3. The end of the connecting column 4 is connected to a side column 5. An adjusting push rod 6 is movably installed at the upper and lower ends of the side column 5. The end of the adjusting push rod 6 is fixedly installed with a connecting rod 7. The end of the connecting rod 7 is movably connected to the frame of the projection board 1. The end of the connecting rod 7 is of a spherical structure. The end of the connecting rod 7 is rotatably embedded in the spherical shell of the frame of the projection board 1. By controlling the extension and retraction of the adjusting push rod 6, the state of the projection board 1 can be changed. For example, by fully extending or shortening the adjusting push rod 6, the curvature of the projection board 1 can be changed. By changing the lengths of the connecting rods 7 above and below, the elevation angle of the projection board 1 can be changed. The installation cross beam 3 is movably installed in a fixed frame 8. A lifting push rod 9 is installed at the bottom of the fixed frame 8. The upper end of the lifting push rod 9 is fixed on the bottom surface of the installation cross beam 3. Controlling the extension and retraction of the lifting push rod 9 can control the lifting of the installation cross beam 3, and further adjust the installation height of the projection board 1, and further adjust it to the optimal viewing angle.

[0046] The front view vision simulation system further includes a first installation frame 10. The first installation frame 10 is of a U-shaped structure. Five projection devices 11 are provided at one end inside the first installation frame 10. An installation rotating shaft 12 is provided at one end of the projection device 11. The installation rotating shaft 12 is rotatably installed in the first installation frame 10. A first friction wheel 13 is provided on the installation rotating shaft 12. A first adjusting motor 14 is provided in the first installation frame 10. The first adjusting motor 14 is rotatably connected to the top surface of the first installation frame 10 through a vertical shaft. A motor fixing frame 15 is provided outside the first adjusting motor 14. The output end of the first adjusting motor 14 is connected to a telescopic drive shaft 16. The telescopic drive shaft 16 is of a two-section structure. The front section of the telescopic drive shaft 16 is of a cross structure. The front section of the telescopic drive shaft 16 is movably inserted into the rear section. The end of the front section of the telescopic drive shaft 16 is fixedly installed with a second friction wheel 17. A bearing sleeve 18 is sleeved on the second friction wheel 17. Two side plates 19 are provided on the side wall of the bearing sleeve 18. A set of first push rods 20 are provided between the side plates 19 and the motor fixing frame 15.

[0047] A mounting swivel 22 is provided at the bottom of the first mounting frame 10, and a group of second push rods 21 are fixedly connected at both ends of the mounting swivel 22. The top of the second push rod 21 is fixedly connected to the bottom surface of the first mounting frame 10, and a mounting inner plate 23 is rotatably provided inside the mounting swivel 22. A second adjusting motor 24 is installed in the middle of the mounting inner plate 23, and the output end of the second adjusting motor 24 passes through the square hole on the bottom surface of the first mounting frame 10 and the top is connected to a mounting bracket 25. An upper fixing rod 26 is provided at each end of the mounting bracket 25, and the upper end of the upper fixing rod 26 is correspondingly inserted into the plug hole on the motor fixing frame 15. A group of positioning holes 28 are opened on the bottom surface of the first mounting frame 10, and the positioning holes 28 correspond to the upper fixing rod 26. A lower fixing rod 27 is provided on each side of the second adjusting motor 24 on the upper surface of the mounting inner plate 23, and the lower fixing rod 27 corresponds to the positioning holes 28 one by one.

[0048] The bottom surface of the second adjusting motor 24 is connected to the third friction wheel 29, the first mounting frame 10 is fixedly installed in the second mounting frame 30 by several bolts, and the fourth friction wheel 32 is rotatably installed in the second mounting frame 30, and the fourth friction wheel 32 corresponds to the third friction wheel 29. Both ends of the bottom shaft 31 pass through the side walls of the second mounting frame 30 and are rotatably connected to the second mounting frame 30. A first gear 3101 is provided on one end of the bottom shaft 31, and a third mounting frame 33 is provided on the outside of the second mounting frame 30. The third mounting frame 33 and the second mounting frame 30 are rotatably connected through a docking shaft 34, and a second gear 3401 is provided on the docking shaft 34. The second gear 3401 is meshed with the first gear 3101. A locking device is provided on the inner wall of the second mounting frame 30. When adjustment is not required, the locking device fixes the bottom shaft 31 to prevent it from moving.

[0049] By controlling the extension of the first push rod 20 to push the side plate 19 forward, the second friction wheel 17 is pressed against the first friction wheel 13. The friction between the second friction wheel 17 and the first friction wheel 13 is very large, and the connection between the two is similar to a bevel gear and can rotate synchronously. Therefore, the first adjusting motor 14 is controlled to start to drive the telescopic drive shaft 16, and then the second friction wheel 17 drives the first friction wheel 13 and the mounting shaft 12, so that the projection device 11 can be rotated to a certain angle, thereby adjusting its horizontal direction. By controlling the start of the second adjusting motor 24 to drive the mounting frame 25 and the upper fixing rod 26 to rotate, and then the upper fixing rod 26 drives the motor fixing frame 15 and the first adjusting motor 14 to rotate, the second friction wheel 17 and the first friction wheels 13 corresponding to other projection devices 11 can correspond to each other, so that The angle of each projection device 11 can be adjusted individually, which is more practical. If the pitch angle of the projection device 11 needs to be adjusted, the second push rod 21 needs to be controlled to extend so that the mounting ring 22 descends. At this time, the upper fixing rod 26 is inserted into the positioning hole 28, and the lower fixing rod 27 is pulled out from the positioning hole 28. The second push rod 21 is further extended so that the third friction wheel 29 and the fourth friction wheel 32 are tightly fitted together. The two are connected similarly to the second friction wheel 17 and the first friction wheel 13. When the second adjustment motor 24 is started, the second adjustment motor 24 itself will rotate, thereby driving the bottom shaft 31 to rotate, and the first gear 3101 rotates around the second gear 3401, thereby changing the pitch angle of the second mounting frame 30, and then changing the pitch angle of the projection device 11, so as to achieve the optimal projection viewing angle.

[0050] While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions, and variations may be made to these embodiments without departing from the principles and spirit of the invention, and that the scope of the invention is defined by the appended claims and their equivalents.

Claims

1. A real vehicle driving simulation system for HMI testing, characterized by: It includes visual simulation system, steering force feedback simulation system, real vehicle pedal signal acquisition system, scene simulation system, physiological data acquisition system, and data synchronization system; The visual simulation system includes a forward visual simulation system and a rearward visual simulation system, which are respectively used to present the forward and rearward visual images rendered in the simulation environment; The steering force feedback simulation system is characterized in that the vehicle under test is fixed on the steering force feedback simulation system, and the front wheels of the vehicle under test are mechanically clamped to the steering simulation rotating table by mechanical fixation. When the front wheels of the vehicle under test rotate, the steering force feedback simulation system can collect the front wheel angle and apply the calculated steering load force to the front wheels, thereby achieving a force feedback effect; The real vehicle pedal signal acquisition system installs pedal travel sensors on the accelerator and brake pedals of the real vehicle. The driver of the tested vehicle can operate the actual pedals. When the pedal position deviates from the initial idle travel position, the pedal travel signal collected by the sensor is sent to the vehicle model in the simulation environment, thereby controlling the acceleration and deceleration of the simulated vehicle. The scenario simulation system uses professional intelligent driving simulation software to build the test environment for testing, including roads, weather, and surrounding buildings, and presents them on the front and rear view simulation systems through graphical rendering. After obtaining these visual inputs, the driver of the tested vehicle performs actual driving operations; The physiological data acquisition system is installed on the actual vehicle being tested and can collect the eye movements, head movements, and physiological indicators of the driver of the vehicle being tested, providing objective evaluation indicators for HMI testing; The data synchronization system synchronously records data from the scenario simulation system and the physiological data acquisition system, associates the driver's actual behavior and actions with the specific environment and events in the simulation environment, and provides effective data conditions for HMI testing; The forward vision simulation system comprises a projection board (1), a central column (2) connected to the back of the projection board (1), the central column (2) being movably connected to a mounting beam (3), a support rod being provided on one side surface of the mounting beam (3), a spherical sleeve being provided in the middle of the central column (2), the end of the support rod being a spherical structure and being rotatably connected in the spherical sleeve, a group of connecting columns (4) being provided at each end of the mounting beam (3), the end of the connecting column (4) being connected to a side column (5), an adjusting push rod (6) being movably installed at the upper and lower ends of the side column (5), a connecting rod (7) being fixedly installed at the end of the adjusting push rod (6), the end of the connecting rod (7) being movably connected to the frame of the projection board (1), the mounting beam (3) being movably installed in a fixed frame (8), a lifting push rod (9) being provided at the bottom of the fixed frame (8), the upper end of the lifting push rod (9) being fixed to the bottom surface of the mounting beam (3).

2. The real vehicle driving simulation system for HMI testing according to claim 1, characterized in that: The forward-looking visual simulation system uses five projectors to receive images rendered by scene simulation software and projects multiple images onto a circular screen structure through software fusion technology. The software fusion technology can process the fusion bands between the images of multiple projectors, on the one hand, to achieve matching of the images with the geometric curvature of the circular screen system, and on the other hand, to eliminate overlap between images, ensuring that the projected images have no gaps and uniform brightness. The rearview scene simulation system uses three small-size displays to receive rearview mirror images rendered by scene simulation software, including two exterior rearview mirrors and one interior rearview mirror. The rearview mirror images include renderings of the exterior body surface and interior interior of the vehicle, thereby ensuring that the images seen by the driver are close to those in the real world.

3. The real vehicle driving simulation system for HMI testing according to claim 1, characterized in that: The steering force feedback simulation system needs to collect the front wheel turning angle of the actual vehicle under test. This part is mechanically fixed to the front wheel and the force feedback simulation system by mechanical clamping. At this time, when the front wheel turns, it will drive the steering simulation mechanism gear to rotate, and the rotation angle is collected by the force feedback simulation system. Afterwards, the collected turning angle will be sent to the vehicle dynamics model of the scene simulation software to calculate the load resistance between the virtual vehicle and the virtual environment road surface at this time, and the resistance target value will be sent to the force feedback simulation motor for applying the load force. The simulated load force is finally reflected on the steering wheel through the real vehicle steering system.

4. The real vehicle driving simulation system for HMI testing according to claim 1, characterized in that: The real vehicle pedal signal acquisition system collects pedal stroke changes caused by driver operation through sensors installed on the accelerator and brake pedals of the real vehicle. The pedal stroke information is sent to the vehicle dynamics model of the scenario simulation software, resulting in the acceleration and deceleration behavior of the virtual vehicle.

5. The real vehicle driving simulation system for HMI testing according to claim 1, characterized in that: The physiological data acquisition system detects the driver's head movements, expressions, and eyes through the eye tracker and head tracker installed on the center console of the actual vehicle to obtain the driver's driving status. At the same time, the physiological detector can also collect the driver's pulse, heartbeat, brain electricity, and skin electricity information through sensors installed on the driver's body to obtain the driver's physiological characteristics. Then judge whether the driver has characteristics of tension and anger.

6. The real vehicle driving simulation system for HMI testing according to claim 1, characterized in that: The data synchronization system sends the environment and events of the scene simulation software and the eye movement, head movement, and physiological data of the physiological data acquisition system to the synchronization platform through the Ethernet communication protocol, thereby supporting the association of the driver's actual behavior and actions with the specific environment and events in the simulation environment, providing effective data conditions for HMI testing.

7. The real vehicle driving simulation system for HMI testing according to claim 2, characterized in that: The front view vision simulation system further includes a first mounting frame (10). The first mounting frame (10) has a U-shaped structure. Five projection devices (11) are arranged at one end inside the first mounting frame (10). An installation rotating shaft (12) is arranged at one end of the projection device (11). The installation rotating shaft (12) is rotatably installed in the first mounting frame (10). A first friction wheel (13) is arranged on the installation rotating shaft (12). A first adjustment motor (14) is arranged in the first mounting frame (10). A motor fixing frame (15) is arranged outside the first adjustment motor (14). The output end of the first adjustment motor (14) is connected to a telescopic drive shaft (16). The telescopic drive shaft (16) has a two-section structure. The front section of the telescopic drive shaft (16) is a cross structure. The front section of the telescopic drive shaft (16) is movably inserted into the rear section. A second friction wheel (17) is fixedly installed at the end of the front section of the telescopic drive shaft (16). A bearing sleeve (18) is sleeved on the second friction wheel (17). Two side plates (19) are arranged on the side wall of the bearing sleeve (18). A set of first push rods (20) is arranged between the side plates (19) and the motor fixing frame (15). An installation rotating ring (22) is arranged below the first mounting frame (10). A set of second push rods (21) is fixedly connected to both ends of the installation rotating ring (22). The top ends of the second push rods (21) are fixedly connected to the bottom surface of the first mounting frame (10). An installation inner plate (23) is rotatably arranged inside the installation rotating ring (22). A second adjustment motor (24) is installed in the middle of the installation inner plate (23). The output end of the second adjustment motor (24) passes through the square hole on the bottom surface of the first mounting frame (10) and the top end is connected to an installation frame (25). One upper fixing rod (26) is arranged at each end of the installation frame (25). The upper ends of the upper fixing rods (26) are correspondingly inserted into the insertion holes on the motor fixing frame (15). A set of positioning holes (28) is formed on the bottom surface of the first mounting frame (10). The positioning holes (28) correspond to the upper fixing rods (26). One lower fixing rod (27) is arranged on each side of the second adjustment motor (24) on the upper surface of the installation inner plate (23). The lower fixing rods (27) correspond to the positioning holes (28) one by one.

8. The real vehicle driving simulation system for HMI testing according to claim 7, characterized in that: The first adjustment motor (14) is rotatably connected to the top surface of the first mounting frame (10) through a vertical shaft.

9. The real vehicle driving simulation system for HMI testing according to claim 7, characterized in that: The bottom surface of the second regulating motor (24) is connected to a third friction wheel (29), the first mounting frame (10) is fixedly mounted in the second mounting frame (30) by a plurality of bolts, a fourth friction wheel (32) is rotatably mounted in the second mounting frame (30), the fourth friction wheel (32) and the third friction wheel (29) correspond to each other, both ends of the bottom shaft (31) pass through the side walls of the second mounting frame (30) and are rotatably connected to the second mounting frame (30), a first gear (3101) is provided on one end of the bottom shaft (31), a third mounting frame (33) is provided on the outer side of the second mounting frame (30), the third mounting frame (33) and the second mounting frame (30) are rotatably connected via a docking shaft (34), a second gear (3401) is provided on the docking shaft (34), and the second gear (3401) and the first gear (3101) are meshed and connected.

Citation Information

Patent Citations

  • Semi-physical driving fatigue vision simulation system platform

    CN101530329A

  • Simulation testing platform system for researching driving behaviors

    CN101770708A