Driving assistance system and method based on automobile data recorder multiplexing

By reusing the dashcam's camera and front millimeter-wave radar for data fusion, the problems of high hardware cost and complicated layout of dashcams and ADAS functions are solved. This achieves cost reduction and simplified layout of ADAS functions, while increasing the time to brake in advance of collision and reducing the discomfort of emergency braking.

CN118928027APending Publication Date: 2024-11-12GUANGZHOU HAIPERTE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411008037.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Existing technology requires the simultaneous installation of two separate system hosts: a dashcam and an ADAS (Advanced Driver Assistance System) function, resulting in high hardware costs and complex deployment.

Method used

By reusing the dashcam's camera and front millimeter-wave radar, and combining the data with the dashcam's main unit, ADAS functions can be achieved, reducing hardware costs and simplifying deployment.

Benefits of technology

While achieving ADAS functionality, it reduced hardware costs, simplified layout, increased collision time for early braking, and reduced discomfort caused by emergency braking.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118928027A_ABST
    Figure CN118928027A_ABST
Patent Text Reader

Abstract

The invention provides a driving assistance system and method based on automobile data recorder multiplexing, and the system comprises an automobile data recorder which is used for obtaining a front road image through a camera, and transmitting the image to a recorder host; the front millimeter wave radar is used for transmitting and receiving a radar signal, acquiring data information by processing the radar signal, and sending the data information to the recorder host; the recorder host is used for receiving images sent by the automobile data recorder and data information sent by the front millimeter wave radar, carrying out data fusion on the images and the data information to obtain road condition information, and sending the road condition information to the drive-by-wire chassis and the central control instrument through a CAN bus; the drive-by-wire chassis is used for braking the vehicle according to the road condition information sent by the recorder host; the central control instrument is used for displaying early warning information according to the road condition information sent by the recorder host. According to the technical scheme, the technical problems that in the prior art, two sets of system hosts with the automobile data recorder function and the ADAS function need to be installed at the same time, so that hardware cost is high, and arrangement is complex are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to driving assistance technology, and in particular to a driving assistance system and method based on driving recorder reuse. Background Art

[0002] Since 2017, standards such as "Technical Requirements for Safety of Commercial Buses", "Technical Requirements for Safety of Motor Vehicle Operation", and "Performance Requirements and Test Procedures for Automatic Emergency Braking Systems of Commercial Vehicles" have been issued intensively, gradually requiring medium and large buses, medium and heavy trucks, and tractors to install advanced driver assistance systems (ADAS) with functions such as Lane Departure Warning (LDW) and Autonomous Emergency Braking (AEB). In addition, starting from May 2024, the first amendment to the two standards of the transportation industry series "Technical Requirements for Safety of Commercial Trucks Part 1: Trucks" (JTT 1178.1-2018) and "Technical Requirements for Safety of Commercial Trucks Part 2: Tractors and Trailers" (JTT 1178.2-2019) has completed the draft for comments. In the future, AEB and LDW will become standard for commercial trucks, which will bring huge incremental space to the commercial vehicle ADAS market and further promote the commercial vehicle ADAS system from the aftermarket to the pre-installed market.

[0003] At present, high-end heavy-duty trucks of major brands mainly adopt the technical solution of "front-view camera + millimeter-wave radar + driver monitoring system (DMS) camera" to realize the application of multiple ADAS functions, maximize the driving experience and driving safety of the vehicle, and enhance the competitiveness in the market. Under the premise that AEB, LDW, DMS and driving recorders become standard, more sensors will not only increase the cost of commercial vehicles, but also make the body interior look complicated. Summary of the invention

[0004] In view of this, the present invention provides a driving assistance system and method based on driving recorder reuse to solve the technical problem that the prior art requires the simultaneous installation of two system hosts with driving recorder function and ADAS function, resulting in high hardware cost and complicated layout.

[0005] The present invention provides a driving assistance system based on multiplexing of a driving recorder, the system comprising: a driving recorder, arranged on a windshield below a rearview mirror in a vehicle, for acquiring a front road image through a camera, and sending the image to a recorder host; a front millimeter-wave radar, arranged at a front grille of a vehicle, for transmitting and receiving radar signals, acquiring data information by processing the radar signals, and sending the data information to the recorder host; a recorder host, respectively connected to the driving recorder and the front millimeter-wave radar, for receiving the image sent by the driving recorder and the data information sent by the front millimeter-wave radar, fusing the two data according to the following function, obtaining road condition information, and sending the road condition information to a wire-controlled chassis and a central control instrument through a CAN bus;

[0006]

[0007] Among them, R is the distance between the millimeter wave radar and the obstacle, α is the angle between the millimeter wave radar transmitting beam and the obstacle, and H is the X coordinate system of the world. w O 0 Z w The X coordinate system of the plane and the millimeter wave radar r O r Z r Distance of the plane, Z 0 X is the world coordinate system w O 0 Y w The X coordinate system of the plane and the millimeter wave radar r O r Y r The distance of the plane, f is the focal length, u is 0 is the initial horizontal coordinate of the pixel point, v 0 is the initial vertical coordinate of the pixel point, u is the real-time horizontal coordinate of the pixel point, v is the real-time vertical coordinate of the pixel point, R1 is the rotation matrix, T is the translation matrix, 0 T is the three-dimensional zero vector, Z c is the z coordinate in the coordinate system of the image acquisition device, dx is the differential in the x-axis direction, and dy is the differential in the y-axis direction; the wire-controlled chassis is connected to the recorder host through the CAN bus, and is used to brake the vehicle according to the braking command of the road condition information sent by the recorder host; the central control instrument is connected to the recorder host through the CAN bus, and is used to display early warning information according to the alarm information in the road condition information sent by the recorder host.

[0008] Furthermore, the road condition information includes obstacles ahead and vehicles deviating from lanes.

[0009] Furthermore, the driving recorder includes a front camera and a driver monitoring camera, wherein: the front camera is a wide-angle camera with an angle of 120° and a pixel of 800W, which is used to obtain images of the road ahead; the driver monitoring camera is a wide-angle camera with an angle of 133° and a pixel of 200W, which is used to obtain images of the vehicle cab.

[0010] Furthermore, the driving recorder is also used to send the cab image to the recorder host; the recorder host is also used to determine whether the driver is fatigued through the cab image, and when the driver is fatigued, send the impending collision time information and road condition information to the wire-controlled chassis and the central control instrument; the wire-controlled chassis is also used to brake the vehicle in advance according to the collision time information and the braking command in the road condition information when the road condition information indicates that there is an obstacle on the road ahead or the vehicle deviates from the lane; the central control instrument displays fatigue warning information based on the impending collision time information and the alarm information in the road condition information.

[0011] Furthermore, the recorder host records and stores the image data sent by the driving recorder in accordance with the standard GBT 19056-2021 "Motor Vehicle Driving Recorder".

[0012] The present application also provides a driving assistance method based on multiplexing of a driving recorder, the method comprising: step 1, the driving recorder obtains a front road image through a camera, and sends the image to a recorder host; step 2, the front millimeter-wave radar transmits and receives a radar signal, obtains data information by processing the radar signal, and sends the data information to the recorder host; step 3, the recorder host receives the image sent by the driving recorder and the data information sent by the front millimeter-wave radar, obtains road condition information by fusing the two data, and sends the road condition information to the wire-controlled chassis and the central control instrument through the CAN bus;

[0013]

[0014] Among them, R is the distance between the millimeter wave radar and the obstacle, α is the angle between the millimeter wave radar transmitting beam and the obstacle, and H is the X coordinate system of the world. w O 0 Z w The X coordinate system of the plane and the millimeter wave radar r O r Z r Distance of the plane, Z 0 X is the world coordinate system w O 0 Y w The X coordinate system of the plane and the millimeter wave radar r O r Y r The distance of the plane, f is the focal length, u is 0 is the initial horizontal coordinate of the pixel point, v 0 is the initial vertical coordinate of the pixel point, u is the real-time horizontal coordinate of the pixel point, v is the real-time vertical coordinate of the pixel point, R1 is the rotation matrix, T is the translation matrix, 0 T is the three-dimensional zero vector, Z c is the z coordinate in the coordinate system of the image acquisition device, dx is the differential in the x-axis direction, and dy is the differential in the y-axis direction; step 4, the wire-controlled chassis brakes the vehicle according to the braking command in the road condition information sent by the recorder host; step 5, the central control instrument displays warning information according to the alarm information in the road condition information sent by the recorder host.

[0015] Furthermore, the step 1 is specifically as follows: step 11, the driving recorder obtains the image of the road ahead through the front camera; step 12, the driving recorder obtains the image of the cab through the driver monitoring camera; step 13, the driving recorder sends the image of the road ahead and the image of the cab to the recorder host.

[0016] Furthermore, step 3 also includes that the recorder host sends the impending collision time information to the wire-controlled chassis and the central control instrument; step 4 also includes that the wire-controlled chassis brakes the vehicle in advance according to the impending collision time information; step 5 also includes that the central control instrument displays fatigue warning information according to the impending collision time information.

[0017] Furthermore, the step 4 is specifically, when the road condition information indicates that there is an obstacle ahead, the vehicle is braked; the step 5 is specifically, when the road condition information indicates that there is an obstacle ahead, the obstacle warning information is displayed, and when the road condition information indicates that the vehicle deviates from the lane, the vehicle deviation warning information is displayed.

[0018] Furthermore, the data information is obtained by processing the radar signal, specifically: the data information is determined by comparing the difference between the transmitted signal and the received signal, and the data information includes the position and speed of obstacles around the vehicle.

[0019] The present invention provides a driving assistance system and method based on the reuse of a driving recorder. The technical solution reuses the images obtained by the camera of the driving recorder, combines the data information obtained by the front millimeter-wave radar, and has the recorder host fuse the two data to determine the road condition information, and then sends it to the wire-controlled chassis and the central control instrument for the wire-controlled chassis to brake, and the central control instrument to display warning information. The technical solution solves the technical problems of the prior art that two sets of system hosts for driving recorder function and ADAS function are deployed at the same time, resulting in high hardness cost and complicated layout; at the same time, it increases the time of collision, takes braking measures in advance, ensures driving safety and reduces the discomfort caused by emergency braking. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a schematic flow chart of a driving assistance method based on multiplexing of a driving recorder provided by the present invention;

[0021] Figure 2 It is a schematic diagram of a driving assistance system based on multiplexing of a driving recorder provided by the present invention;

[0022] Figure 3 It is a schematic diagram of the process of the driving recorder provided by the present invention acquiring images and sending them to the recorder host. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0024] Embodiment 1

[0025] The present application provides a driving assistance system and method based on multiplexing of a driving recorder, such as Figure 2 As shown, the system includes a driving recorder, a front millimeter-wave radar, a recorder host, a wire-controlled chassis, and a central control instrument. Figure 1 As shown, the operating steps of the system are as follows.

[0026] Step 1: The driving recorder obtains the image of the road ahead through the camera and sends the image to the recorder host;

[0027] The driving recorder is installed on the windshield below the rearview mirror inside the car. It is used to obtain images of the road ahead through a camera and send the images to the recorder host.

[0028] Step 2: The front millimeter-wave radar transmits and receives radar signals, obtains data information by processing the radar signals, and sends the data information to the recorder host;

[0029] The front millimeter-wave radar is installed at the front grille of the vehicle. It is used to transmit and receive radar signals, obtain data information by processing radar signals, and send the data information to the recorder host.

[0030] Step 3: The recorder host receives the image sent by the driving recorder and the data information sent by the front millimeter-wave radar, fuses the two data according to the following function, obtains the road condition information, and sends the road condition information to the wire-controlled chassis and the central control instrument through the CAN bus;

[0031]

[0032] Among them, R is the distance between the millimeter wave radar and the obstacle, α is the angle between the millimeter wave radar transmitting beam and the obstacle, and H is the X coordinate system of the world. w O 0 Z w The X coordinate system of the plane and the millimeter wave radar r O r Z r Distance of the plane, Z 0 X is the world coordinate system w O 0 Y w The X coordinate system of the plane and the millimeter wave radar r O r Y r The distance of the plane, f is the focal length, u is 0 is the initial horizontal coordinate of the pixel point, v 0 is the initial vertical coordinate of the pixel point, u is the real-time horizontal coordinate of the pixel point, v is the real-time vertical coordinate of the pixel point, R1 is the rotation matrix, T is the translation matrix, 0 T is the three-dimensional zero vector, Z c is the z coordinate in the image acquisition device coordinate system, dx is the differential in the x-axis direction, and dy is the differential in the y-axis direction;

[0033] The recorder host is connected to the driving recorder and the front millimeter-wave radar respectively, and is used to receive the image sent by the driving recorder and the data information sent by the front millimeter-wave radar, fuse the two data, obtain the road condition information, and send the road condition information to the wire-controlled chassis and the central control instrument through the CAN bus. The recorder host can not only realize the function of the driving recorder, but also serve as the host of the ADAS system to realize the function of the ADAS system, thereby reducing the hardware cost.

[0034] Step 4, the wire-controlled chassis brakes the vehicle according to the braking command in the road condition information sent by the recorder host;

[0035] The wire-controlled chassis is connected to the recorder host through the CAN bus, and is used to brake the vehicle according to the braking command in the road condition information sent by the recorder host. Vehicle braking here refers to applying a certain force to certain parts of the vehicle, mainly the wheels, to slow down and stop the vehicle. The braking time of the entire vehicle can be controlled by the amount of force applied or by the time of force application. The wire-controlled chassis brakes the vehicle according to the braking command in the road condition information. For example, if there is an obstacle ahead and the distance between the vehicle and the obstacle is less than the preset safety distance, the recorder host will send a braking command to the wire-controlled chassis, and the vehicle will be braked through the wire-controlled chassis, thereby realizing the AEB function in the ADAS system.

[0036] Step 5: The central control instrument displays warning information according to the alarm information in the road condition information sent by the recorder host.

[0037] The central control instrument is connected to the recorder host through the CAN bus, and is used to display warning information according to the alarm information in the road condition information sent by the recorder host. Due to different road condition information, the alarm information in the road condition information sent by the recorder host is also different, so the warning information displayed by the central control instrument is different, for example,

[0038] If there is an obstacle ahead, the central control instrument will display obstacle warning information based on the alarm information in the road condition information. If the vehicle deviates from the lane, the central control instrument will display vehicle deviation warning information based on the alarm information in the road condition information. If the vehicle is less than the preset safety distance from the obstacle ahead, that is, the vehicle is about to collide with the obstacle, and the driver still does not take braking measures, that is, step on the brakes, then the system will perform emergency braking, that is, brake the vehicle through the chassis, and then the central control instrument will display collision warning information.

[0039] The present invention provides a driving assistance system and method based on the reuse of a driving recorder. The technical solution reuses the images obtained by the camera of the driving recorder, combines the data information obtained by the front millimeter-wave radar, and has the recorder host fuse the two data to determine the road condition information, and then sends it to the wire-controlled chassis and the central control instrument for the wire-controlled chassis to brake, and the central control instrument to display warning information. The technical solution solves the technical problem of the existing technology that two sets of system hosts for driving recorder function and ADAS function are deployed at the same time, resulting in high hardness cost and complicated layout.

[0040] Embodiment 2

[0041] The present application provides a driving assistance system and method based on multiplexing of a driving recorder, such as Figure 2 The system shown in the figure includes a driving recorder, a front millimeter-wave radar, a recorder host, a wire-controlled chassis and a central control instrument. Figure 1 As shown, the operating steps of the system are as follows.

[0042] Step 1: The driving recorder obtains the image of the road ahead through the camera and sends the image to the recorder host;

[0043] The driving recorder includes a front camera and a driver monitoring camera. The front camera is a wide-angle camera with an angle of 120° and 800W pixels, which is used to obtain images of the road ahead; the driver monitoring camera is a wide-angle camera with an angle of 133° and 200W pixels, which is used to obtain images of the vehicle cab.

[0044] like Figure 3 As shown, the specific operation process of this step is as follows.

[0045] Step 11, the driving recorder obtains the front road image through the front camera;

[0046] Step 12, the driving recorder obtains the cab image through the driver monitoring camera;

[0047] Step 13: The driving recorder sends the front road image and the cab image to the recorder host.

[0048] The images captured by the front camera and the driver monitoring camera can be used to maintain so as to realize the function of the driving recorder, and the images can also be processed to realize the function of ADAS, further reducing the hardware cost.

[0049] Step 2: The front millimeter-wave radar transmits and receives radar signals, obtains data information by processing the radar signals, and sends the data information to the recorder host;

[0050] In order to enable the driving recorder to better realize the functions of the ADAS system, a front millimeter-wave radar can be added to the vehicle to help the subsequent recorder host to judge the road condition information and driver status.

[0051] Step 3: The recorder host receives the image sent by the driving recorder and the data information sent by the front millimeter-wave radar, fuses the two data according to the following function, obtains the road condition information, and sends the road condition information to the wire-controlled chassis and the central control instrument through the CAN bus;

[0052]

[0053] Among them, R is the distance between the millimeter wave radar and the obstacle, α is the angle between the millimeter wave radar transmitting beam and the obstacle, and H is the X coordinate system of the world. w O 0 Z w The X coordinate system of the plane and the millimeter wave radar r O r Z r Distance of the plane, Z 0 X is the world coordinate system w O 0 Y w The X coordinate system of the plane and the millimeter wave radar r O r Y r The distance of the plane, f is the focal length, u is 0 is the initial horizontal coordinate of the pixel point, v 0 is the initial vertical coordinate of the pixel point, u is the real-time horizontal coordinate of the pixel point, v is the real-time vertical coordinate of the pixel point, R1 is the rotation matrix, T is the translation matrix, 0 T is the three-dimensional zero vector, Z cis the z coordinate in the image acquisition device coordinate system, dx is the differential in the x-axis direction, and dy is the differential in the y-axis direction;

[0054] According to step 1, the recorder host can not only receive the image of the road ahead, but also receive the image of the cab. Therefore, the recorder host is also used to determine whether the driver is fatigued through the cab image. When the driver is fatigued, the information about the time to collision (TTC) and road conditions is sent to the wire-controlled chassis and the central control instrument. As can be seen from the above, when there is an obstacle in front of the vehicle or the vehicle deviates from the road, the central control instrument will first display relevant warning information to prompt the driver to take corrective measures, such as braking, etc. If the driver does not take measures, the system will implement vehicle braking and other measures to realize the ADAS function. However, when the driver is fatigued, it means that the driver cannot find the warning information displayed by the central control instrument in time. Therefore, the system will advance the time for vehicle braking instead of waiting for the driver to take measures. At the same time, TTC will be increased to reduce the discomfort caused by emergency braking to the driver, especially when the driver is in a fatigued state and is unprepared for the current emergency braking measures, delaying the duration of the entire braking process will be more humane. The time required for the entire vehicle to brake is determined by the host computer of the recorder based on the received images, so as to ensure the safety of the vehicle occupants and prevent discomfort to the driver due to sudden braking.

[0055] In addition, the recorder host records and stores the image data sent by the driving recorder in accordance with the standard GBT 19056-2021 "Automobile Driving Recorder" to realize the function of the driving recorder.

[0056] Step 4: the wire-controlled chassis brakes the vehicle in advance according to the road condition information and the information about the impending collision time sent by the recorder host;

[0057] As can be seen from the foregoing, when the road condition information indicates that there is an obstacle on the road ahead or the vehicle deviates from the lane, the vehicle is braked in advance according to the imminent collision time information and the braking command in the road condition information, and the advance time is determined according to the imminent collision time.

[0058] Step 5: The central control instrument displays fatigue warning information based on the road condition information and impending collision time information sent by the recorder host.

[0059] As can be seen from the above, when the recorder host determines that the driver is in a fatigued state, it will send information about the time of impending collision. Therefore, the central control instrument can display fatigue warning information based on this, such as making a sound broadcast warning to remind the driver, and then combine the operation of step 4 to realize the DMS function of the ADAS system.

[0060] The present invention provides a driving assistance system and method based on the reuse of a driving recorder. The technical solution reuses the images obtained by the camera of the driving recorder, combines the data information obtained by the front millimeter-wave radar, and has the recorder host fuse the two data to determine the road condition information, and then sends it to the wire-controlled chassis and the central control instrument for the wire-controlled chassis to brake, and the central control instrument to display warning information. The technical solution solves the technical problems of the prior art that two sets of system hosts for driving recorder function and ADAS function are deployed at the same time, resulting in high hardness cost and complicated layout; at the same time, it increases the time of collision, takes braking measures in advance, ensures driving safety and reduces the discomfort caused by emergency braking.

[0061] Embodiment 3

[0062] Step 1: The driving recorder obtains the image of the road ahead through the camera and sends the image to the recorder host;

[0063] The driving recorder sends data to the driving recorder host via LVDS signal format.

[0064] Step 2: The front millimeter-wave radar transmits and receives radar signals, obtains data information by processing the radar signals, and sends the data information to the recorder host;

[0065] The front millimeter wave radar transmits the acquired data information to the driving recorder host through the CAN bus. The data information is obtained by processing the radar signal, specifically: the data information is determined by comparing the difference between the transmitted signal and the received signal, and the data information includes the position and speed of obstacles around the vehicle.

[0066] Step 3: The recorder host receives the image sent by the driving recorder and the data information sent by the front millimeter-wave radar, fuses the two data according to the following function, obtains the road condition information, and sends the road condition information to the wire-controlled chassis and the central control instrument through the CAN bus;

[0067]

[0068]

[0069] Among them, R is the distance between the millimeter wave radar and the obstacle, α is the angle between the millimeter wave radar transmitting beam and the obstacle, and H is the X coordinate system of the world. w O 0 Z w The X coordinate system of the plane and the millimeter wave radar r O r Z r Distance of the plane, Z 0 X is the world coordinate system w O 0 Yw The X coordinate system of the plane and the millimeter wave radar r O r Y r The distance of the plane, f is the focal length, u is 0 is the initial horizontal coordinate of the pixel point, v 0 is the initial vertical coordinate of the pixel point, u is the real-time horizontal coordinate of the pixel point, v is the real-time vertical coordinate of the pixel point, R1 is the rotation matrix, T is the translation matrix, 0 T is the three-dimensional zero vector, Z c is the z coordinate in the image acquisition device coordinate system, dx is the differential in the x-axis direction, and dy is the differential in the y-axis direction;

[0070] The road condition information includes obstacles ahead and vehicles deviating from lanes.

[0071] Step 4, the wire-controlled chassis brakes the vehicle according to the braking command in the road condition information sent by the recorder host;

[0072] When there is an obstacle in front of the vehicle, or the vehicle deviates from the road, the central control instrument will first display relevant warning information to prompt the driver to take corrective measures, such as braking, etc. If the driver does not take measures, the system will implement vehicle braking and other measures to achieve ADAS functions. For example, when an obstacle appears in front of the vehicle, the central control instrument will display obstacle warning information. If the driver does not take measures, the vehicle will get closer and closer to the obstacle. The system provided by the present invention will take braking measures to stop the vehicle; when the vehicle deviates from the lane, the central control instrument will display vehicle deviation warning information. If the driver does not take measures, the vehicle will deviate from the lane and approach obstacles such as flower beds and vehicles next to it. When the vehicle gets closer and closer to the obstacle, the system provided by the present invention will take braking measures to stop the vehicle.

[0073] Step 5: The central control instrument displays warning information according to the alarm information in the road condition information sent by the recorder host.

[0074] When the road condition information indicates that there is an obstacle ahead, the central control instrument displays the obstacle warning information according to the alarm information in the road condition information sent by the recorder host; when the road condition information indicates that the vehicle deviates from the lane, the central control instrument displays the vehicle deviation warning information according to the alarm information in the road condition information sent by the recorder host.

[0075] The present invention provides a driving assistance system and method based on the reuse of a driving recorder. The technical solution reuses the images obtained by the camera of the driving recorder, combines the data information obtained by the front millimeter-wave radar, and has the recorder host fuse the two data to determine the road condition information, and then sends it to the wire-controlled chassis and the central control instrument for the wire-controlled chassis to brake, and the central control instrument to display warning information. The technical solution solves the technical problems of the prior art that two sets of system hosts for driving recorder function and ADAS function are deployed at the same time, resulting in high hardness cost and complicated layout; at the same time, it increases the time of collision, takes braking measures in advance, ensures driving safety and reduces the discomfort caused by emergency braking.

[0076] In summary, the embodiment of the present invention provides a driving assistance system and method based on the reuse of a driving recorder. The technical solution reuses the image obtained by the camera of the driving recorder, combines the data information obtained by the front millimeter-wave radar, and has the recorder host perform data fusion on the two to determine the road condition information, and then sends it to the wire-controlled chassis and the central control instrument for the wire-controlled chassis to brake, and the central control instrument to display warning information. The technical solution reuses the front camera of the driving recorder as the front-view camera of the ADAS function, reuses the driver monitoring camera of the driving recorder as the DMS function camera, and the driving recording function and the ADAS function share a host, which reduces the system hardware cost and reduces the complexity of the layout. The recorder host realizes the DMS system function and the AEB system function at the same time. The recorder host will refer to the driver status signal output by the DMS system. When the obstacle in front of the vehicle triggers the forward alarm and the recorder host detects that the driver is driving fatigued and does not take measures, the recorder host will increase the TTC, and take brakes in advance to ensure driving safety and reduce the discomfort caused by emergency braking. This technical solution can also quickly complete the ADAS system modification of after-sales vehicles by adding a millimeter-wave radar and a multi-functional driving recorder system, and can also reduce after-sales costs.

[0077] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A driving assistance system based on multiplexing of driving recorders, characterized in that: The system comprises: The driving recorder is installed on the windshield below the rearview mirror in the car, and is used to obtain images of the road ahead through a camera and send the images to the recorder host; The front millimeter-wave radar is installed at the front grille of the vehicle, and is used to transmit and receive radar signals, obtain data information by processing radar signals, and send the data information to the recorder host; The recorder host is connected to the driving recorder and the front millimeter-wave radar respectively, and is used to receive the image sent by the driving recorder and the data information sent by the front millimeter-wave radar, and then perform data fusion according to the following function to obtain the road condition information, and send the road condition information to the wire-controlled chassis and the central control instrument through the CAN bus; Among them, R is the distance between the millimeter wave radar and the obstacle, α is the angle between the millimeter wave radar transmitting beam and the obstacle, and H is the X coordinate system of the world. w OZ w The X coordinate system of the plane and the millimeter wave radar r O r Z r The distance of the plane, Z0 is the X coordinate system of the world w OY w The X coordinate system of the plane and the millimeter wave radar r O r Y r The distance of the plane, f is the focal length, u0 is the initial horizontal coordinate of the pixel, v0 is the initial vertical coordinate of the pixel, u is the real-time horizontal coordinate of the pixel, v is the real-time vertical coordinate of the pixel, R1 is the rotation matrix, T is the translation matrix, 0 T is the three-dimensional zero vector, Z c is the z coordinate in the image acquisition device coordinate system, dx is the differential in the x-axis direction, and dy is the differential in the y-axis direction; The wire-controlled chassis is connected to the recorder host through the CAN bus and is used to brake the vehicle according to the braking command in the road condition information sent by the recorder host; The central control instrument is connected to the recorder host through the CAN bus and is used to display early warning information based on the alarm information in the road condition information sent by the recorder host.

2. According to claim 1, a driving assistance system based on driving recorder reuse is characterized in that: The road condition information includes obstacles ahead and vehicles deviating from lanes.

3. The driving assistance system based on driving recorder reuse according to claim 1, characterized in that: The driving recorder includes a front camera and a driver monitoring camera, wherein: The front camera is a wide-angle camera with an angle of 120° and a pixel of 800W, which is used to obtain images of the road ahead; The driver monitoring camera is a wide-angle camera with an angle of 133° and a pixel of 2 million, and is used to obtain images of the vehicle cab.

4. The driving assistance system based on driving recorder reuse according to claim 3, characterized in that: The driving recorder is also used to send the cab image to the recorder host; The recorder host is also used to determine whether the driver is fatigued through the cab image, and if the driver is fatigued, send the information of the impending collision time and road condition to the wire-controlled chassis and the central control instrument; The wire-controlled chassis is also used to brake the vehicle in advance according to the collision time information and the braking command in the road condition information when the road condition information indicates that there is an obstacle on the road ahead or the vehicle has deviated from the lane; The central control instrument displays fatigue warning information based on the impending collision time information and road condition information.

5. The driving assistance system based on multiplexing of driving recorders according to claim 3, characterized in that: The recorder host records and stores the image data sent by the driving recorder in accordance with the standard GBT 19056-2021 "Automobile Driving Recorder".

6. A method of using the driving assistance system based on driving recorder reuse according to claims 1-5, characterized in that: The method comprises: Step 1: The driving recorder obtains the image of the road ahead through the camera and sends the image to the recorder host; Step 2: The front millimeter-wave radar transmits and receives radar signals, obtains data information by processing the radar signals, and sends the data information to the recorder host; Step 3: The recorder host receives the image sent by the driving recorder and the data information sent by the front millimeter-wave radar, fuses the two data according to the following function, obtains the road condition information, and sends the road condition information to the wire-controlled chassis and the central control instrument through the CAN bus; Among them, R is the distance between the millimeter wave radar and the obstacle, α is the angle between the millimeter wave radar transmitting beam and the obstacle, and H is the X coordinate system of the world. w OZ w The X coordinate system of the plane and the millimeter wave radar r O r Z r The distance of the plane, Z0 is the X coordinate system of the world w OY w The X coordinate system of the plane and the millimeter wave radar r O r Y r The distance of the plane, f is the focal length, u0 is the initial horizontal coordinate of the pixel, v0 is the initial vertical coordinate of the pixel, u is the real-time horizontal coordinate of the pixel, v is the real-time vertical coordinate of the pixel, R1 is the rotation matrix, T is the translation matrix, 0 T is the three-dimensional zero vector, Z c is the z coordinate in the image acquisition device coordinate system, dx is the differential in the x-axis direction, and dy is the differential in the y-axis direction; Step 4, the wire-controlled chassis brakes the vehicle according to the braking command in the road condition information sent by the recorder host; Step 5: The central control instrument displays warning information based on the road condition information sent by the recorder host.

7. The driving assistance method based on driving recorder reuse according to claim 6, characterized in that: The step 1 is specifically as follows: Step 11, the driving recorder obtains the front road image through the front camera; Step 12, the driving recorder obtains the cab image through the driver monitoring camera; Step 13: The driving recorder sends the front road image and the cab image to the recorder host.

8. The driving assistance method based on driving recorder reuse according to claim 7, characterized in that: The step 3 also includes the recorder host sending the imminent collision time information to the wire-controlled chassis and the central control instrument; Step 4 also includes, the wire-controlled chassis braking the vehicle in advance according to the imminent collision time information; Step 5 also includes the central control instrument displaying fatigue warning information based on the impending collision time information.

9. The driving assistance method based on driving recorder reuse according to claim 6, characterized in that: Specifically, step 4 includes braking the vehicle when the road condition information indicates that there is an obstacle ahead; Specifically, step 5 includes displaying obstacle warning information when the road condition information indicates that there is an obstacle ahead, and displaying vehicle deviation warning information when the road condition information indicates that the vehicle deviates from the lane.

10. The driving assistance method based on driving recorder reuse according to claim 6, characterized in that: The obtaining of data information by processing the radar signal is specifically: determining the data information by comparing the difference between the transmitted signal and the received signal, wherein the data information includes the position and speed of obstacles around the vehicle.