Vehicle driving monitoring device and method

By installing a side front view camera and a side rear view camera on the vehicle, stitching images to generate front and rear view images of the entire vehicle, and sending an alarm signal when determining the risk of lane change, the existing technology of obstructions blocking the field of view and signals is solved. The problem has achieved the accuracy and safety of vehicle lane change judgment.

CN118928221AInactive Publication Date: 2024-11-12CHERY AUTOMOBILE CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411015679.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2024-11-12
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In the prior art, when a vehicle changes lane, large obstacles in front or rear of the vehicle block the field of view and radar signals, the driver cannot accurately determine whether there is a risk in lane change, and cannot provide alarm information in time, which increases the risk of traffic accidents.

Method used

Install side front view camera and side rear view camera on the vehicle to obtain images on the front and rear side of the vehicle, and splice the images through the control module to generate front and rear view images of the entire vehicle, display them to the driver, and change lanes in the judgment An alarm signal is issued when there is a risk.

Benefits of technology

By obtaining the vehicle side obstacle information in all aspects, ensuring the accuracy of lane change judgments, and promptly reminding the driver when there are risks, improving driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118928221A_ABST
    Figure CN118928221A_ABST
Patent Text Reader

Abstract

The invention discloses a vehicle driving monitoring device and method, and belongs to the technical field of vehicle engineering, and the device comprises a side front view camera which is used for obtaining a side front image of a vehicle; the side rear-view camera is used for acquiring a side rear image of the vehicle; the control module is used for splicing the vehicle side front image and the vehicle side rear image to obtain front and rear view images of the whole vehicle; when a vehicle steering signal is received, a display device is controlled to display a steering side image in front and back view images of the whole vehicle; according to a steering side image in the front and rear view images of the whole vehicle, judging whether steering has risks or not; when the steering risk is judged, the alarm device is controlled to send a steering alarm signal; the display device is used for displaying the front and back view images of the whole vehicle or a steering side image in the front and back view images of the whole vehicle; and the alarm device is used for sending an alarm signal. And the driving safety of the vehicle is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of vehicle engineering technology, and in particular to a vehicle driving monitoring device and method. Background Art

[0002] With the development of technology, cars have become the main means of transportation for people. However, with the increase in the number of cars, traffic accidents are becoming more and more frequent. Among them, one of the causes of traffic accidents is the lane change of cars.

[0003] When there is a risk in changing lanes, the driver is promptly reminded. In related technologies, radars are installed in the front and rear of the vehicle. The radars monitor whether there are obstacles in front and behind the vehicle, as well as the distance between the obstacles and the vehicle, to determine whether there is a risk in changing lanes.

[0004] However, when there are obstacles such as large vehicles in front of or behind the vehicle, the obstacles in front of the vehicle can easily block the driver's field of vision, making it impossible for the driver to see the obstacles on the road to be changed in time, and unable to accurately judge whether the vehicle can change lanes. In addition, when there are obstacles such as large vehicles in front of or behind the vehicle, the signal of the vehicle's radar is easily blocked, and the radar cannot accurately measure whether there are obstacles in front and behind the vehicle. Therefore, it is impossible to accurately judge whether there is a risk in changing lanes, and it is impossible to provide alarm information to the driver in time, which is prone to road traffic safety accidents. Summary of the invention

[0005] The present application provides a vehicle driving monitoring device and method, which can solve the technical problem in the related art that it is impossible to provide an early warning for the vehicle to change lanes due to the influence of large obstacles in front of the vehicle. The technical solution is as follows:

[0006] In one aspect, a vehicle driving monitoring device is provided, comprising:

[0007] Side front view camera, used to obtain the side front image of the vehicle;

[0008] Side rear-view camera, used to obtain images of the side and rear of the vehicle;

[0009] The control module is used to splice the vehicle side front image and the vehicle side rear image to obtain the front and rear visual field image of the whole vehicle; when receiving the vehicle turning signal, control the display device to display the turning side image in the front and rear visual field image of the whole vehicle; judge whether there is a risk in turning according to the turning side image in the front and rear visual field image of the whole vehicle; when it is judged that there is a risk in turning, control the alarm device to send a turning alarm signal;

[0010] A display device, used for displaying the front and rear visual field images of the whole vehicle or the image of the steering side in the front and rear visual field images of the whole vehicle;

[0011] Alarm device, used to send out alarm signals.

[0012] In some embodiments, the control module is used to determine whether there is an obstacle within the side rear setting range of the vehicle's turning side and whether there is an obstacle within the side front setting range of the vehicle's turning side based on the turning side image in the front and rear field of view images of the entire vehicle; when there is an obstacle within the side rear setting range of the vehicle's turning side, or there is an obstacle within the side front setting range of the vehicle's turning side, it is determined that there is a risk in vehicle turning.

[0013] In some embodiments, the control module is used to determine that a vehicle turn signal is received when a turn signal on signal, a voice turn signal or a steering wheel angle signal is received.

[0014] In some embodiments, the control module is used to control the display device to display the turning side image in the front and rear field of view images of the whole vehicle in a warning color when it is determined that there is a risk in turning.

[0015] In some embodiments, when the vehicle is located at the boundary of a lane, the side front image acquired by the side front view camera contains all information on the side front of the vehicle boundary; the image acquired by the side rear view camera contains all information on the side rear of the vehicle boundary.

[0016] In some embodiments, the display device includes an in-vehicle display device and an out-vehicle display device;

[0017] An in-vehicle display device, used to display the front and rear visual field images of the entire vehicle and the image of the steering side in the front and rear visual field images of the entire vehicle;

[0018] The external display device is used to display the image of the side and rear of the vehicle.

[0019] In some embodiments, the side rear view camera is mounted on the vehicle's rear view mirror.

[0020] In some embodiments, the warning device includes a voice warning device and a steering wheel vibration device.

[0021] On the other hand, a vehicle driving monitoring method is provided, comprising:

[0022] Acquire a vehicle front side image and a vehicle rear side image;

[0023] The front side image of the vehicle and the rear side image of the vehicle are stitched together to obtain the front and rear field of view images of the entire vehicle;

[0024] When a vehicle turning signal is received, the turning side image in the front and rear field of view of the whole vehicle is displayed;

[0025] Based on the images of the steering side in the front and rear field of view of the vehicle, determine whether there is a risk in steering;

[0026] When it is determined that there is a risk in turning, a turning alarm signal is issued.

[0027] In some embodiments, based on the turning side image in the front and rear field of view images of the whole vehicle, it is determined whether there is an obstacle in the side rear setting range of the turning side of the vehicle and whether there is an obstacle in the side front setting range of the turning side of the vehicle;

[0028] When there is an obstacle within a set range behind the side of the vehicle turning, or there is an obstacle within a set range in front of the side of the vehicle turning, it is determined that there is a risk in the vehicle turning.

[0029] The technical solution provided by this application can at least bring the following beneficial effects:

[0030] In the present application, by installing a side front view camera and a side rear view camera on the vehicle, the side front view camera and the side rear view camera can be used to obtain the vehicle side front image and the vehicle side rear image, and then the vehicle side front image and the vehicle side rear image are spliced ​​to obtain the front and rear field of view image of the whole vehicle. When the vehicle turns to change lanes, the turning side image in the front and rear field of view image of the whole vehicle is displayed through a display device to provide a reference for the driver to turn, so that the driver can accurately judge whether to turn and change lanes; and when it is judged that there is a risk in turning, an alarm signal is issued to remind the driver to ensure driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0032] Figure 1 The field of view of the vehicle mentioned in the embodiment when the vehicle is not equipped with a side front view camera;

[0033] Figure 2 A field of view of a vehicle driving monitoring device provided in an embodiment of the present application;

[0034] Figure 3 The field of view of a vehicle driving monitoring device when changing lanes to the right provided in an embodiment of the present application;

[0035] Figure 4 The field of view of a vehicle driving monitoring device when changing lanes on the left side provided in an embodiment of the present application;

[0036] Figure 5 A structural block diagram of a vehicle driving monitoring device provided in an embodiment of the present application;

[0037] Figure 6 A control flow chart of a vehicle driving monitoring device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0038] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0039] Before explaining in detail a vehicle driving monitoring device provided in an embodiment of the present application, an application scenario provided in an embodiment of the present application is first introduced.

[0040] With the development of technology, cars have become the main means of transportation for people. However, with the increase in the number of cars, traffic accidents are becoming more and more frequent. Among them, one of the causes of traffic accidents is the lane change of cars. At present, when the driver needs to change lanes, the driver can manually turn on the turn signal and at the same time observe whether the front and rear sides of the car are safe enough and whether they meet the requirements of lane change. The lane change process is relatively cumbersome. For example, Figure 1 As shown in the figure, when there is a moving vehicle, especially a large vehicle, in front of the vehicle, the effective front vision of the driver is blocked by the vehicle, especially the large vehicle, forming a blind spot A. The blind spot A is large, and when the vehicle is about to change lanes, the driver cannot observe the vehicles on the other road in the blind spot. When the driver changes lanes quickly to overtake, a collision accident is very likely to occur.

[0041] Moreover, because cars sometimes have blind spots, the driver may not observe the car in front or behind the vehicle. Changing lanes at this time will cause the vehicle to collide with the car in the turning lane, causing a traffic accident.

[0042] In the current technology, there is a method of installing a radar in front of the vehicle, which uses the radar to detect whether there are obstacles such as vehicles in front of the vehicle, and the distance between the obstacle and the vehicle, and then determines whether there is a risk in the vehicle changing lanes. Since the radar relies on transmitting signal waves and detecting obstacles by receiving reflected signal waves, when there are obstacles such as large vehicles in front of the vehicle, the radar signal is easily blocked, and it is impossible to accurately judge whether there are obstacles in front of the vehicle, or the distance between the obstacle and the vehicle, and thus it is impossible to accurately judge whether there is a risk in the vehicle changing lanes, and thus it is impossible to provide the driver with timely and accurate reminders.

[0043] Based on such an application scenario, the present application provides a vehicle driving monitoring device.

[0044] Next, we will combine Figure 2-Figure 6 A vehicle driving monitoring device provided in an embodiment of the present application is explained in detail.

[0045] A vehicle driving monitoring device, comprising:

[0046] Side front view camera, used to obtain the side front image of the vehicle;

[0047] Side rear-view camera, used to obtain images of the side and rear of the vehicle;

[0048] The control module is used to splice the vehicle side front image and the vehicle side rear image to obtain the front and rear visual field image of the whole vehicle; when receiving the vehicle turning signal, control the display device to display the turning side image in the front and rear visual field image of the whole vehicle; judge whether there is a risk in turning according to the turning side image in the front and rear visual field image of the whole vehicle; when it is judged that there is a risk in turning, control the alarm device to send a turning alarm signal;

[0049] A display device, used for displaying the front and rear visual field images of the whole vehicle or the image of the steering side in the front and rear visual field images of the whole vehicle;

[0050] Alarm device, used to send out alarm signals.

[0051] like Figure 2 As shown, the side front view camera includes a left front view camera and a right front view camera; the side rear view camera includes a left rear view camera and a right rear view camera.

[0052] The left front-view camera is used to obtain the image in front of the left side of the vehicle;

[0053] The right front-view camera is used to obtain the image in front of the right side of the vehicle;

[0054] The left rear-view camera is used to obtain the image of the left rear of the vehicle;

[0055] The right rear-view camera is used to obtain images of the right rear side of the vehicle.

[0056] In some embodiments, when the vehicle is located at the boundary of a lane, the side front image acquired by the side front view camera contains all information on the side front of the vehicle boundary; the image acquired by the side rear view camera contains all information on the side rear of the vehicle boundary.

[0057] like Figure 3 As shown, when the vehicle moves to the right boundary of the lane, the right front-view camera and the right rear-view camera can observe all information in front of and behind the right lane of the vehicle, including obstacles such as vehicles traveling in the right lane.

[0058] like Figure 4 As shown, when the vehicle moves to the left boundary of the lane, the left front-view camera and the left rear-view camera can observe all information in front of and behind the left lane of the vehicle, including obstacles such as vehicles traveling in the left lane.

[0059] In some embodiments, the control module is used to stitch the left front image of the vehicle and the right front image of the vehicle to obtain a front view image of the vehicle; stitch the left rear image of the vehicle and the left rear image of the vehicle to obtain a rear view image of the vehicle; stitch the front view image of the vehicle and the rear view image of the vehicle to obtain a front and rear field of view image of the entire vehicle; during normal driving of the vehicle, control the display device to display the front and rear field of view images of the entire vehicle.

[0060] In some embodiments, Figure 5 As shown, the control module includes an electronic exterior rearview mirror image processing unit, an electronic exterior frontview mirror image processing unit and an image stitching unit;

[0061] The electronic exterior rearview mirror image processing unit is used to splice the left rear image of the vehicle and the left rear image of the vehicle to obtain a vehicle rear view image.

[0062] The electronic exterior front-view mirror image processing unit is used to splice the left front image of the vehicle and the right front image of the vehicle to obtain a front view image of the vehicle.

[0063] The image stitching unit is used to stitch the vehicle front view image and the vehicle rear view image to obtain the front and rear field of view images of the entire vehicle.

[0064] In addition, the control module can also be an integrated controller, such as a vehicle domain controller.

[0065] In some embodiments, the control module is used to determine whether there is an obstacle within the side rear setting range of the vehicle's turning side and whether there is an obstacle within the side front setting range of the vehicle's turning side based on the turning side image in the front and rear field of view images of the entire vehicle; when there is an obstacle within the side rear setting range of the vehicle's turning side, or there is an obstacle within the side front setting range of the vehicle's turning side, it is determined that there is a risk in vehicle turning.

[0066] Among them, the side rear setting range and the side front setting range are determined according to the minimum safety distance between the vehicle and the side rear vehicle and the minimum safety distance between the vehicle and the side front vehicle when the vehicle changes lanes. When the distance between the side front vehicle and the vehicle is greater than the corresponding minimum safety distance, and the distance between the side rear vehicle and the vehicle is greater than the corresponding minimum safety distance, it is determined that there is no possibility of collision between the vehicle and the vehicle in the turning lane, and there is no risk in vehicle turning.

[0067] When the distance between the vehicle in front of the vehicle and the vehicle is less than or equal to the minimum safety distance, it is determined that there is an obstacle within the set range in front of the vehicle; when the distance between the vehicle behind the vehicle and the vehicle is less than or equal to the minimum safety distance, it is determined that there is an obstacle within the set range behind the vehicle.

[0068] In some embodiments, the control module is used to determine that a vehicle turn signal is received when a turn signal on signal, a voice turn signal, a turn switch command signal or a steering wheel angle signal is received.

[0069] In some embodiments, the control module is used to control the display device to display the turning side image in the front and rear field of view images of the whole vehicle in a warning color when it is determined that there is a risk in turning.

[0070] The turning side image in the front and rear field of view image of the whole vehicle refers to the turning side part in the front and rear field of view image of the whole vehicle.

[0071] For example, when receiving a left turn signal from the vehicle, the control module controls the display device to enlarge and display the left image in the front and rear field of view of the entire vehicle to provide a reference for the driver to turn left; and when it is determined that there is a risk in turning left, the control module controls the display device to display the left image in the front and rear field of view of the entire vehicle in red.

[0072] In some embodiments, the display device includes an in-vehicle display device and an out-vehicle display device;

[0073] An in-vehicle display device, used to display the front and rear visual field images of the entire vehicle and the image of the steering side in the front and rear visual field images of the entire vehicle;

[0074] The external display device is used to display the image of the side and rear of the vehicle.

[0075] Both the in-vehicle display device and the out-vehicle display device use display screens; the out-vehicle display device includes a left out-vehicle display device and a right out-vehicle display device, the left out-vehicle display device is used to display the left rear image; the right out-vehicle display device is used to display the right rear image.

[0076] The exterior display device may adopt an electronic exterior rearview mirror.

[0077] The in-vehicle display device is used to display the front and rear field of view images of the entire vehicle when the vehicle is driving normally. When the control module receives the vehicle turning signal, the turning side image in the front and rear field of view images of the entire vehicle is enlarged to adapt to the in-vehicle display device, and the turning side image in the front and rear field of view images of the entire vehicle is displayed in a targeted manner to provide a reference for the driver's steering control.

[0078] In some embodiments, the warning device includes a voice warning device and a steering wheel vibration device.

[0079] The voice alarm device is used to issue a voice alarm message when there is a risk in vehicle turning.

[0080] The steering wheel vibration device is used to drive the steering wheel to vibrate when there is a risk in vehicle steering.

[0081] When there is a risk in vehicle turning, the alarm device will send out an alarm message to remind the driver to change lanes carefully and drive safely.

[0082] The embodiment of the present application provides a vehicle driving monitoring device, such as Figure 6 As shown, during the driving process of the vehicle, the side front camera and the side rear camera are used to obtain the side front image and the side rear image of the vehicle;

[0083] Through the control module, the front side images of the vehicle are spliced ​​to obtain the front view image of the vehicle; the rear side images of the vehicle are spliced ​​to obtain the rear view image of the vehicle; the front view image of the vehicle and the rear view image of the vehicle are spliced ​​to obtain the front and rear field of view images of the entire vehicle.

[0084] When the vehicle is driving normally, the side and rear images of the vehicle are displayed through the external display device, and the front and rear field images of the entire vehicle are displayed through the internal display device.

[0085] When the control module receives a vehicle turning signal such as a turn signal on signal, a voice turn signal, a turn switch command signal or a steering wheel angle signal, the in-vehicle display device is controlled to adaptively display the turning side image in the front and rear visual images of the whole vehicle, and judges whether there is a risk in the vehicle turning according to the front and rear visual images of the whole vehicle; when it is determined that there is a risk in the vehicle turning, the in-vehicle display device is controlled to display the turning side image in the front and rear visual images of the whole vehicle in an alarm color, and the alarm device is controlled to send an alarm signal to remind the driver to drive carefully.

[0086] The device provided in the embodiment of the present application can comprehensively obtain all obstacle information in front of and behind the vehicle on both sides of the vehicle by installing side front view cameras and side rear view cameras on the vehicle, thereby ensuring the accuracy of the judgment of the danger of vehicle turning. When the vehicle turns and changes lanes, the turning side image in the front and rear field images of the whole vehicle is displayed through the display device to provide a reference for the driver to turn, so that the driver can accurately judge whether to turn and change lanes; and when it is judged that there is a risk in turning, an alarm signal is issued to remind the driver to drive carefully to ensure driving safety.

[0087] After explaining a vehicle driving monitoring device provided in an embodiment of the present application, a vehicle driving monitoring method provided in an embodiment of the present application will be introduced next.

[0088] A vehicle driving monitoring method, comprising:

[0089] Acquire a vehicle front side image and a vehicle rear side image;

[0090] The front side image of the vehicle and the rear side image of the vehicle are stitched together to obtain the front and rear field of view images of the entire vehicle;

[0091] When a vehicle turning signal is received, the turning side image in the front and rear field of view of the whole vehicle is displayed;

[0092] Based on the images of the steering side in the front and rear field of view of the vehicle, determine whether there is a risk in steering;

[0093] When it is determined that there is a risk in turning, a turning alarm signal is issued.

[0094] In some embodiments, based on the turning side image in the front and rear field of view images of the whole vehicle, it is determined whether there is an obstacle in the side rear setting range of the turning side of the vehicle and whether there is an obstacle in the side front setting range of the turning side of the vehicle;

[0095] When there is an obstacle within a set range behind the side of the vehicle turning, or there is an obstacle within a set range in front of the side of the vehicle turning, it is determined that there is a risk in the vehicle turning.

[0096] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with this embodiment can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0097] Although the above describes the specific implementation mode of the present invention in conjunction with the accompanying drawings, it is not intended to limit the scope of protection of the present invention. Those skilled in the art should understand that various modifications or variations that can be made by those skilled in the art on the basis of the technical solution of the present invention without creative work are still within the scope of protection of the present invention.

Claims

1. A vehicle driving monitoring device, It is characterized in that include: Side front view camera, used to obtain the side front image of the vehicle; Side rear-view camera, used to obtain images of the side and rear of the vehicle; The control module is used to splice the vehicle front side image and the vehicle rear side image to obtain the front and rear field of view image of the whole vehicle; when receiving the vehicle turning signal, control the display device to display the turning side image in the front and rear field of view image of the whole vehicle; and judge whether there is a risk in turning according to the turning side image in the front and rear field of view image of the whole vehicle; When it is determined that there is a risk in turning, the control alarm device sends out a turning alarm signal; A display device, used for displaying the front and rear visual field images of the whole vehicle or the image of the steering side in the front and rear visual field images of the whole vehicle; Alarm device, used to send out alarm signals.

2. A vehicle driving monitoring device as claimed in claim 1, It is characterized in that A control module is used to determine whether there is an obstacle in a set range behind the side of the vehicle and whether there is an obstacle in a set range in front of the side of the vehicle according to the image of the turning side in the front and rear field of view of the whole vehicle; When there is an obstacle within a set range behind the side of the vehicle turning, or there is an obstacle within a set range in front of the side of the vehicle turning, it is determined that there is a risk in the vehicle turning.

3. A vehicle driving monitoring device as claimed in claim 1, It is characterized in that The control module is used to determine whether a vehicle turn signal is received when a turn signal on signal, a voice turn signal or a steering wheel angle signal is received.

4. A vehicle driving monitoring device as claimed in claim 1, It is characterized in that The control module is used to control the display device to display the turning side image in the front and rear field of view images of the whole vehicle in a warning color when it is determined that there is a risk in turning.

5. A vehicle driving monitoring device as claimed in claim 1, It is characterized in that When the vehicle is located at the boundary of the lane, the side front image acquired by the side front view camera contains all information on the side front of the vehicle boundary; the image acquired by the side rear view camera contains all information on the side rear of the vehicle boundary.

6. A vehicle driving monitoring device as claimed in claim 1, It is characterized in that The display device includes an in-vehicle display device and an out-vehicle display device; An in-vehicle display device, used to display the front and rear visual field images of the entire vehicle and the image of the steering side in the front and rear visual field images of the entire vehicle; The external display device is used to display the image of the side and rear of the vehicle.

7. A vehicle driving monitoring device as claimed in claim 1, It is characterized in that The side rearview cameras are installed on the vehicle's rearview mirrors.

8. A vehicle driving monitoring device as claimed in claim 1, It is characterized in that The alarm device includes a voice alarm device and a steering wheel vibration device.

9. A vehicle driving monitoring method, It is characterized in that include: Acquire a vehicle front side image and a vehicle rear side image; The front side image of the vehicle and the rear side image of the vehicle are stitched together to obtain the front and rear field of view images of the entire vehicle; When a vehicle turning signal is received, the turning side image in the front and rear field of view of the whole vehicle is displayed; Based on the images of the steering side in the front and rear field of view of the vehicle, determine whether there is a risk in steering; When it is determined that there is a risk in turning, a turning alarm signal is issued.

10. A vehicle driving monitoring method as claimed in claim 9, It is characterized in that According to the turning side image in the front and rear field of view of the whole vehicle, it is judged whether there is an obstacle in the side rear setting range of the vehicle turning side and whether there is an obstacle in the side front setting range of the vehicle turning side; When there is an obstacle within a set range behind the side of the vehicle turning, or there is an obstacle within a set range in front of the side of the vehicle turning, it is determined that there is a risk in the vehicle turning.

Citation Information

Cited By

  • Automobile parking front wheel automatic aligning system and method

    CN119459863A