Curve driving warning method and device based on turning mirror recognition and storage medium

Abstract

The invention relates to the field of curve driving safety driving, and discloses a curve driving warning method and device based on turning mirror recognition and a storage medium, the method is applied to a vehicle, the vehicle is provided with a front-view camera, and the method comprises the steps of obtaining an image in front of the vehicle during driving, and recognizing whether a turning mirror exists in front of the vehicle during driving through the image in front of the vehicle during driving; when the turning mirror exists in front of the vehicle during driving, warning information is sent out inside and outside the vehicle at the same time, the warning information in the vehicle comprises sound warning and a turning mirror surface image shot by a front-view camera displayed by a central control screen of the vehicle, and the warning information outside the vehicle comprises flashing of a headlamp and whistling of a horn. According to the implementation of the invention, the early warning of all vehicles and pedestrians entering the curve range is realized, and the traffic safety problem caused by the fact that the vehicles do not know the road condition of the lane on the other side of the curve when passing through the curve is solved.

Description

Technical Field

[0001] This invention relates to the field of curve traffic safety, and specifically to a method, device, and storage medium for curve driving warning based on turning mirror recognition. Background Technology

[0002] When driving on curves, traffic accidents are highly likely to occur because the actual road conditions on the other side of the curve are unpredictable. To avoid curve accidents, the current practice is to install turning mirrors at curves to help drivers observe the road conditions on the other side. However, due to the complex road conditions at curves, drivers often cannot see the turning mirrors in time. Furthermore, turning mirrors are generally wide-angle mirrors with cluttered information on the mirror surface, failing to focus on the road scene that the driver wants to see. Therefore, traditional turning mirrors have low visibility and limited effectiveness in improving traffic safety on curves. Summary of the Invention

[0003] The purpose of this invention is to provide a method, device, and storage medium for configuring a vehicle with a cornering mirror recognition-based cornering warning system, so as to realize the real-time observation of the cornering mirror as described in the background art, and to provide warnings to the driver of the vehicle and all oncoming people and vehicles within the cornering range.

[0004] To achieve the above objectives, the present invention provides a method for road safety warning based on cornering mirror recognition, comprising:

[0005] A method for warning vehicles on curves based on turning mirror recognition, applied to a vehicle equipped with a forward-facing camera, the method comprising:

[0006] Acquire an image of the area in front of the vehicle, and use the image to identify whether a turning mirror is present in front of the vehicle.

[0007] When the vehicle is traveling in front of the turning mirror, the forward-looking camera captures the road information displayed on the mirror surface of the turning mirror. The road information includes the road image captured by the forward-looking camera and displayed on the mirror surface of the turning mirror.

[0008] When a turning mirror is present in front of the vehicle, warning messages are issued both inside and outside the vehicle.

[0009] According to the above-mentioned technical means, the method for identifying whether a turning mirror exists in front of a vehicle through the image of the vehicle's front includes:

[0010] Extract the contour information from the image of the vehicle's forward movement;

[0011] The outline information is compared with the graphics in the turning mirror graphic library, which includes graphics of multiple preset turning mirror shapes.

[0012] Furthermore, when a target contour in the contour information matches any one of the graphics in the turning mirror graphics library, the vehicle headlights flash. During the flashing process, the difference in reflected light brightness between the target contour and the objects surrounding the contour is detected in the image in front of the vehicle. When the difference in reflected light brightness between the target contour and the objects surrounding the target contour is greater than a preset brightness threshold, it is determined that there is a turning mirror in front of the vehicle.

[0013] According to the above-mentioned technical means, when there is a turning mirror in front of the vehicle, the vehicle issues a warning message. The warning includes external warning and internal warning. External warning methods include: flashing headlights and honking the horn; internal warning methods include: sound alarm and displaying the mirror image on the turning mirror on the vehicle's central control screen.

[0014] Based on the above technical means, the contour information of the road vehicle forward image displayed on the turning mirror is extracted, including:

[0015] The road vehicle forward image displayed on the turning mirror is processed to obtain a binarized image; edge detection is performed on the binarized image to obtain the road surface edge contour in front of the vehicle in the turning mirror image.

[0016] Furthermore, the image range of the vehicle's driving direction displayed on the vehicle's central control screen includes:

[0017] The turning mirror displays an image within the outline of the road surface in front of the vehicle.

[0018] The turning mirror displays images of the road shoulders on the left and right sides outside the road edge outline in front of the vehicle.

[0019] A cornering warning device based on cornering mirror recognition is applied to a vehicle equipped with a forward-facing camera. The device includes: a memory, a processor, a forward-facing camera, a warning module, a cornering mirror recognition module, a road information collection module, and a central control screen display range processing module.

[0020] The memory, processor, forward-facing camera, warning module, turning mirror recognition module, road information collection module, and central control screen display range processing module are all interconnected with the processor. The memory stores computer instructions, and the processor executes the computer instructions to perform the warning method described in claim 1 or 3.

[0021] The turning mirror recognition module is used to acquire an image of the front of the vehicle and to identify whether a turning mirror is present in front of the vehicle based on the image.

[0022] The warning module sends an alarm message inside and outside the vehicle when a turning mirror is in front of the vehicle.

[0023] The road information acquisition module is used to acquire road information displayed on the mirror surface of the turning mirror through the forward-looking camera when the turning mirror is in front of the vehicle. The road information includes the road image displayed on the mirror surface of the turning mirror acquired by the forward-looking camera.

[0024] The central control screen display range processing module is used to generate a road outline based on the road information displayed on the turning mirror, and display the image of the range as described in claim 5 on the vehicle's central control screen.

[0025] Furthermore, the warning module includes: a vehicle central control screen, an in-vehicle sound alarm, vehicle headlights, and a horn.

[0026] Furthermore, the human-machine interface includes: a vehicle central control screen; the human-machine interface has two functions, including: displaying the road image displayed on the turning mirror, and setting the vehicle's internal and external warning methods and selecting specific warning items.

[0027] Furthermore, the aforementioned vehicle interior and exterior warning settings for cornering and the selection of specific warning items include:

[0028] In-car audible alarm: On or Off;

[0029] The vehicle's central control screen displays: On or Off;

[0030] Vehicle headlights flashing: On or off;

[0031] Sound the horn: to turn on or off.

[0032] This invention also provides a computer-readable storage medium storing computer instructions, which are used to cause a computer to execute the warning method according to any one of claims 1 to 9.

[0033] Significance of this invention:

[0034] Collecting road information ahead using the vehicle's forward-facing camera and promptly identifying and issuing warnings via turn-by-turn mirrors has two significant implications. First, for the driver, the audible alarm immediately alerts them to the presence of a turn-by-turn mirror. The vehicle's central control screen, however, displays an image only of the road surface and objects within a limited shoulder area, as turn-by-turn mirrors are typically wide-angle mirrors. This allows for a clearer view of the road conditions on the other side of the curve. Second, for all vehicles and pedestrians within the curve's radius, the timely warning provides advance notice of an approaching vehicle on the other side of the curve. The headlight flashes, reflected by the turn-by-turn mirror, naturally increase the attention of those being warned. Therefore, implementing a turn-by-turn mirror-based warning system, including its methods, devices, and storage media, will greatly enhance the effectiveness of turn-by-turn mirrors and significantly improve driving safety on curves.

[0035] Figure 1 Flowchart of methods for warning vehicles on curves;

[0036] Figure 2 Flowchart for the inspection and verification of turning mirrors;

[0037] Figure 3 Vehicle central control screen display range confirmation process;

[0038] Figure 4 Block diagram of a curve driving warning device;

[0039] Figure 5 A diagram illustrating the warning settings.

[0040] The labels in the diagram represent:

[0041] 1. Human-machine interface; 2. Memory; 3. Processor; 4. Warning module; 5. Forward-facing camera; 6. Road information collection module; 7. Turning mirror recognition module; 8. Central control screen display range processing module; 100. Vehicle central control screen; 101. In-vehicle sound alarm; 102. Vehicle headlights; 103. Horn. Detailed Implementation

[0042] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0043] According to embodiments of the present invention, a method, apparatus, and storage medium for cornering warning based on cornering mirror recognition are provided. It should be noted that the steps shown in the flowcharts in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowcharts, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0044] like Figure 1 As shown, the curve driving warning method based on turning mirror recognition includes the following steps:

[0045] S1. A curve driving warning method based on turning mirror recognition, applied to a vehicle, wherein the vehicle is equipped with a forward-view camera, and the forward-view camera is used to obtain the image of the vehicle's front when it is driving;

[0046] S2. Process the image of the vehicle ahead acquired by the forward-view camera to determine whether there is a turning mirror in front of the vehicle.

[0047] S3. When it is determined that there is a turning mirror in front of the vehicle, warning messages are issued simultaneously inside and outside the vehicle.

[0048] like Figure 2 As shown, identifying the presence of a turning mirror in front of the vehicle using the image of the vehicle's path includes:

[0049] Extract the contour information from the image of the vehicle's forward movement;

[0050] The outline information is compared with the graphics in the turning mirror graphic library, which includes graphics of multiple preset turning mirror shapes.

[0051] When a target contour in the contour information matches any one of the graphics in the turning mirror graphics library, the vehicle headlights flash. During the flashing process, the difference in reflected light brightness between the target contour and the objects surrounding the contour is detected in the image in front of the vehicle. When the difference in reflected light brightness between the target contour and the objects surrounding the target contour is greater than a preset brightness threshold, it is determined that there is a turning mirror in front of the vehicle.

[0052] Furthermore, when a turning mirror is present in front of the vehicle, the vehicle issues a warning message, including external warnings and internal warnings. External warnings include flashing headlights and honking the horn; internal warnings include sound alarms and displaying the mirror image on the turning mirror on the vehicle's central control screen.

[0053] The purpose of the in-vehicle warning is for the driver of the vehicle. Upon hearing the warning, the driver will naturally pay attention to the turning mirror and observe the mirror surface.

[0054] External warnings are provided to all vehicles and pedestrians entering the curve area, and their actual range of effect exceeds what the turning mirror itself can display.

[0055] Furthermore, such as Figure 3 As shown:

[0056] Extracting contour information from the road vehicle forward image displayed on the turning mirror, including:

[0057] The road vehicle forward image displayed on the turning mirror is processed to obtain a binarized image; edge detection is performed on the binarized image to obtain the road surface edge contour in front of the vehicle in the turning mirror image.

[0058] Preferably, the image range of the vehicle's front direction displayed on the vehicle's central control screen includes:

[0059] The turning mirror displays an image within the outline of the road surface in front of the vehicle.

[0060] The turning mirror displays images of the road shoulders on both sides outside the road edge outline in front of the vehicle in the image.

[0061] Turning mirrors are usually wide-angle mirrors with a wide display range, but they cannot focus on what the driver wants to see. The method of the present invention, however, allows the driver to clearly obtain the road conditions ahead by displaying road and shoulder images only on the vehicle's central control screen.

[0062] like Figure 4 A cornering warning device based on turning mirror recognition is characterized in that it is applied to a vehicle, the vehicle is equipped with a forward-looking camera, and the device includes: a vehicle central control screen 100, a memory 2, a processor 3, a warning module 4, a forward-looking camera 5, a road information collection module 6, a turning mirror recognition module 7, and a central control screen display range processing module 8.

[0063] The memory 2, forward-facing camera 5, warning module 4, turning mirror recognition module 7, road information collection module 6, and central control screen display range processing module 8 are all interconnected with the processor 3. The memory 2 stores computer instructions, and the processor 3 executes the warning method by executing the computer instructions.

[0064] The turning mirror recognition module 7 is used to acquire an image of the front of the vehicle and to identify whether a turning mirror is present in front of the vehicle based on the image of the front of the vehicle.

[0065] Warning module 4: When a turning mirror is present in front of the vehicle, an alarm message is issued both inside and outside the vehicle.

[0066] The road information acquisition module 6 is used to acquire road information displayed on the mirror surface of the turning mirror through the forward-view camera 5 when the turning mirror is in front of the vehicle. The road information includes the road image displayed on the mirror surface of the turning mirror acquired by the forward-view camera 5.

[0067] The central control screen display range processing module 8 is used to generate a road outline based on the road information displayed on the turning mirror, and display the above-mentioned range on the vehicle's central control screen 100.

[0068] Furthermore, the warning module 4 includes: a vehicle central control screen 100, an in-vehicle sound alarm 101, a vehicle headlight 102, and a horn 103.

[0069] Furthermore, the human-machine interface 1 includes: a vehicle central control screen 100; the human-machine interface 1 has two functions, including: displaying the road surface and shoulder images displayed on the turning mirror, and setting the vehicle's internal and external warning methods and selecting specific warning items.

[0070] Furthermore, the device of the present invention is applied to a vehicle, and the hardware of each module constituting the device is an existing configuration of the vehicle.

[0071] like Figure 5 As shown, the vehicle's internal and external warning settings for cornering and the selection of specific warning items are implemented through the human-machine interface (vehicle central control screen) 1, including:

[0072] In-car audible alarm: On or Off;

[0073] The vehicle's central control screen displays: On or Off;

[0074] Vehicle headlights flashing: On or off;

[0075] Sound the horn: to turn on or off.

[0076] This is a feature designed to adapt to the environment and human preferences. For example, in situations where honking is prohibited, turning off the horn can prevent corresponding illegal behavior.

[0077] Furthermore, a computer-readable storage medium is provided, characterized in that computer instructions are stored on the computer-readable storage medium, the computer instructions being used to cause a computer to execute the warning method described in this invention.

[0078] The present invention provides a method, device, and storage medium for cornering mirror recognition-based cornering warnings. Without increasing vehicle hardware configuration, it enables the detection and confirmation of cornering mirrors. By detecting the edges of the road surface, a suitable road image for the driver's observation is determined. The flashing of headlights and the horn not only enhance the effectiveness of the cornering mirrors but also expand their actual range of operation. The implementation of this cornering mirror recognition-based cornering warning method, device, and storage medium is of great significance for cornering driving safety.

[0079] It should be understood that the application of the present invention is not limited to the examples above. Once those skilled in the art learn the basic inventive concept, they can improve or modify the above description. Therefore, the appended claims are intended to be interpreted as including the embodiments and all changes and modifications that fall within the scope of this application.

[0080] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application, and all such improvements and variations should fall within the protection scope of the appended claims.

Claims

1. A method for providing warnings on curved roads based on turning mirror recognition, characterized in that, Applied to a vehicle equipped with a forward-facing camera, the method includes: Acquire an image of the area in front of the vehicle, and use the image to identify whether a turning mirror is present in front of the vehicle. When the vehicle is traveling in front of the turning mirror, the forward-looking camera captures the road information displayed on the mirror surface of the turning mirror. The road information includes the road image captured by the forward-looking camera and displayed on the mirror surface of the turning mirror. When a turning mirror is present in front of the vehicle, warning messages are issued both inside and outside the vehicle.

2. The method according to claim 1, characterized in that, Identifying the presence of a turning mirror in front of the vehicle using the image of the vehicle's path includes: Extract the contour information from the image of the vehicle's forward movement; The outline information is compared with the graphics in the turning mirror graphic library, which includes graphics of multiple preset turning mirror shapes. When a target contour in the contour information matches any one of the graphics in the turning mirror graphics library, the vehicle headlights flash. During the flashing process, the difference in reflected light brightness between the target contour and the objects surrounding the contour is detected in the image in front of the vehicle. When the difference in reflected light brightness between the target contour and the objects surrounding the target contour is greater than a preset brightness threshold, it is determined that there is a turning mirror in front of the vehicle.

3. The method according to claim 1, characterized in that... When a turning mirror is in front of the vehicle, the vehicle issues a warning message. The warning includes external warnings and internal warnings. External warnings include: flashing headlights and honking the horn. Internal warnings include: sound alarm and displaying the mirror image on the vehicle's central control screen.

4. The method according to claims 1-3, characterized in that... Extracting contour information from the road vehicle forward image displayed on the turning mirror, including: The road vehicle forward image displayed on the turning mirror is processed to obtain a binarized image; edge detection is performed on the binarized image to obtain the road surface edge contour in front of the vehicle in the turning mirror image.

5. The method according to claim 3 or 4, characterized in that, The area of ​​the image in front of the vehicle displayed on the vehicle's central control screen includes: The turning mirror displays an image within the outline of the road surface in front of the vehicle. The turning mirror displays images of the road shoulders on the left and right sides outside the road edge outline in front of the vehicle.

6. A cornering warning device based on cornering mirror recognition, characterized in that, Applied to vehicles, the vehicles are equipped with a forward-looking camera, and the device includes: a human-machine interface, a memory, a processor, a forward-looking camera, a warning module, a turning mirror recognition module, a road information collection module, and a central control screen display range processing module; The human-machine interface, memory, forward-facing camera, warning module, turning mirror recognition module, road information collection module, and central control screen display range processing module are all interconnected with the processor. The memory stores computer instructions, and the processor executes the computer instructions to perform the warning method described in claim 1 or 3. The turning mirror recognition module is used to acquire an image of the front of the vehicle and to identify whether a turning mirror is present in front of the vehicle based on the image. The warning module issues an alarm message both inside and outside the vehicle when a turning mirror is in front of the vehicle. The road information acquisition module is used to acquire road information displayed on the mirror surface of the turning mirror through the forward-looking camera when the turning mirror is in front of the vehicle. The road information includes the road image displayed on the mirror surface of the turning mirror acquired by the forward-looking camera. The central control screen display range processing module is used to generate a road outline based on the road information displayed on the turning mirror, and display the image of the range as described in claim 5 on the vehicle's central control screen.

7. The warning module according to claim 6, characterized in that: The vehicle's central control screen, in-vehicle sound alarm, headlights, and horn.

8. The human-machine interface according to claim 7, characterized in that: Vehicle center console screen; The human-machine interface has two functions, including: displaying the road image as described in claims 5 and 6, setting the vehicle's internal and external warning methods, and selecting the specific warning items.

9. The vehicle interior and exterior warning system settings and specific warning item selection for curved driving as described in claim 8, including: In-car audible alarm: On or Off; The vehicle's central control screen displays: On or Off; Vehicle headlights flashing: On or off; Sound the horn: to turn on or off.

10. A computer-readable storage medium. The computer-readable storage medium stores computer instructions for causing a computer to execute the warning method according to any one of claims 1 to 9.

Images