Information prompting method and device during vehicle driving

By obtaining the image information of the front and rear view of the vehicle in real time, we can judge the risk type when changing lanes or turning and generate prompt information, which solves the risk of accidents caused by blind spots in the vehicle's vision when changing lanes or turning, and improves the driver's attention and Vehicle safety.

CN118928215APending Publication Date: 2024-11-12GUANGZHOU XIAOPENG MOTORS TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411162187.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-22
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

There are blind spots in the field of vision when changing lanes or turning, making it difficult for drivers to fully observe the progress of other vehicles or pedestrians, distract themselves, and increase the risk of accidents.

Method used

By obtaining the image information of the front and rear field of view on the vehicle in real time, we can judge the risk type when changing lanes or turning, and generate corresponding prompt information, including visual and voice prompts, to assist the driver in making lanes or turning judgments.

Benefits of technology

It improves the driver's attention concentration, explicitly prompts the vehicle's collision risk when turning, reduces the incidence of accidents, enhances the safety of the vehicle, and provides drivers with a convenient and intelligent user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118928215A_ABST
    Figure CN118928215A_ABST
Patent Text Reader

Abstract

The invention provides an information prompting method and device during vehicle driving, and relates to the technical field of vehicle control. According to the scheme, in the running process of the vehicle, the image information in the front view of the vehicle and the image information in the rear view of the vehicle are obtained in real time, namely the front side image information and the rear side image information, and the risk type of the vehicle during lane changing or turning is judged according to the front side image information and the rear side image information; a driver does not need to observe the advancing condition of other vehicles or pedestrians through a rearview mirror, so that the attention of the driver is improved; meanwhile, according to the risk type, prompt information corresponding to the risk type is generated to prompt a user that the collision risk and the risk degree exist during steering of the vehicle, namely, more explicit risk prompt is conducted on a driver, the purpose of assisting the driver in lane changing or turning judgment is achieved, the accident rate in the vehicle driving process is reduced, and the driving safety of the vehicle is improved. The safety of the vehicle is improved, and more convenient and intelligent vehicle use experience is provided for a driver.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle control, and in particular to a method and device for providing information when a vehicle is traveling. Background Art

[0002] Usually, when a vehicle changes lanes or turns, there are blind spots in the field of vision, which poses a risk of collision and easily increases the probability of a vehicle accident.

[0003] In the prior art, when a vehicle is changing lanes or turning, the driver needs to actively observe the movement of other vehicles through the rearview mirror to avoid vehicles or pedestrians on the side of the vehicle and maintain a safe distance. At the same time, the driver must always observe their driving status and take preventive measures.

[0004] However, this active observation method makes it difficult for the driver to fully observe these situations, and it will distract the driver's attention, posing certain safety risks. Summary of the invention

[0005] The purpose of the present invention is to provide a method and device for providing information prompts when a vehicle is driving, in order to improve the safety of the vehicle when driving, in view of the above-mentioned deficiencies in the prior art.

[0006] To achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:

[0007] In a first aspect, an embodiment of the present application provides a method for providing information when a vehicle is driving, the method comprising:

[0008] When the vehicle is traveling, obtaining rear image information and front image information, wherein the front image information is image information in the front field of view of the vehicle, and the rear image information is image information in the rear field of view of the vehicle;

[0009] Determining the risk type of the vehicle when turning according to the rear image information, the front image information and the turning type of the vehicle, wherein the turning type includes: changing lanes or turning;

[0010] According to the risk type, prompt information corresponding to the risk type is generated to prompt the user that the vehicle has a collision risk and the degree of risk when turning.

[0011] Optionally, determining the risk type of the vehicle when turning according to the rear image information, the front image information and the turning type of the vehicle includes:

[0012] If the turning type is lane change, determining whether there is a first target object in the rear field of view of the vehicle according to the rear image information, wherein the first target object is an object located in the rear field of view of the vehicle and in a moving state;

[0013] If the first target object exists, determining first distance information between the vehicle and the first target object according to the rear image information and pre-constructed calibration information;

[0014] The risk type of the vehicle when changing lanes is determined according to the first distance information and the type of the first target object.

[0015] Optionally, the first distance information includes: a first horizontal distance and a first vertical distance;

[0016] The determining, according to the first distance information and the type of the first target object, the risk type of the vehicle when changing lanes includes:

[0017] If the first target object is a vehicle and the first lateral distance is less than a preset first safety lateral distance, the risk type of the vehicle when changing lanes is determined based on the first longitudinal distance, the preset first safety longitudinal distance, and the preset second safety longitudinal distance.

[0018] Optionally, determining the risk type of the vehicle when changing lanes according to the first longitudinal distance, a preset first safety longitudinal distance, and a preset second safety longitudinal distance includes:

[0019] If the first longitudinal distance is less than the first safe longitudinal distance, determining that the risk type of the vehicle when changing lanes is high risk;

[0020] If the first longitudinal distance is between the first safe longitudinal distance and the second safe longitudinal distance, it is determined that the risk type of the vehicle when changing lanes is low risk.

[0021] Optionally, determining the risk type of the vehicle when changing lanes according to the first distance information and the type of the first target object includes:

[0022] If the type of the first target object is non-vehicle and the first lateral distance is less than the preset second safety lateral distance, the risk type of the vehicle when changing lanes is determined based on the first longitudinal distance, the preset first safety longitudinal distance and the preset second safety longitudinal distance.

[0023] Optionally, determining the risk type of the vehicle when changing lanes according to the first longitudinal distance, the preset first safety longitudinal distance, and the preset second safety longitudinal distance includes:

[0024] If the first longitudinal distance is less than the first safe longitudinal distance, determining that the risk type of the vehicle when changing lanes is high risk;

[0025] If the first longitudinal distance is between the first safe longitudinal distance and the second safe longitudinal distance, it is determined that the risk type of the vehicle when changing lanes is low risk.

[0026] Optionally, determining the risk type of the vehicle when turning according to the rear image information, the front image information and the turning type of the vehicle includes:

[0027] If the steering type is turning, determining whether there is a second target object in the front field of view of the vehicle according to the front image information, wherein the second target object is a non-vehicle in a moving state;

[0028] If the second target object exists, determining second distance information between the vehicle and the second target object according to the front image information and pre-constructed calibration information;

[0029] According to the second distance information, the risk type of the vehicle when changing lanes is determined.

[0030] Optionally, the second distance information includes: a second horizontal distance and a second vertical distance;

[0031] When the second lateral distance is less than a preset second safe lateral distance, determining the risk type of the vehicle when changing lanes according to the second distance information includes:

[0032] If the second longitudinal distance is less than a preset first safety longitudinal distance, determining that the risk type of the vehicle when turning is high risk;

[0033] If the second longitudinal distance is between the first safety longitudinal distance and a preset second safety longitudinal distance, it is determined that the risk type of the vehicle when turning is low risk.

[0034] Optionally, generating prompt information corresponding to the risk type according to the risk type includes:

[0035] If the risk type is low risk, the first target object in the rear image information or the second target object in the front image information is marked and displayed using a first color, and a voice prompt message is generated;

[0036] If the risk type is high risk, the first target object in the rear image information or the second target object in the front image information is marked and displayed with a second color, and a voice prompt message is generated to control the seat belt on the vehicle to perform a tightening operation and turn on a pre-set recording function on the vehicle.

[0037] In a second aspect, an embodiment of the present application further provides an information prompt device when a vehicle is driving, the device comprising: a control unit, a first shooting unit and a second shooting unit, the control unit is connected to the first shooting unit and the second shooting unit respectively, the first shooting unit is arranged at the front of the vehicle, and the second shooting unit is arranged at the rear of the vehicle;

[0038] The first shooting unit is used to collect front image information in the field of view in front of the vehicle when the vehicle is traveling, and send the front image information to the control unit;

[0039] The second shooting unit is used to collect rear image information within the rear field of view of the vehicle when the vehicle is traveling, and send the rear image information to the control unit;

[0040] The control unit is used to execute the vehicle driving information prompt method provided in the first aspect.

[0041] In the third aspect, an embodiment of the present application also provides a control unit, comprising: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the control unit is running, the processor communicates with the storage medium through the bus, and the processor executes the machine-readable instructions to execute the method for information prompting during vehicle driving as provided in the first aspect above.

[0042] The beneficial effects of this application are:

[0043] The embodiments of the present application provide a method and device for prompting information when a vehicle is driving. In this solution, while the vehicle is driving, image information in the field of view in front of the vehicle and image information in the field of view behind the vehicle, i.e., front image information and rear image information, are acquired in real time, and the risk type of the vehicle when changing lanes or turning is judged based on the front image information and the rear image information, i.e., the driver does not need to observe the forward conditions of other vehicles or pedestrians through the rearview mirror, thereby improving the driver's attention; at the same time, prompt information corresponding to the risk type is generated based on the risk type, so as to prompt the user that the vehicle has a collision risk and the degree of risk when turning, i.e., a more explicit risk prompt is provided to the driver, thereby achieving the purpose of assisting the driver in making lane change or turning judgments, reducing the accident rate during vehicle driving, improving the safety of the vehicle, and providing the driver with a more convenient and intelligent car use experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0045] Figure 1 A schematic diagram of the structure of a vehicle driving information prompting device provided in an embodiment of the present application;

[0046] Figure 2 A schematic diagram of a flow chart of a method for providing information prompts when a vehicle is driving provided in an embodiment of the present application;

[0047] Figure 3 A schematic diagram of a flow chart of another method for providing information prompts when a vehicle is traveling provided in an embodiment of the present application;

[0048] Figure 4 A schematic diagram of the distance between a vehicle and other vehicles when the vehicle is traveling provided in an embodiment of the present application;

[0049] Figure 5 A flowchart of another method for providing information prompts when a vehicle is driving provided in an embodiment of the present application;

[0050] Figure 6 A schematic diagram of a flow chart of another method for providing information prompts when a vehicle is traveling provided in an embodiment of the present application;

[0051] Figure 7 A schematic diagram of the structure of a control unit provided in an embodiment of the present application.

[0052] Icon: 101 - control unit; 102 - first shooting unit; 103 - second shooting unit. DETAILED DESCRIPTION

[0053] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the drawings in the present application only serve the purpose of explanation and description and are not used to limit the scope of protection of the present application. In addition, it should be understood that the schematic drawings are not drawn in real proportion. The flowchart used in this application shows the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowchart can be implemented out of sequence, and the steps without logical context can be reversed in order or implemented simultaneously. In addition, those skilled in the art can add one or more other operations to the flowchart under the guidance of the content of the present application, or remove one or more operations from the flowchart.

[0054] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0055] It should be noted that the term "comprising" will be used in the embodiments of the present application to indicate the existence of the features declared thereafter, but does not exclude the addition of other features.

[0056] The structure of the vehicle driving information prompting device provided by the present application will be introduced in detail through the following embodiments.

[0057] Figure 1 This is a schematic diagram of the structure of the vehicle driving information prompt device provided by this application, such as Figure 1 As shown, the device includes: a control unit 101, a first shooting unit 102 and a second shooting unit 103, the control unit 101 is connected to the first shooting unit 102 and the second shooting unit 103 respectively, the first shooting unit 102 is arranged at the front of the vehicle, and the second shooting unit 103 is arranged at the rear of the vehicle.

[0058] For example, the first shooting unit 102 and the second shooting unit 103 may be stereo cameras with shooting functions, and may be used to shoot image information within the field of view of the vehicle. For example, the first shooting unit 102 is disposed at the front of the vehicle, such as the left front side and the right front side; and the second shooting unit 103 is disposed at the rear of the vehicle, such as the left rear side and the right rear side.

[0059] The control unit 101 may be an on-board control unit on a vehicle, and has a data processing function.

[0060] The first photographing unit 102 is used to collect the front image information in the front field of view of the vehicle when the vehicle is traveling, and send the front image information to the control unit 101; the second photographing unit 103 is used to collect the rear image information in the rear field of view of the vehicle when the vehicle is traveling, and send the rear image information to the control unit 101;

[0061] The control unit 101 is used to execute the vehicle driving information prompt method provided in the following embodiment to prompt the driver of the collision risk and the degree of risk when the vehicle is turning, that is, it can assist the driver to observe the forward conditions of other vehicles in all directions, reduce the accident rate during vehicle driving, improve the safety of the vehicle, and provide the driver with a more convenient and intelligent car use experience.

[0062] The implementation principle and corresponding beneficial effects of the vehicle driving information prompt method steps provided in this application will be explained through multiple specific embodiments as follows.

[0063] refer to Figure 2 As shown, it is a flow chart of a method for providing information prompts when a vehicle is driving provided by an embodiment of the present application; optionally, the execution subject of the method may be the above-mentioned Figure 1 It should be understood that in other embodiments, the order of some steps in the method for providing information when the vehicle is traveling can be interchanged according to actual needs, or some steps can be omitted or deleted. Figure 2 As shown, the method includes:

[0064] S201. Acquire rear side image information and front side image information while the vehicle is traveling.

[0065] Among them, the rear image information is the image information within the field of view behind the vehicle, and the front image information is the image information within the field of view in front of the vehicle.

[0066] In one possible implementation, for example, during vehicle travel, Figure 1 The first shooting unit in the vehicle collects image information in the front field of view of the vehicle in real time, that is, front side image information; and Figure 1 The second camera unit in the system collects the image information in the rear field of view of the vehicle, namely the rear image information, in real time. Therefore, the driver can be assisted to observe the forward situation of other vehicles or pedestrians in all directions based on the rear image information and the front image information, without the need for the driver to observe through the rearview mirror, thus improving the driver's attention.

[0067] S202: Determine the risk type of the vehicle when turning according to the rear image information, the front image information and the turning type of the vehicle.

[0068] Among them, the steering type includes: changing lanes or turning. Changing lanes means driving the vehicle from the current lane to another lane. Turning includes: turning left and turning right.

[0069] It is understandable that when a vehicle changes lanes or turns, there is a blind spot on the turning side (the B-pillar blind spot on the lane-changing side when changing lanes, and the A-pillar blind spot on the turning side when turning at an intersection), which poses a collision risk and causes the driver to lack a sense of security. Therefore, by calling the side rear and side front cameras, the corresponding side image can be automatically popped up when the corresponding scene is identified, so that the driver can check the environment on the turning side, increase a sense of security, and reduce the risk of collision.

[0070] In this embodiment, in order to reduce the collision risk of the vehicle when turning, it is proposed that the risk type of the vehicle when changing lanes or turning, i.e. low risk or high risk, can be judged based on the rear image information, the front image information and the steering type of the vehicle.

[0071] S203. Generate prompt information corresponding to the risk type according to the risk type to prompt the user that there is a collision risk and the degree of risk when the vehicle turns.

[0072] In this embodiment, prompt information corresponding to the risk type can be generated according to different risk types. For example, when the risk type of the vehicle when changing lanes or turning is low risk, a voice prompt information is generated, such as the risk level of turning right is low risk, do not turn right, to remind the user that the vehicle has a collision risk and the risk level when turning, reducing the accident rate during vehicle driving, improving vehicle safety, and providing drivers with a more convenient and intelligent car experience.

[0073] In summary, the embodiment of the present application provides a method for providing information prompts when a vehicle is driving. In this solution, while the vehicle is driving, image information in the field of view in front of the vehicle and image information in the field of view behind the vehicle, i.e., front image information and rear image information, are acquired in real time, and the risk type of the vehicle when changing lanes or turning is judged based on the front image information and the rear image information, i.e., the driver does not need to observe the movement of other vehicles or pedestrians through the rearview mirror, thereby improving the driver's attention; at the same time, prompt information corresponding to the risk type is generated based on the risk type, so as to remind the user that there is a collision risk and the degree of risk when the vehicle is turning, i.e., a more explicit risk prompt is provided to the driver, thereby achieving the purpose of assisting the driver in making lane change or turning judgments, reducing the accident rate during vehicle driving, improving the safety of the vehicle, and providing the driver with a more convenient and intelligent car use experience.

[0074] The following example will explain in detail how to determine the risk type of the vehicle when turning according to the turning type of the vehicle.

[0075] The first one: changing lanes

[0076] Optionally, refer to Figure 3 As shown, the above step S202 includes:

[0077] S301: If the turning type is lane change, determine whether there is a first target object in the rear field of view of the vehicle based on the rear image information.

[0078] The first target object is an object located in the rear field of view of the vehicle and in a moving state. For example, the first target object is a vehicle, a pedestrian, a person driving a non-motor vehicle (such as an automatic car, an electric car, a tricycle, etc.), a pet (such as a cat, a dog), etc.

[0079] S302: If there is a first target object, determine first distance information between the vehicle and the first target object according to the rear image information and pre-constructed calibration information.

[0080] The pre-built calibration information refers to the relationship between the real field of view of the calibration camera and the distance between the object in the image and the vehicle.

[0081] S303: Determine a risk type of the vehicle when changing lanes according to the first distance information and the type of the first target object.

[0082] The types of the first target object include vehicles and non-vehicles.

[0083] Optionally, when the vehicle's turning type is lane change, it can be detected based on the collected rear image information whether there is a first target object in the rear field of view of the vehicle. If a moving object is identified in the rear field of view of the vehicle, the first distance information between the vehicle and the first target object is calculated based on the multiple frames of images in the rear image information and the pre-constructed calibration information. Based on the first distance information and the type of the first target object, it is determined whether the risk type of the vehicle when changing lanes is high risk or low risk.

[0084] Optionally, refer to Figure 4 As shown, the first distance information includes: a first horizontal distance and a first vertical distance; the above step S303 includes:

[0085] If the first target object is a vehicle and the first lateral distance is less than a preset first safety lateral distance, the risk type of the vehicle when changing lanes is determined based on the first longitudinal distance, the preset first safety longitudinal distance, and the preset second safety longitudinal distance.

[0086] Exemplarily, for example, the first safe lateral distance is 5 m.

[0087] In this embodiment, for example, when the type of the first target object is a vehicle, the first lateral distance between vehicle 1 and other vehicles is first determined, and vehicle 2 with the smallest lateral distance is regarded as a potential risk object. For example, when the first lateral distance between vehicle 1 and vehicle 2 is greater than or equal to 5m, that is, the lanes in which vehicle 2 and vehicle 1 are traveling are cross-lanes, it can be determined that there is no risk of collision between vehicle 1 and vehicle 2 when changing lanes; when the first lateral distance between vehicle 1 and vehicle 2 is less than 5m, it can be determined that there is a potential risk, and it is necessary to further determine the risk type of vehicle 1 when changing lanes based on the first longitudinal distance between vehicle 1 and vehicle 2, the preset first safety longitudinal distance, and the preset second safety longitudinal distance, so as to improve the accuracy of the determination result.

[0088] Optionally, the determining the risk type of the vehicle when changing lanes according to the first longitudinal distance, the preset first safety longitudinal distance, and the preset second safety longitudinal distance includes:

[0089] In the first case, if the first longitudinal distance is less than the first safe longitudinal distance, it is determined that the risk type of the vehicle when changing lanes is high risk.

[0090] In one feasible manner, for example, when the first longitudinal distance between the front ends of vehicle 1 and vehicle 2 is less than 1 m, that is, the distance between vehicle 1 and vehicle 2 is relatively close, it can be determined that there is a risk of collision between vehicle 1 and vehicle 2 when changing lanes, and the risk type is high risk.

[0091] In the second case, if the first longitudinal distance is between the first safe longitudinal distance and the second safe longitudinal distance, it is determined that the risk type of the vehicle when changing lanes is low risk.

[0092] Exemplarily, for example, the second safety longitudinal distance is 5 m.

[0093] In one feasible manner, for example, when the first longitudinal distance between the front ends of vehicle 1 and vehicle 2 is between 1m and 5m, that is, greater than 1m and less than 5m, it can be determined that there is a risk of collision between vehicle 1 and vehicle 2 when changing lanes, and the risk type is low risk.

[0094] Optionally, the above step S303 includes:

[0095] If the type of the first target object is non-vehicle and the first lateral distance is less than the preset second safety lateral distance, the risk type of the vehicle when changing lanes is determined based on the first longitudinal distance, the preset first safety longitudinal distance and the preset second safety longitudinal distance.

[0096] Exemplarily, for example, the second safety lateral distance is 2 m.

[0097] Optionally, when the type of the first target object is different, the safety distance used is also different. Therefore, when the type of the first target object is non-vehicle, such as a pedestrian, if the first lateral distance between vehicle 1 and pedestrian 1 is greater than or equal to 2m, it can be determined that there is no collision risk for vehicle 1; if the first lateral distance between vehicle 1 and pedestrian 1 is less than 2m, it can be determined that there is a collision risk, and it is necessary to further determine the risk type of the vehicle when changing lanes based on the first longitudinal distance, the first safety longitudinal distance, and the second safety longitudinal distance to improve the accuracy of the determination result.

[0098] Optionally, the above step of determining the risk type of the vehicle when changing lanes according to the first longitudinal distance, the preset first safety longitudinal distance, and the preset second safety longitudinal distance includes:

[0099] First, if the first longitudinal distance is less than the first safe longitudinal distance, it is determined that the risk type of the vehicle when changing lanes is high risk.

[0100] In one feasible manner, for example, when the first longitudinal distance between vehicle 1 and pedestrian 1 is less than 1 m, that is, the distance between vehicle 1 and pedestrian 1 is relatively close, it can be determined that there is a risk of collision between vehicle 1 and pedestrian 1 when changing lanes, and the risk type of collision is high risk.

[0101] Second, if the first longitudinal distance is between the first safe longitudinal distance and the second safe longitudinal distance, it is determined that the risk type of the vehicle when changing lanes is low risk.

[0102] In another achievable manner, for example, when the first longitudinal distance between vehicle 1 and pedestrian 1 is between 1m and 5m, that is, greater than 1m and less than 5m, it can be determined that there is a risk of collision between vehicle 1 and pedestrian 1 when changing lanes, and the risk type of collision is low risk.

[0103] Optionally, in this embodiment, when judging the risk type when the vehicle changes lanes, the rear image information can be used to determine whether there is a potential collision object in the rear field of view of the vehicle. If so, the risk type of the vehicle when changing lanes is further determined based on the type of the vehicle and the potential collision object, so that the driver can determine whether to perform the lane change operation based on the determined risk type, thereby increasing the safety of the vehicle and reducing the risk of collision.

[0104] Second, turn

[0105] Optionally, refer to Figure 5 As shown, the above step S202 includes:

[0106] S501: If the steering type is turning, determine whether there is a second target object in the front field of view of the vehicle based on the front image information.

[0107] The second target object is a non-vehicle in a moving state. For example, the second target object may be a pedestrian, a person driving a non-motor vehicle (such as an automobile, an electric vehicle, a tricycle, etc.), a pet (such as a cat, a dog), etc.

[0108] S502: If there is a second target object, determine second distance information between the vehicle and the second target object according to the front image information and pre-constructed calibration information.

[0109] S503: Determine the risk type of the vehicle when changing lanes based on the second distance information.

[0110] Optionally, when the vehicle's steering type is turning, such as turning left, the collected front image information can be used to detect whether there is a second target in the front field of view of the vehicle. If a pedestrian is identified in the front field of view of the vehicle, the second distance information between the vehicle and the second target is calculated based on the multiple frames of images in the front image information and the pre-built calibration information, and the risk type of the vehicle when turning is determined to be high risk or low risk based on the second distance information. That is, when turning, the vehicle only needs to determine whether there is a collision risk between the vehicle and other non-vehicles in motion.

[0111] Optionally, the second distance information includes: a second lateral distance and a second longitudinal distance; when the second lateral distance is less than a preset second safety lateral distance, the above step S503 includes:

[0112] If the second longitudinal distance is less than the preset first safety longitudinal distance, the risk type of the vehicle when turning is determined to be high risk; if the second longitudinal distance is between the first safety longitudinal distance and the preset second safety longitudinal distance, the risk type of the vehicle when turning is determined to be low risk.

[0113] Exemplarily, for example, the preset second safety lateral distance is 2 m.

[0114] In one achievable manner, for example, when the second lateral distance between the vehicle 1 and the pedestrian 1 is greater than or equal to 2m, it can be determined that there is no risk of collision between the vehicle 1 and the pedestrian 1 when turning; when the first lateral distance between the vehicle 1 and the pedestrian 1 is less than 2m, and the second longitudinal distance between the vehicle 1 and the pedestrian 1 is less than 1m, it can be determined that the risk type of the vehicle when turning is high risk; for another example, when the first lateral distance between the vehicle 1 and the pedestrian 1 is less than 2m, and the second longitudinal distance between the vehicle 1 and the pedestrian 1 is between 1m and 5m, that is, greater than 1m and less than 5m, it can be determined that the risk type of the vehicle when turning is low risk;

[0115] Optionally, refer to Figure 6 As shown, the above step S203 includes:

[0116] S601: If the risk type is low risk, a first target object in the rear image information or a second target object in the front image information is marked and displayed using a first color, and a voice prompt message is generated.

[0117] In one feasible method, for example, the rear-side image information or the front-side image information collected in real time is displayed on a display screen in the vehicle cab, and the first target object in the rear-side image information or the second target object in the front-side image information is marked and displayed in yellow-orange. At the same time, the edge of the screen on the turning side glows yellow and flashes yellow, and a voice warning is given to inform the driver that there is a potential collision risk when the vehicle changes lanes or turns, and the risk type is low risk.

[0118] S602: If the risk type is high risk, the first target in the rear image information or the second target in the front image information is marked and displayed with a second color, and a voice prompt message is generated to control the seat belt on the vehicle to perform a tightening operation and turn on a pre-set recording function on the vehicle.

[0119] In another feasible manner, for example, the rear image information or the front image information collected in real time is displayed on a display screen in the vehicle cab, and the first target object in the rear image information or the second target object in the front image information is marked and displayed in red. At the same time, the edge of the screen on the turning side glows red and flashes red, and a voice warning is given. If the vehicle still has further deviation movement, a "beep" sound effect is played to strengthen the prompt; at the same time, the seat belts on the vehicle are controlled to tighten to ensure the safety of all passengers in the vehicle. The edge of the turning side on the vehicle instrument also flashes red to strengthen the reminder, and automatically triggers the pre-set recording function on the vehicle to inform the driver that the vehicle has a collision risk when changing lanes or turning, and the risk type is high, that is, the obstacle is basically parallel to the vehicle body and is almost exactly in the blind spot, and the collision risk is high.

[0120] Optionally, in this solution, the reminders of the target objects are differentiated according to different image viewing angles and scenes, as follows:

[0121] 1. For turning and lane changing images (rear side images), moving vehicles and non-vehicles (also known as vulnerable objects) are marked at the same time. Based on the rear side image information, the driver can be assisted in making lane change decisions, and based on the risk type when the vehicle changes lanes, the driver is reminded to pay attention to vehicles or non-vehicles coming from behind. In other words, it is necessary to pay attention to vehicles and non-vehicles in the blind spot at the same time to improve the safety of vehicle driving.

[0122] 2. For intersection turning scenes (side front images), only non-vehicles in motion are marked, and vehicles are not marked. The blind spot of intersection turning will not block vehicles, but there may be blind spots for non-vehicles. Therefore, only non-vehicles are marked to remind drivers to pay attention to non-vehicles on the turning side.

[0123] Optionally, refer to Figure 7As shown, a control unit is provided in an embodiment of the present application. The control unit can be integrated into a terminal device or a chip of a terminal device. The control unit can be a computing device with data processing capabilities.

[0124] The control unit includes: a processor 701 and a memory 702 .

[0125] The memory 702 is used to store programs, and the processor 701 calls the programs stored in the memory 702 to execute the above method embodiment. The specific implementation method and technical effect are similar and will not be repeated here.

[0126] Optionally, the present invention also provides a program product, such as a computer-readable storage medium, comprising a program, which is used to execute the above method embodiment when executed by a processor.

[0127] In the several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0128] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0129] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0130] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (English: processor) to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (English: Read-Only Memory, abbreviated: ROM), random access memory (English: Random Access Memory, abbreviated: RAM), disk or optical disk and other media that can store program codes.

Claims

1. A method for providing information when a vehicle is driving, characterized in that: The method comprises: When the vehicle is traveling, the rear image information and the front image information are acquired, wherein the front image information is the image information in the front field of view of the vehicle, and the rear image information is the image information in the rear field of view of the vehicle; Determining the risk type of the vehicle when turning according to the rear image information, the front image information and the turning type of the vehicle, wherein the turning type includes: changing lanes or turning; According to the risk type, prompt information corresponding to the risk type is generated to prompt the user that the vehicle has a collision risk and the degree of risk when turning.

2. The method according to claim 1, characterized in that The determining, according to the rear image information, the front image information and the steering type of the vehicle, the risk type of the vehicle when turning, comprises: If the turning type is lane change, determining whether there is a first target object in the rear field of view of the vehicle according to the rear image information, wherein the first target object is an object located in the rear field of view of the vehicle and in a moving state; If the first target object exists, determining first distance information between the vehicle and the first target object according to the rear image information and pre-constructed calibration information; The risk type of the vehicle when changing lanes is determined according to the first distance information and the type of the first target object.

3. The method according to claim 2, characterized in that The first distance information includes: a first horizontal distance and a first vertical distance; The determining, according to the first distance information and the type of the first target object, the risk type of the vehicle when changing lanes includes: If the first target object is a vehicle and the first lateral distance is less than a preset first safety lateral distance, the risk type of the vehicle when changing lanes is determined based on the first longitudinal distance, the preset first safety longitudinal distance, and the preset second safety longitudinal distance.

4. The method according to claim 3, characterized in that The determining, according to the first longitudinal distance, a preset first safety longitudinal distance, and a preset second safety longitudinal distance, the risk type of the vehicle when changing lanes includes: If the first longitudinal distance is less than the first safe longitudinal distance, determining that the risk type of the vehicle when changing lanes is high risk; If the first longitudinal distance is between the first safe longitudinal distance and the second safe longitudinal distance, it is determined that the risk type of the vehicle when changing lanes is low risk.

5. The method according to claim 2, characterized in that: The determining, according to the first distance information and the type of the first target object, the risk type of the vehicle when changing lanes includes: If the type of the first target object is non-vehicle and the first lateral distance is less than the preset second safety lateral distance, the risk type of the vehicle when changing lanes is determined based on the first longitudinal distance, the preset first safety longitudinal distance and the preset second safety longitudinal distance.

6. The method according to claim 5, characterized in that The determining, according to the first longitudinal distance, the preset first safety longitudinal distance, and the preset second safety longitudinal distance, the risk type of the vehicle when changing lanes includes: If the first longitudinal distance is less than the first safe longitudinal distance, determining that the risk type of the vehicle when changing lanes is high risk; If the first longitudinal distance is between the first safe longitudinal distance and the second safe longitudinal distance, it is determined that the risk type of the vehicle when changing lanes is low risk.

7. The method according to claim 1, characterized in that The determining, according to the rear image information, the front image information and the steering type of the vehicle, the risk type of the vehicle when turning, comprises: If the steering type is turning, determining whether there is a second target object in the front field of view of the vehicle according to the front image information, wherein the second target object is a non-vehicle in a moving state; If the second target object exists, determining second distance information between the vehicle and the second target object according to the front image information and pre-constructed calibration information; According to the second distance information, the risk type of the vehicle when changing lanes is determined.

8. The method according to claim 7, characterized in that The second distance information includes: a second horizontal distance and a second vertical distance; When the second lateral distance is less than a preset second safe lateral distance, determining the risk type of the vehicle when changing lanes according to the second distance information includes: If the second longitudinal distance is less than a preset first safety longitudinal distance, determining that the risk type of the vehicle when turning is high risk; If the second longitudinal distance is between the first safety longitudinal distance and a preset second safety longitudinal distance, it is determined that the risk type of the vehicle when turning is low risk.

9. The method according to any one of claims 1 to 8, characterized in that: The generating, according to the risk type, prompt information corresponding to the risk type includes: If the risk type is low risk, the first target object in the rear image information or the second target object in the front image information is marked and displayed using a first color, and a voice prompt message is generated; If the risk type is high risk, the first target in the rear image information or the second target in the front image information is marked and displayed with a second color, and a voice prompt message is generated to control the seat belt on the vehicle to perform a tightening operation and turn on a pre-set recording function on the vehicle.

10. A vehicle driving information prompting device, characterized in that: The device comprises: a control unit, a first shooting unit and a second shooting unit, wherein the control unit is connected to the first shooting unit and the second shooting unit respectively, the first shooting unit is arranged at the front of the vehicle, and the second shooting unit is arranged at the rear of the vehicle; The first shooting unit is used to collect front image information in the field of view in front of the vehicle when the vehicle is traveling, and send the front image information to the control unit; The second shooting unit is used to collect rear image information within the rear field of view of the vehicle when the vehicle is traveling, and send the rear image information to the control unit; The control unit is used to execute the vehicle driving information prompt method described in any one of claims 1 to 9.