Driving support method, device, and vehicle

Abstract

Embodiments of the present application provide a driving assistance method, an apparatus, and a vehicle. The method includes: when a driver drives a vehicle, acquiring real-time traveling parameters of the vehicle and surrounding environment information; determining the driving habit of the driver based on the real-time traveling parameters and the surrounding environment information; and presenting driving reminder information to the driver when the driving habit meets a first preset condition. The driving assistance method in the embodiments of the present application may be applied to a new energy vehicle or an intelligent vehicle. As a result, when a driver drives a vehicle, the driving habit of the driver can be determined in real time, and then a targeted driving reminder is provided based on the driving habit of the driver. This helps a driver with bad driving habits to know and / or reinforce the attention that needs to be paid during the driving process, helps the driver to form good driving habits, and further helps to improve driving safety.

Description

Technical Field

[0001]

[0001] This application relates to the field of intelligent driving, and more specifically, to a driving assistance method and apparatus, and a vehicle.

Background Art

[0002]

[0002] With the upgrade of the performance of chips and algorithms, intelligent driving functions are evolving towards fully automated driving. However, due to multiple limitations in realizing fully automated driving, shared autonomy has become the development standard of intelligent driving. Human-machine cooperative co-driving vehicles can better handle road risks and obtain a better driving experience. In the human driving mode, most traffic violations are caused by incorrect driving habits. It is difficult for a driver to form good driving habits and always maintain good driving habits as they grow from a novice to an expert.

[0003]

[0003] Therefore, it is necessary to urgently develop a driving assistance method and apparatus, and a vehicle.

Summary of the Invention

[0004]

[0004] This application provides a driving assistance method and apparatus, and a vehicle that identify drivers with different driving habits, provide an adaptive reminder based on the driving habits of the drivers, thereby improving the driving experience of the drivers and improving driving safety.

[0005]

[0005] The vehicle (sometimes referred to as a vehicle, car, or automobile) in this application is a vehicle in the broad sense, and may be a means of transportation (e.g., car, truck, motorcycle, train, airplane, ship), an industrial vehicle (e.g., pallet truck, trailer, tractor), a work vehicle (e.g., excavator, bulldozer, crane), an agricultural machine (e.g., lawn mower, harvester), an amusement device, a toy vehicle, or the like. The type of vehicle is not limited in this application.

[0006]

[0006] According to a first aspect, a driving assistance method is provided. The method may be executed by a vehicle, or may be executed by a terminal mounted on a vehicle such as in-vehicle infotainment of the vehicle, or may be executed by a chip or circuit used in the vehicle. This is not limited in this application. For the sake of easy explanation, hereinafter, the explanation will be made by using an example in which the method is executed by a device. It should be understood that the device may be arranged in a terminal mounted on a vehicle, or may be arranged in another hardware device. This is not particularly limited in this application.

[0007]

[0007] The method may include: a step of obtaining real-time traveling parameters of the vehicle and surrounding environment information when a driver drives the vehicle; a step of determining the driving habit of the driver based on the real-time traveling parameters and the surrounding environment information; and a step of presenting driving reminder information to the driver when the driving habit meets a first preset condition.

[0008]

[0008] In the above technical solution, the driving habit of the driver can be determined based on the vehicle traveling parameters and the surrounding environment data of the vehicle, which are acquired in real time when the driver drives the vehicle. It should be understood that the driving habit is the driving behavior or tendency of the driver, which gradually develops in the long-term driving operation and does not change instantaneously and easily. Also, based on the driving habit of the driver, it may be determined whether to provide a driving reminder in the driving process of the vehicle. This helps the driver with bad driving habits to improve their driving behavior. In particular, in the field of shared vehicles, the drivers using the vehicle may be different each time, and accordingly have different driving habits. In this case, the driving data is acquired in real time, the driving habit of the driver is judged, and the driving reminder information is presented to the driver with bad driving habits. This can help the driver with bad driving habits to know and / or strengthen the attention needed to be taken in the driving process, help the driver to form good driving habits, and further help to improve driving safety.

[0009]

[0009] It should be noted that the real-time driving data may include the driving data acquired since the driver started the vehicle in the current trip of the vehicle, or may include the driving data acquired from a first time point, where the first time point is a time point after a preset period from the current time point. For example, the preset period may be 20 minutes, or 40 minutes, or other periods.

[0010]

[0010] For example, real-time traveling parameters include, but are not limited to: vehicle speed, vehicle acceleration rate, accelerator pedal position during acceleration, vehicle deceleration rate, brake pedal position during deceleration, steering wheel angle, turning speed during steering, and parking period. Peripheral environment information includes, but is not limited to: road information (e.g., traffic congestion, surrounding pedestrians, curves, and traffic signs), and surrounding vehicle information (e.g., distance from the vehicle ahead).

[0011]

[0011] In some possible implementations, based on the real-time driving parameters of the vehicle and the peripheral environment information of the vehicle, it may be determined whether speeding, non-yielding, an overly close distance from the vehicle ahead, a temporary parking violation, and a traffic regulation violation are occurring during the driving process. Then, based on the weights of speeding, non-yielding, an overly close distance from the vehicle ahead, a temporary parking violation, and a traffic regulation violation, the driving habit of the driver is determined.

[0012]

[0012] In some possible implementations, the driving habit of the driver may be expressed based on a driving habit score. For example, the driving habit score is as follows: Score (Driving Habits) =a 1 +a 2 +a 3 +a 4 +a 5 Here, a 1 to a 5 respectively represent the weights of vehicle speed, yielding, inter-vehicle distance, temporary parking, and traffic regulations, and each value of a 1 to a 5 can be any real number between 0 and 1, and the smaller the Score (Driving Habits) , the worse the driving habit. In the above case, "the driving habit meets the first preset condition" means: Score (Driving Habits)may include being less than a first preset threshold value, where the first preset threshold value represents a good driving habit score, such as a value like 3 or 4. As another example, the driving habit score is as follows: Score (Driving Habits) =a 1 +a 2 +a 3 +a 4 +a 5 +a 6 where a 6 represents the weight of another driving behavior, such as forward collision warning (FCW) or the number of forced ADAS disengagements, and the value of a 6 can be any real number between 0 and 1. In the above case, "the driving habit meets the first preset condition" may mean: Score (Driving Habits) is less than a second preset threshold value, where the second preset threshold value represents a good driving habit score, such as a value like 4 or 5.

[0013]

[0013] Regarding the first aspect, in some implementations of the first aspect, the method further includes: determining the driver's driving experience based on real-time traveling parameters. When the driving habit meets the first preset condition, the step of presenting driving reminder information to the driver includes: when the driving habit meets the first preset condition and the driving experience meets the second preset condition, presenting driving reminder information to the driver.

[0014]

[0014] It should be understood that the driving experience represents the driver's proficiency and / or driving years when driving the vehicle.

[0015]

[0015] In some possible implementations, the driving experience of the driver is determined based on at least one of the acceleration data, deceleration data, and turning data that occur in the process of the driver driving the vehicle. For example, "the driving experience meets the second preset condition" means: The deceleration data in the process of the driver driving the vehicle is within the range representing insufficient driving experience and within the range in the deceleration Gaussian model; The acceleration data in the process of the driver driving the vehicle is within the range representing insufficient driving experience and within the range in the acceleration Gaussian model; and The turning data in the process of the driver driving the vehicle is within the range representing insufficient driving experience and within the range in the steering Gaussian model; It may include at least one of the above.

[0016]

[0016] In some possible implementations, the driving experience of the driver may be further determined based on real-time traveling parameters and surrounding environment data. For example, the driving experience of the driver is determined based on the parking space type in the surrounding environment data and the parking duration in the process of the driver driving the vehicle.

[0017] "The driving experience meets the second preset condition" may include that the parking duration is within the last x% of the time interval required to park in this type of parking space, where the value of x may be 50, 60, or another value. In yet another example, the braking smoothness of the vehicle in a road section may be determined based on the brake pedal position and the brake actuation duration in the real-time traveling parameters. Further, the driving experience of the driver may be determined based on the road information and the smoothness of the brake in the surrounding environment data.

[0018] "The driving experience meets the second preset condition" may include that when the deceleration smoothness of the vehicle in the current driving is within the last y% of the value interval of the deceleration smoothness in the current road section, the value of x may be 50, 60, or another value.

[0019]

[0017] In the above technical solution, drivers with bad driving habits and insufficient driving experience are alerted with driving reminder information. This supports the driver to learn and / or strengthen driving experience, helps the driver to form good driving habits, improve driving experience, and further supports improving driving safety.

[0020]

[0018] Regarding the first aspect, in some implementations of the first aspect, the method includes: When it is detected that the vehicle speed of the vehicle exceeds the preset vehicle speed, presenting vehicle speed reminder information to the driver, where the vehicle speed reminder information reminds the driver of deceleration and / or the recommended vehicle speed; and / or When another road user is detected, presenting yielding instruction information to the driver, where the yielding instruction information reminds the driver to yield to another road user; and / or When the distance between the vehicle and the vehicle in front is less than or equal to the preset distance, presenting inter-vehicle distance reminder information to the driver, where the inter-vehicle distance reminder information reminds the driver to maintain the inter-vehicle distance and / or reminds the driver of the recommended inter-vehicle distance; and / or When it is detected that the vehicle has entered a restricted parking area, presenting temporary parking reminder information to the driver, where the temporary parking reminder information reminds the driver of the restricted parking area and / or the parking period; and / or A step of presenting driving observation reminder information to a driver when at least one of vehicle lane change, vehicle deceleration, another vehicle behind the vehicle, and an obstacle on the road is detected, wherein the driving observation reminder information prompts the driver to notice the violation reminder information around the vehicle; and further includes the step.

[0021]

[0019] In some possible implementations, in different road scenarios, the vehicle speed allowed on the road or the vehicle speed required for safe driving is different. In this case, whether the vehicle is speeding may be determined based on the road scenario. If the vehicle is determined to be speeding, the driver receives a prompt of vehicle speed reminder information. For example, in poor visibility weather such as rainy, snowy, or foggy days, if it is detected that the vehicle speed exceeds the preset speed, the driver receives a prompt to decelerate and / or the driver receives a prompt of the recommended vehicle speed on the road. Alternatively, when there are pedestrians around the road and / or the vehicle is driving towards a curve, if it is detected that the vehicle speed exceeds the preset speed, the driver receives a prompt to decelerate and / or the driver receives a prompt of the recommended vehicle speed on the road. Alternatively, when it is detected that the vehicle is changing lanes and entering a main road, if it is detected that the vehicle speed exceeds the preset speed, the driver receives a prompt to decelerate and / or the driver receives a prompt of the recommended vehicle speed on the road.

[0022]

[0020] In some possible implementations, the driver may further receive prompts by information such as the recommended size and frequency of the accelerator pedal, and the recommended size and frequency of the brake.

[0023]

[0021] In some possible implementations, another road user may include a vulnerable road user (VRU), such as a pedestrian, a cyclist, or an electric vehicle. Alternatively, another road user may include a special vehicle, such as a police vehicle, a fire truck, an ambulance, a technical rescue vehicle, or a school bus. Alternatively, in some scenarios, another road user may include another road user other than the host vehicle. In some possible implementations, when another road user is detected in some scenario, yield prompt information is provided. For example, at a traffic signal, a traffic sign, or an intersection without a marking line, when it is detected that a vehicle is traveling from the right side to the left side of the host vehicle on a road that goes straight on the host vehicle's road, the driver is alerted to yield to the other road user.

[0024]

[0022] For example, by using one or more of devices such as an in-vehicle screen, a human machine interface (HMI), a head-up display, and an audio-video system, the driver can receive the presentation of the aforementioned information.

[0023] In some possible implementations, obstacles on the driving road include objects that affect the driver's judgment regarding road conditions: one or more vehicles parked on both sides of the road, another vehicle on a congested road, and other objects that affect the driver's line of sight, but are not limited thereto.

[0025]

[0024] In the above technical solution, the driver receives reminders of different driving reminder information based on different driving scenarios. This helps the driver accumulate driving experience and / or improve driving habits based on different scenarios. This helps improve the safety of driving.

[0026]

[0025] Regarding the first aspect, in some implementations of the first aspect, the method further includes: presenting data on non-standard driving that occurred during the current trip when the current trip ends, and / or presenting the comparison result between the data on non-standard driving that occurred during the current trip and the data on non-standard driving that occurred during past trips.

[0027]

[0026] For example, the data on non-standard driving includes the behavior of non-standard driving and / or the number of non-standard driving occurrences.

[0028]

[0027] For example, by using one or more of devices such as an in-vehicle screen, an in-vehicle audio-video device, and a head-up display, the driver may receive the presentation of the aforementioned information.

[0029]

[0028] In some possible implementations, if there is no non-standard driving behavior in the trip process, only the trip route is displayed, and / or the number of times the driver completes a standard driving trip is displayed, so as to motivate the driver to continue maintaining good driving habits.

[0030]

[0029] In the aforementioned technical solution, a driving behavior summary is executed at the end of the driving trip to assist the driver in understanding and being impressed by the driver's driving performance. This enables the driver to form good driving habits and maintain safe driving attention.

[0031]

[0030] Regarding the first aspect, in some implementations of the first aspect, non-standard driving includes: the distance between the vehicle and the vehicle ahead being less than or equal to a preset distance, not yielding the road to another road user, parking violations, speed violations, and traffic regulation violations including at least one of them.

[0032] Regarding the first aspect, in some implementations of the first aspect, when the vehicle travels to the first road section and intelligent driving is supported in the first road section, the method includes: further including the step of prompting the driver to switch the vehicle to the intelligent driving mode;

[0033]

[0032] For example, the intelligent driving mode of the vehicle may be a mode in which the vehicle completes driving behaviors such as lane keeping, overtaking and lane merging, stopping at a red signal and proceeding at a green signal, and the interaction between lighting and horn sound under the control of an intelligent system (instead of human labor). Alternatively, the intelligent driving mode may be a mode in which the driving behavior of the vehicle is mainly controlled and completed by an intelligent system. In the latter case, it should be understood that manual intervention in the driving behavior is allowed. In other words, the driver can respond to the actual road conditions under a series of prompts of the intelligent system.

[0034]

[0033] In some possible implementations, when the vehicle is traveling on a road section where intelligent driving is not supported, the driver is timely prompted to take over the vehicle.

[0035]

[0034] In the above technical solution, the driver is supported to switch the vehicle from the manual control mode to the intelligent driving mode. This helps to reduce the driver's driving burden.

[0036]

[0035] Regarding the first aspect, in some implementations of the first aspect, before the step of presenting driving reminder information to the driver, the method further includes: determining the driving reminder information based on the surrounding environment information;

[0037]

[0036] Regarding the first aspect, in some implementations of the first aspect, the real-time traveling parameter includes a yielding parameter, and the yielding parameter represents an action of a vehicle yielding the road to another road user in the current trip.

[0038]

[0037] In the above technical solution, the driving habit of the driver is evaluated by introducing the yielding parameter into the driving process. This helps to reduce the risk caused to traffic safety by drivers lacking the driving habit of yielding.

[0039]

[0038] According to the second aspect, a driving assistance device is provided. The device includes: An acquisition unit configured to acquire the real-time traveling parameter of the vehicle and the surrounding environment information when the driver drives the vehicle; A processing unit configured to determine the driving habit of the driver based on the real-time traveling parameter and the surrounding environment information; and A prompt unit configured to present driving reminder information to the driver when the driving habit meets the first preset condition.

[0040]

[0039] Regarding the second aspect, in some implementations of the second aspect, the processing unit is further configured to determine the driving experience of the driver based on the real-time traveling parameter. Specifically, the prompt unit is configured to present driving reminder information to the driver when the driving habit meets the first preset condition and the driving experience meets the second preset condition.

[0041]

[0040] Regarding the second aspect, in some implementations of the second aspect, further: The prompt unit is configured to present driver vehicle speed reminder information to the driver when it is detected that the vehicle speed of the vehicle exceeds the preset vehicle speed, and the vehicle speed reminder information is to remind the driver of deceleration and / or the recommended vehicle speed; and / or The prompt unit is configured to present yielding instruction information to the driver when another road user is detected, and the yielding instruction information is to remind the driver to yield to another road user; and / or The prompt unit is configured to present vehicle distance reminder information to the driver when the distance between the vehicle and the vehicle ahead is less than or equal to the preset distance, and the vehicle distance reminder information is to remind the driver to maintain the vehicle distance and / or to remind the driver of the recommended vehicle distance; and / or The prompt unit is configured to present temporary parking reminder information to the driver when it is detected that the vehicle has entered a restricted parking area, and the temporary parking reminder information is to remind the driver of the restricted parking area and / or the parking period; and / or The prompt unit is configured to present driving observation reminder information to the driver when at least one of a lane change of the vehicle, deceleration of the vehicle, another vehicle behind the vehicle, and an obstacle on the driving road is detected, and the driving observation reminder information is to prompt the driver to notice the violation reminder information around the vehicle.

[0042]

[0041] Regarding the second aspect, in some implementations of the second aspect, the prompt unit is further configured to present the data of non-standard driving that occurred during the current trip and / or the comparison result between the data of non-standard driving that occurred during the current trip and the data of non-standard driving that occurred during past trips when the current trip ends.

[0043] Regarding a second aspect, in some implementations of the second aspect, non-standard driving is: the distance between the vehicle and the vehicle ahead is less than or equal to a preset distance, not yielding the road to another road user, a parking violation, a speed violation, and a traffic regulation violation including at least one of the above.

[0044] Regarding a second aspect, in some implementations of the second aspect, when the vehicle travels to a first road section and intelligent driving is supported in the first road section, the prompt unit is further configured to prompt the driver to switch the vehicle to the intelligent driving mode.

[0045] Regarding a second aspect, in some implementations of the second aspect, the processing unit is further configured to determine the driving reminder information based on the surrounding environment information before presenting the driving reminder information to the driver.

[0046] Regarding a second aspect, in some implementations of the second aspect, the real-time traveling parameters include yielding parameters, and the yielding parameters represent an action of the vehicle yielding the road to another road user in the current trip.

[0047] According to a third aspect, a driving assistance device is provided. The device includes: a memory configured to store a program; and a processor configured to execute the program stored in the memory. When the program stored in the memory is executed, the processor is configured to execute the method in any one of the possible implementations of the first aspect.

[0048]

[0047] According to the fourth aspect, a driver assistant is provided, which includes one of a virtual image and a physical image. The driver assistant includes at least one processor configured to execute the method in any one of the possible implementations of the first aspect. The driver assistant may be mounted on at least one of an in-vehicle screen, a head-up display (HUD), an in-vehicle audio device, and a cockpit.

[0049]

[0048] It should be noted that the driver assistant in this embodiment of the present application may include a virtual image or may be a physical product. The virtual image may include a virtual digital human or another virtual image presented on an in-vehicle screen or a head-up display (HUD), or may include a virtual voice assistant installed in an in-vehicle audio device. The physical product may include an in-vehicle robot installed in a cockpit, etc.

[0050]

[0049] According to the fifth aspect, an advanced driver assistance system is provided. The system includes the device in any one of the possible implementations of the second or third aspect, or the driver assistant in any one of the implementations of the fourth aspect.

[0051]

[0050] According to the sixth aspect, an intelligent vehicle is provided. The intelligent vehicle includes the device in any one of the possible implementations of the second or third aspect, or the driver assistant in any one of the implementations of the fourth aspect, or the system in any one of the implementations of the fifth aspect.

[0052]

[0051] According to the seventh aspect, a computer program product is provided. The computer program product includes computer program code, and when the computer program code is executed on a computer, the computer can execute the method in any one of the possible implementations of the first aspect.

[0053]

[0052] It should be noted that all or part of the computer program code may be stored in the first storage medium. The first storage medium may be encapsulated together with the processor, or may be encapsulated separately from the processor. This is not particularly limited in this embodiment of the present application.

[0054]

[0053] According to an eighth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores program code. When the computer program code is executed on a computer, the computer can execute the method in any one of the possible implementations of the first aspect.

[0055]

[0054] According to a ninth aspect, a chip is provided. The chip includes a processor configured to call a computer program or computer instruction stored in a memory, whereby the processor executes the method in any one of the possible implementations of the first aspect.

[0056]

[0055] Regarding the ninth aspect, in a possible implementation, the processor is coupled to the memory via an interface.

[0057]

[0056] Regarding the ninth aspect, in a possible implementation, the chip system further includes a memory. The memory stores a computer program or computer instruction.

Brief Description of the Drawings

[0058]

Figure 1

[0057] FIG. 1 is a schematic functional block diagram of a vehicle according to an embodiment of the present application.

Figure 2

[0058] FIG. 2 is a schematic diagram of a system architecture necessary to implement a driving assistance method according to an embodiment of the present application.

Figure 3

[0059] Figure 3 is a schematic flowchart of the driving assistance method according to the embodiment of the present application.

Figure 4

[0060] Figure 4 is a schematic diagram of the deceleration rate Gaussian model according to the embodiment of the present application.

Figure 5

[0061] Figure 5 is a schematic diagram of an application scenario of the driving assistance method according to the embodiment of the present application.

Figure 6

[0062] Figure 6 is another schematic diagram of an application scenario of the driving assistance method according to the embodiment of the present application.

Figure 7

[0063] Figure 7 is yet another schematic diagram of an application scenario of the driving assistance method according to the embodiment of the present application.

Figure 8

[0064] Figure 8 is another schematic flowchart of the driving assistance method according to the embodiment of the present application.

Figure 9

[0065] Figure 9 is a schematic block diagram of the driving assistance device according to the embodiment of the present application.

Figure 10

[0066] Figure 10 is another schematic block diagram of the driving assistance device according to the embodiment of the present application.

Embodiments for Carrying Out the Invention

[0059]

[0067] Hereinafter, with reference to the accompanying drawings in the embodiments of the present application, the technical solutions in the embodiments of the present application will be described. In the description of the embodiments of the present application, " / " means "or" unless otherwise specified. For example, A / B may represent A or B. In this specification, "and / or" only describes the relevance relationship for explaining related objects, indicating that there may be three relationships. For example, A and / or B may represent the following three cases: only A exists, both A and B exist, and only B exists.

[0060]

[0068] In the embodiments of this application, words with prefixes such as "first" and "second" are only used to distinguish different objects to be described, and do not limit the position, order, priority, quantity, content, etc. of the objects to be described. In the embodiments of this application, the use of words with prefixes such as ordinal numbers to distinguish the objects to be described does not constitute a limitation on the objects to be described. For the description of the objects to be described, please refer to the description of the context in the claims or embodiments. The use of such words with prefixes should not constitute an extra limitation. Also, in the description of the embodiments, unless otherwise specified, "a plurality" means two or more.

[0061]

[0069] FIG. 1 is a schematic functional block diagram of a vehicle 100 according to an embodiment of the present invention. The vehicle 100 may include a sensing system 120, a display device 130, and a computing platform 150. The sensing system 120 may include various types of sensors for sensing the surrounding environment information of the vehicle 100. For example, the sensing system 120 may include a positioning system. The positioning system may be a global positioning system (GPS), or one or more of a BeiDou system or another positioning system, an inertial measurement unit (IMU), a lidar, a millimeter-wave radar, an ultrasonic radar, and a camera device.

[0062]

[0070] Some or all of the functions of the vehicle 100 may be controlled by the computing platform 150. The computing platform 150 may include processors 151 to 15n (where n is a positive integer). A processor is a circuit having a signal processing function. In an implementation, a processor is a circuit having an instruction reading and execution capability, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which may be understood as a microprocessor), a digital signal processor (DSP), etc. In another implementation, a processor can implement a specific function by using the logical relationship of a hardware circuit. The logical relationship of the hardware circuit is fixed or reconfigurable. For example, a processor is a hardware circuit, such as a field programmable gate array (FPGA), and is realized by using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD). In a reconfigurable hardware circuit, the process by which a processor loads a configuration document to realize a hardware circuit configuration may be understood as the process by which a processor loads instructions to implement some or all of the functions of the aforementioned units. Further, a processor may alternatively be a hardware circuit designed for artificial intelligence and may be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), or a deep learning processing unit (DPU). Further, the computing platform 150 may further include a memory.The memory is configured to store instructions. Part or all of the processors 151 to 15n may call the instructions in the memory to execute the instructions and perform the corresponding functions.

[0063]

[0071] The display device 130 in the cockpit is classified into two major types. The first type is an in-vehicle display, and the second type is a projection display, such as a head-up display (HUD) device. The in-vehicle display is a physical display and an important part of the in-vehicle infotainment system. Multiple displays, such as a digital instrument display, a central control screen, a display in front of the passenger in the passenger seat (also called the front-row passenger), a display in front of the passenger in the left rear row, and a display in front of the passenger in the right rear row, may be arranged in the cockpit. Even the vehicle window may be used as a display for display purposes. The head-up display is also referred to as a head-up display system. The head-up display is mainly configured to display driving information such as speed and navigation on a display device (for example, the front windshield) in front of the driver, so as to shorten the driver's line-of-sight movement time, avoid pupil changes caused by the driver's line-of-sight movement, and improve driving safety and comfort. For example, the HUD includes a combiner-HUD (C-HUD) system, a windshield-HUD (W-HUD) system, and an augmented reality-HUD (AR-HUD) system. In some possible implementations, the vehicle-mounted display may include an HMI.

[0064]

[0072] As described above, most traffic violations are caused by incorrect driving habits. When a driver grows from a beginner to an experienced driver, it is difficult to learn skills and form and always maintain good driving habits without support and assistance from the vehicle side. In all driving scenarios, there is no adaptive reminder mechanism for drivers with various driving habits and vehicle proficiency levels. In view of this, the embodiments of this application provide a driving assistance method, an apparatus, and a vehicle for acquiring a driver's driving data in real time, determining whether to provide a driving reminder based on the driving data, and determining reminder content based on vehicle surrounding environment information and / or vehicle driving state data. This can assist drivers with bad driving habits and / or insufficient driving experience in learning and / or strengthening their driving experience, improving the driver's driving experience, and further assisting in improving driving safety.

[0065]

[0073] Figure 2 is a diagram of the advanced driver assistance system architecture according to the embodiment of the present application. As shown in Figure 2, the advanced driver assistance system includes a driving virtual assistance unit, and the driving virtual assistance unit includes a learning unit, a user interaction module, a control module, a data management module, and a data acquisition module. The data acquisition module may include one or more imaging devices and one or more sensors in the sensing system 120 shown in Figure 1. The data management module may include one or more memories in the computing platform 150 shown in Figure 1. The user interaction module may include one or more display devices 130 in Figure 1, or alternatively, the user interaction module may include an audio system. The control module may include one or more processors within the computing platform 150 shown in Figure 1. The learning unit may include one or more processors within the computing platform 150 shown in Figure 1. More specifically, the learning unit may include a learning application unit and a learning method unit. In a specific implementation process, the data acquisition module can acquire the driver's driving data including acceleration data (e.g., acceleration rate, gas pedal position, and number of acceleration adjustments), deceleration data (e.g., deceleration rate and brake pedal position), rotation data (e.g., steering wheel angle and turning rate), manual parking period, and the like. The data management module can process the driving data, for example, calculate the driver's average manual parking period. The data management module can further store the data acquired by the data acquisition module.Furthermore, the learning application unit can determine the driving experience and driving habits of the driver based on the driving data, the data processed by the data management module, and the algorithms stored in the learning method unit. Also, the data acquisition module can further acquire vehicle surrounding environment information. The vehicle surrounding environment information includes, but is not limited to, road information (e.g., traffic jams, surrounding pedestrians, curves, traffic signs) and surrounding vehicle information (e.g., distance from the vehicle ahead). The learning unit can determine whether to provide a driving reminder and the content of the driving reminder based on the vehicle surrounding environment information and / or vehicle driving state data in the data acquisition module and by referring to the driving experience and driving habits of the driver. When it is necessary to provide a driving reminder, the learning unit sends an instruction to the control module, as a result of which the control module can control the user interaction module to provide the driving reminder. The driving reminder includes at least one of the following: vehicle speed reminder, right-of-way reminder, driving observation reminder, inter-vehicle distance reminder, temporary parking / parking prohibition reminder, and other driving violation reminder.

[0066]

[0074] In some possible implementations, the advanced driver assistance system (ADAS) further includes an autonomous driving unit. The autonomous driving unit is connected to one or more sensors in the sensing system shown in FIG. 1. The driving virtual assistance unit can acquire driving data, vehicle surrounding environment information, etc. from the autonomous driving unit. In some possible implementations, the control instruction may be further sent to the autonomous driving unit by using the control module in the driving virtual assistance unit, whereby the autonomous driving unit provides a driving reminder.

[0067]

[0075] It should be understood that the foregoing modules and systems are merely examples. In actual applications, the foregoing modules and systems may be added or removed based on actual requirements. For example, the data management module and the data processing module may be integrated into one module, or the learning unit and the control module may be integrated into one module.

[0068]

[0076] Figure 3 is a schematic flowchart of an operation support method according to an embodiment of the present invention. Method 300 may be applied to the vehicle shown in FIG. 1, or may be executed by the system shown in FIG. 2. It should be understood that the steps or operations of the operation support method shown in FIG. 3 are merely examples for explanation. In this embodiment of the present application, other operations or variations of the operations in FIG. 3 may be further executed. Method 300 includes the following steps.

[0069]

[0077] S301: Obtain the driving data of the driver.

[0070]

[0078] For example, acceleration data such as acceleration rate and accelerator pedal position, deceleration data such as deceleration rate and brake pedal position, rotation data such as steering wheel angle and rotation speed, manual parking period, and other data are obtained.

[0071]

[0079] For example, the time when the driving data of the driver starts to be obtained may be the time when the driver starts the vehicle. For example, the driving data may include the driving data of the current trip. More specifically, the driving data may include the driving data obtained from the time when the driver starts the vehicle in the current trip, or may include the driving data obtained from the first time point, and the first time point is a time point that is a preset period after the current time point. For example, the preset period may be 20 minutes (min), or 40 minutes, or other periods.

[0072]

[0080] S302: Determine the driving experience and driving habits of the driver.

[0073]

[0081] In this embodiment of the present application, the driving experience and driving habits represent the driving behavior of the driver. The driving experience represents the proficiency and / or driving years of the driver when driving a vehicle, and the driving habit is the driving behavior or driving tendency of the driver, which gradually develops in long-term driving activities and does not easily change in a short period of time. It should be understood that a driver with rich driving experience does not necessarily have good driving habits, and a driver with excellent driving habits does not necessarily have rich driving experience.

[0074]

[0082] In some possible implementations, the driving experience and driving habits of the driver may be determined based on the driving data of the driver and the surrounding environment information in the driving process of the vehicle.

[0075]

[0083] In one example, the driving experience of the driver may be determined based on the manual parking period. For example, based on the type of parking space, the interval of the period required to park in that type of parking space is determined. Further, if the parking period in the current trip is within the first x% of the interval of the period required to park in this type of parking space, the driver is determined to have rich driving experience; otherwise, the driver is determined to have insufficient driving experience. For example, x may be 50, or 60, or any real number between 0 and 100.

[0076]

[0084] In another example, the deceleration data, acceleration data, and rotation data in the driving data are compared with the corresponding Gaussian model to determine the driving experience of the driver.

[0077]

[0085] For example, in the case of deceleration data, the driving experience of the driver may be determined based on the deceleration rate and the brake duration. Specifically, the Gaussian distribution of the deceleration data may be determined according to the following formula:

[0078]

Number

[0079]

Number

[0080]

[0086] Furthermore, a deceleration Gaussian model shown in FIG. 4 may be constructed. The upper ellipse in FIG. 4 represents a driver with little driving experience (e.g., a novice driver), and the lower ellipse in FIG. 4 represents a driver with rich driving experience. The deceleration data in the driving data is compared with the Gaussian model shown in FIG. 4. If the deceleration data falls within the upper ellipse, it indicates that the driver has little driving experience. If the deceleration data falls within the lower ellipse, it indicates that the driver has rich driving experience.

[0081]

[0087] In some possible implementations, if there are multiple deceleration data groups in the driving data of the current trip, the multiple deceleration data groups are determined separately, and furthermore, the driving experience of the driver is determined by combining the determination results of all groups of the deceleration data. For example, if more than 80% of the deceleration data is within the upper ellipse, the driver is determined to have insufficient driving experience, or if more than 80% of the deceleration data is within the lower ellipse, the driver is determined to have rich driving experience.

[0082]

[0088] The driver's driving experience may alternatively be determined by using an acceleration Gaussian model in combination with acceleration data, or it should be understood that the driver's driving experience may alternatively be determined by using a steering Gaussian model in combination with rotation data.

[0083]

[0089] In some possible implementations, if the driving data of the current trip includes all of the acceleration data, deceleration data, and rotation data, the driver's driving experience may be determined by combining result A determined based on the acceleration data, result D determined based on the deceleration data, and result T determined based on the rotation data. Here, A, D, and T may each be set to 0 or 1.

[0084] When A, D, and T are set to 1, the determination result indicates that "the driver has rich driving experience".

[0085] When A, D, and T are set to 0, it indicates that "the driver has insufficient driving experience".

[0086] For example, the final result of the driving experience is: E 1 = a×A + b×D + c×T is satisfied, where a, b, and c are the weights of result A determined based on the acceleration data, result D determined based on the deceleration data, and result T determined based on the rotation data, respectively. For example, a = 0.4, b = 0.3, c = 0.3 may be set. In this case, when E 1 is 0.6 or more, the driver is determined to have rich driving experience. It should be understood that a, b, and c may alternatively be set to other real numbers, and the determination condition may alternatively change together with the weight values. This is not particularly limited in this application.

[0087]

[0090] In some possible implementations, the final result of the driving experience is: E 2=a×A + b×D + c×T + d×P, where P is a result determined based on the parking period, and P may be separately set to 0 or 1.

[0088] When P is set to 1, the determination result indicates that "the driver has rich driving experience".

[0089] When P is set to 0, it indicates that "the driver has insufficient driving experience".

[0090] Here, d is the weight of the result determined based on the parking period. For example, a, b, c, and d may be set to 0.4, 0.3, 0.2, and 0.1 respectively. In this case, when 2 E is 0.5 or more, the driver is determined to have rich driving experience.

[0091]

[0091] In some possible implementations, the driving experience of the driver may alternatively be determined based on at least one of acceleration smoothness, deceleration smoothness, and turning smoothness. For example, a value interval of the acceleration smoothness (or deceleration smoothness, or turning smoothness) of past passing vehicles in the road section where the vehicle is currently traveling is determined. Further, if the acceleration smoothness (or deceleration smoothness, or turning smoothness) of the host vehicle in the current trip is within the first y% of the value interval of the acceleration smoothness in the current road section, the driver is determined to have rich driving experience; otherwise, the driver is determined to have insufficient driving experience. For example, x may be 50, or 60, or any real number between 0 and 100. For example, the driving experience of the driver may alternatively be determined by comprehensively considering acceleration smoothness, deceleration smoothness, and turning smoothness. For example, the formula for calculating deceleration smoothness may be like DS = λs(Ms|T), where Mm is the brake pedal position, T is the brake actuation duration, and λs is a smoothness equation. It should be understood that acceleration smoothness and turning smoothness may also be calculated according to the above formula.

[0092]

[0092] In some possible implementations, the driving habit of the current driver may be represented by a driving habit score Score (Driving Habits) For example, Score (Driving Habits) =a 1 +a 2 +a 3 +a 4 +a 5 where a 1 to a 5 represent the weights of vehicle speed, yielding, inter-vehicle distance, temporary parking, and traffic regulations, respectively, which are specifically shown in Table 1. a 1 to a5 Each value of can be a real number between 0 and 1, and a 1 through a 5 Each value of can be a real number between 0 and 1.

[0093] For example, if either the ratio of speed violation and sharp turning is greater than 0.5, or the ratio of hard braking is greater than 0.5, occurs in the current trip, a 1 is set to 0; otherwise, a 1 is set to 1.

[0094] If yielding is not executed in a specific road section during the current trip, a 2 is set to 0; otherwise, a 2 is set to 1.

[0095] If the ratio of unsafe following is greater than 0.5 in the current trip, a 3 is set to 0; otherwise, a 3 is set to 1.

[0096] If a temporary stop occurs and road traffic is obstructed during the current trip, a 4 is set to 0; otherwise, a 4 is set to 1.

[0097] If a traffic rule violation occurs during the current trip, for example, driving is not performed based on lanes, indicators, or signs, a 5 is set to 0; otherwise, a 5 is set to 1.

[0001]

[0098]

[0002] Furthermore, if Score (Driving Habits) is greater than A, the driving habit of the driver is good; or if Score (Driving Habits)When it is below A, it is necessary to improve the driving habits of the driver, where A is the score of good driving habits. For example, A may be 3 or 4, or may be another value from 0 to 5.

[0099] Table 1 Driver's Driving Behavior and Weight of Driving Behavior in Driving Habit Score

[0100] [Table 1]

[0093] In some possible implementations, if there are one or more fixed drivers of the vehicle, the driving experience and driving habits of the driver may be further determined based on the driver profile. Also, when the driving habits are determined, the driving habit score may be as follows: Score (Driving Habits) =a 1 +a 2 +a 3 +a 4 +a 5 +a 6 Here, a 6 is the weight dominated by another driving behavior, such as the number of forced terminations of intelligent driving and FCW. When the number of times of forward collision warning and / or the number of forced terminations of intelligent driving exceed the preset threshold, a 6 is set to 0; otherwise, a 6 is set to 1.

[0101]

[0094] In some possible implementations, if there are one or more fixed drivers of the vehicle, the non-standard driving behaviors of each driver may be counted separately in a preset trip. For example, the number of times driver A violates speed limits, fails to yield, follows unsafely, parks illegally, and violates traffic regulations are recorded separately. For example, the preset trip may be based on 500 km or 1000 km, or may be another value.

[0102]

[0095] S303: Determine whether it is true that the driver has rich driving experience and good driving habits.

[0103]

[0096] Specifically, if it is not true that the driver has rich driving experience and good driving habits, S304 is executed; otherwise, S305 is executed.

[0104]

[0097] It should be understood that "it is not true that the driver has rich driving experience and good driving habits" includes the following: The driver has rich driving experience but has bad driving habits; The driver has good driving habits but only has insufficient driving experience; The driver has insufficient driving experience and bad driving habits.

[0105]

[0098] S304: Provide a driving reminder and / or driving recommendation.

[0106]

[0099] For example, vehicle surrounding environment information is obtained, and based on the vehicle surrounding environment information, the content and timing of the driving reminder and / or driving recommendation are determined. In some possible implementations, a vehicle speed reminder and / or recommendation, a right-of-way reminder and / or recommendation, a driving observation reminder and / or recommendation, a following distance reminder and / or recommendation, a temporary parking / no parking reminder and / or recommendation, and other driving violation reminders may be provided.

[0107]

[0100] For example, the driving reminder and / or driving recommendation may be provided by using a display device such as a central control screen; or the driving reminder and / or driving recommendation may be provided by a voice broadcast method or the like; or the driving reminder and / or driving recommendation may be provided via a human-computer interaction interface such as an HMI. This is not particularly limited in this embodiment of the present application.

[0108]

[0101] In one example, the driver receives a reminder of the observed driving speed and / or the recommended driving speed based on the road condition risk and the braking distance. For example, on rainy, snowy, foggy days, or other low visibility weather conditions, driving reminders and / or driving recommendations are provided. For example, the driver receives a reminder to slow down, or the driver receives a reminder of the recommended vehicle speed. For example, the driver receives a reminder such as "The recommended vehicle speed does not exceed 20 km / h" by using a display device and / or in a voice broadcast manner. Also, in cases such as road congestion, surrounding pedestrians, curves, etc., the driver receives a reminder to slow down or a reminder of the recommended vehicle speed. When the driver is about to enter a major road, the driver receives a reminder of the recommended route and vehicle speed. In some possible implementations, the driver may be further prompted to enable intelligent driving. In the above scenarios, the driver may further receive reminders of information such as the intensity and frequency of the recommended accelerator pedal and the intensity and frequency of the brakes by using a display device and / or in a voice broadcast manner.

[0109] As shown in FIG. 5, when the vehicle passes through a road section where there are a plurality of parked vehicles on one side, a driver with insufficient driving experience and / or bad driving habits can receive a reminder, and the recommended speed is provided to prevent accidents caused by the sudden appearance of pedestrians. Specifically, as shown in FIG. 5(a), the current driving speed of the vehicle is 40 km / h. When it is detected that a plurality of vehicles are parked on the left side, pedestrians may appear from the center of the parked vehicles. In this case, "In case pedestrians appear, suppress the vehicle speed and pay attention to the vehicles on the left" may be displayed on the central control screen. Also, the recommended vehicle speed

[0110]

Number

[0111]

Number

[0112]

[0102] In some possible implementations, when it is determined that the driver has insufficient driving experience and / or bad driving habits, the central control screen may be used to recommend that the driver should enable intelligent driving. Specifically, as shown in Figure 5(b), a message "The current road section supports intelligent driving. Do you really want to enable it?" is displayed on the central control screen. The driver can confirm to enable intelligent driving by tapping the "OK" button on the screen, or there is also a possibility of not enabling intelligent driving by tapping the "No" button on the screen. Further, after intelligent driving is enabled according to the driver's tap operation, the vehicle's automatic driving module takes over the vehicle and controls the vehicle speed to drop to 20 km / h, and as shown in Figure 5(c), by using the screen, the driver is presented with the message "Intelligent driving is enabled."

[0113]

[0103] In some possible implementations, the aforementioned recommended vehicle speed may be sensed and adjusted by the autonomous driving system, or may be received through vehicle-to-infrastructure (V2I) communication, or may be determined in another manner. Further, the intensity and frequency of the reminded accelerator pedal, the recommended braking intensity and frequency, etc. may be calculated based on the recommended vehicle speed, or may be determined by other methods.

[0114]

[0104] In another example, the driver is prompted to yield in a specific road section. For example, the driver is: prompted to yield to pedestrians in schools, communities, and villages; prompted to yield to pedestrians, bicycles, and motorcycles on rainy or snowy days; prompted to yield to left-turning vehicles at right-turn intersections; prompted to yield at intersections without signals; prompted to yield at roundabouts; prompted to yield when entering a major road; prompted to yield on slopes; prompted to yield based on traffic signs and markings; prompted to yield when being overtaken by a vehicle; and prompted to yield when encountering special vehicles (such as police vehicles, fire trucks, ambulances, work rescue vehicles, school buses, etc.).

[0115] As shown in FIG. 6(a), at an intersection without signals, if it is detected that there are vehicles traveling from left to right at the intersection, for a driver with insufficient driving experience and / or bad driving habits, a reminder such as "Please yield to the vehicle on the left" as shown in FIG. 6(b) may be provided. For a driver with rich driving experience and good driving habits, the reminder may not be provided, and the central control screen is controlled to display the picture shown in FIG. 6(c).

[0116]

[0105] In some possible implementations, the position of another road user may be obtained by using a vehicle sensing system, or determined based on information received via V2I, or determined based on information received via vehicle to vehicle (V2V) communication, or determined in another way.

[0117]

[0106] As another example, in a restricted parking area such as the roadside of a railway station or an airport terminal building, a prompt for the parking period is provided. If the lane is blocked, a reminder is provided and an automatic adjustment option is provided. If parking is done on an inclined plane, the front wheels are rotated to prevent slipping. In a prohibited parking area (in accordance with traffic laws), a reminder is provided and nearby parking lots and parking spaces are recommended.

[0118]

[0107] In some possible implementations, information such as the parking period, recommended nearby parking lots, and parking spaces may be determined based on information received via V2I, or determined based on information received via vehicle to everything (V2X), or determined in another manner.

[0119]

[0108] In yet another example, a recommended following distance is based on road condition hazards, braking distance, low visibility weather such as rainy, snowy, or foggy days, traffic jams, nearby pedestrians, and curves. When encountering another road user such as a large vehicle, parked vehicle, bicycle, motorcycle, school bus, or pedestrian, a prompt to maintain a following distance is provided.

[0120]

[0109] In some possible implementations, the recommended inter-vehicle distance may be preset by the system. For example, for various scenarios such as bad weather with poor visibility like rainy, snowy, or foggy days, traffic jams, surrounding pedestrians, and curves, the recommended inter-vehicle distances are set separately. Alternatively, the recommended inter-vehicle distance may be determined in other ways.

[0121]

[0110] In some possible implementations, if there are one or more fixed drivers of the vehicle and the driving experience and driving habits of the drivers are determined based on a driver profile, individualized reminders may be further provided for different drivers. For example, driver A is a driver with insufficient driving experience and / or bad driving behavior. However, in a preset trip (for example, at 1000 km or another value), driver A has never taken the action of not yielding in a specific road section. In this case, a reminder requiring yielding may not be provided in this road section.

[0122]

[0111] S305: Do not provide a driving reminder and / or driving recommendation.

[0123]

[0112] For example, if it is determined that the driver has rich driving experience and good driving habits, the driving reminder may not be provided during the driving process, and the energy consumption may be reduced.

[0124]

[0113] In one possible implementation, according to the driving assistance method provided in this embodiment of the present application, statistics regarding the type and / or quantity of non-standard driving behaviors may be further collected for each trip, and a trip summary and reminder are provided. For example, in a certain trip, bad driving behaviors include "not yielding at intersections", "not keeping a distance from large vehicles", and "parking violations"; the occurrence times of the above-mentioned behaviors are 3, 4, and 3 respectively. In this case, when the trip ends, reminder information as shown in FIG. 7(a) is displayed to assist the driver in understanding and enhancing the impression of the driver's driving performance. Optionally, a comparison is made between the occurrence times of the above-mentioned behaviors and the number of bad driving behaviors recorded in past trips, and the change in non-standard driving behaviors when compared with those in past trips (for example, "5 items have been improved compared with the previous ones") is presented to the driver to promote the formation of good driving habits and maintain safe driving alertness. If there are no bad driving behaviors during the trip process, only the trip route may be displayed, or the number of times the driver has completed zero-risk trips may be displayed to motivate the driver to continue maintaining good driving habits. For example, as shown in FIG. 7(b), content such as "The risk event is 0, and it is a very smooth trip. 10 consecutive safe trips have been achieved. Please maintain this!" may be displayed. It should be understood that the driver may alternatively receive the presentation of the above-mentioned information in a voice broadcast manner or the like.

[0125]

[0114] In the embodiments of the present application, terms such as "abundant", "good", "insufficient", and "bad" are introduced for ease of understanding and explanation and shall not constitute any limitation to the present application.

[0126]

[0115] Embodiments of the present application acquire a driver's driving data in real time, determine whether to provide a driving reminder based on the driving data, and determine reminder content based on vehicle surrounding environment information and / or vehicle driving state data, thereby providing a driving assistance method. This can assist a driver with bad driving habits and / or insufficient driving experience in learning and / or strengthening their driving experience, improving the driver's driving experience, and further improving driving safety. In particular, in the field of shared vehicles, the drivers using a specific vehicle may be different each time, and accordingly have different driving experiences and different driving habits. In this case, driving data is acquired in real time to determine the driver's driving experience and driving habits, and further, a driving reminder is provided. This can improve driving safety.

[0127]

[0116] FIG. 8 is a schematic flowchart of a driving assistance method 800 according to an embodiment of the present application. The method 800 may be applied to the vehicle shown in FIG. 1 or may be executed by the system shown in FIG. 2. It should be understood that the steps or operations of the driving assistance method shown in FIG. 8 are merely examples for illustration purposes. In this embodiment of the present application, other operations or variations of the operations in FIG. 8 may be further executed. The method 800 includes the following steps.

[0128]

[0117] S801: When a driver drives a vehicle, acquire the vehicle's real-time traveling parameters and surrounding environment information.

[0129]

[0118] For example, the vehicle may be the vehicle 100 in the foregoing embodiment, or may be another vehicle. The real-time traveling data may include the driving data in the foregoing embodiment, or may include the traveling status data of the vehicle in the foregoing embodiment, or may include the traveling parameters of the vehicle when another driver drives the vehicle. The surrounding environment information may be the surrounding environment information of the vehicle in the foregoing embodiment, or may include other surrounding environment information of the vehicle in the traveling process of the vehicle.

[0130]

[0119] For the method of acquiring the real-time traveling parameters and the surrounding environment information, please refer to the description in the foregoing embodiment. Details will not be described again here.

[0131]

[0120] S802: Determine the driving habit of the driver based on the real-time traveling parameters and the surrounding environment information.

[0132]

[0121] For example, the driving habit may include the driving habit described in the foregoing embodiment. For the method of determining the driving habit of the driver based on the real-time traveling parameters and the surrounding environment information, please refer to the description in the foregoing embodiment. Details will not be described again here.

[0133]

[0122] S803: When the driving habit meets the first preset condition, present the driving reminder information to the driver.

[0134]

[0123] For example, the first preset condition may include that the driving habit score Score (Driving Habits) in the foregoing embodiment is smaller than the good-driving habit score, or may be another condition that can represent the bad driving habit of the driver.

[0135]

[0124] The driving reminder information may include the driving reminder and / or driving recommendation in the foregoing embodiments, or may include at least one of the vehicle speed reminder, right-of-way reminder, driving observation reminder, inter-vehicle distance reminder, temporary parking / no parking reminder, or other driving violation reminders in the foregoing embodiments. More specifically, for the method of presenting the driving reminder information to the driver, please refer to the description in the foregoing embodiments. Details are not described again here.

[0136]

[0125] In the foregoing technical solution, based on the vehicle traveling parameters and the surrounding environment information of the vehicle that are obtained in real time when the driver drives the vehicle, the driving habits of the driver can be identified. Also, whether to provide a driving reminder during the driving process of the vehicle may be determined based on the driving habits of the driver. This can assist a driver with bad driving habits to learn and / or strengthen the caution required during the driving process, assist the driver to form good driving habits, and further assist in improving driving safety.

[0137]

[0126] In the embodiments of the present application, unless otherwise specified or there is no logical contradiction, the terms and / or descriptions among the embodiments are consistent and can be referenced to each other, and the technical features in different embodiments may be combined into a new embodiment based on their internal logical relationships.

[0138]

[0127] The method provided in the embodiments of the present application is described in detail above with reference to FIGS. 3 to 8. Hereinafter, with reference to FIGS. 9 and 10, the device provided in the embodiments of the present application will be described in detail. The description of the device embodiments corresponds to the description of the method embodiments. Therefore, for the content not described in detail, please refer to the method embodiments. For the sake of brevity, details are not described again here.

[0139]

[0128] FIG. 9 is a schematic block diagram of the driving assistance device 2000 according to an embodiment of the present invention. The device 2000 includes an acquisition unit 2010, a processing unit 2020, and a prompt unit 2030. The acquisition unit 2010 is capable of realizing a corresponding communication function. The processing unit 2020 is configured to execute data processing. The prompt unit 2030 is configured to present driving reminder information to the driver.

[0140]

[0129] Optionally, the device 2000 may further include a storage unit. The storage unit may be configured to store instructions and / or data. The processing unit 2020 is capable of reading the instructions and / or data in the storage unit, and as a result, the device implements the embodiments of the foregoing method.

[0141]

[0130] The device 2000 may include a unit configured to execute the method of FIG. 3 or FIG. 8. Further, the units in the device 2000 and the other operations and / or functions described above are each intended to implement the corresponding procedures of the embodiments of the method of FIG. 3 or FIG. 8.

[0142]

[0131] When the device 2000 is configured to execute the method 800 of FIG. 8, the acquisition unit 2010 may be configured to execute S801 of the method 800, the processing unit 2020 may be configured to execute S802 of the method 800, and the prompt unit 2030 may be configured to execute S803 of the method 800.

[0143]

[0132] Specifically, the apparatus 200 includes: an acquisition unit 2010 configured to acquire real-time traveling parameters of the vehicle and surrounding environment information when a driver drives the vehicle; a processing unit 2020 configured to determine the driving habit of the driver based on the real-time traveling parameters and the surrounding environment information; and a prompt unit 2030 configured to present driving reminder information to the driver when the driving habit meets the first preset condition.

[0144]

[0133] In some possible implementations, the processing unit 2020 is further configured to determine the driving experience of the driver based on the real-time traveling parameters. Specifically, the prompt unit 2030 is configured to present driving reminder information to the driver when the driving habit meets the first preset condition and the driving experience meets the second preset condition.

[0145]

[0134] In some possible implementations, further: The prompt unit 2030 is configured to present vehicle speed reminder information to the driver when it is detected that the vehicle speed of the vehicle exceeds the preset vehicle speed, and the vehicle speed reminder information is to remind the driver to decelerate and / or the recommended vehicle speed; and / or The prompt unit 2030 is configured to present yielding instruction information to the driver when another road user is detected, and the yielding instruction information is to remind the driver to yield to another road user; and / or The prompt unit 2030 is configured to present inter-vehicle distance reminder information to the driver when the distance between the vehicle and the vehicle ahead is less than or equal to the preset distance, and the inter-vehicle distance reminder information is to remind the driver to maintain the inter-vehicle distance and / or the recommended inter-vehicle distance; and / or The prompt unit 2030 is configured to present temporary parking reminder information to the driver when it is detected that the vehicle has entered a restricted parking area, and the temporary parking reminder information is to remind the driver of the restricted parking area and / or the parking period; and / or The prompt unit 2030 is configured to present driving observation reminder information to the driver when at least one of a lane change of the vehicle, a deceleration of the vehicle, another vehicle behind the vehicle, and an obstacle on the driving road is detected, and the driving observation reminder information is to prompt the driver to notice the violation reminder information around the vehicle.

[0146]

[0135] In some possible implementations, the prompt unit 2030 is further configured to present non-standard driving data that occurred during the current trip and / or present a comparison result between the non-standard driving data that occurred during the current trip and the non-standard driving data that occurred during past trips when the current trip ends.

[0147]

[0136] In some possible implementations, non-standard driving includes at least one of a distance between the vehicle and a vehicle ahead being less than or equal to a preset distance, not yielding the road to another road user, a parking violation, a speed violation, and a traffic regulation violation.

[0148]

[0137] In some possible implementations, when the vehicle travels to a first road section and intelligent driving is supported in the first road section, the prompt unit 2030 is further configured to prompt the driver to switch the vehicle to the intelligent driving mode.

[0149]

[0138] In some possible implementations, the processing unit 2020 is further configured to determine the driving reminder information based on the surrounding environment information before the prompt unit 2030 presents the driving reminder information to the driver.

[0150]

[0139] In one possible implementation, the real-time traveling parameter includes a concession parameter, and the concession parameter represents an action of a vehicle yielding to another road user in the current trip.

[0151]

[0140] It should be understood that the division of units in the device is merely a logical function division, and may be fully or partially integrated into a physical entity or physically separated during actual implementation. Furthermore, the units of the device may be realized in the form of a processor calling software. For example, the device includes a processor, the processor is connected to a memory, the memory stores instructions, and the processor calls the instructions stored in the memory to implement any one of the foregoing methods or implement the functions of the units of the device. The processor is, for example, a general-purpose processor such as a CPU or a microprocessor. The memory is an internal memory or an external memory of the device. Alternatively, the units of the device may be realized in the form of a hardware circuit, and some or all of the functions of the units may be realized by designing a hardware circuit. The hardware circuit may be understood as one or more processors. For example, in an implementation, the hardware circuit is an ASIC, and some or all of the functions of the foregoing units are realized by designing the logical relationship between components in the circuit. Regarding another example, in another implementation, the hardware circuit may be realized by using a PLD. An FPGA is used as an example. The FPGA may include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is set by using a configuration file to implement some or all of the functions of the foregoing units. All the units of the foregoing device may be realized in the form of a processor calling software, or in the form of a hardware circuit, or some of the units are implemented in the form of a processor calling software, and the remaining units are realized in the form of a hardware circuit.

[0152]

[0141] In this embodiment of the present application, the processor is a circuit having signal processing capabilities. In implementation, the processor may be a circuit having the ability to read and execute instructions, for example, a CPU, a microprocessor, a GPU, or a DSP. In another implementation, the processor may be able to realize specific functions by using the logical relationships of hardware circuits. The logical relationships of the hardware circuits may be fixed or reconfigurable. For example, the processor is a hardware circuit implemented by using an ASIC or a PLD, such as an FPGA. In a reconfigurable hardware circuit, the process in which the processor loads a configuration document to realize the hardware circuit configuration may be understood as the process in which the processor loads instructions to implement some or all of the functions of the aforementioned units. Further, the processor may alternatively be a hardware circuit designed for artificial intelligence and may be understood as an ASIC, such as an NPU, a TPU, or a DPU.

[0153]

[0142] It can be seen that the units in the aforementioned device may be one or more processors (or processing circuits) configured to implement the aforementioned method, for example, a CPU, a GPU, an NPU, a TPU, a DPU, a microprocessor, a DSP, an ASIC, an FPGA, or a combination of at least two of these processor forms.

[0154]

[0143] Further, all or part of the units in the aforementioned device may be integrated together or may be realized independently. In implementation, a plurality of units are integrated together and realized in the form of a system-on-a-chip (SOC). The SOC may include at least one processor configured to implement any one of the aforementioned methods or to implement the functions of the units of the device. The types of at least one processor may be different. For example, the at least one processor includes a CPU and an FPGA, a CPU and an artificial intelligence processor, or a CPU and a GPU.

[0155]

[0144] Figure 10 is a schematic block diagram of an operation support device according to an embodiment of the present application. The operation support device 2100 shown in FIG. 10 may include a processor 2110, a transceiver 2120, and a memory 2130. The processor 2110, the transceiver 2120, and the memory 2130 are connected via an internal connection path. The memory 2130 is configured to store instructions. The processor 2110 is configured to execute the instructions stored in the memory 2130, and as a result, the transceiver 2120 receives / sends some parameters. Optionally, the memory 2130 may be coupled to the processor 2110 via an interface or integrated with the processor 2110.

[0156]

[0145] It should be noted that the transceiver 2120 may include, but is not limited to, a transceiver device such as an input / output interface for performing communication between the device 2100 and another device or a communication network.

[0157]

[0146] In an implementation process, the steps of the foregoing method may be completed by using an integrated logic circuit of hardware within the processor 2110 or by using instructions in the form of software. The method disclosed with reference to the embodiments of this application may be directly executed by a hardware processor or may be executed by using a combination of hardware within the processor and software modules. The software modules may be disposed in a storage medium that is mature in the art, for example, a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, or a register. The storage medium is disposed within the memory 2130. The processor 2110 reads information within the memory 2130 and completes the steps of the foregoing method in combination with the hardware of the processor 2110. To avoid repetition, details are not described again here.

[0158]

[0147] The processor 2110 may be a general-purpose CPU, microprocessor, ASIC, GPU, or one or more integrated circuits, and is configured to execute a related program to implement the driving assistance method in the embodiment of the method of this application. The processor 2110 may further be an integrated circuit chip and has signal processing capabilities. In a specific implementation process, the steps of the driving assistance method in this application may be completed by using the integrated logic circuit of the hardware in the processor 2110 or by using instructions in the form of software. Alternatively, the processor 2110 may be a general-purpose processor, DSP, ASIC, FPGA, or another programmable logic device, individual gate, transistor logic device, or individual hardware component. The processor can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor, or the processor may be any conventional processor or the like. The steps in the method disclosed with reference to the embodiments of this application may be directly executed and completed by a hardware decoding processor, or may be executed and completed by using a combination of hardware and software modules in the decoding processor. The software module may be disposed in a storage medium that is mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or register. The storage medium is disposed in the memory 2130. The processor 2110 reads the information in the memory 2130 and executes the driving assistance method in the embodiment of the method of this application in combination with the hardware of the processor 2110.

[0159]

[0148] The memory 2130 may be a read-only memory (ROM), static storage device, dynamic storage device, or random access memory (RAM).

[0160]

[0149] The transceiver 2120 uses, but is not limited to, a transceiver device, such as a transceiver, to effect communication between the device 2100 and another device or a communication network.

[0161]

[0150] Embodiments of the present application further provide a driver assistant. The driver assistant includes at least one of a virtual image and a physical image. The driver assistant includes at least one processor configured to execute a computer program stored in a memory, whereby the driver assistant executes the method of FIG. 3 or FIG. 8. The driver assistant may be mounted on at least one of an in-vehicle screen, a head-up display (HUD), a cockpit, and an in-vehicle audio device.

[0162]

[0151] Embodiments of the present application further provide an advanced driver assistance system. The system includes the aforementioned device 2000 or the aforementioned device 2100.

[0163]

[0152] Embodiments of the present application further provide an intelligent vehicle. The intelligent vehicle may include the aforementioned device 2000 or the aforementioned device 2100.

[0164]

[0153] Embodiments of the present application further provide a computer-readable medium. The computer-readable medium stores program code, and when the computer program code is executed on a computer, the computer can execute the method of FIG. 3 or FIG. 8.

[0165]

[0154] Embodiments of the present application further provide a chip including at least one processor and a memory. The at least one processor is coupled to the memory and is configured to read and execute instructions in the memory to execute the method of FIG. 3 or FIG. 8.

[0166]

[0155] It should be understood that the sequence numbers of the foregoing processes do not mean the execution sequences in various embodiments of the present application. The execution sequence of a process should be determined based on the function and internal logic of the process, and should not be construed as any limitation to the implementation process of the embodiments of the present application.

[0167]

[0156] Those skilled in the art can recognize that in combination with the examples described in the embodiments disclosed in this specification, the units and algorithm steps may be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether the function is executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use various methods to implement the functions described for each specific application, but it should not be considered that the implementation goes beyond the scope of the present application.

[0168]

[0157] For the sake of simplicity of description, those skilled in the art will clearly understand that for the detailed operation processes of the foregoing systems, devices, and units, reference may be made to the corresponding processes in the embodiments of the foregoing methods. Details are not described again here.

[0169]

[0158] In some embodiments provided by this application, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the described device embodiments are merely examples. For example, the unit division is merely a logical function division and may be other divisions in actual implementation. For example, a plurality of units or components may be combined or integrated into another system, or some features may be ignored or not executed. Further, the disclosed mutual coupling or direct coupling or communication connection may be realized via some interface. The indirect coupling or communication connection between devices or units may be realized in electronic, mechanical, or other forms.

[0170]

[0159] The units described as separate parts may or may not be physically separate, and the parts shown as units may or may not be physical units, that is, they may be arranged in one place or may be distributed over a plurality of network units. Some or all of the units can be selected based on actual requirements to achieve the purpose of the solution of the embodiment.

[0171]

[0160] Further, the functional units in the embodiments of this application may be integrated into one processing unit, each of the units may physically exist alone, or two or more units may be integrated into one unit.

[0172]

[0161] When the function is realized in the form of a software functional unit and sold or used as an independent product, the function may be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of this application, in essence, or the part that contributes to the prior art or a part of the technical solution may also be realized in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for instructing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in the embodiments of this application. The aforementioned storage medium includes any medium capable of storing program codes such as a USB flash drive, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

[0173]

[0162] The foregoing description is merely a specific implementation of this application and the protection scope of this application is not limited thereto. Any modifications or substitutions easily devised by those skilled in the art within the technical scope disclosed in this application shall fall within the protection scope of this application. Therefore, the protection scope of this application shall follow the protection scope of the claims.

Claims

1. A driving assistance method, comprising: when a driver drives a vehicle, obtaining real-time traveling parameters of the vehicle and surrounding environment information; determining the driving habit of the driver based on the real-time traveling parameters and the surrounding environment information; and when the driving habit meets a first preset condition, presenting driving reminder information to the driver. A method comprising the above steps.

2. The method according to claim 1, further comprising: determining the driving experience of the driver based on the real-time traveling parameters; and when the driving habit meets the first preset condition, the step of presenting driving reminder information to the driver is: when the driving habit meets the first preset condition and the driving experience meets a second preset condition, presenting the driving reminder information to the driver. A method comprising the above steps.

3. In the method according to claim 1 or 2, the step of presenting driving reminder information to the driver is: when it is detected that the vehicle speed of the vehicle exceeds a preset vehicle speed, presenting vehicle speed reminder information to the driver, where the vehicle speed reminder information reminds the driver to decelerate and / or the recommended vehicle speed; and / or when another road user is detected, presenting yielding instruction information to the driver, where the yielding instruction information reminds the driver to yield to the other road user; and / or when the distance between the vehicle and the vehicle in front is less than or equal to a preset distance, presenting vehicle distance reminder information to the driver, where the vehicle distance reminder information reminds the driver to maintain the vehicle distance and / or the recommended vehicle distance; and / or when it is detected that the vehicle has entered a restricted parking area, presenting temporary parking reminder information to the driver, where the temporary parking reminder information reminds the driver of the restricted parking area and / or the parking period. When at least one of the following is detected: a lane change of the vehicle, deceleration of the vehicle, another vehicle behind the vehicle, and an obstacle on the road surface, presenting driving observation reminder information to the driver, wherein the driving observation reminder information prompts the driver to notice the violation reminder information around the vehicle; A method comprising the above.

4. In the method according to any one of Claims 1 to 3: When the current trip ends, presenting the data of non-standard driving occurred during the current trip, and / or presenting the comparison result between the data of non-standard driving occurred during the current trip and the data of non-standard driving occurred during past trips; A method further comprising the above.

5. In the method according to Claim 4, the non-standard driving includes: The distance between the vehicle and the vehicle ahead is less than or equal to a preset distance, Failing to yield the road to another road user, Parking violation, Speed violation, and Traffic regulation violation A method including at least one of the above.

6. In the method according to any one of Claims 1 to 5, when the vehicle travels to a first road section and intelligent driving is supported in the first road section, the method includes: Prompting the driver to switch the vehicle to the intelligent driving mode; A method further comprising the above.

7. In the method according to any one of Claims 1 to 6, before the step of presenting the driving reminder information to the driver, the method includes: Determining the driving reminder information based on the surrounding environment information; A method further comprising the above.

8. In the method according to any one of Claims 1 to 7, the real-time traveling parameter includes a yielding parameter, and the yielding parameter represents an action of the vehicle yielding the road to another road user in the current trip.

9. A driving assistance device, comprising: An acquisition unit configured to acquire the real-time traveling parameters of the vehicle and the surrounding environment information when the driver drives the vehicle; A processing unit configured to determine the driving habit of the driver based on the real-time traveling parameters and the surrounding environment information; and A prompt unit configured to present driving reminder information to the driver when the driving habit satisfies a first preset condition; An apparatus including the same.

10. A driving assistance apparatus comprising: A memory configured to store a computer program; and A processor configured to execute the computer program stored in the memory so that the driving assistance apparatus executes the method according to any one of Claims 1 to 9; An apparatus including the same.

11. A driver assistant including at least one of a virtual image and a physical image, comprising: A processor configured to execute a computer program stored in a memory so that the driver assistant executes the method according to any one of Claims 1 to 9, wherein the driver assistant can be mounted on at least one of a screen mounted on a vehicle, a head-up display (HUD), a voice device mounted on the vehicle, and a cockpit.

12. An intelligent vehicle including the apparatus according to Claim 9 or 10, or the driver assistant according to Claim 11.

13. A computer-readable storage medium storing a computer program, wherein when the computer program is executed by a computer, the method according to any one of Claims 1 to 9 is executed.

14. A chip including a processor and a data interface, wherein the processor reads instructions stored in a memory via the data interface and executes the method according to any one of Claims 1 to 9.

Images