Driving action guiding method and device, equipment, medium and vehicle

By obtaining the vehicle's driving conditions and navigation information, generating standard driving parameters and projecting virtual driving images, it solves the problem that novice drivers find it difficult to determine the timing and amplitude of driving movements, and achieves accurate driving guidance and safety improvement.

CN118991809APending Publication Date: 2024-11-22FUTURUS TECH CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202310564763.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-18
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

It is difficult for novice drivers to determine the timing and range of driving movements during driving, resulting in improper operation and safety hazards. The existing head-up display device cannot provide personalized navigation instructions based on the driver's driving ability.

Method used

By obtaining the vehicle's driving conditions, navigation information and vehicle parameters, standard driving parameters are determined, and a matching virtual driving image is generated. The virtual driving image is projected by the head-up display device for the driver to imitate and perform driving operations.

Benefits of technology

It provides accurate driving guidance, improves driving experience and safety, helps drivers better master driving movements, reduces cognitive load, and improves driving skills.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118991809A_ABST
    Figure CN118991809A_ABST
Patent Text Reader

Abstract

The invention relates to a driving action guiding method, device and equipment, a medium and a vehicle, and relates to the technical field of auxiliary driving. The driving road condition, the navigation information and the vehicle parameters of the vehicle are obtained; determining standard driving parameters corresponding to the driving road condition based on the driving road condition, the navigation information and the vehicle parameters; based on the standard driving parameters, generating a first virtual driving image with the driving action matched with the standard driving parameters; and projecting the first virtual driving image to the front of the driver through a head-up display device, so that the driver can drive the vehicle by simulating the driving action of the first virtual driving image, and the virtual driving image corresponding to the standard driving action corresponding to the current road condition can be displayed on an HUD picture of the vehicle in real time. The standard driving action is dynamically displayed through the virtual driving image, a driver can directly refer to the driving action of the virtual driving image to carry out driving operation, accurate driving guidance can be provided for the driver, and driving experience and driving safety are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of assisted driving technology, and in particular to a driving action guidance method, device, equipment, medium and vehicle. Background Art

[0002] Existing Head Up Display (HUD) devices can guide drivers to drive vehicles by displaying navigation instructions (such as navigation arrows), making driving easier and safer. However, drivers of different driving levels require different navigation instructions. For example, novice drivers may need more detailed instructions, including turning angles, turning timing, vehicle speed, etc., while experienced drivers may only need a simple prompt to execute accurately. Therefore, based on the different driving abilities and habits of drivers, different levels of prompts and guidance need to be provided to help drivers drive vehicles better.

[0003] For novice drivers, even if they have navigation instructions and know that they need to perform steering, reversing and other operations during driving, they may not be able to determine the timing and amplitude of each driving action, which may lead to improper driving operations and bring safety hazards. Therefore, a driving action guidance method is urgently needed to accurately guide the driver's driving actions. Summary of the invention

[0004] In order to solve the above technical problems, the present disclosure provides a driving action guidance method, device, equipment, medium and vehicle.

[0005] A first aspect of the present disclosure provides a driving action guiding method, the method comprising:

[0006] Obtain the vehicle's driving conditions, navigation information and vehicle parameters;

[0007] Determine standard driving parameters corresponding to the vehicle driving under the driving conditions based on the driving conditions, navigation information and vehicle parameters;

[0008] Based on the standard driving parameters, generating a first virtual driving image whose driving action matches the standard driving parameters;

[0009] The first virtual driving image is projected in front of the driver through the head-up display device, so that the driver can drive the vehicle by imitating the driving action of the first virtual driving image.

[0010] A second aspect of the present disclosure provides a driving action guiding device, the device comprising:

[0011] The first acquisition module is used to acquire the vehicle's driving conditions, navigation information and vehicle parameters;

[0012] A first determination module is used to determine the standard driving parameters corresponding to the vehicle driving under the driving conditions based on the driving conditions, navigation information and vehicle parameters;

[0013] A first generating module, for generating, based on the standard driving parameters, a first virtual driving image whose driving action matches the standard driving parameters;

[0014] The first projection module is used to project the first virtual driving image in front of the driver through the head-up display device, so that the driver can drive the vehicle by imitating the driving movements of the first virtual driving image.

[0015] A third aspect of the present disclosure provides a vehicle machine device, the device comprising:

[0016] A memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the driving action guidance method of the first aspect mentioned above can be implemented.

[0017] A fourth aspect of the present disclosure provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the driving action guidance method of the first aspect can be implemented.

[0018] The fifth aspect of the present disclosure provides a vehicle, which includes the driving action guidance device of the second aspect or the vehicle-mounted device of the third aspect or the computer-readable storage medium of the fourth aspect, and can implement the driving action guidance method of the first aspect.

[0019] Compared with the prior art, the technical solution provided by the present invention has the following advantages:

[0020] The present invention obtains the driving condition, navigation information and vehicle parameters of a vehicle; determines the standard driving parameters corresponding to the driving condition based on the driving condition, navigation information and vehicle parameters; generates a first virtual driving image whose driving action matches the standard driving parameters based on the standard driving parameters; projects the first virtual driving image in front of the driver through a head-up display device so that the driver can drive the vehicle by imitating the driving action of the first virtual driving image, and can display the virtual driving image corresponding to the standard driving action corresponding to the current road condition on the HUD screen of the vehicle in real time, and dynamically display the standard driving action through the virtual driving image, so that the driver can directly refer to the driving action imitated by the virtual driving image to perform driving operations, and can provide the driver with accurate driving guidance, thereby improving driving experience and driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0022] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0023] Figure 1 is a flow chart of a driving action guidance method provided by an embodiment of the present disclosure;

[0024] Figure 2 is a flow chart of another driving action guiding method provided by an embodiment of the present disclosure;

[0025] Figure 3 is a flow chart of another driving action guidance method provided by an embodiment of the present disclosure;

[0026] Figure 4 is a flow chart of a driving action guidance method provided by an embodiment of the present disclosure;

[0027] Figure 5 is a structural schematic diagram of a driving action guiding device provided by an embodiment of the present disclosure;

[0028] Figure 6 It is a structural schematic diagram of a vehicle machine device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0029] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0030] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0031] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0032] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0033] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0034] Existing Head Up Display (HUD) devices can guide drivers to drive vehicles by displaying navigation instructions (such as navigation arrows), making driving easier and safer. However, drivers of different driving levels require different navigation instructions. For example, novice drivers may need more detailed instructions, including turning angles, turning timing, vehicle speed, etc., while experienced drivers may only need a simple prompt to execute accurately. Therefore, based on the different driving abilities and habits of drivers, different levels of prompts and guidance need to be provided to help drivers drive vehicles better.

[0035] For novice drivers, even if they have navigation instructions and know that they need to perform steering, reversing and other operations during driving, they may not be able to determine the timing and amplitude of each driving action, which may lead to improper driving operations and bring safety hazards. Therefore, a driving action guidance method is urgently needed to accurately guide the driver's driving actions.

[0036] In response to the defects of related technologies in driving guidance, the embodiments of the present disclosure provide a driving action guidance method, device, equipment, medium and vehicle, which can display a virtual driving image corresponding to the standard driving action corresponding to the current road conditions on the vehicle's HUD screen in real time, and dynamically display the standard driving action through the virtual driving image. The driver can directly refer to the driving action of the virtual driving image to perform driving operations, which can provide the driver with accurate driving guidance and improve driving experience and driving safety.

[0037] The driving action guidance method provided by the embodiment of the present disclosure can be executed by a vehicle-mounted device, which can be understood as any device with processing and computing capabilities. The device is usually installed in the console in the front row of the vehicle and can control various functions of the vehicle to realize interaction between the user and the vehicle.

[0038] In order to better understand the inventive concept of the embodiments of the present disclosure, the technical solutions of the embodiments of the present disclosure are described below in conjunction with exemplary embodiments.

[0039] Figure 1 is a flow chart of a driving action guidance method provided by an embodiment of the present disclosure, such as Figure 1 As shown, the driving action guidance method provided in this embodiment includes the following steps:

[0040] Step 110: Obtain the vehicle's driving conditions, navigation information, and vehicle parameters.

[0041] In the disclosed embodiments, the driving road condition can be understood as the external environmental information when the vehicle is driving, that is, the real-time information of various environmental elements on the road, which may include information of vehicles, pedestrians, road signs, etc. Navigation information can be understood as information guiding the vehicle to drive, which may include information such as straight driving, turning, reversing, changing lanes, speed limit, etc. Vehicle parameters can be understood as parameters of the vehicle itself related to driving, including fixed parameters of the vehicle, such as the vehicle model, outline size, turning radius, etc., and also real-time parameters of the vehicle, such as speed, mass, etc.

[0042] In the disclosed embodiment, the vehicle is equipped with various perception sensors such as cameras and laser radars, which can collect environmental information outside the vehicle. The vehicle equipment can obtain environmental information outside the vehicle from the perception sensors, and analyze the driving road condition information based on the environmental information. The vehicle equipment can obtain navigation information from the navigation map, obtain fixed parameters of the vehicle from the storage space, and obtain real-time parameters of the vehicle from various built-in data sensors.

[0043] Step 120: Based on the driving road condition, navigation information and vehicle parameters, determine the standard driving parameters corresponding to the vehicle driving under the driving road condition.

[0044] In the disclosed embodiment, after obtaining the driving conditions, navigation information and vehicle parameters of the vehicle, the vehicle machine device can determine the standard driving parameters corresponding to the vehicle driving under the driving conditions based on the driving conditions, navigation information and vehicle parameters. The standard driving parameters can be understood as the driving parameters corresponding to the standard driving action of the vehicle driving under the driving conditions, and can include parameters such as the steering angle of the vehicle steering wheel, the steering timing, the movement range of the accelerator pedal, and the movement range of the brake pedal.

[0045] In some embodiments, the vehicle's driving conditions, navigation information, and vehicle parameters may be input into a preset standard driving model, and based on the standard driving model, standard driving parameters corresponding to the driving conditions may be generated.

[0046] The standard driving model is a deep learning neural network model, which is trained based on driving parameters corresponding to standard driving behaviors of high-level drivers under various types of driving conditions, navigation information and vehicle parameters. Specifically, the driving parameters corresponding to standard driving behaviors of high-level drivers under various types of driving conditions, navigation information and vehicle parameters can be obtained, and then a data set is constructed based on the driving parameters corresponding to standard driving behaviors of high-level drivers under various types of driving conditions, navigation information and vehicle parameters. The model is trained based on the data set, so that the model can determine the standard driving parameters corresponding to the driving conditions according to the driving conditions, navigation information and vehicle parameters, and obtain the standard driving model.

[0047] Step 130: Based on the standard driving parameters, generate a first virtual driving image whose driving action matches the standard driving parameters.

[0048] In the disclosed embodiment, the virtual driving image may be understood as an image of a digital virtual person, which may be a two-dimensional virtual driving image or a three-dimensional virtual driving image, which is not limited here.

[0049] The vehicle-mounted device may generate a first virtual driving image whose driving action matches the standard driving parameters based on the standard driving parameters corresponding to the vehicle driving under the driving conditions, that is, each driving action of the first virtual driving image is the same as the standard driving action corresponding to the standard driving parameters. Specifically, the virtual driving image may display the driving action perspective of operating the steering wheel with hands, display the driving action perspective of stepping on the accelerator pedal or the brake pedal with feet, and display other driving action perspectives.

[0050] In some embodiments, based on the standard driving parameters, generating a first virtual driving image whose driving action matches the standard driving parameters may include steps 1301-1302:

[0051] Step 1301: input standard driving parameters into a preset human posture generation model, and generate standard driving posture data corresponding to the standard driving parameters based on the human posture generation model.

[0052] In the disclosed embodiment, the vehicle machine device can input the standard driving parameters into a preset human posture generation model, and generate standard driving posture data corresponding to the standard driving parameters based on the human posture generation model. The posture data can be the coordinate information of key points of the human body.

[0053] Among them, the human posture generation model is a deep learning neural network model, for example, it can be a generative adversarial network (GAN) or a variational autoencoder (VAE). The human posture generation model is trained based on the driver posture data corresponding to multiple standard driving parameters. Specifically, the driver posture data corresponding to multiple standard driving parameters can be obtained, and then a data set can be constructed based on the driver posture data corresponding to the multiple standard driving parameters, and the model training is performed based on the data set, so that the model can generate corresponding standard driving posture data based on the standard driving parameters to obtain a standard driving model.

[0054] Step 1302: construct a first virtual driving image based on the standard driving posture data.

[0055] In the disclosed embodiment, the vehicle-mounted device may construct a first virtual driving image based on standard driving posture data.

[0056] In some embodiments, a three-dimensional digital virtual human model pre-created using three-dimensional modeling software (such as Blender, Maya, etc.) is stored in the vehicle machine device. After obtaining the standard driving posture data, the skeletal structure data for controlling the human body posture can be determined based on the standard driving posture data, and then the skeletal structure data is added to the three-dimensional digital virtual human model to generate a first virtual driving image controlled by the standard driving posture data.

[0057] Step 140: Project the first virtual driving image in front of the driver through a head-up display device, so that the driver can drive the vehicle by imitating the driving movements of the first virtual driving image.

[0058] In the disclosed embodiments, a Head Up Display (HUD) device can project some information needed for driving a vehicle (such as speed, navigation and other driving information) to users (such as drivers, passengers, etc.), allowing users to see the required information without lowering or turning their heads as much as possible, so that the user's line of sight can be kept on the road, thereby improving driving safety.

[0059] In the disclosed embodiment, the vehicle-mounted device may communicate with the head-up display device. After generating a first virtual driving image whose driving actions match standard driving parameters, the vehicle-mounted device may send the first virtual driving image to the head-up display device. The head-up display device may project the first virtual driving image in front of the driver so that the driver can drive the vehicle by imitating the driving actions of the first virtual driving image.

[0060] For example, the HUD device can project the first virtual driving image sent by the vehicle equipment onto the HUD screen in front of the driver, such as a clear perspective of the virtual driving image's arms and hands operating the steering wheel, and feet controlling the accelerator and brake, distinguishing the movement postures of the upper and lower body, and adding some arrows and colors to increase the prompt effect. For example, when encountering a turn on an elevated bridge, the HUD device can display the appropriate movement of the virtual driving image's arms to operate the steering wheel, and display the appropriate movement of the virtual driving image's feet to control the brakes at the current vehicle speed.

[0061] If the driver's imitation of the virtual driving image's action range is insufficient or too large, the vehicle equipment can generate feedback information in different colors and send it to the HUD device for display. For example, when the turning range and turning timing meet the calculation range, green color is used to indicate that the current action is appropriate; when it is greater than or less than the calculation range, red color is used to indicate that the current action is inappropriate.

[0062] In different driving scenarios, the virtual driving image will focus on different factors. For example, in highway driving scenarios, the virtual driving image will focus on factors such as vehicle speed and lane keeping, acceleration and deceleration lane changes, etc. In urban driving scenarios, the virtual driving image will focus on factors such as traffic signals and pedestrian safety. In addition, in driving scenarios with passengers in the vehicle cabin, the virtual driving image will focus on factors such as ride comfort.

[0063] The vehicle equipment can also provide corresponding driving style and driving skills suggestions based on the driver's personalized needs and preferences and send them to the HUD device for display.

[0064] The disclosed embodiment obtains the driving condition, navigation information and vehicle parameters of the vehicle; determines the standard driving parameters corresponding to the driving condition based on the driving condition, navigation information and vehicle parameters; generates a first virtual driving image whose driving actions match the standard driving parameters based on the standard driving parameters; projects the first virtual driving image in front of the driver through a head-up display device so that the driver can drive the vehicle by imitating the driving actions of the first virtual driving image, and can display the virtual driving image corresponding to the standard driving actions corresponding to the current road condition on the HUD screen of the vehicle in real time, and dynamically display the standard driving actions through the virtual driving image, so that the driver can directly refer to the driving actions imitated by the virtual driving image to perform driving operations, and can provide the driver with accurate driving guidance, thereby improving driving experience and driving safety.

[0065] In some embodiments of the present disclosure, after determining the standard driving parameters corresponding to the vehicle driving under the driving conditions, the vehicle equipment can also project the standard driving parameters to the front of the driver through the head-up display device, so that the driver can drive the vehicle according to the driving actions of the first virtual driving image and the standard driving parameters, which can provide the driver with accurate driving guidance and improve the driving experience and driving safety. In other words, the user can watch the real-time driving action rendering video of the first virtual driving image (virtual driver) projected on the HUD, so that the user can synchronously imitate the driving actions (turning the steering wheel, stepping on the accelerator, stepping on the brake, etc.).

[0066] Humans have mirror neurons, which refer to a type of neurons in the human brain. When we see others do a certain action, these neurons will be activated, producing a similar experience to that of doing the action ourselves. Therefore, by utilizing the characteristics of mirror neurons possessed by humans, novice drivers can be guided to imitate and learn by letting them observe the high-level driving actions of virtual drivers, because compared with arrows, directional curves, etc., this method is more intuitive and efficient for human understanding and learning.

[0067] Therefore, the HUD provides the system-generated high-level first virtual driving image with visual feedback of driving actions, which can help novice drivers improve their grasp of driving actions in various scenarios. This reduces the driver's cognitive load, and users can quickly improve their driving ability and accumulate experience by imitating the actions of the HUD visual feedback.

[0068] Figure 2 is a flow chart of a driving action guidance method provided by an embodiment of the present disclosure, such as Figure 2 As shown, the driving action guidance method provided in this embodiment includes the following steps:

[0069] Step 210: Obtain the vehicle's driving conditions, navigation information, and vehicle parameters.

[0070] Step 220: Based on the driving road condition, navigation information and vehicle parameters, determine the standard driving parameters corresponding to the vehicle driving under the driving road condition.

[0071] Step 230: Based on the standard driving parameters, generate a first virtual driving image whose driving action matches the standard driving parameters.

[0072] Step 240: Project the first virtual driving image in front of the driver through the head-up display device, so that the driver can drive the vehicle by imitating the driving movements of the first virtual driving image.

[0073] The contents of steps 210-240 in the embodiment of the present disclosure may refer to the contents of the above-mentioned steps 110-140, which will not be repeated here.

[0074] Step 250: Obtain the actual driving parameters of the driver.

[0075] In the disclosed embodiment, the actual driving parameters may be understood as driving parameters corresponding to the actual driving actions of the driver.

[0076] After the first virtual driving image is projected onto the vehicle-mounted device in front of the driver through the head-up display device, the vehicle-mounted device can obtain the driver's actual driving parameters. The actual driving parameters may include parameters such as the actual steering angle of the steering wheel, the actual steering timing, the actual movement amplitude of the accelerator pedal, and the actual movement amplitude of the brake pedal. Specifically, the actual steering angle and actual steering timing of the steering wheel operated by the driver can be obtained from the steering sensor configured on the steering wheel, the actual movement amplitude of the accelerator pedal operated by the driver can be obtained from the movement sensor near the accelerator pedal, and the actual movement amplitude of the brake pedal operated by the driver can be obtained from the movement sensor near the brake pedal.

[0077] Step 260: In response to the actual driving parameter being consistent with the standard driving parameter, display a first prompt message.

[0078] In the disclosed embodiment, the vehicle-mounted device may compare the driver's actual driving parameters with the standard driving parameters. When the actual driving parameters are consistent with the standard driving parameters, the vehicle-mounted device may display a first prompt message in response to the actual driving parameters being consistent with the standard driving parameters.

[0079] Step 270: In response to the actual driving parameter being inconsistent with the standard driving parameter, display a second prompt message.

[0080] In the embodiment of the present disclosure, when the actual driving parameter is inconsistent with the standard driving parameter, the vehicle machine device can display a second prompt message in response to the actual driving parameter being inconsistent with the standard driving parameter. The second prompt message is different from the first prompt message.

[0081] Therefore, according to the comparison results between the actual driving parameters and the standard driving parameters, different prompt information can be displayed in the image part corresponding to the driving image to prompt the driver, so that the driver can clearly understand the accurate driving actions and improper driving actions, so as to make targeted improvements and improve driving skills.

[0082] In some embodiments, in response to the actual driving parameters being inconsistent with the standard driving parameters, displaying the second prompt information may include steps 2701-2702:

[0083] Step 2701: In response to the inconsistency between the actual driving parameters and the standard driving parameters, a second virtual driving image is generated based on the actual driving parameters, with the driving action matching the actual driving parameters.

[0084] In the disclosed embodiment, when the actual driving parameters are inconsistent with the standard driving parameters, the vehicle-mounted device can generate a second virtual driving image whose driving action matches the actual driving parameters based on the actual driving parameters in response to the inconsistency between the actual driving parameters and the standard driving parameters. The specific generation steps can refer to the generation steps of the first virtual driving image described above, which will not be repeated here.

[0085] Step 2702: Project the second virtual driving image onto the HUD screen so that the driver can compare the second virtual driving image with the first virtual driving image.

[0086] In the disclosed embodiment, the vehicle device can project the second virtual driving image onto the HUD screen, so that the driver can compare the second virtual driving image with the first virtual driving image and timely check the difference between the actual driving action and the standard driving action. In other words, the second prompt information can be the second virtual driving image that matches the driving action with the actual driving parameters.

[0087] Therefore, based on the comparison results of the second virtual driving image corresponding to the actual driving parameters and the first virtual driving image corresponding to the standard driving parameters, the difference between the actual driving action and the standard driving action can be checked in time, so that the driver can clearly understand the accurate driving action and the improper driving action, so as to make targeted improvements and improve driving skills.

[0088] In some other embodiments, in response to the actual driving parameter being inconsistent with the standard driving parameter, displaying the second prompt information may include steps 2711-2713:

[0089] Step 2711: In response to the actual driving parameter being inconsistent with the standard driving parameter, a problem parameter of the inconsistency between the actual driving parameter and the standard driving parameter and a difference between the problem parameter and the standard parameter corresponding to the problem parameter are obtained.

[0090] In the disclosed embodiment, when the actual driving parameters are inconsistent with the standard driving parameters, the vehicle-mounted device may, in response to the inconsistency between the actual driving parameters and the standard driving parameters, obtain the problem parameters of the inconsistency between the actual driving parameters and the standard driving parameters and the difference between the problem parameters and the standard parameters corresponding to the problem parameters.

[0091] Step 2712: Determine driving improvement suggestions corresponding to the problem parameters based on the size of the difference.

[0092] In the disclosed embodiment, the vehicle-mounted device may calculate the size of the difference between the problem parameter and the standard parameter corresponding to the problem parameter, and determine the driving improvement suggestion corresponding to the problem parameter based on the size of the difference between the problem parameter and the standard parameter corresponding to the problem parameter.

[0093] For example, when the problem parameter of the inconsistency between the actual driving parameters and the standard driving parameters is the actual steering angle, the vehicle equipment can calculate the difference between the actual steering angle and the standard steering angle. When the difference is greater than the preset steering threshold, it means that the steering angle is too large, and the driving improvement suggestion can be to control the steering force and steering operation range, which should not be too large. The preset steering threshold can be set as needed and is not limited here.

[0094] Step 2713: Project the problem parameters, difference values, and driving improvement suggestions in front of the driver via a head-up display device.

[0095] In the disclosed embodiment, the vehicle machine device can project the problem parameter of inconsistency between the actual driving parameter and the standard driving parameter, the difference between the problem parameter and the standard parameter corresponding to the problem parameter, and the driving improvement suggestion to the front of the driver through the head-up display device. That is, the second prompt information may include the problem parameter of inconsistency between the actual driving parameter and the standard driving parameter, the difference between the problem parameter and the standard parameter corresponding to the problem parameter, and the driving improvement suggestion.

[0096] Therefore, by comparing and analyzing the driver's actual driving parameters with the standard driving parameters, the driver can be shown problem parameters, differences and driving improvement suggestions, which can help the driver understand his driving conditions in more detail and take corresponding measures in time to improve his driving skills according to the driving improvement suggestions. At the same time, it can also allow the driver to control his driving behavior more independently and enhance the driver's self-confidence and driving ability.

[0097] For example, if it is found that the driver's posture is not stable enough on certain sections of the road, there is a decrease in attention (slow reaction), insufficient or excessive movement, too fast or too slow acceleration, etc. Based on these problems, the system can provide the driver with corresponding precautions and help tips to help them improve their driving skills and improve driving safety. This analysis and reminder method based on driver posture data can help drivers better understand their driving conditions and take corresponding measures in time to improve driving skills and ensure driving safety. At the same time, this method can also allow drivers to control their driving behavior more independently and enhance their self-confidence and driving ability.

[0098] In some other embodiments, the first prompt information may include a first color, the second prompt information may include a second color, and the second color is different from the first color. After obtaining the actual driving parameters of the driver, the vehicle-mounted device may determine the image part of the first virtual driving image corresponding to each sub-driving parameter included in the actual driving parameters.

[0099] The actual driving parameter may include at least one sub-driving parameter, and each sub-driving parameter corresponds to an image part of the virtual driving image. For example, when the sub-driving parameter is the actual steering angle of the steering wheel, the image part of the virtual driving image corresponding to the actual steering angle is the hand; when the sub-driving parameter is the actual movement range of the accelerator pedal or the brake pedal, the image part of the virtual driving image corresponding to the actual movement range is the right foot.

[0100] At this time, in response to the actual driving parameter being consistent with the standard driving parameter, the first prompt information is displayed, and in response to the sub-driving parameter being consistent with the sub-standard parameter in the standard driving parameter corresponding to the sub-driving parameter, a first color is displayed at the image part corresponding to the sub-driving parameter. For example, the first color may be green.

[0101] At this time, in response to the inconsistency between the actual driving parameter and the standard driving parameter, the second prompt information is displayed, which can be in response to the inconsistency between the sub-driving parameter and the sub-standard parameter in the standard driving parameter corresponding to the sub-driving parameter, displaying a second color at the image part corresponding to the sub-driving parameter. For example, the second color can be red.

[0102] Therefore, according to the comparison results between the actual driving parameters and the standard driving parameters, different colors can be displayed on the image parts corresponding to the driving image to prompt the driver, so that the driver can clearly understand the accurate driving actions and improper driving actions, so as to make targeted improvements and improve driving skills.

[0103] Figure 3 is a flow chart of a driving action guidance method provided by an embodiment of the present disclosure, such as Figure 3 As shown, the driving action guidance method provided in this embodiment includes the following steps:

[0104] Step 310: Obtain the vehicle's driving conditions, navigation information, and vehicle parameters.

[0105] Step 320: Based on the driving road condition, navigation information and vehicle parameters, determine the standard driving parameters corresponding to the vehicle driving under the driving road condition.

[0106] Step 330: Based on the standard driving parameters, generate a first virtual driving image whose driving action matches the standard driving parameters.

[0107] Step 340: Project the first virtual driving image in front of the driver through the head-up display device, so that the driver can drive the vehicle by imitating the driving movements of the first virtual driving image.

[0108] The contents of steps 310-340 in the embodiment of the present disclosure may refer to the contents of the above steps 110-140, which will not be repeated here.

[0109] Step 350: Obtain the actual driving parameters of the driver.

[0110] In the disclosed embodiment, the vehicle-mounted device can obtain the actual driving parameters of the driver.

[0111] Step 360: Determine the difference between the actual driving parameters and the standard driving parameters.

[0112] In the disclosed embodiment, the vehicle-mounted device may determine the difference between the actual driving parameters and the standard driving parameters.

[0113] Step 370: Determine a target driving operation score corresponding to the difference size based on a first corresponding relationship between the difference size and the driving operation score, wherein the first corresponding relationship includes a negative correlation between the difference size and the driving operation score.

[0114] In the disclosed embodiment, the vehicle-mounted device pre-stores a first correspondence between the difference between the actual driving parameters and the standard driving parameters and the driving operation score. The first correspondence includes a negative correlation between the difference and the driving operation score, that is, the larger the difference, the lower the driving operation score, and the smaller the difference, the higher the driving operation score.

[0115] The vehicle-mounted device may determine a target driving operation score corresponding to the size of the difference between the actual driving parameter and the standard driving parameter based on the first corresponding relationship between the size of the difference and the driving operation score.

[0116] Step 380: Project the target driving operation score onto the HUD screen.

[0117] In the disclosed embodiment, the vehicle-mounted device may project the target driving operation score onto the HUD screen.

[0118] Therefore, by scoring the driver's actual driving operations, it can help the driver to have a more comprehensive understanding of his overall driving condition.

[0119] In some embodiments, after determining the target driving operation score corresponding to the difference size, the vehicle-mounted device may also add the target driving operation score to the historical driving operation score to obtain a total driving operation score; based on a second correspondence between the total driving operation score and the driving experience level, determine the target driving experience level corresponding to the total driving operation score; and project the target driving operation score and the target driving experience level onto the HUD screen.

[0120] The historical driving operation score is the sum of the driver's driving operation scores before the current driving operation. The vehicle-mounted device pre-stores a second correspondence between the total driving operation score and the driving experience level, and the second correspondence includes a positive correlation between the total driving operation score and the driving experience level, that is, the higher the total driving operation score, the higher the driving experience level. For example, the driving experience level may include Lv1→Lv2→Lv3→Lv4→Lv5, etc.

[0121] Therefore, by scoring the driver's actual driving operations and determining the driving experience level, it can help the driver to have a more comprehensive understanding of his or her overall driving condition, motivate the driver to continuously improve his or her driving skills, accumulate driving experience, improve the driving experience level, gradually increase the requirements for driving skills, and help the driver quickly grow into an experienced driver.

[0122] In some embodiments of the present disclosure, it is also possible to Figure 4 A flowchart of a driving action guidance method is provided to guide driving actions.

[0123] Figure 5 is a schematic diagram of the structure of a driving action guidance device provided by an embodiment of the present disclosure, and the device can be understood as the above-mentioned vehicle equipment or part of the functional modules in the above-mentioned vehicle equipment. Figure 5 As shown, the driving action guiding device 500 includes:

[0124] The first acquisition module 510 is used to acquire the driving conditions, navigation information and vehicle parameters of the vehicle;

[0125] A first determination module 520, for determining standard driving parameters corresponding to the vehicle driving under the driving conditions based on the driving conditions, navigation information and vehicle parameters;

[0126] A first generating module 530 is used to generate a first virtual driving image whose driving action matches the standard driving parameters based on the standard driving parameters;

[0127] The first projection module 540 is used to project the first virtual driving image in front of the driver through the head-up display device, so that the driver can drive the vehicle by imitating the driving movements of the first virtual driving image.

[0128] Optionally, the driving action guiding device 500 includes:

[0129] The second projection module is used to project the standard driving parameters in front of the driver through the head-up display device, so that the driver can drive the vehicle according to the driving actions of the first virtual driving image and the standard driving parameters.

[0130] Optionally, the driving action guiding device 500 includes:

[0131] The second acquisition module is used to acquire the actual driving parameters of the driver;

[0132] A first display module, configured to display first prompt information in response to the actual driving parameter being consistent with the standard driving parameter;

[0133] The second display module is used to display second prompt information in response to the inconsistency between the actual driving parameters and the standard driving parameters, where the second prompt information is different from the first prompt information.

[0134] Optionally, the first prompt information includes a first color, the second prompt information includes a second color, and the second color is different from the first color;

[0135] The driving action guiding device 500 comprises:

[0136] A second determining module is used to determine the image part of the first virtual driving image corresponding to each sub-driving parameter included in the actual driving parameter;

[0137] The first display module includes:

[0138] A first display submodule, configured to display a first color at a portion of the image corresponding to the sub-driving parameter in response to the sub-driving parameter being consistent with a sub-standard parameter in the standard driving parameter corresponding to the sub-driving parameter;

[0139] The second display module includes:

[0140] The second display submodule is used for displaying a second color at the image part corresponding to the sub-driving parameter in response to the inconsistency between the sub-driving parameter and the sub-standard parameter in the standard driving parameter corresponding to the sub-driving parameter.

[0141] Optionally, the second display module includes:

[0142] a generating submodule, for generating, in response to the inconsistency between the actual driving parameters and the standard driving parameters, a second virtual driving image whose driving action matches the actual driving parameters based on the actual driving parameters;

[0143] The first projection submodule is used to project the second virtual driving image onto the HUD screen so that the driver can compare the second virtual driving image with the first virtual driving image.

[0144] Optionally, the second display module includes:

[0145] an acquisition submodule, for acquiring, in response to the inconsistency between the actual driving parameter and the standard driving parameter, a problem parameter in which the actual driving parameter is inconsistent with the standard driving parameter and a difference between the problem parameter and a standard parameter corresponding to the problem parameter;

[0146] A determination submodule is used to determine driving improvement suggestions corresponding to the problem parameters based on the size of the difference;

[0147] The second projection submodule is used to project the problem parameters, difference values ​​and driving improvement suggestions in front of the driver through the head-up display device.

[0148] Optionally, the driving action guiding device 500 includes:

[0149] The third acquisition module is used to obtain the actual driving parameters of the driver;

[0150] A third determination module is used to determine the difference between the actual driving parameter and the standard driving parameter;

[0151] A fourth determination module, configured to determine a target driving operation score corresponding to the difference size based on a first corresponding relationship between the difference size and the driving operation score, wherein the first corresponding relationship includes a negative correlation between the difference size and the driving operation score;

[0152] The third projection module is used to project the target driving operation score onto the HUD screen.

[0153] Optionally, the driving action guiding device 500 includes:

[0154] A calculation module, used for adding the target driving operation score to the historical driving operation score to obtain a total driving operation score;

[0155] a fifth determining module, configured to determine a target driving experience level corresponding to the total driving operation score based on a second corresponding relationship between the total driving operation score and the driving experience level, wherein the second corresponding relationship includes a positive correlation between the total driving operation score and the driving experience level;

[0156] The fourth projection module is used to project the target driving operation score and the target driving experience level onto the HUD screen.

[0157] Optionally, the first determining module 520 includes:

[0158] The parameter generation submodule is used to input the driving conditions, navigation information and vehicle parameters into a preset standard driving model, and based on the standard driving model, generate standard driving parameters corresponding to the vehicle driving under the driving conditions.

[0159] Optionally, the first generating module 530 includes:

[0160] A posture data generation submodule, used for inputting the standard driving parameters into a preset human posture generation model, and generating standard driving posture data corresponding to the standard driving parameters based on the human posture generation model;

[0161] The construction submodule is used to construct a first virtual driving image based on the standard driving posture data, where the first virtual driving image is a two-dimensional virtual driving image or a three-dimensional virtual driving image.

[0162] Optionally, the standard driving model is obtained by training based on driving parameters corresponding to standard driving behaviors of high-level drivers under various types of driving conditions, navigation information and vehicle parameters.

[0163] Optionally, the above-mentioned human body posture generation model is trained based on driver posture data corresponding to multiple standard driving parameters.

[0164] The driving action guidance device provided in the embodiments of the present disclosure can implement the method of any of the above embodiments, and its execution method and beneficial effects are similar, which will not be repeated here.

[0165] The disclosed embodiments also provide a vehicle-mounted device, which includes a processor and a memory, wherein a computer program is stored in the memory. When the computer program is executed by the processor, the method of any of the above embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0166] The vehicle machine device in the embodiment of the present disclosure can be understood as any device with processing and computing capabilities. The device is usually installed in the console in the front row of the vehicle, and can control various functions of the vehicle to realize interaction between the user and the vehicle.

[0167] Figure 6 is a structural diagram of a vehicle machine device provided by an embodiment of the present disclosure, such as Figure 6 As shown, the vehicle-mounted device 600 may include a processor 610 and a memory 620, wherein a computer program 621 is stored in the memory 620. When the computer program 621 is executed by the processor 610, the method provided by any of the above-mentioned embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0168] Of course, to simplify, Figure 6 Only some of the components related to the present invention in the vehicle machine device 600 are shown, and components such as a bus, an input / output interface, an input device, and an output device are omitted. In addition, according to specific application conditions, the vehicle machine device 600 may also include any other appropriate components.

[0169] An embodiment of the present disclosure provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the method of any of the above embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0170] The above-mentioned computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0171] The computer program may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer device, partially on the user's device, as a separate software package, partially on the user's computer device and partially on a remote computer device, or entirely on a remote computer device or server.

[0172] An embodiment of the present disclosure provides a vehicle, which includes the above-mentioned driving action guidance device or the above-mentioned vehicle-mounted equipment or the above-mentioned computer-readable storage medium, and can implement the method of any of the above-mentioned embodiments. Its execution method and beneficial effects are similar and will not be repeated here.

[0173] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other.

[0174] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0175] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A driving action guidance method, characterized in that: include: Obtain the vehicle's driving conditions, navigation information and vehicle parameters; Determining standard driving parameters corresponding to the vehicle driving under the driving condition based on the driving condition, navigation information and vehicle parameters; Based on the standard driving parameters, generating a first virtual driving image whose driving action matches the standard driving parameters; The first virtual driving image is projected in front of the driver through a head-up display device, so that the driver can drive the vehicle by imitating the driving movements of the first virtual driving image.

2. The method according to claim 1, characterized in that After determining the standard driving parameters corresponding to the vehicle driving under the driving conditions, the method further includes: The standard driving parameters are projected in front of the driver through a head-up display device, so that the driver can drive the vehicle according to the driving actions of the first virtual driving image and the standard driving parameters.

3. The method according to claim 1, characterized in that: After projecting the first virtual driving image in front of the driver through the head-up display device, the method further includes: Obtaining the actual driving parameters of the driver; In response to the actual driving parameter being consistent with the standard driving parameter, displaying a first prompt message; In response to the actual driving parameter being inconsistent with the standard driving parameter, second prompt information is displayed, where the second prompt information is different from the first prompt information.

4. The method according to claim 3, characterized in that The first prompt information includes a first color, the second prompt information includes a second color, and the second color is different from the first color; After obtaining the actual driving parameters of the driver, the method further includes: Determining an image part of the first virtual driving image corresponding to each sub-driving parameter included in the actual driving parameter; In response to the actual driving parameter being consistent with the standard driving parameter, displaying first prompt information includes: In response to the sub-driving parameter being consistent with a sub-standard parameter in the standard driving parameter corresponding to the sub-driving parameter, displaying the first color at the image portion corresponding to the sub-driving parameter; In response to the actual driving parameter being inconsistent with the standard driving parameter, displaying second prompt information includes: In response to the sub-driving parameter being inconsistent with a sub-standard parameter in the standard driving parameters corresponding to the sub-driving parameter, the second color is displayed at the image portion corresponding to the sub-driving parameter.

5. The method according to claim 3, characterized in that: In response to the actual driving parameter being inconsistent with the standard driving parameter, displaying second prompt information includes: In response to the actual driving parameter being inconsistent with the standard driving parameter, generating, based on the actual driving parameter, a second virtual driving image whose driving action matches the actual driving parameter; The second virtual driving image is projected onto the HUD screen so that the driver can compare the second virtual driving image with the first virtual driving image.

6. The method according to claim 3, characterized in that: In response to the actual driving parameter being inconsistent with the standard driving parameter, displaying second prompt information includes: In response to the actual driving parameter being inconsistent with the standard driving parameter, obtaining a problem parameter in which the actual driving parameter is inconsistent with the standard driving parameter and a difference between the problem parameter and a standard parameter corresponding to the problem parameter; Based on the size of the difference, determining a driving improvement suggestion corresponding to the problem parameter; The problem parameter, the difference value and the driving improvement suggestion are projected in front of the driver through a head-up display device.

7. The method according to claim 1, characterized in that After projecting the first virtual driving image in front of the driver through the head-up display device, the method further includes: Obtaining the actual driving parameters of the driver; determining a difference between the actual driving parameter and the standard driving parameter; determining a target driving operation score corresponding to the difference size based on a first corresponding relationship between the difference size and the driving operation score, wherein the first corresponding relationship includes a negative correlation between the difference size and the driving operation score; The target driving operation score is projected onto the HUD screen.

8. The method according to claim 7, characterized in that After determining the target driving operation score corresponding to the difference size based on the first corresponding relationship between the difference size and the driving operation score, the method further includes: Adding the target driving operation score to the historical driving operation score to obtain a total driving operation score; determining a target driving experience level corresponding to the total driving operation score based on a second corresponding relationship between the total driving operation score and the driving experience level, wherein the second corresponding relationship includes a positive correlation between the total driving operation score and the driving experience level; The target driving operation score and the target driving experience level are projected onto the HUD screen.

9. The method according to claim 1, characterized in that: The determining, based on the driving road condition, navigation information and vehicle parameters, the standard driving parameters corresponding to the vehicle driving under the driving road condition includes: The driving conditions, navigation information and vehicle parameters are input into a preset standard driving model, and based on the standard driving model, standard driving parameters corresponding to the vehicle driving under the driving conditions are generated.

10. The method according to claim 1, characterized in that The step of generating, based on the standard driving parameters, a first virtual driving image whose driving action matches the standard driving parameters comprises: Inputting the standard driving parameters into a preset human posture generation model, and generating standard driving posture data corresponding to the standard driving parameters based on the human posture generation model; Based on the standard driving posture data, the first virtual driving image is constructed, and the first virtual driving image is a two-dimensional virtual driving image or a three-dimensional virtual driving image.

11. The method according to claim 9, characterized in that The standard driving model is obtained by training based on driving parameters corresponding to standard driving behaviors of high-level drivers under various types of driving conditions, navigation information and vehicle parameters.

12. The method according to claim 10, characterized in that The human body posture generation model is obtained by training based on driver posture data corresponding to a plurality of standard driving parameters.

13. A driving action guiding device, characterized in that: include: The first acquisition module is used to acquire the vehicle's driving conditions, navigation information and vehicle parameters; A first determination module is used to determine the standard driving parameters corresponding to the vehicle driving under the driving condition based on the driving condition, navigation information and vehicle parameters; A first generating module, configured to generate, based on the standard driving parameters, a first virtual driving image whose driving action matches the standard driving parameters; The first projection module is used to project the first virtual driving image in front of the driver through a head-up display device, so that the driver can drive the vehicle by imitating the driving movements of the first virtual driving image.

14. A vehicle machine device, characterized in that: include: A memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the driving action guidance method according to any one of claims 1 to 12 is implemented.

15. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the driving action guidance method according to any one of claims 1 to 12 is implemented.

16. A vehicle, characterized in that: The vehicle includes the driving action guidance device according to claim 13 or the vehicle machine device according to claim 14 or the computer-readable storage medium according to claim 15.

Citation Information

Cited By

  • Driving auxiliary teaching method and device, electronic equipment and storage medium

    CN121938255A

  • Driving assistance teaching method and device, electronic equipment and storage medium

    CN121938255B