Vehicle auxiliary driving information determination method and device, medium and product

By acquiring driver and vehicle information, the system determines the monitoring needs for vehicle-assisted driving information, obtains compensatory environmental information about the vehicle, and provides driving prompts, thereby addressing potential safety hazards during vehicle driving and improving driving safety and user experience.

CN121133713APending Publication Date: 2025-12-16SHANGHAI JIDOU TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202511607777.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-11-05
Publication Date
2025-12-16

AI Technical Summary

Technical Problem

If there are unexpected situations on the road, the driver's driving behavior is not standardized, or the driver fails to pay attention to abnormal conditions in the driving environment in time, the vehicle will have high driving safety hazards, affecting the user's driving experience and personal safety.

Method used

By determining the driver's driving status information and the vehicle's driving information, the system obtains the monitoring requirements for the vehicle's assisted driving information, controls the environmental information monitoring equipment, obtains the compensatory environmental information of the vehicle's environmental information monitoring equipment, obtains the vehicle's compensatory environmental information, and determines driving prompt information based on the compensatory environmental information and current operating parameters, and controls the information interaction equipment to display the driving prompt information.

Benefits of technology

The monitoring device, which acquires assisted driving information based on the driver's driving status and vehicle driving information, provides compensatory environmental information, reduces the accident rate, and improves driving safety and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121133713A_ABST
    Figure CN121133713A_ABST
Patent Text Reader

Abstract

The invention discloses a vehicle auxiliary driving information determination method and device, a medium and a product, and relates to the technical field of vehicle control, and the method comprises the steps: determining the driving state information of a driver, the target driving route of a vehicle and the current operation parameters; based on the driving state information, the target driving route and the current operation parameters, determining a monitoring demand of auxiliary driving information of the vehicle, and based on the monitoring demand of the auxiliary driving information, determining control parameters of environment information monitoring equipment of the vehicle; the environment information monitoring equipment is controlled to operate based on the control parameters, and compensation type environment information of the vehicle is obtained; according to the compensation type environment information and the current operation parameters, driving prompt information of the vehicle is determined, and an information interaction device of the vehicle is controlled to display the driving prompt information. The driving prompt information of the vehicle is determined in combination with the driving state information of the driver and the driving information of the vehicle, so that the driving safety of the vehicle and the driving experience of an automobile user are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of vehicle control technology, and in particular to a method, device, medium, and product for determining vehicle driver assistance information. Background Technology

[0002] During vehicle operation, if unexpected situations arise on the road, the driver's driving behavior is improper, or the driver fails to notice abnormal conditions in the driving environment in a timely manner, the vehicle will pose a significant safety hazard. Driving safety is one of the most pressing concerns for car owners. Therefore, how to monitor abnormal conditions in the driving environment and determine the vehicle's driver assistance information to reduce safety hazards and improve driving safety and the driving experience is a pressing issue in the field of vehicle control. Summary of the Invention

[0003] This invention provides a method, device, medium, and product for determining vehicle assisted driving information. It determines the monitoring needs of vehicle assisted driving information based on the driver's driving status information and the vehicle's driving information, and then determines the vehicle's compensatory environmental information and driving prompt information in order to reduce the vehicle's accident rate, improve vehicle driving safety, and enhance the driving experience of car users.

[0004] According to one aspect of the present invention, a method for determining vehicle assisted driving information is provided, the method comprising:

[0005] Determine the driver's driving status information and the vehicle's driving information, including the vehicle's target driving route and current operating parameters;

[0006] Based on driving status information, target driving route and current operating parameters, determine the monitoring requirements for vehicle assisted driving information, and based on the monitoring requirements for assisted driving information, determine the control parameters for vehicle environmental information monitoring equipment.

[0007] The control environment information monitoring equipment operates based on control parameters and acquires the vehicle's compensated environmental information;

[0008] Based on the compensated environmental information and current operating parameters, determine the driving prompts for the vehicle and control the vehicle's information interaction devices to display the driving prompts.

[0009] According to another aspect of the present invention, a vehicle-assisted driving information determining apparatus is provided. The vehicle-assisted driving information determining apparatus is used to implement the vehicle-assisted driving information determining method in any embodiment of the present invention. The apparatus includes:

[0010] The information acquisition module is used to determine the driver's driving status information and the vehicle's driving information, including the vehicle's target driving route and current operating parameters.

[0011] The parameter determination module is used to determine the vehicle's assisted driving information monitoring requirements based on driving status information, target driving route and current operating parameters, and to determine the control parameters of the vehicle's environmental information monitoring equipment based on the assisted driving information monitoring requirements.

[0012] The information monitoring module is used to control the environmental information monitoring equipment to operate based on control parameters and to acquire the vehicle's compensated environmental information.

[0013] The information prompt module is used to determine the driving prompt information of the vehicle based on the compensated environmental information and the current operating parameters, and to control the vehicle's information interaction device to display the driving prompt information.

[0014] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0015] At least one processor; and a memory communicatively connected to the at least one processor;

[0016] The memory stores a computer program that can be executed by at least one processor, which enables the at least one processor to perform the method for determining vehicle-assisted driving information in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the method for determining vehicle-assisted driving information in any embodiment of the present invention.

[0018] According to another aspect of the present invention, a computer program product is provided, the computer program product including a computer program, which, when executed by a processor, implements a method for determining vehicle assisted driving information according to any embodiment of the present invention.

[0019] The method for determining vehicle assisted driving information of the present invention includes: determining the driver's driving state information and the vehicle's driving information, wherein the vehicle's driving information includes the vehicle's target driving route and current operating parameters; determining the vehicle's assisted driving information monitoring requirements based on the driving state information, the target driving route, and the current operating parameters, and determining the control parameters of the vehicle's environmental information monitoring equipment based on the assisted driving information monitoring requirements; controlling the environmental information monitoring equipment to operate based on the control parameters and acquiring the vehicle's compensatory environmental information; determining the vehicle's driving prompt information based on the compensatory environmental information and the current operating parameters, and controlling the vehicle's information interaction device to display the driving prompt information. The technical solution of this invention determines the monitoring needs of assisted driving information based on the driver's driving status information, the vehicle's target driving route, and current operating parameters. This allows for the determination of control parameters for the environmental information monitoring equipment, which then operates based on these parameters. This enables low-cost and high-quality acquisition of the vehicle's compensatory environmental information. Combining this information with the current operating parameters, the invention identifies potential safety hazards in the driving environment that the driver may not have noticed, potentially causing driving conflicts. This data then generates driving prompts to alert the driver to take timely measures to avoid these hazards, reducing the accident rate and improving driving safety and the user's driving experience. This solution addresses the problem that during vehicle operation, if unexpected situations arise on the road, the driver's driving behavior is irregular, or the driver fails to notice abnormal conditions in the driving environment, the vehicle will face significant driving safety risks, impacting the user's driving experience and even endangering their personal safety.

[0020] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in this invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a flowchart illustrating a method for determining vehicle assisted driving information provided by the present invention;

[0023] Figure 2 This is a flowchart illustrating another method for determining vehicle assisted driving information provided by the present invention;

[0024] Figure 3 This is a schematic diagram of the structure of a vehicle driver assistance information determination device provided by the present invention;

[0025] Figure 4 This is a schematic diagram of the structure of an electronic device provided by the present invention. Detailed Implementation

[0026] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are merely some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "first," "second," "initial," "intermediate," "candidate," "alternate," "target," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0028] The acquisition, storage, use, and processing of data in the technical solution of this invention all comply with relevant laws and regulations. Specifically, the user information collected in this invention is information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, storage, use, processing, transmission, provision, disclosure, and application of related data all comply with relevant national and regional laws, regulations, and standards, and necessary confidentiality measures are taken. This does not violate public order and good morals, and corresponding operation entry points are provided for users to choose to authorize or reject automated decision-making results; if the user chooses to reject, the process proceeds to the expert decision-making process. It should be noted that in the embodiments of this application, certain software, components, models, and other existing industry solutions may be mentioned. These should be considered exemplary, intended only to illustrate the feasibility of implementing the technical solution of this application, and do not imply that the applicant has already used or necessarily used the relevant content of such solutions.

[0029] Figure 1This is a flowchart illustrating a method for determining vehicle-assisted driving information provided by the present invention. This embodiment is applicable to determining and displaying safety conflict information in the driving environment that the driver has not paid timely attention to, reducing safety hazards during vehicle operation, improving vehicle driving safety and the driving experience of car users. This method can be executed by the vehicle-assisted driving information determining device provided by the present invention. This device can be implemented in hardware and / or software. In a specific embodiment, the device can be integrated into an electronic device. The following embodiments will illustrate this using the integration of the device into an electronic device as an example. Figure 1 The method specifically includes the following steps:

[0030] S101. Determine the driver's driving status information and the vehicle's driving information.

[0031] Among these, driver's driving status information can be understood as a collection of driving behavior data during vehicle operation. This information reflects the driver's control over the vehicle and includes, but is not limited to, steering wheel operation data, drive-related operation data, and driving environment data that the driver is focused on. This driving environment data is related to the vehicle's real-time location, the driver's relative position within the vehicle, and visual orientation. Vehicle driving information can be understood as the vehicle's operational status data during operation. It is a dynamic data set that depicts "how the vehicle is operating" in real time across time and space. It digitizes the entire picture of the vehicle's movement and operation on the current road and in the current environment, reflecting where the vehicle is, how fast it is, where it is going, where it came from, whether it needs to accelerate / decelerate, whether it needs to turn, and its energy consumption. The vehicle's driving information includes its target driving route and current operating parameters. The target driving route can be understood as a driving guidance path planned based on the vehicle's origin and destination, guiding the driver from the origin to the destination. The vehicle's current operating parameters can be understood as the vehicle's real-time operating status parameters at the time of information acquisition, including the vehicle's current position, current speed, and current direction. The current position can be understood as the vehicle's real-time position at the time of information acquisition, i.e., the vehicle's relative position on the target driving route at the time of information acquisition. The current speed can be understood as the vehicle's real-time operating speed at the time of information acquisition, and the current direction can be understood as the vehicle's forward direction at the time of information acquisition. The vehicle's current position, current speed, and current direction can be used to predict the vehicle's operating mode over a future period. The vehicle's real-time position can be determined using positioning tools such as the Global Positioning System (GPS), Global Navigation Satellite System (GNSS), and BeiDou Navigation Satellite System; this invention does not specify this feature.

[0032] Specifically, the vehicle is equipped with information monitoring devices to monitor the driver's driving status and vehicle driving information. For example, sensors on the steering wheel determine steering wheel operation data; sensors on the accelerator and clutch determine drive-related operation data; an image acquisition device collects the driver's body contour information, analyzes it to obtain data such as the driver's facial orientation and eye position, and combines this data with the driver's relative position in the driver's seat to determine the driving environment data that the driver is concerned about; positioning devices determine the vehicle's current position; interaction with the vehicle controller obtains the vehicle's current speed; and the vehicle's current driving direction is determined based on the vehicle's position at the current information monitoring time and its position at the previous information monitoring time. The advantage of this setup is that it can obtain accurate and real-time vehicle driving information and driver driving status information, so as to identify environmental information that the driver may not be paying attention to, thereby improving driving safety while maximizing the efficiency of determining assisted driving information and reducing the cost of determining assisted driving information.

[0033] In one implementation, S101 specifically includes: determining the vehicle's starting position, destination position, and driving preference information, and determining the vehicle's initial driving route based on the starting position, destination position, and driving preference information; determining the vehicle's current position, and determining the vehicle's target driving route based on the current position and the initial driving route; and using a driving state monitoring device to determine the driver's visual orientation data, the vehicle's steering wheel angle data, accelerator pedal force data, brake pedal force data, and driver's seat pressure data.

[0034] The vehicle's starting position can be understood as its departure point. This can be obtained via a positioning tool when the vehicle starts, or determined based on the user's input of driving requirements into the navigation tool. Generally, when using a navigation tool, the user needs to input both the departure and destination points to plan a route. The departure point input by the user is the vehicle's starting position, and the destination point is the vehicle's destination. Furthermore, users can set filtering conditions for driving routes when using navigation tools, such as avoiding highways or rural roads, to plan routes that meet their driving needs and provide a high-quality driving experience. The filtering conditions input by the user constitute driving preference information. In addition, driving preference information can also be determined based on the vehicle's historical driving information. For example, by obtaining a preset number of driving tasks or driving tasks within a preset time period before the current driving task, and analyzing the route features of the obtained driving tasks, driving preference information can be determined.

[0035] The initial driving route can be understood as the vehicle's path determined based on its starting position, destination, and driving preferences. However, since vehicles move in real time, deviations from the pre-planned route are possible under special circumstances. Therefore, the driving route needs to be dynamically adjusted in real time. To reduce the processor resources required for secondary path planning, the initial driving route can be modified and adjusted based on the current position and nearby road conditions to obtain the path from the current position to the destination—the vehicle's target driving route. The driving state monitoring device can be understood as sensors that acquire driver state information, including an image acquisition unit for driver's visual orientation data, sensors for steering wheel angle data, sensors for accelerator pedal force data, sensors for brake pedal force data, and sensors for driver's seat pressure data. This setup aims to illustrate the specific content and acquisition methods of driver state information and vehicle driving information, thus defining the data source for determining assisted driving information.

[0036] Specifically, driver's visual orientation data is used to represent the driver's area of ​​environmental attention, vehicle steering wheel angle data can represent the vehicle's tilt, and accelerator pedal force data, brake pedal force data, and driver's seat pressure data can reflect the driver's posture in the driver's seat. Combined with image information acquired by the image acquisition device, the driver's contour information can be determined. By combining the vehicle's tilt, driver's visual orientation data, and contour information, environmental information that the driver can and cannot pay attention to during vehicle driving can be obtained. This allows the driver assistance system to monitor environmental information that the driver cannot pay attention to during driving, determine whether there are any safety hazards in that area, and improve driving safety.

[0037] S102. Based on driving status information, target driving route and current operating parameters, determine the monitoring requirements for vehicle assisted driving information, and based on the monitoring requirements for assisted driving information, determine the control parameters for vehicle environmental information monitoring equipment.

[0038] Among them, assisted driving information can be understood as environmental information that the driver cannot pay attention to during driving. This information has a certain positional relationship with the vehicle. Taking the four directions of front, back, left, and right as an example, when the driver cannot pay attention to the environmental information on the right side of the vehicle, the assisted driving information is the environmental information on the right side and the right front side of the vehicle (front and back are relative to the driving direction). Obtaining this information is to avoid driving accidents caused by sudden situations in the right side area of ​​the vehicle (such as merging with other vehicles, passing pedestrians, etc.). The monitoring requirements of assisted driving information are the instructions for obtaining assisted driving information. For example, when the assisted driving information is the environmental information on the right side and the right front side of the vehicle, the monitoring requirements for assisted driving information are determined to be the monitoring instructions for the right side and the right front side of the vehicle.

[0039] Environmental information monitoring equipment can be understood as image acquisition devices that capture images of the vehicle's operating environment. Different types of vehicles require different numbers of image acquisition devices. Generally, these devices need to be evenly deployed on the vehicle's exterior to ensure they can monitor environmental information from all directions. The image acquisition devices are capable of heightening and rotation. The control parameters of the vehicle's environmental information monitoring equipment can be understood as the height and rotation control parameters for these devices. This allows the devices to be adjusted to acquire environmental information that the driver cannot perceive during driving, thus improving the quality of that information.

[0040] Optionally, based on driving status information, target driving route, and current operating parameters, the monitoring requirements for vehicle assisted driving information are determined, including: determining the vehicle's first driving environment information based on visual orientation data, steering wheel angle data, accelerator pedal force data, brake pedal force data, and driver's seat pressure data; determining the vehicle's second driving environment information based on the first driving environment information, the environmental information of the target driving route, and the current position; and determining the monitoring requirements for assisted driving information based on the second driving environment information and the positional relationship between the vehicle and the vehicle.

[0041] The first driving environment information can be understood as the environmental information that the driver can perceive while driving, while the second driving environment information can be understood as the environmental information that the driver cannot perceive while driving. Specifically, based on visual orientation data, steering wheel angle data, accelerator pedal force data, brake pedal force data, and driver's seat pressure data, the driver's driving posture can be analyzed, thereby determining the vehicle's first driving environment information, i.e., the environmental information that the driver can perceive while driving. Based on the known first driving environment information, combined with the environmental information of the target driving route and the vehicle's current position, the vehicle's second driving environment information can be determined, i.e., the environmental information that the driver cannot perceive while driving. Furthermore, the positional relationship between the second driving environment information and the vehicle can be understood as the relative positional relationship between the second driving environment information and the vehicle, for example, the second driving environment information is on the right side of the vehicle, the second driving environment information is on the right front side of the vehicle, the second driving environment information is on the left side of the vehicle, the second driving environment information is on the left front side of the vehicle, etc., in order to determine the monitoring requirements of assisted driving information and thus determine the control parameters of the environmental information monitoring equipment.

[0042] On the one hand, when the environmental information monitoring equipment includes an image acquisition unit, the image acquisition unit is deployed on the first surface of the vehicle, which is the outer surface of the vehicle's shell away from the ground. In this configuration, the image acquisition unit must be able to rotate 360° and be mounted on the roof of the vehicle to enable it to acquire environmental information from all directions. Based on the monitoring requirements of assisted driving information, the control parameters of the vehicle's environmental information monitoring equipment are determined, including: acquiring the current monitoring range of the image acquisition unit, and determining the deflection angle and offset data of the image acquisition unit based on the current monitoring range and the monitoring requirements of assisted driving information.

[0043] The current monitoring range can be understood as the range of environmental information acquired by the image acquisition device in its current posture. The deflection angle of the image acquisition device can be understood as the amount of rotation of the image acquisition device, including the direction of rotation and the angle of rotation. The offset data of the image acquisition device can be understood as the rise or fall data of the image acquisition device. For example, in rainy or snowy weather, it is necessary to acquire ground data to avoid unnecessary driving accidents caused by untimely road condition checks. The image acquisition device can be adaptively raised.

[0044] Taking the area directly in front of the vehicle as 0°C as an example, assuming the current monitoring range of the image acquisition device is 270°C-360°C (equivalent to 0°C), and the monitoring requirement for assisted driving information is the right side and the right front side of the vehicle, then the deflection angle of the image acquisition device is determined to be a 90° rotation in the direction of travel. It is worth noting that if there is no need for ground monitoring, the offset data can remain stationary. However, in situations with heavy traffic, the offset data can be moved upwards by a preset distance (a pre-set amount of movement) to monitor the relative position and trajectory of the vehicle compared to other vehicles, predict the probability of a collision, and take appropriate braking measures in advance or in a timely manner to avoid driving accidents.

[0045] On the other hand, when the environmental information monitoring device includes at least two image acquisition units, the at least two image acquisition units are evenly deployed on the second surface of the vehicle. The second surface is the outer surface of the shell of the vehicle that is perpendicular to the ground. In this way, the image acquisition units are evenly deployed on the outside of the vehicle body. When the environmental information monitoring device includes two image acquisition units, they can be deployed relative to each other on the left and right sides of the vehicle body. When the environmental information monitoring device includes three image acquisition units, the three image acquisition units are deployed relative to each other on the outside of the vehicle body with an angle difference of 120°. When the environmental information monitoring device includes at least four image acquisition units, the at least four image acquisition units are evenly deployed on the four sides of the vehicle body. Alternatively, when there are image acquisition units on all four sides, more image acquisition units can be deployed on the side with higher demand for environmental information acquisition to improve the monitoring quality of environmental information in that direction. The present invention does not limit the specific deployment method. Based on the monitoring requirements of assisted driving information, the control parameters of the vehicle's environmental information monitoring equipment are determined, including: determining candidate image acquisition devices according to the monitoring requirements of assisted driving information and the deployment locations of at least two image acquisition devices; obtaining the current monitoring range of the candidate image acquisition devices; and determining the deflection angle and offset data of the candidate image acquisition devices according to the current monitoring range of the candidate image acquisition devices and the monitoring requirements of assisted driving information.

[0046] A candidate image acquisition device can be understood as an image acquisition device that needs to perform a compensatory environmental information acquisition task. For example, when image sensors are deployed on the left and right sides of a vehicle, and the monitoring requirement for assisted driving information is to monitor the environmental information on the right side of the vehicle, the image acquisition device deployed on the right side of the vehicle is identified as a candidate image acquisition device. The purpose of this setting is to specifically control the image acquisition device to perform the compensatory environmental information acquisition task, minimizing the workload of the image acquisition device while ensuring the quality of the acquired compensatory environmental information. Furthermore, the method for determining the deflection angle and offset data of the candidate image acquisition device is the same as the method for determining the deflection angle and offset data of the image acquisition device in the above example, and will not be elaborated here.

[0047] S103. The control environment information monitoring equipment operates based on control parameters and acquires the vehicle's compensatory environmental information.

[0048] The control environment information monitoring equipment operates based on control parameters and acquires the vehicle's compensatory environmental information. This can be understood as the control environment information monitoring equipment operating based on control parameters and acquiring real-time driving environment images of the vehicle after the environmental information monitoring equipment has stabilized. The resulting image information is the vehicle's compensatory environmental information.

[0049] Specifically, after obtaining the vehicle's compensatory environmental information, the method of the present invention further includes: obtaining the cumulative number of trips on the target driving route and determining whether the cumulative number of trips is greater than a preset route driving threshold; if the cumulative number of trips is greater than the preset route driving threshold, obtaining the characteristic road segment information of the target driving route and adjusting the compensatory environmental information using the characteristic road segment information of the target driving route.

[0050] The cumulative number of trips can be understood as the number of times the target route has been used. The preset route travel threshold can be understood as a pre-set condition for measuring the usage of a route. When the cumulative number of trips exceeds the preset route travel threshold, the target route is considered a frequently used route. The characteristic road segment information of the target route can be understood as common abnormal information of the target route in multiple travel records. This can be determined by analyzing the user's driving habits and the compensatory environmental information in multiple travel records. Adjusting the compensatory environmental information using the characteristic road segment information of the target route can be understood as determining the sum of the characteristic road segment information and the compensatory environmental information of the target route as the new compensatory environmental information. For example, if the target route has obtained environmental information on the right side of the vehicle in segment A in multiple travel records, it proves that the environmental information of segment A has a significant impact on the user's driving safety. However, if the environmental information of segment A is not in the compensatory environmental information, then the environmental information of segment A will be added to the compensatory environmental information to monitor the environmental information of segment A in a timely manner, improve obstacle avoidance, and enhance driving safety.

[0051] S104. Based on the compensated environmental information and current operating parameters, determine the vehicle's driving prompt information and control the vehicle's information interaction device to display the driving prompt information.

[0052] The vehicle's driving alert information can be understood as warning information about operating conditions that affect safe driving. For example, if the driver is focusing on the left side of the vehicle, but a running pedestrian suddenly appears on the right front side, given the vehicle's speed and direction, a collision is highly likely. The system predicts the collision based on the vehicle's speed and direction, as well as the pedestrian's speed and direction, and generates driving alert information. This alert includes, but is not limited to, the collision location, probability, timing, and severity, allowing the user to adjust vehicle settings and reduce the probability of the accident. The display methods for these alerts include, but are not limited to, screen display, audible alerts (with varying volumes and frequencies depending on the severity or urgency of the malfunction), and broadcasts, so the driver understands the severity of the malfunction. Furthermore, if multiple warnings are ineffective and the crisis persists, the invention will take emergency measures, such as forcibly stopping the vehicle. This is designed to reduce injuries to the vehicle, its occupants, and other objects / pedestrians / vehicles in the driving environment.

[0053] In one specific implementation, the vehicle's driving prompt information is determined based on compensatory environmental information and current operating parameters, including: determining the vehicle's current driving intention based on the current location, current driving speed, current driving direction, and target driving route; processing the compensatory environmental information to obtain abnormal environmental information, wherein the abnormal environmental information is at least one characteristic road segment information and / or at least one characteristic moving object information; and determining the vehicle's driving prompt information based on the current driving intention and the abnormal environmental information.

[0054] The current driving intention can be understood as the predicted driving mode of the vehicle over a future period of time (e.g., 30 seconds, 1 minute, etc.) based on the current location, current speed, current direction, and target route. Abnormal environmental information can be understood as characteristic moving object information (e.g., pedestrians, vehicles, or moving objects whose driving modes have changed) or characteristic road segment information (abnormal driving environments, such as unidentified objects or unclear ground conditions, or obstructed roads). Determining the vehicle's driving prompts based on the current driving intention and abnormal environmental information can be understood as analyzing moving objects or road segments in the abnormal environmental information that conflict with the current vehicle's driving, and generating driving prompts based on the collision situation between the moving object and the current vehicle or the current vehicle's driving parameters on that road segment.

[0055] Furthermore, the present invention also supports early warning based on the vehicle's historical driving habits and current driving behavior. For example, based on historical operating information and real-time operating scenarios, it can predict possible operational errors that the vehicle may make in specific road sections or scenarios (e.g., frequently driving over the line at a certain curve, failing to brake in time at a certain intersection, etc.). If the specific road section or scenario matches the current location information and scenario, an early warning mechanism is triggered to remind the driver not to make erroneous operations.

[0056] It is worth noting that vehicle control information can be partially synchronized (only processing rules are synchronized to protect user data privacy) or fully synchronized (processing rules and historical driving data are synchronized to maximize vehicle safety) to all vehicles under the driver's name via cloud connectivity, thereby improving driving safety for each vehicle under that driver's name. The synchronization interval of control information is related to the user's driving habits and driving needs, and this invention does not set this interval.

[0057] The technical solution of the above embodiments determines the monitoring needs of assisted driving information based on the driver's driving status information, the vehicle's target driving route, and current operating parameters. This allows for the determination of control parameters for the environmental information monitoring equipment, which then operates based on these parameters. This enables low-cost and high-quality acquisition of the vehicle's compensatory environmental information. Combining this compensatory environmental information with the current operating parameters, the system identifies potential safety hazards in the driving environment that the driver may not have noticed and that could conflict with the vehicle's current driving. This data then generates driving prompts to alert the driver to take timely measures to avoid these hazards, reducing the accident rate and improving driving safety and the user's driving experience. Furthermore, the monitoring range of the environmental information monitoring equipment of this invention can be adjusted based on the driver's driving status information, the vehicle's target driving route, and current operating parameters, improving the flexibility of environmental information monitoring. This design avoids the blind spots inherent in fixed sensing strategies, thereby enhancing the quality of environmental information monitoring. This addresses the issue that during vehicle operation, if unexpected situations arise on the road, the driver's driving behavior is irregular, or the driver fails to notice abnormal conditions in the driving environment in a timely manner, the vehicle will pose a high risk of driving safety, affecting the user's driving experience and even endangering the user's personal safety.

[0058] Figure 2 This is a flowchart illustrating another method for determining vehicle assisted driving information provided by the present invention. Based on the above embodiments, this embodiment provides a preferred method for determining assisted driving information, essentially a method for determining vehicle assisted driving information with more complete process details. Specifically, as shown... Figure 2 As shown, the method includes:

[0059] S201. Determine the vehicle's starting position, destination position, and driving preference information, and determine the vehicle's initial driving route based on the starting position, destination position, and driving preference information.

[0060] S202. Determine the vehicle's current location and, based on the current location and the initial driving route, determine the vehicle's target driving route.

[0061] S203. Using driving condition monitoring equipment, determine the driver's visual orientation data, vehicle steering wheel angle data, accelerator pedal force data, brake pedal force data, and driver's seat pressure data.

[0062] S204. Based on visual orientation data, steering wheel angle data, accelerator pedal force data, brake pedal force data, and driver's seat pressure data, determine the vehicle's primary driving environment information.

[0063] S205. Based on the first driving environment information, the environmental information of the target driving route, and the current location, determine the second driving environment information of the vehicle.

[0064] S206. Based on the second driving environment information and the positional relationship between vehicles, determine the monitoring requirements for assisted driving information.

[0065] S207. Based on the monitoring requirements of assisted driving information, determine the control parameters of the vehicle's environmental information monitoring equipment.

[0066] S208. The control environment information monitoring equipment operates based on control parameters and acquires the vehicle's compensatory environmental information.

[0067] S209. Determine the vehicle's current driving intention based on its current location, current speed, current direction of travel, and target route.

[0068] S210. Process the compensated environmental information to obtain abnormal environmental information.

[0069] Among them, abnormal environment information includes at least one characteristic road segment information and / or at least one characteristic moving object information.

[0070] S211. Based on the current driving intention and abnormal environment information, determine the driving prompt information for the vehicle and control the vehicle's information interaction device to display the driving prompt information.

[0071] Figure 3 This is a schematic diagram of the structure of a vehicle driver assistance information determination device provided by the present invention. Figure 3 As shown, the device includes: an information acquisition module 301, a parameter determination module 302, an information monitoring module 303, and an information prompting module 304.

[0072] The information acquisition module 301 is used to determine the driver's driving status information and the vehicle's driving information, wherein the vehicle's driving information includes the vehicle's target driving route and current operating parameters.

[0073] The parameter determination module 302 is used to determine the vehicle's assisted driving information monitoring requirements based on driving status information, target driving route and current operating parameters, and to determine the control parameters of the vehicle's environmental information monitoring equipment based on the assisted driving information monitoring requirements.

[0074] The information monitoring module 303 is used to control the environmental information monitoring equipment to operate based on control parameters and to acquire the vehicle's compensated environmental information.

[0075] The information prompt module 304 is used to determine the driving prompt information of the vehicle based on the compensated environmental information and the current operating parameters, and to control the vehicle's information interaction device to display the driving prompt information.

[0076] Optionally, the vehicle's current operating parameters include the vehicle's current position. The information acquisition module 301 is specifically used to: determine the vehicle's starting position, destination position, and driving preference information, and determine the vehicle's initial driving route based on the starting position, destination position, and driving preference information; determine the vehicle's current position, and determine the vehicle's target driving route based on the current position and the initial driving route; and use driving state monitoring equipment to determine the driver's visual orientation data, the vehicle's steering wheel angle data, accelerator pedal force data, brake pedal force data, and driver's seat pressure data.

[0077] Optionally, the parameter determination module 302 is specifically used to: determine the vehicle's first driving environment information based on visual orientation data, steering wheel angle data, accelerator pedal force data, brake pedal force data, and driver's seat pressure data; determine the vehicle's second driving environment information based on the first driving environment information, the environmental information of the target driving route, and the current position; and determine the monitoring requirements for assisted driving information based on the second driving environment information and the positional relationship between the vehicle and the vehicle.

[0078] Optionally, when the environmental information monitoring device includes an image acquisition unit, the image acquisition unit is deployed on a first surface of the vehicle, which is the outer surface of the vehicle's housing away from the ground; the parameter determination module 302 is specifically used to: obtain the current monitoring range of the image acquisition unit, and determine the deflection angle and offset data of the image acquisition unit based on the current monitoring range of the image acquisition unit and the monitoring requirements of the assisted driving information.

[0079] Optionally, when the environmental information monitoring equipment includes at least two image acquisition devices, the at least two image acquisition devices are evenly deployed on the second surface of the vehicle, which is the outer surface of the shell on the vehicle that is perpendicular to the ground; the parameter determination module 302 is specifically used to: determine candidate image acquisition devices according to the monitoring requirements of assisted driving information and the deployment positions of at least two image acquisition devices; obtain the current monitoring range of the candidate image acquisition devices, and determine the deflection angle and offset data of the candidate image acquisition devices according to the current monitoring range of the candidate image acquisition devices and the monitoring requirements of assisted driving information.

[0080] Optionally, the vehicle's current operating parameters also include the vehicle's current speed and current direction of travel; the information prompting module 304 is specifically used to: determine the vehicle's current driving intention based on the current location, current speed, current direction of travel, and target route; process the compensating environmental information to obtain abnormal environmental information, wherein the abnormal environmental information is at least one characteristic road segment information and / or at least one characteristic moving object information; and determine the vehicle's driving prompt information based on the current driving intention and the abnormal environmental information.

[0081] Optionally, the vehicle assisted driving information determination device further includes an information processing module, which is used to obtain the cumulative number of trips on the target driving route after obtaining the vehicle's compensatory environmental information, and determine whether the cumulative number of trips is greater than a preset route driving threshold; if the cumulative number of trips is greater than the preset route driving threshold, then the characteristic road segment information of the target driving route is obtained, and the compensatory environmental information is adjusted using the characteristic road segment information of the target driving route.

[0082] The vehicle assisted driving information determination device provided by the present invention can execute the vehicle assisted driving information determination method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0083] Figure 4 This is a schematic diagram of the structure of an electronic device provided by the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0084] like Figure 4As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the read-only memory 12 or loaded from the storage unit 18 into the RAM 13. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, read-only memory 12, and RAM 13 are interconnected via a bus 14. An input / output interface 15 is also connected to the bus 14.

[0085] Multiple components in electronic device 10 are connected to input / output interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of monitors, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0086] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, central processing units, graphics processing units, various special-purpose artificial intelligence computing chips, various processors running machine learning model algorithms, digital signal processors, and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as methods for determining vehicle-assisted driving information.

[0087] In some embodiments, the method for determining vehicle-assisted driving information may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via read-only memory 12 and / or communication unit 19. When the computer program is loaded into random access memory 13 and executed by processor 11, one or more steps of the method for determining vehicle-assisted driving information described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the method for determining vehicle-assisted driving information by any other suitable means (e.g., by means of firmware).

[0088] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays, application-specific integrated circuits (ASICs), application-specific standard products (ASICs), systems-on-a-chip (SoCs), payload programmable logic devices, computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0089] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0090] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory, read-only memory, erasable programmable read-only memory / flash memory, optical fibers, portable compact disk read-only memory, optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0091] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a cathode ray tube or liquid crystal display) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (voice input and / or tactile input).

[0092] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0093] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product within the cloud computing service system to address the shortcomings of traditional physical hosts and virtual private servers, such as high management difficulty and weak business scalability.

[0094] In one specific embodiment, the present invention also includes a computer program product, which includes a computer program that, when executed by a processor, implements the method for determining vehicle assisted driving information according to any embodiment of the present invention.

[0095] In the implementation of a computer program product, computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof. Programming languages ​​include object-oriented programming languages ​​as well as conventional procedural programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including local area networks (LANs) or wide area networks (WANs), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0096] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0097] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for determining vehicle assisted driving information, characterized in that, include: Determine the driver's driving status information and the vehicle's driving information, wherein the vehicle's driving information includes the vehicle's target driving route and current operating parameters; Based on the driving status information, the target driving route, and the current operating parameters, the monitoring requirements for the vehicle's assisted driving information are determined, and based on the monitoring requirements for the assisted driving information, the control parameters for the vehicle's environmental information monitoring equipment are determined. The environmental information monitoring equipment is controlled to operate based on the control parameters and to acquire the vehicle's compensated environmental information. Based on the compensated environmental information and the current operating parameters, the driving prompt information for the vehicle is determined, and the vehicle's information interaction device is controlled to display the driving prompt information.

2. The method according to claim 1, characterized in that, The vehicle's current operating parameters include the vehicle's current location. Determining the driver's driving status information and the vehicle's driving information includes: The starting position, destination position, and driving preference information of the vehicle are determined, and the initial driving route of the vehicle is determined based on the starting position, destination position, and driving preference information. Determine the current position of the vehicle, and determine the target driving route of the vehicle based on the current position and the initial driving route; Using driving status monitoring equipment, the driver's visual orientation data, the vehicle's steering wheel angle data, accelerator pedal force data, brake pedal force data, and driver's seat pressure data are determined.

3. The method according to claim 2, characterized in that, The step of determining the monitoring requirements for the vehicle's assisted driving information based on the driving status information, the target driving route, and the current operating parameters includes: Based on the visual orientation data, the steering wheel angle data, the accelerator pedal force data, the brake pedal force data, and the driver's seat pressure data, the first driving environment information of the vehicle is determined; Based on the first driving environment information, the environmental information of the target driving route, and the current location, the second driving environment information of the vehicle is determined; Based on the positional relationship between the second driving environment information and the vehicle, the monitoring requirements for the assisted driving information are determined.

4. The method according to claim 1, characterized in that, When the environmental information monitoring device includes an image acquisition device, the image acquisition device is deployed on a first surface of the vehicle, the first surface being the outer surface of the shell of the vehicle that is away from the ground; The determination of control parameters for the vehicle's environmental information monitoring equipment based on the monitoring requirements of the assisted driving information includes: The current monitoring range of the image acquisition device is obtained, and the deflection angle and offset data of the image acquisition device are determined based on the current monitoring range of the image acquisition device and the monitoring requirements of the assisted driving information.

5. The method according to claim 1, characterized in that, When the environmental information monitoring device includes at least two image acquisition units, the at least two image acquisition units are evenly deployed on the second surface of the vehicle, the second surface being the outer surface of the shell of the vehicle that is perpendicular to the ground; The determination of control parameters for the vehicle's environmental information monitoring equipment based on the monitoring requirements of the assisted driving information includes: Candidate image collectors are determined based on the monitoring requirements of the assisted driving information and the deployment locations of the at least two image collectors; The current monitoring range of the candidate image acquisition device is obtained, and the deflection angle and offset data of the candidate image acquisition device are determined based on the current monitoring range of the candidate image acquisition device and the monitoring requirements of the assisted driving information.

6. The method according to claim 2, characterized in that, The vehicle's current operating parameters also include the vehicle's current speed and current direction of travel; determining the vehicle's driving prompt information based on the compensated environmental information and the current operating parameters includes: The vehicle's current driving intention is determined based on its current location, current speed, current direction of travel, and target route. The compensated environmental information is processed to obtain abnormal environmental information, wherein the abnormal environmental information is at least one characteristic road segment information and / or at least one characteristic moving object information; Based on the current driving intention and the abnormal environment information, the driving prompt information for the vehicle is determined.

7. The method according to claim 1, characterized in that, After acquiring the compensated environmental information of the vehicle, the method further includes: Obtain the cumulative number of trips for the target route and determine whether the cumulative number of trips is greater than a preset route trip threshold; If the cumulative number of trips exceeds the preset route travel threshold, then the characteristic road segment information of the target travel route is obtained, and the compensatory environmental information is adjusted using the characteristic road segment information of the target travel route.

8. An electronic device, characterized in that, The electronic device includes: At least one processor; and a memory communicatively connected to said at least one processor; The memory stores a computer program that can be executed by the at least one processor, which is then executed by the at least one processor to enable the at least one processor to perform the method for determining vehicle-assisted driving information as described in any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the method for determining vehicle driver assistance information as described in any one of claims 1 to 7.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the method for determining vehicle driver assistance information as described in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Auxiliary driving method, device and equipment and storage medium

    CN112277955A

  • Driving assistance processing method and device, computer readable medium and electronic equipment

    CN113119962A

  • Driving state detection method and device, electronic equipment and readable storage medium

    CN118762353A

  • Vehicle driving behavior monitoring method and device

    CN120711236A

  • System and method for estimating available driving distance of electic vehicle

    US20180066958A1