User takeover method and system for intelligent driving assistance system
Through risk level classification and flexible human-computer interaction prompts, the problem of insufficient information and overload of the takeover prompt design in the intelligent driving assistance system is solved, driving safety and system trust are improved, and accurate and timely user takeover is achieved.
Patent Information
- Application Number
- CN202411378124.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-30
- Publication Date
- 2024-11-29
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In driving scenarios that cannot be effectively covered, the existing intelligent driving assistance system indicates that there is insufficient information and overload of information in the design, resulting in the user failing to take over the vehicle in time, increasing the risk of accidents.
Adopt the risk level division mechanism, collect data in real time through sensors, analyze the driving environment and vehicle status, use visual, sound and tactile prompts to remind users to take over the vehicle, select different levels of prompt methods according to the risk level, and adjust the prompt intensity according to the driver's reaction. .
It improves users' sense of trust in the intelligent driving assistance system, improves driving safety and system utilization, ensures accurate and timely user takeover in different driving scenarios, and reduces potential risks.
Smart Images

Figure CN119037464A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of automobile assisted driving, and in particular to a user takeover method and system for an intelligent driving assistance system. Background Art
[0002] With the popularity of smart cars, users are using assisted driving functions more and more frequently. However, despite the high intelligence of these systems, they still cannot cope with all driving scenarios. To ensure driving safety, when the system cannot effectively cover the situation, the OEM usually actively prompts the user to take over the vehicle through the assisted driving system. However, the design of the takeover prompt needs to strike a balance between efficiency, simplicity, intuitiveness and reliability to ensure that the prompt can be effectively conveyed when necessary.
[0003] There are two main flaws in the current technical solutions: insufficient information and information overload. Insufficient information means that the takeover prompts of the assisted driving system are not concise or intuitive enough, which may cause the user to fail to receive the information in time, thereby increasing the risk of accidents. On the other hand, information overload is manifested as too frequent takeover prompts, which are issued even when the driver does not need to intervene, interfering with normal driving. Such excessive prompts may cause users to ignore the takeover prompts, and then fail to respond in time in truly emergency conditions. Summary of the invention
[0004] In view of the defects in the prior art, the purpose of the present invention is to provide a user takeover method and system for an intelligent driving assistance system, which divides the risk levels for special scenarios that the intelligent driving assistance system cannot handle, and uses different human-computer interaction methods to prompt users to take over the vehicle for dangerous scenarios of different levels, so that users can have more trust in the intelligent driving assistance function, thereby improving user usage rate and driving safety.
[0005] In order to achieve the above technical effects, the present invention adopts the following technical solutions:
[0006] According to a first aspect of the present invention, a method for user takeover of an intelligent driving assistance system is provided, which specifically comprises the following steps:
[0007] Step S1: Advanced driver assistance system (ADAS) sensors collect data about the vehicle's surrounding environment and its own status in real time;
[0008] Step S2: The ADAS domain controller receives the data transmitted by the sensor, performs real-time analysis on the driving environment and vehicle status, determines dangerous scenarios and assesses risk levels, and divides the scenarios into four different levels according to their degree of danger. Level 1 means that the driving assistance system is controllable and the driver needs to pay attention; Level 2 means that the driving assistance system is controllable but there are certain safety risks and the driver needs to take over; Level 3 means that there are risks in controlling the driving assistance system and the driver is expected to take over immediately; Level 4 means that the driving assistance system is abnormal and the driver needs to take over immediately;
[0009] Step S3: the system selects different levels of first-level prompts, second-level prompts, third-level prompts and fourth-level prompts according to the risk level, and the different levels of prompts are composed of one or more prompt modes of visual prompts, sound prompts and tactile prompts, wherein the visual prompt refers to outputting and flashing warning information through the display screen of the infotainment system; the sound prompt refers to making a sound through the speaker of the infotainment system; the tactile prompt refers to the system triggering the tightening of the seat belt through the body control system, or vibrating the steering wheel through the electronic power steering system; wherein, the higher the prompt level, the more prompt modes, the higher the flashing frequency, and the higher the sound prompt frequency;
[0010] Step S4: The system will cancel the current prompt or increase the prompt level according to the driver's response; if the driver fails to take over the vehicle in time, the system will further strengthen the prompt according to the risk level until the risk is eliminated or the driver successfully takes over.
[0011] Preferably, the sensor types in step S1 include environment perception sensors and vehicle status sensors; wherein the environment perception sensors include cameras and radars, and the vehicle status sensors can measure the driving speed and direction of the vehicle.
[0012] Preferably, the first-level prompt is to output only the warning message "Please drive carefully" on the display screen, excluding auditory prompts and tactile prompts;
[0013] The secondary prompt includes visual prompt and auditory prompt, but does not include tactile prompt. The visual prompt is a warning message "Please take over immediately" output on the display screen, and the prompt box is marked yellow and flashing. The auditory prompt is a 1Hz sound from the speaker.
[0014] The three-level prompts include visual prompts, auditory prompts and tactile prompts, wherein the visual prompt is the output of the warning message "Please take over immediately" and the steering wheel warning picture on the display screen, and the prompt box is marked red and flashing, the auditory prompt is the speaker emitting a 2Hz sound; the tactile prompt is the steering wheel vibration;
[0015] The four levels of prompts include visual prompts, auditory prompts and tactile prompts. The visual prompt is the output of a warning message "Please take over the vehicle immediately" and a steering wheel warning picture on the display screen, and the prompt box is marked red and flashing. The auditory prompt is a 4Hz sound from the speaker; the tactile prompt is the vibration of the steering wheel and the tightening of the seat belt.
[0016] According to a second aspect of the present invention, there is provided an intelligent driving assistance system user takeover system, which is used to implement the above-mentioned intelligent driving assistance system user takeover method, and includes the following components:
[0017] Data acquisition module: This module includes ADAS sensors, which are used to collect data about the vehicle’s surroundings and its own status in real time;
[0018] Risk level assessment module: This module is used to receive data transmitted by the data acquisition module, conduct real-time analysis of the driving environment and vehicle status, determine dangerous scenarios and assess risk levels;
[0019] Danger prompt module: When the risk level is determined, this module selects the corresponding visual, sound and tactile prompt methods according to the risk level provided by the risk level assessment module, and sends different prompt instructions to the relevant hardware modules;
[0020] Feedback and adjustment module: This module is used to further cancel the current prompt or increase the prompt intensity based on the driver's response. If the driver fails to take over the vehicle in time, the system can further strengthen the prompt according to the risk level until the risk is eliminated or the driver successfully takes over.
[0021] Compared with the prior art, the present invention has the following beneficial effects:
[0022] The user takeover method of the intelligent driving assistance system provided by the present invention enables the driver to take over the vehicle at an appropriate time through flexible prompting methods and dynamic takeover strategies, which helps to enhance the driver's trust in the intelligent driving assistance system, thereby improving the system's utilization rate and driving safety. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:
[0024] Figure 1 A framework diagram of the user takeover method of the intelligent driving assistance system described in the first embodiment;
[0025] Figure 2 This is an example diagram of prompting methods for different risk levels described in the first embodiment;
[0026] Figure 3This is a flowchart of the steps of the user takeover method of the intelligent driving assistance system described in the first embodiment;
[0027] Figure 4 It is a framework diagram of the user takeover system of the intelligent driving assistance system described in the second embodiment. DETAILED DESCRIPTION
[0028] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.
[0029] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0030] First Embodiment
[0031] like Figure 1 , 2 As shown in FIG. 3 , this embodiment provides a method for user takeover of an intelligent driving assistance system, which divides the danger levels for special scenarios that the intelligent driving assistance system cannot handle, and uses different human-computer interaction methods to prompt users to take over the vehicle for different levels of dangerous scenarios, so that users can have more trust in the intelligent driving assistance function, improve user usage rate and driving safety, and specifically includes the following steps:
[0032] Step S1: Environmental perception and data collection: Advanced driver assistance system (ADAS) sensors collect data about the vehicle's surroundings and its own status in real time. Sensor types include environmental perception sensors (such as cameras, radars) and vehicle status sensors (such as speed, direction, etc.). These data provide a basis for the system to analyze the driving environment and identify potential dangers.
[0033] Step S2: Data processing and risk level assessment: The ADAS domain controller receives the data transmitted by the sensor, analyzes the driving environment and vehicle status in real time through the safety algorithm mechanism, determines the dangerous scene and assesses the risk level, and divides it into different levels (Level 1 to Level 4) according to the degree of danger. From low risk to emergency risk, there are different degrees of user takeover requirements.
[0034] Level 1: The driving assistance system is controllable and requires the driver to pay attention.
[0035] Level 2: The driving assistance system is controllable, but there are certain safety risks, and the driver needs to take over;
[0036] Level 3: The driver assistance system controls are risky and the driver is expected to take over immediately;
[0037] Level 4: The driving assistance system is abnormal and the driver needs to take over immediately.
[0038] The higher the level, the more urgent the working condition. Examples of working conditions at different risk levels are shown in Table 1 below:
[0039]
[0040] Table 1: Example of working conditions at different risk levels
[0041] Step S3: Prompt type and response decision; When the risk level is determined, the system selects corresponding visual, sound and tactile prompts according to the level to remind the driver to take over the vehicle. The visual prompt refers to outputting warning information through the display screen of the infotainment system to remind the driver of the current risk. The prompt method for each level is different, and the prompt intensity increases with the increase of the risk level; the sound prompt refers to the sound emitted through the speaker of the infotainment system to attract the driver's attention; the tactile prompt means that when the risk level is high, the system triggers the tightening of the seat belt through the body control module, or vibrates the steering wheel through the electronic power steering system to enhance the driver's perception. Under different risk levels, the controller sends different prompt instructions to the relevant hardware modules as shown in Table 2 below. Level 1 corresponds to the first level prompt, level 2 corresponds to the second level prompt, level 3 corresponds to the third level prompt, and level 4 corresponds to the fourth level prompt. Among them, the higher the prompt level, the more prompt methods, the higher the flashing frequency, and the higher the sound prompt frequency. As shown in Table 2 and the figure, the first-level prompt is to output the warning message "Please drive carefully" only on the display screen to remind the driver of the current risk, without auditory prompts and tactile prompts; the second-level prompt includes visual prompts and auditory prompts, but does not include tactile prompts. The visual prompt is the text and outer frame of "Please take over immediately" marked in yellow and flashing, and the auditory prompt is a 1Hz sound from the speaker; the third-level prompt includes visual prompts, auditory prompts and tactile prompts. The visual prompt is to output the warning message "Please take over immediately" and the steering wheel warning picture on the display screen, and the prompt outer frame is marked in red and flashing, and the auditory prompt is a 2Hz sound from the speaker; the tactile prompt is the vibration of the steering wheel. The fourth-level prompt includes visual prompts, auditory prompts and tactile prompts. The visual prompt is to output the warning message "Please take over the vehicle immediately" and the steering wheel warning picture on the display screen, and the prompt outer frame is marked in red and flashing, and the auditory prompt is a 4Hz sound from the speaker; the tactile prompt is the vibration of the steering wheel and the tightening of the seat belt.
[0042]
[0043] Table 2: Example of prompts for different risk levels
[0044] Step S4: User takeover feedback and system adjustment: After the driver receives the prompt, if he needs to take over the vehicle, he should take action immediately (such as steering or braking). The system will make further adjustments based on the driver's response, such as canceling the current prompt or increasing the prompt intensity. If the driver does not take over the vehicle in time, the system may further strengthen the prompt according to the danger level until the risk is eliminated or the driver successfully takes over.
[0045] Through the above steps, the intelligent driving assistance system can implement accurate and timely user takeover strategies in different driving scenarios to reduce potential risks. This combination of hardware and software design can not only make full use of hardware resources such as sensors and controllers, but also achieve precise control through software strategies to form an efficient driving assistance system.
[0046] Second Embodiment
[0047] like Figure 4 As shown, this embodiment provides an intelligent driving assistance system user takeover system, which is used to implement the intelligent driving assistance system user takeover method described in the first embodiment, and specifically includes the following modules:
[0048] Data acquisition module: This module includes ADAS sensors, which are used to collect data about the vehicle's surrounding environment and its own status in real time.
[0049] Risk level assessment module: This module is used to receive data transmitted by the data acquisition module, conduct real-time analysis of the driving environment and vehicle status through a safety algorithm mechanism, determine dangerous scenarios and assess risk levels, and divide them into different levels (Level 1 to Level 4) according to the degree of danger.
[0050] Danger warning module: When the risk level is determined, this module selects the corresponding visual, sound and tactile warning methods according to the risk level provided by the risk level assessment module, and sends different warning instructions to the relevant hardware modules.
[0051] Feedback and system adjustment module: This module is used to further adjust the risk level prompt according to the driver's response, such as canceling the current prompt or increasing the prompt intensity. If the driver does not take over the vehicle in time, the system may further strengthen the prompt according to the danger level until the risk is eliminated or the driver successfully takes over.
[0052] The above describes the specific embodiments of the present invention. Based on the above description, relevant personnel can make various changes and modifications without departing from the technical concept of the present invention.
Claims
1. A method for user takeover of an intelligent driving assistance system, characterized in that: The specific steps include: Step S1: Advanced driver assistance system (ADAS) sensors collect data about the vehicle's surrounding environment and its own status in real time; Step S2: The ADAS domain controller receives the data transmitted by the sensor, performs real-time analysis of the driving environment and vehicle status, determines dangerous scenarios and assesses risk levels, and divides the scenarios into four different levels according to their degree of danger. Level 1 means that the driving assistance system is controllable and the driver needs to pay attention; Level 2 means that the driving assistance system is controllable but there are certain safety risks, and the driver needs to take over; Level 3 means that there are risks in controlling the driving assistance system and the driver is expected to take over immediately; Level 4 means that the driving assistance system is abnormal and the driver needs to take over immediately; Step S3: the system selects different levels of first-level prompts, second-level prompts, third-level prompts and fourth-level prompts according to the risk level, and the different levels of prompts are composed of one or more prompt modes of visual prompts, sound prompts and tactile prompts, wherein the visual prompt refers to outputting and flashing warning information through the display screen of the infotainment system; the sound prompt refers to making a sound through the speaker of the infotainment system; the tactile prompt refers to the system triggering the tightening of the seat belt through the body control system, or vibrating the steering wheel through the electronic power steering system; wherein, the higher the prompt level, the more prompt modes, the higher the flashing frequency, and the higher the sound prompt frequency; Step S4: The system will cancel the current prompt or increase the prompt level according to the driver's response; if the driver fails to take over the vehicle in time, the system will further strengthen the prompt according to the risk level until the risk is eliminated or the driver successfully takes over.
2. The user takeover method of the intelligent driving assistance system according to claim 1, characterized in that: The sensor types in step S1 include environment perception sensors and vehicle status sensors; wherein the environment perception sensors include cameras and radars, and the vehicle status sensors can measure the vehicle's driving speed and direction.
3. The user takeover method of the intelligent driving assistance system according to claim 1, characterized in that: The first-level prompt is to output the warning message "Please drive carefully" on the display screen only, excluding auditory prompts and tactile prompts; The secondary prompt includes visual prompt and auditory prompt, but does not include tactile prompt. The visual prompt is a warning message "Please take over immediately" output on the display screen, and the prompt box is marked yellow and flashing. The auditory prompt is a 1Hz sound from the speaker. The three-level prompts include visual prompts, auditory prompts and tactile prompts, wherein the visual prompt is the output of the warning message "Please take over immediately" and the steering wheel warning picture on the display screen, and the prompt box is marked red and flashing, the auditory prompt is the speaker emitting a 2Hz sound; the tactile prompt is the steering wheel vibration; The four levels of prompts include visual prompts, auditory prompts and tactile prompts. The visual prompt is the output of a warning message "Please take over the vehicle immediately" and a steering wheel warning picture on the display screen, and the prompt box is marked red and flashing. The auditory prompt is a 4Hz sound from the speaker; the tactile prompt is the vibration of the steering wheel and the tightening of the seat belt.
4. An intelligent driving assistance system user takeover system, used to implement the intelligent driving assistance system user takeover method according to any one of claims 1 to 3, characterized in that: It includes the following components: Data acquisition module: This module includes ADAS sensors, which are used to collect data about the vehicle’s surroundings and its own status in real time; Risk level assessment module: This module is used to receive data transmitted by the data acquisition module, conduct real-time analysis of the driving environment and vehicle status, determine dangerous scenarios and assess risk levels; Danger prompt module: When the risk level is determined, this module selects the corresponding visual, sound and tactile prompt methods according to the risk level provided by the risk level assessment module, and sends different prompt instructions to the relevant hardware modules; Feedback and adjustment module: This module is used to further cancel the current prompt or increase the prompt intensity based on the driver's response. If the driver fails to take over the vehicle in time, the system can further strengthen the prompt according to the risk level until the risk is eliminated or the driver successfully takes over.
Citation Information
Patent Citations
An automatic driving takeover safety warning system and a method thereof
CN109849919A
Automatic driving hierarchical takeover interaction method and device and readable storage medium
CN113460087A
L3-level automatic driving system state degradation processing method and system
CN115320639A
Autonomous vehicle takeover urgency degree discrimination method and system and automatic vehicle takeover urgency degree warning method and system
CN117642321A
Generative auxiliary driving takeover prompting method and system based on dynamic scene response
CN118205574A
Cited By
Vehicle takeover reminding method, device and equipment, vehicle, medium and program product
CN121448422A
Scene-awareness-oriented acoustic control and multi-mode prompting method in intelligent cabin and related system
CN121650690A
