Intelligent driving vehicle driver hand release alarm control system and method
Through the driver's hand-off alarm control system for intelligent driving vehicles, multiple sensors are used to detect and divide the risk levels of driver's hand-off, and adopt vehicle control strategies to solve the safety risks caused by drivers' long-term hand-off, and improve the driver's use of intelligent driving System safety awareness and vehicle control capabilities.
Patent Information
- Application Number
- CN202411378137.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-30
- Publication Date
- 2024-11-19
AI Technical Summary
In existing intelligent driving systems, drivers often mistakenly hand over the control of the vehicle to the system, resulting in the inability to take over the vehicle as soon as possible in an emergency, increasing the risk of safety accidents, and lacking alarms and dangers for drivers to escape. The mechanism of hierarchy.
An intelligent driving vehicle driver's hand-off alarm control system is designed, and hand-off detection is carried out through capacitive sensors, grip sensing sensors and image sensors. Combined with the timing unit and the judgment unit, the hazard level is divided and corresponding vehicle control strategies are adopted, including warning and vehicle. Control actions until the intelligent driving system is disabled.
It realizes monitoring and grading of the time the driver leaves the steering wheel with both hands and grading of hazard levels, adopts corresponding warning and vehicle control strategies to avoid safety accidents, cultivates the driver's habit of using the intelligent driving system correctly, and performs according to the increase in the hazard level caused by the loss of hands. Corresponding measures.
Smart Images

Figure CN118977729A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of intelligent driving vehicles, and in particular to an intelligent driving vehicle driver's hands-off alarm control system and method. Background Art
[0002] According to the "Automobile Driving Automation Classification" (GB / T40429-2021), the current autonomous driving technology is divided into six levels from L0 to L5: L0 is pure manual driving, L1 is driving automation, L2 is intelligent assisted driving, L3 is automatic assisted driving, L4 is automatic driving, and L5 is unmanned driving. The industry generally refers to L2 and L3 level intelligent driving systems as intelligent driving or intelligent assisted driving systems, and L4 and above are collectively referred to as automatic driving. With the development of automobile intelligence, the intelligent driving system has also become popular, but consumers often mistakenly understand the intelligent driving system as an automatic driving system. After turning on the L intelligent driving system, they often leave their hands on the steering wheel for a long time, ignoring the definition that the intelligent driving system is only an assisted driving system. The driver still has the dominant control of the vehicle, and mistakenly gives the control of the vehicle to the intelligent driving system; and after the driver leaves the steering wheel, the probability of distraction such as eating, playing with mobile phones, and dozing off will be greatly increased. In this mode, if an emergency occurs, the driver cannot take over the vehicle in the first time, which is very likely to cause a safety accident. The prior art does not provide an alarm for the driver to take the hands off the car during intelligent driving, nor does it classify the danger level of the hands-off time and implement corresponding vehicle control strategies. Summary of the invention
[0003] In view of the defects in the prior art, the purpose of the present invention is to provide a smart driving vehicle driver's hands-off alarm control system and method, which can detect and alarm whether the driver has hands on the steering wheel, and divide the alarm level and corresponding vehicle control strategy according to the hands-off duration.
[0004] In order to achieve the above-mentioned object of the invention, the present invention provides the following technical solutions:
[0005] An intelligent driving vehicle driver's hands-off alarm control system, the system comprising:
[0006] Hands-off redundant sensing module: including capacitive sensor, grip force sensing sensor and image sensor. The capacitive sensor senses whether the driver has taken his hands off by detecting the current at the driver's fingertips. The grip force sensing sensor determines whether the driver has taken his hands off by detecting the pressure exerted by the driver's fingers on the steering wheel. The image sensor monitors and analyzes the driver's hand behavior in real time through an infrared camera to achieve hands-off detection.
[0007] Hands-off judgment module: includes a timing unit and a judgment unit. The timing unit starts timing after the hands-off redundant sensing module inputs a hands-off signal, stops timing and resets to zero after the hands-off redundant sensing module inputs a signal that the driver holds the steering wheel, and obtains hands-off time information. The judgment unit receives the vehicle status input from the vehicle-mounted CAN bus, including intelligent driving system function information, vehicle speed information, gear information, and hands-off time information, and outputs a hands-off signal including the hands-off time to the danger level classification module after comprehensive judgment;
[0008] Danger level classification module: according to the received hands-off signal including the hands-off time, the danger level is divided with the hands-off time as the threshold, and corresponding warnings and vehicle control strategies are proposed according to different danger levels. The danger levels are divided into the first danger level, the second danger level, the third danger level, and the fourth danger level from low to high; when the first recovery condition is met, the second danger level is lifted; when the second recovery condition is met, the third danger level is lifted; when the third recovery condition is met, the fourth danger level is lifted;
[0009] Alarm prompt module: responsible for receiving the danger level signal from the danger level classification module, and performing the hands-off alarm warning control. It is also responsible for receiving the recovery signal from the danger level classification module and releasing the hands-off alarm prompt;
[0010] Vehicle regulation and control module: including a control unit and a register unit, responsible for receiving vehicle control requests from the danger level classification module, executing vehicle control actions such as prohibiting lane changes, prohibiting acceleration, and shutting down the intelligent driving system. The vehicle regulation and control module sends vehicle control instructions to the vehicle braking system, steering system, and intelligent driving system through the on-board CAN communication transceiver module;
[0011] On-board CAN bus transceiver module: interacts with the vehicle controller through the signal interface and provides feedback on the vehicle control status.
[0012] Preferably, the capacitive sensor, grip force sensor and image sensor can independently detect the driver's hands-off behavior, avoiding misjudgment or missed judgment caused by failure of a single sensor. The hands-off redundant sensing module inputs the fused signal of whether the driver has taken his hands off the steering wheel and the signal of the driver holding the steering wheel into the hands-off judgment module.
[0013] Preferably, the timing unit starts timing in seconds after receiving the driver's hands-off signal. The timing process can be interrupted by the driver's hands-on steering wheel signal. After receiving the driver's hands-on steering wheel signal, the timing register time is reset to zero until the hands-off redundant sensing module inputs the driver's hands-off signal and then restarts timing.
[0014] Preferably, the judgment unit receives the vehicle speed signal, gear position signal and function signal of the intelligent driving system in the vehicle-mounted CAN bus transceiver module, and outputs a hands-off signal including the hands-off time when the vehicle speed is greater than 0, the gear position is in the forward gear and the intelligent driving system function is turned on.
[0015] Preferably, the corresponding warning and vehicle control strategies proposed according to different danger levels include:
[0016] If the hands-off time is less than or equal to the threshold t1, the first danger level is triggered, and only the hands-off timer starts, and no vehicle control action is taken. The corresponding strategy at this time is: low risk, no warning;
[0017] If the hands-off time is greater than threshold t1 and less than or equal to threshold t2, the second danger level is triggered. The corresponding strategy at this time is: low risk. The danger level classification module sends a first-level warning to the alarm prompt module, and sends a lane change prohibition request of the intelligent driving system to the vehicle control module, inhibiting the intelligent driving functions related to lane change to prevent the driver from failing to take over the vehicle in time during the lane change process.
[0018] If the hands-off time is greater than threshold t2 and less than or equal to threshold t3, the third danger level is triggered. The corresponding strategy at this time is: medium risk. The danger level classification module sends a secondary warning to the alarm prompt module, and sends a lane change prohibition request to the vehicle control module to inhibit the lane change-related intelligent driving function to prevent the driver from being unable to take over the vehicle in time during the lane change process; at the same time, a request to prohibit the intelligent driving system from accelerating is sent to the vehicle control module to maintain the current vehicle speed without accelerating to avoid more dangerous situations.
[0019] If the hands-off time is greater than the threshold t3 and less than or equal to the threshold t4, the fourth danger level is triggered. The corresponding strategy at this time is: high risk. The danger level classification module sends a third-level warning to the alarm prompt module, and sends a request to turn on the vehicle's double flash warning lights to the alarm prompt module to prompt the rear vehicle to carefully avoid it; sends a request to tighten the driver's seat belt or massage or vibrate the driver's seat to the alarm prompt module to further remind the driver to take over the vehicle; sends a request to prohibit the intelligent driving system from changing lanes to the vehicle control module, inhibits the intelligent driving functions related to lane changing, and prevents the driver from being unable to take over the vehicle in time during the lane change process; sends a uniform deceleration request to the vehicle control module to control the vehicle to slowly reduce the speed to a safe speed, and then exit the intelligent driving system;
[0020] If the hands-off time is greater than the threshold t4, it is the highest risk level, the intelligent driving system is exited, and penalty measures are initiated;
[0021] Among them, the hands-off time thresholds t1, t2, t3, and t4 are positively correlated with the inverse of the vehicle speed. The calculation method of the hands-off time thresholds is:
[0022] t1 =t+A / v;
[0023] Among them, t is a fixed time parameter, A is a fixed coefficient, and v is the current vehicle speed;
[0024] t x =t*(x–1)+B / v;
[0025] Wherein, x is an integer and 2≤x≤4, B is a fixed coefficient, and v is the current vehicle speed.
[0026] Preferably, the first recovery condition is that the driver holds the steering wheel or steps on the accelerator or brake pedal, at which time the hands-off time is reset and re-accumulated, the intelligent driving function is restored, and the driver can manually turn off the intelligent driving function and the hands-off alarm and vehicle control system;
[0027] The second recovery condition is that the driver resumes holding the steering wheel and keeps holding the steering wheel for more than 2 seconds, or the driver manually turns off the intelligent driving function and the hands-off alarm and vehicle control system;
[0028] The third recovery condition requires the driver to manually power off and ignite the vehicle to restart the intelligent driving system and the hands-off alarm system. If used again, the intelligent driving system function needs to be manually turned on again.
[0029] Preferably, the hands-off alarm control includes:
[0030] The second danger level corresponds to the first level of hands-off alarm warning, which includes sending a text reminder of "Please hold the steering wheel" and a low-frequency cyclical voice reminder of "Please hold the steering wheel" to the instrument. The second danger level alarm prompt can be released when the first recovery condition is met;
[0031] The third danger level corresponds to the second level of hands-off alarm warning, which includes sending a text reminder of "Please hold the steering wheel" to the instrument with a flashing border in a clear warning color, accompanied by a high-frequency cyclical prompt voice "Please hold the steering wheel". The third danger level alarm prompt can be released when the second recovery condition is met;
[0032] The fourth danger level corresponds to the third level hands-off alarm warning. The third level hands-off alarm warning includes sending a text reminder "Please hold the steering wheel" to the instrument with a flashing border in a clear warning color, accompanied by an urgent voice prompt "Please hold the steering wheel"; at the same time, a strong stimulation request is made to tighten the driver's seat belt and massage or vibrate the driver's seat to prompt the driver to take over the vehicle, and the double flash warning lights are turned on to remind the vehicles behind. The alarm prompt of the fourth danger level can be lifted when the third recovery condition is met.
[0033] Preferably, the penalty measures include: if the highest hands-free danger level is triggered once, the use of the smart driving function is prohibited within 24 hours; if the highest hands-free danger level is triggered twice cumulatively, the use of the smart driving function is prohibited within a week; if the highest hands-free danger level is triggered 3-4 times cumulatively, the use of the smart driving function is prohibited within a month; if the highest hands-free danger level is triggered 5 times cumulatively, the smart driving function is locked, and the driver is required to log in to the learning APP and learn the smart driving and hands-free rules before unlocking and using the smart driving function. After successful unlocking, the highest danger level times are reset to zero and accumulated again.
[0034] Preferably, the system can be used as a subsystem of the intelligent driving system to help the intelligent driving system perform hands-off detection and vehicle control, or it can be used as a separate control system outside the intelligent driving system to perform hands-off detection and corresponding vehicle control when a non-intelligent driving system car or the intelligent driving system is not activated, thereby improving driving safety.
[0035] A method for controlling a hands-off alarm for a driver of an intelligent driving vehicle adopts any one of the above-mentioned intelligent driving vehicle hands-off alarm control systems, and the method comprises:
[0036] S1: After the hands-off alarm and control system is activated, the hands-off redundant sensing module starts to detect whether the driver has taken his hands off the steering wheel, and sends a signal to the hands-off judgment module.
[0037] S2: The hands-off judgment module obtains vehicle status information such as vehicle speed, gear position, and intelligent driving function activation through the vehicle-mounted CAN bus transceiver module, and combines the hands-off signal obtained by the hands-off redundant perception module to make a comprehensive information judgment on whether the driver has taken the hands off. When the vehicle speed is greater than 0, the gear position is in the forward gear, and the intelligent driving system function is activated, the hands-off alarm timing starts, and the hands-off timing information is sent to the hazard level classification module;
[0038] S3: The danger level classification module receives the hands-off signal including the hands-off time, classifies the danger level according to the threshold corresponding to the hands-off time and the danger level classification strategy, and sends the corresponding alarm prompt and vehicle control request to the alarm prompt module and the vehicle regulation and control module;
[0039] S4: The vehicle regulation and control module receives a vehicle control request of the second danger level, the third danger level or the fourth danger level, and executes the corresponding vehicle safety control, including steering, vehicle speed and intelligent driving system function control and penalty strategy;
[0040] S5: The alarm prompt module releases the second danger level, the third danger level or the fourth danger level respectively according to the received first recovery condition, the second recovery condition or the third recovery condition;
[0041] S6: The vehicle CAN bus transceiver module interacts with the vehicle controller through the standard vehicle CAN communication signal interface and feedbacks the vehicle control status.
[0042] Compared with the prior art, the intelligent driving vehicle driver's hands-off alarm control system and method provided by the present invention can monitor the time when the driver's hands are off the steering wheel, and classify the danger level according to the hands-off time and the driving mode, and take corresponding warnings and vehicle control strategies according to the danger level until the driver takes over the vehicle or takes punitive measures such as disabling the intelligent driving system. It can cultivate the driver's habit of using the intelligent driving system correctly, warn and correct the driver's behavior of taking the hands off the steering wheel for a long time, and execute corresponding vehicle control strategies according to the increase in the danger level caused by taking the hands off, so as to avoid safety accidents. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:
[0044] Figure 1 This is a schematic diagram of the intelligent driving vehicle driver's hands-off warning control system in Example 1;
[0045] Figure 2 It is a framework diagram of the hands-off judgment module in Example 1;
[0046] Figure 3 The warning and vehicle control strategy diagram corresponding to different danger levels in Example 1;
[0047] Figure 4 This is a flow chart of the hands-off alarm control method for an intelligent driving vehicle driver in Example 2. DETAILED DESCRIPTION
[0048] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.
[0049] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.
[0050] It should be noted that similar numbers and letters represent similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in the subsequent figures. In addition, all directional indications in this application (such as up, down, left, right, front, back, bottom...) are only used to explain the relative position relationship, movement, etc. between the components under a certain specific posture (as shown in the figures). If the specific posture changes, the directional indication will also change accordingly. Furthermore, the descriptions involving "first", "second", etc. in the application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated.
[0051] Example 1
[0052] like Figure 1 As shown, the intelligent driving vehicle driver's hands-off alarm control system provided in this embodiment includes a hands-off redundant perception module, a hands-off judgment module, a danger level classification module, an alarm prompt module, a vehicle control module and an on-board CAN bus transceiver module.
[0053] The hands-off redundant sensing module includes a capacitive sensor, a grip sensor and an image sensor. The capacitive sensor senses whether the driver has taken his hands off the steering wheel by detecting the current at the driver's fingertips. The grip sensor determines whether the driver has taken his hands off the steering wheel by detecting the pressure exerted by the driver's fingers on the steering wheel. The image sensor detects whether the driver has taken his hands off the steering wheel by monitoring and analyzing the driver's hand behavior in real time through an infrared camera. Furthermore, the three sensors can detect the driver's hands off the steering wheel separately to avoid misjudgment or missed judgment caused by single perception failure. The hands-off redundant sensing module inputs the fused signals of whether the driver has taken his hands off the steering wheel and the signal of the driver holding the steering wheel into the hands-off judgment module.
[0054] like Figure 2 As shown, the hands-off judgment module includes a timing unit and a judgment unit. The timing unit starts timing after the hands-off redundant sensing module inputs the hands-off signal, and stops timing and clears after the hands-off redundant sensing module inputs the driver's hand-holding steering wheel signal. The result is the hands-off time information. The judgment unit receives the vehicle status input from the vehicle CAN bus, including the intelligent driving system function information, vehicle speed information, gear information, and hands-off time information, and outputs the hands-off signal containing the hands-off time to the danger level classification module after comprehensive judgment.
[0055] Furthermore, after receiving the driver's hands-off signal, the timing unit in the judgment module starts timing in seconds. The timing process can be interrupted by the driver's hands-on steering wheel signal. After receiving the driver's hands-on steering wheel signal, the timing register time is reset to zero until the hands-off redundant sensing module inputs the driver's hands-off signal and restarts timing. Therefore, the timing unit outputs a hands-off time signal.
[0056] Furthermore, the judgment unit receives the vehicle speed signal, gear position signal and function signal of the intelligent driving system in the vehicle-mounted CAN bus transceiver module, and when the vehicle speed is greater than 0, the gear position is in the forward gear and the intelligent driving system function is turned on, it outputs a hands-off signal including the hands-off time.
[0057] like Figure 3 As shown, after receiving the hands-off signal including the hands-off time, the danger level classification module divides the danger level based on the hands-off time as the threshold, and divides it into four danger levels from low to high, namely the first danger level, the second danger level, the third danger level, and the fourth danger level, and proposes corresponding warnings and vehicle control strategies after determining the danger level.
[0058] Furthermore, the hands-off time has different danger levels at different vehicle speeds. The hands-off risk factor is small at low speeds. Therefore, the hands-off time threshold is divided into t1, t2, t3, and t4, and is positively correlated with the inverse of the vehicle speed. The calculation method of the hands-off time threshold is:
[0059] t 1 =t+A / v;
[0060] Among them, t is a fixed time parameter, A is a fixed coefficient, and v is the current vehicle speed.
[0061] t x =t*(x–1)+B / v;
[0062] Wherein, x is an integer and 2≤x≤4, B is a fixed coefficient, and v is the current vehicle speed.
[0063] Furthermore, the hazard level classification and vehicle control strategy with hands-off time as the threshold include:
[0064] If the hands-off time is less than or equal to the threshold t1, the first danger level is triggered and only the hands-off timer starts without taking any vehicle control action. The corresponding strategy at this time is: low risk, no warning.
[0065] If the hands-off time is greater than threshold t1 and less than or equal to threshold t2, the second danger level is triggered. The corresponding strategy at this time is: low risk, the danger level classification module sends a first-level warning to the alarm prompt module, and sends a lane change prohibition request of the intelligent driving system to the vehicle control module, inhibiting the intelligent driving function related to lane change to prevent the driver from being unable to take over the vehicle in time during the lane change process. When the first recovery condition is met, the second danger level is released.
[0066] Specifically, the first recovery condition is that the driver holds the steering wheel or steps on the accelerator or brake pedal. At this time, the hands-off time is reset and re-accumulated, and the intelligent driving function is restored. The driver can manually turn off the intelligent driving function, the hands-off alarm and the vehicle control system.
[0067] If the hands-off time is greater than threshold t2 and less than or equal to threshold t3, the third danger level is triggered. The corresponding strategy at this time is: medium risk, the danger level classification module sends a secondary warning to the alarm prompt module, and sends a lane change prohibition request to the vehicle control module to inhibit the lane change-related intelligent driving function to prevent the driver from being unable to take over the vehicle in time during the lane change process; at the same time, a request to prohibit the intelligent driving system from accelerating is sent to the vehicle control module to maintain the current vehicle speed without accelerating to avoid more dangerous situations. When the second recovery condition is met, the third danger level is lifted.
[0068] Specifically, the second recovery condition is that the driver resumes holding the steering wheel with his hands and maintains it for more than 2 seconds, or the driver manually turns off the intelligent driving function, the hands-off alarm, and the vehicle control system.
[0069] If the hands-off time is greater than the threshold t3 and less than or equal to the threshold t4, the fourth danger level is triggered. The corresponding strategy at this time is: high risk, the danger level classification module sends a third-level warning to the alarm prompt module, and sends a request to turn on the vehicle's double flash warning lights to the alarm prompt module to prompt the rear vehicle to carefully avoid; send a request to tighten the driver's seat belt or massage or vibrate the driver's seat to the alarm prompt module to further remind the driver to take over the vehicle; send a request to prohibit the intelligent driving system from changing lanes to the vehicle control module, inhibit the intelligent driving functions related to lane change, and prevent the driver from being unable to take over the vehicle in time during the lane change process; send a uniform deceleration request to the vehicle control module to control the vehicle to slowly reduce the speed to a safe speed, generally 10kph, and then exit the intelligent driving system. When the third recovery condition is met, the fourth danger level is released.
[0070] Specifically, the third recovery condition requires the driver to manually power off and ignite the vehicle to restart the intelligent driving system and the hands-off alarm system. If used again, the intelligent driving system function needs to be manually turned on again.
[0071] If the hands-off time is greater than the threshold t4, it is the highest danger level, the intelligent driving system is exited, and penalty measures are initiated.
[0072] The penalty measures include: if the highest hands-free danger level is triggered once, the smart driving function will be prohibited for 24 hours; if the highest hands-free danger level is triggered twice in total, the smart driving function will be prohibited for one week; if the highest hands-free danger level is triggered 3-4 times in total, the smart driving function will be prohibited for one month; if the highest hands-free danger level is triggered 5 times in total, the smart driving function will be locked, and the driver will need to log in to the learning APP and learn the smart driving and hands-free rules before unlocking and using the smart driving function. After successful unlocking, the highest danger level times will be reset to zero and accumulated again.
[0073] The alarm prompt module is responsible for receiving the danger level signal sent by the danger level classification module, and correspondingly performing the three-level hands-off alarm warning control. It is also responsible for receiving the recovery signal sent by the danger level classification module and releasing the hands-off alarm prompt.
[0074] The second danger level corresponds to the first-level hands-off alarm warning. The first-level hands-off alarm warning includes sending a text reminder "Please hold the steering wheel" and a low-frequency cyclic prompt voice "Please hold the steering wheel" to the instrument. The alarm prompt of the second danger level can be lifted when the first recovery condition is met.
[0075] The third danger level corresponds to the second level hands-off alarm warning. The second level hands-off alarm warning includes sending a text reminder "Please hold the steering wheel" to the instrument with a flashing border in an obvious warning color, such as red or purple, and a high-frequency cyclical prompt voice "Please hold the steering wheel". The alarm prompt of the third danger level can be lifted when the second recovery condition is met.
[0076] The fourth danger level corresponds to the third level hands-off alarm warning. The third level hands-off alarm warning includes sending a text reminder "Please hold the steering wheel" to the instrument with a flashing border in an obvious warning color, such as red or purple, and an urgent voice reminder "Please hold the steering wheel"; at the same time, a strong stimulation request is made to tighten the driver's seat belt and massage or vibrate the driver's seat to prompt the driver to take over the vehicle, and the double flash warning lights are turned on to remind the vehicles behind. The alarm prompt of the fourth danger level can be lifted when the third recovery condition is met.
[0077] The vehicle regulation and control module includes a control unit and a register unit. It is responsible for receiving vehicle control requests issued by the hazard level classification module and executing vehicle control actions such as prohibiting lane changes, prohibiting acceleration, and shutting down the intelligent driving system. The vehicle regulation and control module sends vehicle control instructions to the vehicle braking system, steering system, and intelligent driving system through the on-board CAN communication transceiver module.
[0078] This embodiment provides a hands-off alarm control system for an intelligent driving vehicle driver, which can be used as a subsystem of the intelligent driving system to help the intelligent driving system perform hands-off detection and vehicle control. It can also be used as a separate control system outside the intelligent driving system to perform hands-off detection and corresponding vehicle control when a non-intelligent driving system car or the intelligent driving system is not activated, thereby improving driving safety.
[0079] Example 2
[0080] like Figure 4 As shown, the intelligent driving vehicle driver's hands-off alarm control method provided in this embodiment includes:
[0081] S1: After the hands-off alarm and control system is activated, the hands-off redundant sensing module starts to detect whether the driver has taken his hands off the steering wheel, and sends a signal indicating whether the driver has taken his hands off the steering wheel to the hands-off judgment module.
[0082] S2: The hands-off judgment module obtains vehicle status information such as vehicle speed, gear position, and intelligent driving function activation through the on-board CAN bus transceiver module, and combines the hands-off signal obtained by the hands-off redundant perception module to make a comprehensive information judgment on whether the driver has taken the hands off the car. When the vehicle speed is greater than 0, the gear position is in the forward gear, and the intelligent driving system function is activated, the hands-off alarm timing starts, and the hands-off timing information is sent to the hazard level classification module.
[0083] S3: The danger level classification module receives the hands-off signal including the hands-off time, classifies the danger level according to the threshold corresponding to the hands-off time and the danger level classification strategy, and sends the corresponding alarm prompt and vehicle control request to the alarm prompt module and the vehicle regulation and control module.
[0084] S4: The vehicle regulation and control module receives a vehicle control request of the second hazard level, the third hazard level or the fourth hazard level, and executes a corresponding vehicle safety control, including steering, vehicle speed and intelligent driving system function control and penalty strategy.
[0085] S5: The alarm prompt module releases the second danger level, the third danger level or the fourth danger level according to the received first recovery condition, the second recovery condition or the third recovery condition.
[0086] S6: The vehicle CAN bus transceiver module interacts with the vehicle controller through the standard vehicle CAN communication signal interface and feedbacks the vehicle control status.
[0087] The above describes the specific embodiments of the present invention. Based on the above description, relevant personnel can make various changes and modifications without departing from the technical concept of the present invention.
Claims
1. An intelligent driving vehicle driver's hands-off alarm control system, characterized in that: The system comprises: Hands-off redundant sensing module: including capacitive sensor, grip force sensing sensor and image sensor. The capacitive sensor senses whether the driver has taken his hands off by detecting the current at the driver's fingertips. The grip force sensing sensor determines whether the driver has taken his hands off by detecting the pressure exerted by the driver's fingers on the steering wheel. The image sensor monitors and analyzes the driver's hand behavior in real time through an infrared camera to achieve hands-off detection. Hands-off judgment module: includes a timing unit and a judgment unit. The timing unit starts timing after the hands-off redundant sensing module inputs a hands-off signal, stops timing and resets to zero after the hands-off redundant sensing module inputs a signal that the driver holds the steering wheel, and obtains hands-off time information. The judgment unit receives the vehicle status input from the vehicle-mounted CAN bus, including intelligent driving system function information, vehicle speed information, gear information, and hands-off time information, and outputs a hands-off signal including the hands-off time to the danger level classification module after comprehensive judgment; Danger level classification module: according to the received hands-off signal including the hands-off time, the danger level is divided with the hands-off time as the threshold, and corresponding warnings and vehicle control strategies are proposed according to different danger levels. The danger levels are divided into the first danger level, the second danger level, the third danger level, and the fourth danger level from low to high; when the first recovery condition is met, the second danger level is lifted; when the second recovery condition is met, the third danger level is lifted; when the third recovery condition is met, the fourth danger level is lifted; Alarm prompt module: responsible for receiving the danger level signal from the danger level classification module, and performing the hands-off alarm warning control. It is also responsible for receiving the recovery signal from the danger level classification module and releasing the hands-off alarm prompt; Vehicle regulation and control module: including a control unit and a register unit, responsible for receiving vehicle control requests from the danger level classification module, executing vehicle control actions such as prohibiting lane changes, prohibiting acceleration, and shutting down the intelligent driving system. The vehicle regulation and control module sends vehicle control instructions to the vehicle braking system, steering system, and intelligent driving system through the on-board CAN communication transceiver module; On-board CAN bus transceiver module: interacts with the vehicle controller through the signal interface and provides feedback on the vehicle control status.
2. The intelligent driving vehicle driver's hands-off warning control system according to claim 1 is characterized in that: The capacitive sensor, grip force sensor and image sensor can independently detect the driver's hands-off state, avoiding misjudgment or missed judgment caused by failure of a single perception; the hands-off redundant perception module inputs the fused driver's hands-off signal and the driver's hands-on steering wheel signal into the hands-off judgment module.
3. The intelligent driving vehicle driver's hands-off warning control system according to claim 1 is characterized in that: After receiving the driver's hands-off signal, the timing unit starts timing in seconds. The timing process can be interrupted by the driver's hands-on steering wheel signal. After receiving the driver's hands-on steering wheel signal, the timing register time is cleared until the hands-off redundant sensing module inputs the driver's hands-off signal and then restarts timing.
4. The intelligent driving vehicle driver's hands-off warning control system according to claim 1 is characterized in that: The judgment unit receives the vehicle speed signal, gear position signal and function signal of the intelligent driving system in the vehicle-mounted CAN bus transceiver module, and outputs a hands-off signal including the hands-off time when the vehicle speed is greater than 0, the gear position is in the forward gear and the intelligent driving system function is turned on.
5. The intelligent driving vehicle driver's hands-off warning control system according to claim 1 is characterized in that: The corresponding warning and vehicle control strategies according to different danger levels include: If the hands-off time is less than or equal to the threshold t1, the first danger level is triggered, and only the hands-off timer starts, and no vehicle control action is taken. The corresponding strategy at this time is: low risk, no warning; If the hands-off time is greater than threshold t1 and less than or equal to threshold t2, the second danger level is triggered. The corresponding strategy at this time is: low risk. The danger level classification module sends a first-level warning to the alarm prompt module, and sends a lane change prohibition request of the intelligent driving system to the vehicle control module, inhibiting the intelligent driving functions related to lane change to prevent the driver from failing to take over the vehicle in time during the lane change process. If the hands-off time is greater than threshold t2 and less than or equal to threshold t3, the third danger level is triggered. The corresponding strategy at this time is: medium risk. The danger level classification module sends a secondary warning to the alarm prompt module, and sends a lane change prohibition request to the vehicle control module to inhibit the lane change-related intelligent driving function to prevent the driver from being unable to take over the vehicle in time during the lane change process; at the same time, a request to prohibit the intelligent driving system from accelerating is sent to the vehicle control module to maintain the current vehicle speed without accelerating to avoid more dangerous situations. If the hands-off time is greater than the threshold t3 and less than or equal to the threshold t4, the fourth danger level is triggered. The corresponding strategy at this time is: high risk. The danger level classification module sends a third-level warning to the alarm prompt module, and sends a request to turn on the vehicle's double flash warning lights to the alarm prompt module to prompt the rear vehicle to carefully avoid it; sends a request to tighten the driver's seat belt or massage or vibrate the driver's seat to the alarm prompt module to further remind the driver to take over the vehicle; sends a request to prohibit the intelligent driving system from changing lanes to the vehicle control module, inhibits the intelligent driving functions related to lane changing, and prevents the driver from being unable to take over the vehicle in time during the lane change process; sends a uniform deceleration request to the vehicle control module to control the vehicle to slowly reduce the speed to a safe speed, and then exit the intelligent driving system; If the hands-off time is greater than the threshold t4, it is the highest risk level, the intelligent driving system is exited, and penalty measures are activated; Among them, the hands-off time thresholds t1, t2, t3, and t4 are positively correlated with the inverse of the vehicle speed. The calculation method of the hands-off time thresholds is: t1=t+A / v; Among them, t is a fixed time parameter, A is a fixed coefficient, and v is the current vehicle speed; t x =t*(x–1)+B / v; Wherein, x is an integer and 2≤x≤4, B is a fixed coefficient, and v is the current vehicle speed.
6. The intelligent driving vehicle driver's hands-off warning control system according to claim 1 is characterized in that: The first recovery condition is that the driver holds the steering wheel or steps on the accelerator or brake pedal. At this time, the hands-off time is reset and re-accumulated, and the intelligent driving function is restored. The driver can manually turn off the intelligent driving function and the hands-off alarm and vehicle control system; The second recovery condition is that the driver resumes holding the steering wheel and keeps holding the steering wheel for more than 2 seconds, or the driver manually turns off the intelligent driving function and the hands-off alarm and vehicle control system; The third recovery condition requires the driver to manually power off and ignite the vehicle to restart the intelligent driving system and the hands-off alarm system. If used again, the intelligent driving system function needs to be manually turned on again.
7. The intelligent driving vehicle driver's hands-off warning control system according to claim 1 is characterized in that: The hands-off alarm warning control includes: The second danger level corresponds to the first level of hands-off alarm warning, which includes sending a text reminder "Please hold the steering wheel" and a low-frequency cyclical voice reminder "Please hold the steering wheel" to the instrument. The second danger level alarm prompt can be released when the first recovery condition is met; The third danger level corresponds to the second level of hands-off alarm warning, which includes sending a text reminder "Please hold the steering wheel" to the instrument with a flashing border in a clear warning color, accompanied by a high-frequency cyclical voice prompt "Please hold the steering wheel". The third danger level alarm prompt can be released when the second recovery condition is met; The fourth danger level corresponds to the third level hands-off alarm warning. The third level hands-off alarm warning includes sending a text reminder "Please hold the steering wheel" to the instrument with a flashing border in a clear warning color, accompanied by an urgent voice reminder "Please hold the steering wheel"; at the same time, a strong stimulation request is made to tighten the driver's seat belt and massage or vibrate the driver's seat to prompt the driver to take over the vehicle, and the double flash warning lights are turned on to remind the vehicles behind. The alarm prompt of the fourth danger level can be lifted when the third recovery condition is met.
8. The intelligent driving vehicle driver's hands-off warning control system according to claim 5 is characterized in that: The punishment measures include: if the highest hands-free danger level is triggered once, the smart driving function will be prohibited for 24 hours; if the highest hands-free danger level is triggered twice in total, the smart driving function will be prohibited for one week; if the highest hands-free danger level is triggered 3-4 times in total, the smart driving function will be prohibited for one month; if the highest hands-free danger level is triggered 5 times in total, the smart driving function will be locked, and the driver will need to log in to the learning APP and learn the smart driving and hands-free rules before unlocking and using the smart driving function. After successful unlocking, the highest danger level times will be reset to zero and accumulated again.
9. The intelligent driving vehicle driver's hands-off warning control system according to claim 1 is characterized in that: The system can be used as a subsystem of an intelligent driving system to help the intelligent driving system perform hands-off detection and vehicle control, or it can be used as a separate control system outside the intelligent driving system to perform hands-off detection and corresponding vehicle control when a non-intelligent driving system car or the intelligent driving system is not activated, thereby improving driving safety.
10. A method for controlling a hands-off alarm for a driver of an intelligent driving vehicle, characterized in that: The method adopts the intelligent driving vehicle driver's hands-off warning control system as described in any one of claims 1 to 9, and comprises: S1: After the hands-off alarm and control system is activated, the hands-off redundant sensing module starts to detect whether the driver has taken his hands off the steering wheel, and sends a signal to the hands-off judgment module. S2: The hands-off judgment module obtains vehicle status information such as vehicle speed, gear position, and intelligent driving function activation through the vehicle-mounted CAN bus transceiver module, and combines the hands-off signal obtained by the hands-off redundant perception module to make a comprehensive information judgment on whether the driver has taken the hands off. When the vehicle speed is greater than 0, the gear position is in the forward gear, and the intelligent driving system function is activated, the hands-off alarm timing starts, and the hands-off timing information is sent to the hazard level classification module; S3: The danger level classification module receives the hands-off signal including the hands-off time, classifies the danger level according to the threshold corresponding to the hands-off time and the danger level classification strategy, and sends the corresponding alarm prompt and vehicle control request to the alarm prompt module and the vehicle regulation and control module; S4: The vehicle regulation and control module receives a vehicle control request of the second danger level, the third danger level or the fourth danger level, and executes the corresponding vehicle safety control, including steering, vehicle speed and intelligent driving system function control and penalty strategy; S5: The alarm prompt module releases the second danger level, the third danger level or the fourth danger level respectively according to the received first recovery condition, the second recovery condition or the third recovery condition; S6: The vehicle CAN bus transceiver module interacts with the vehicle controller through the standard vehicle CAN communication signal interface and feedbacks the vehicle control status.
Citation Information
Patent Citations
Device and a method for driver releasing warning
CN109050397A
Vehicle early warning method and device
CN112498364A
Driving behavior early warning system and method for bus drivers
CN112937439A
Hand release warning method and device and electronic equipment
CN115339461A
Steering wheel out-of-hand detection method, system, device and equipment and storage medium
CN116142205A
Cited By
Steering wheel hand release time control method and related device
CN120773771A
Supervision and alarm method for multiple times of hand release of driver during lane keeping period
CN121084401A
System and method for adjusting hand release alarm strategy according to driver state
CN121201102A
