Steering wheel hands-off detection method, device, computer equipment and storage medium

By determining the associated scenarios based on the vehicle status and using capacitive or torque detection methods to detect the steering wheel holding status, the problem of the existing technology being unable to effectively detect the driver's abuse of the driving assistance system when it is not activated is solved. Safe detection and personalized feedback are achieved when the system is not activated, improving the safety and legality of autonomous driving technology.

CN119116969BActive Publication Date: 2025-09-23FAW JIEFANG AUTOMOTIVE CO
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411391310.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-10-08
Publication Date
2025-09-23
Estimated Expiration
2044-10-08

AI Technical Summary

Technical Problem

Existing hands-off steering wheel detection systems cannot effectively detect driver abuse when the driving assistance system is inactive, posing a safety hazard. In addition, vision-based detection methods are expensive and difficult to apply on a large scale in mass-produced models.

Method used

By determining the driver-vehicle association scenario based on the vehicle status, capacitive or torque-based detection methods are used to detect the steering wheel's grip status. When abuse is detected, corresponding processing strategies are implemented, such as sending a fault flag or prompting the driver to take over the vehicle, ensuring that the system can monitor the driver's behavior even when it is not activated.

Benefits of technology

It can detect driver abuse when the driving assistance system is inactive, reduce the risk of traffic accidents, improve the system's adaptability to various driving scenarios, ensure the safety and legality of autonomous driving technology, provide personalized feedback, and reduce false positives and missed alerts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119116969B_ABST
    Figure CN119116969B_ABST
Patent Text Reader

Abstract

The present application relates to the field of intelligent driving technology, and in particular to a method, device, computer equipment, computer-readable storage medium, and computer program product for detecting hands-off steering wheels. The method comprises: determining the driver-vehicle association scenario based on the current vehicle state; determining a corresponding hands-off steering wheel detection method based on the driver-vehicle association scenario; detecting the steering wheel's gripping state based on the steering wheel's hands-off detection method, wherein the gripping state includes a single-hand gripping state and a two-hand gripping state; and executing a corresponding abuse handling strategy when it is determined that steering wheel abuse exists based on the steering wheel's gripping state. This method can detect driver abuse during the inactive period of the driving assistance system, thereby reducing safety risks.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to a method, device, computer equipment, computer-readable storage medium, and computer program product for detecting hands-off steering. Background Art

[0002] With the advancement of autonomous driving technology, driver assistance systems and conditional autonomous driving systems are becoming increasingly common in modern vehicles. These systems use various sensors and algorithms to assist the driver in driving, even enabling partial or full autonomous driving in certain situations. Hands-off steering detection systems are a key component of these systems, monitoring whether the driver is in control of the vehicle and ensuring they can promptly take over control when necessary.

[0003] Current hands-off steering detection systems primarily utilize capacitive, torque-based, or vision-based detection methods. While these methods can achieve some degree of hands-off detection, they have limitations. For example, they cannot effectively detect human abuse of the system, such as by placing objects on the steering wheel to trick the system into believing the driver's hands are always on the wheel. Furthermore, vision-based detection methods are costly, making them difficult to implement on a large scale in production vehicles. However, current technologies primarily perform online detection when the driver assistance system is activated, making it difficult to detect abuse when the system is inactive.

[0004] Therefore, a method, apparatus, computer device, computer-readable storage medium, and computer program product for detecting hands-off steering are needed that can detect driver abuse during the inactivity period of a driving assistance system and reduce safety risks. Summary of the Invention

[0005] Based on this, it is necessary to provide a steering wheel hands-off detection method, device, computer equipment, computer-readable storage medium and computer program product that can detect driver abuse behavior during the inactivation period of the driving assistance system and reduce safety risks in response to the above technical problems.

[0006] In a first aspect, the present application provides a method for detecting a hands-off steering wheel, comprising:

[0007] Determine the driver-vehicle association scenario based on the current vehicle status;

[0008] Determining a corresponding hands-off steering wheel detection method based on the associated scenario between the driver and the vehicle;

[0009] Detecting a steering wheel holding state according to the steering wheel hands-off detection method, wherein the holding state includes a single-handed holding state and a two-handed holding state;

[0010] When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, a corresponding abuse handling strategy is executed.

[0011] In one embodiment, determining the association scenario between the driver and the vehicle based on the current vehicle state includes:

[0012] Based on the current vehicle's anti-theft system unlocking status, door opening and closing status, and powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0013] In one embodiment, after detecting the steering wheel being held according to the steering wheel hands-off detection method, the method further includes:

[0014] When the driver is in a leaving-the-vehicle scenario and the steering wheel is held in a state where the driver holds the steering wheel with his hands, it is determined that there is steering wheel abuse.

[0015] In one embodiment, after detecting the steering wheel being held according to the steering wheel hands-off detection method, the method further includes:

[0016] When the driver is in a cockpit scene, the driving assistance system of the vehicle is not activated, and the steering wheel is held in the driver's hand, it is determined that there is steering wheel abuse.

[0017] In one embodiment, detecting the steering wheel gripping state according to the steering wheel hands-off detection method includes:

[0018] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the steering wheel's grip status;

[0019] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system (EPS) to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel's grip state.

[0020] In one embodiment, when determining that steering wheel abuse exists based on the gripping state of the steering wheel, executing a corresponding abuse handling strategy includes:

[0021] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0022] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0023] In a second aspect, the present application further provides a steering wheel hands-off detection device, comprising:

[0024] A scene determination module is used to determine the associated scene between the driver and the vehicle based on the current vehicle state;

[0025] a detection mode selection module, configured to determine a corresponding hands-off steering wheel detection mode according to the associated scenario between the driver and the vehicle;

[0026] a detection module, configured to detect a steering wheel holding state according to the steering wheel hands-off detection method, wherein the holding state includes a single-handed holding state and a two-handed holding state;

[0027] The control module is configured to execute a corresponding abuse handling strategy when it is determined that there is steering wheel abuse based on the gripping state of the steering wheel.

[0028] In a third aspect, the present application further provides a computer device comprising a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0029] Determine the driver-vehicle association scenario based on the current vehicle status;

[0030] Determining a corresponding hands-off steering wheel detection method based on the associated scenario between the driver and the vehicle;

[0031] Detecting a steering wheel holding state according to the steering wheel hands-off detection method, wherein the holding state includes a single-handed holding state and a two-handed holding state;

[0032] When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, a corresponding abuse handling strategy is executed.

[0033] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0034] Determine the driver-vehicle association scenario based on the current vehicle status;

[0035] Determining a corresponding hands-off steering wheel detection method based on the associated scenario between the driver and the vehicle;

[0036] Detecting a steering wheel holding state according to the steering wheel hands-off detection method, wherein the holding state includes a single-handed holding state and a two-handed holding state;

[0037] When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, a corresponding abuse handling strategy is executed.

[0038] In a fifth aspect, the present application further provides a computer program product, comprising a computer program, which, when executed by a processor, implements the following steps:

[0039] Determine the driver-vehicle association scenario based on the current vehicle status;

[0040] Determining a corresponding hands-off steering wheel detection method based on the associated scenario between the driver and the vehicle;

[0041] Detecting a steering wheel holding state according to the steering wheel hands-off detection method, wherein the holding state includes a single-handed holding state and a two-handed holding state;

[0042] When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, a corresponding abuse handling strategy is executed.

[0043] The aforementioned hands-off steering wheel detection method, device, computer equipment, computer-readable storage medium, and computer program product monitor the driver's correct grip on the steering wheel in real time. The system can promptly issue a warning when the driver's hands leave the steering wheel, thereby reducing traffic accidents caused by driver inattention. This technology can distinguish between one-handed and two-handed grip states, providing more personalized feedback, reducing false positives and false negatives, and enhancing the user experience of assisted driving systems. It can also detect and address driver abuse of the system, such as by placing objects to trick the system into thinking the driver is holding the steering wheel, ensuring that the system can reliably alert the driver to take control when necessary. This method can also detect when the driver assistance system is inactive, improving the system's adaptability to various driving scenarios and ensuring that driver behavior can be monitored even when the system is inactive. Accurate hands-off steering wheel detection technology can provide more reliable safety assurance for the development of autonomous driving technology and promote the transition from assisted driving to fully autonomous driving. Through online compliance monitoring technology, autonomous vehicles can better comply with road traffic regulations, improving the legality and safety of autonomous vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments of the present application or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying any creative work.

[0045] Figure 1 A diagram illustrating an application environment of a method for detecting hands-off steering wheel in one embodiment;

[0046] Figure 2 1 is a flow chart of a method for detecting hands-off steering wheel in one embodiment;

[0047] Figure 3 A schematic diagram of a flow chart for using scenario judgment in the most detailed embodiment;

[0048] Figure 4 A schematic diagram of the process of the driver entering and exiting the scene in the most detailed embodiment;

[0049] Figure 5 This is a schematic diagram of the first process flow of the driving scenario in the most detailed embodiment;

[0050] Figure 6 This is a second flow chart of a driving scenario in the most detailed embodiment;

[0051] Figure 7 is a structural block diagram of a steering wheel hands-off detection device in one embodiment;

[0052] Figure 8 FIG. 1 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0054] The steering wheel hands-off detection method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown, the terminal 102 communicates with the server 104 via a network. The data storage system can store data that the server 104 needs to process. The data storage system can be integrated on the server 104 or placed on the cloud or other network servers.

[0055] The server 104 determines the association scenario between the driver and the vehicle based on the current vehicle status; determines the corresponding steering wheel hands-off detection method based on the association scenario between the driver and the vehicle; detects the steering wheel holding state based on the steering wheel hands-off detection method, and the holding state includes a one-handed holding state and a two-handed holding state; when it is determined that there is steering wheel abuse based on the steering wheel holding state, the corresponding abuse handling strategy is executed through the terminal 102.

[0056] Terminal 102 may include, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices may include smart speakers, smart TVs, smart air conditioners, smart car devices, and projectors. Portable wearable devices may include smart watches, smart bracelets, and head-mounted devices. Head-mounted devices may include virtual reality (VR) devices, augmented reality (AR) devices, smart glasses, and the like. Server 104 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server providing cloud computing services.

[0057] In an exemplary embodiment, Figure 2 As shown, a method for detecting a hands-off steering wheel is provided. Figure 1 The server in the example is used to illustrate the method, which includes the following steps S202 to S208.

[0058] Step S202: Determine the association scenario between the driver and the vehicle based on the current vehicle state.

[0059] Specifically, whether the vehicle's anti-theft system is unlocked or locked, which generally indicates whether the driver is authorized to enter the vehicle. Whether the door is open or closed, which helps determine whether the driver is inside the vehicle or entering / exiting the vehicle. Whether the vehicle is started or turned off, which helps determine whether the vehicle is ready to drive or has stopped. Whether the vehicle is moving or stationary, which is crucial for determining whether the driver needs to control the vehicle. Whether the driver is operating the vehicle's controls, such as window switches, lights, air conditioning, electronic parking brake (EPB), seat adjustment, gear selection, etc. Record and analyze the chronological sequence of a series of events, such as whether a door is opened and then closed, and the correlation between these events and vehicle status changes.

[0060] Step S204: determining a corresponding hands-off steering wheel detection method according to the associated scenario between the driver and the vehicle.

[0061] Specifically, the association scenario between the driver and the vehicle refers to the interaction state between the driver and the vehicle, including but not limited to whether the driver is in the vehicle, whether the vehicle is driving, whether the driver is operating the vehicle's control equipment, etc.

[0062] The corresponding steering wheel hands-off detection method refers to the detection method selected according to the above scenarios to ensure that whether the steering wheel is held by the driver can be effectively monitored in different situations.

[0063] Step S206 : detecting the steering wheel holding state according to the steering wheel hands-off detection method, where the holding state includes a single-hand holding state and a two-hand holding state.

[0064] Specifically, the steering wheel's grip status, including one-handed grip and two-handed grip, is detected according to the hands-off detection method. This is to ensure that when the autonomous driving or assisted driving function is enabled, the driver can take over vehicle control in a timely manner, thereby ensuring driving safety. Different detection methods have their own advantages and application scenarios:

[0065] Torque-sensing steering: This detects whether the driver's hands are on the steering wheel by detecting small movements of the steering wheel. This method is less expensive, but requires the driver to turn the steering wheel from time to time to avoid the system's warning.

[0066] Grip-sensing steering wheels: These use grip-sensing sensors to detect whether the driver is holding the steering wheel, using a small ECU and sensor pads on the steering wheel. This method doesn't require turning the steering wheel, but does require a certain amount of grip.

[0067] Capacitive sensing steering wheel: It senses the driver's operating intention by detecting the microcurrent at the fingertips, and recognizes the fingers more accurately. It does not require strong grip, just a light touch.

[0068] In actual application, the system will use these detection methods to identify whether the driver's hands are on the steering wheel, and whether it is one hand or two hands.

[0069] Step S208: When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, a corresponding abuse handling strategy is executed.

[0070] Specifically, if steering wheel abuse is determined based on the steering wheel's grip state, the corresponding abuse handling strategy will be implemented. This means that when the system confirms that the driver is not holding the steering wheel correctly through steering wheel hands-off detection technology, a series of measures will be taken to ensure driving safety. These measures may include:

[0071] Warning reminder: The system may use visual, auditory or tactile feedback (such as steering wheel vibration) to remind the driver to hold the steering wheel.

[0072] Limited Functionality: In certain situations, if it detects that the driver is not holding the steering wheel, the system may limit or disable certain automated driving features until the driver regains control.

[0073] Emergency procedures: In extreme situations, if the driver fails to respond to the system's warning and hold the steering wheel within the specified time, the vehicle may automatically perform safety procedures such as slowing down, pulling over, etc. to avoid an accident.

[0074] Recording events: The system may record detailed information about steering wheel abuse events, including time, date, and duration, which can be used for subsequent analysis or legal accountability.

[0075] The aforementioned hands-off steering detection method monitors the driver's correct grip on the steering wheel in real time, enabling the system to promptly issue a warning if the driver's hands leave the steering wheel, thereby reducing traffic accidents caused by driver inattention. This technology can distinguish between one-handed and two-handed grips, providing more personalized feedback, reducing false positives and false negatives, and enhancing the user experience of the assisted driving system. It can also detect and address driver abuse of the system, such as by placing objects to trick the system into believing the driver's hands are on the steering wheel, ensuring that the system can reliably alert the driver to take control when necessary. This method can also detect when the driver assistance system is inactive, improving the system's adaptability to various driving scenarios and ensuring that driver behavior can be monitored even when the system is inactive. Accurate hands-off steering detection technology can provide more reliable safety assurance for the development of autonomous driving technology and promote the transition from assisted driving to fully autonomous driving. Online compliance monitoring technology can help autonomous vehicles better comply with road traffic regulations, improving the legality and safety of autonomous vehicles.

[0076] In an exemplary embodiment, determining the driver-vehicle association scenario based on the current vehicle state includes:

[0077] Based on the current vehicle's anti-theft system unlocking status, door opening and closing status, and powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0078] Specifically, it involves a comprehensive analysis of the vehicle's current state in order to provide the driver with appropriate interaction and assistance. This typically includes the following aspects:

[0079] Immobilizer unlock status: The vehicle's immobilizer status can indicate whether the driver is authorized to enter the vehicle. For example, when the immobilizer changes from active to inactive, it usually means that the driver has unlocked the vehicle using a legitimate key or code.

[0080] Door opening / closing motion: The opening and closing status of a door can indicate whether the driver is inside the vehicle or entering / exiting the vehicle. If the driver's door experiences an opening and then closing motion, this may mean that the driver has entered the vehicle and is preparing to start.

[0081] Powertrain status: The powertrain status (start or stop) can indicate whether the vehicle is ready to drive or has stopped. For example, if the vehicle is in the start state (i.e., the high voltage is on), it can be considered to be in the driving state.

[0082] In this embodiment, by analyzing this information, the system can determine whether the driver is in the cabin (preparing to drive or driving) or has left the vehicle. This judgment is crucial for achieving safe and intelligent human-vehicle interaction because it determines when the driver needs to take control and when automated driving assistance functions can be enabled.

[0083] In an exemplary embodiment, according to the steering wheel hands-off detection method, after detecting the steering wheel being held, the method further includes:

[0084] When the driver is in a leaving-the-vehicle scenario and the steering wheel is held in a state where the driver holds the steering wheel with his hands, it is determined that there is steering wheel abuse.

[0085] Specifically, the out-of-vehicle scenario refers to a situation where the driver is not inside the vehicle or is not driving. This may include a state where the vehicle is turned off, the doors are closed, and the anti-theft system is activated. The steering wheel's held state involves steering wheel hands-off detection technology, which can be used to detect whether the driver is actually in contact with the steering wheel through torque, grip force, or capacitance. In the out-of-vehicle scenario, if the system detects that the steering wheel is held, this usually means that someone or an object has applied force to the steering wheel, and the driver should not be in contact with the steering wheel at this time, so the system will consider this to be an abuse.

[0086] Abuse may include the following:

[0087] The driver has left the vehicle but has not completely shut down the vehicle: For example, the driver left the vehicle to run an errand but did not completely shut down or lock the vehicle, leaving it in a standby state.

[0088] Using objects to trick the system: Drivers may place objects on the steering wheel, such as hanging a heavy object, to trick the system into thinking they are still holding the steering wheel, even if they have left the vehicle.

[0089] In this embodiment, by monitoring the driver's correct grip on the steering wheel in real time, the system can promptly issue a warning if the driver's hands leave the wheel, thereby reducing traffic accidents caused by driver inattention. It can also detect and address driver abuse of the system, such as placing objects to trick the system into believing the driver is always holding the steering wheel, ensuring that the system can reliably remind the driver to take control when necessary.

[0090] In an exemplary embodiment, according to the steering wheel hands-off detection method, after detecting the steering wheel being held, the method further includes:

[0091] When the driver is in the cockpit scene, the vehicle's driving assistance system is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

[0092] Specifically, the cockpit scenario refers to a scenario where the driver is inside the vehicle and potentially in control of the vehicle. A vehicle with a deactivated driver assistance system means the vehicle's autonomous or assisted driving features are not enabled. In this scenario, the driver is typically required to have their hands on the steering wheel, ready to take over control of the vehicle if needed.

[0093] The steering wheel is held in the driver's hands: the hands-off steering wheel detection system is used to confirm that the driver's hands are holding the steering wheel.

[0094] Under the above conditions, if the system detects that the driver has their hands on the steering wheel but is not actually driving or attempting to drive (for example, the vehicle is not started or is parked), this may be considered abuse. Abuse may occur when the driver deliberately tricks the system into thinking they are in control of the vehicle to avoid system warnings or disable certain features, when in fact they may not be ready to take over control. The purpose is to ensure that the driver maintains control of the vehicle when the assisted driving system is not activated, preventing the driver from being unable to respond in a timely manner due to distraction or other reasons when the system requires them to take over. For example, if the driver has their hands on the steering wheel while waiting in a parked vehicle or in traffic, but the vehicle is not started or driving in autonomous mode, the system may consider this abuse. The system may record this behavior or alert the driver when it is detected to ensure that they are ready to take over control of the vehicle at any time.

[0095] In this embodiment, by ensuring that the driver maintains a hands-on grip on the steering wheel when the driver assistance system is not activated, vehicle safety is improved, preventing the driver from being unable to take control in an emergency. This effectively prevents drivers from deceiving the system to avoid hands-off warnings, ensuring that the driver can immediately take control of the vehicle when needed, and reducing the risk of accidents caused by driver inattention. By accurately detecting the steering wheel grip state, the system can more reliably determine whether the driver is ready to take over the vehicle, thereby providing appropriate warnings or intervention when necessary. This reduces false positives and missed positives, avoids unnecessary warnings that disturb the driver, and ensures that the driver can respond quickly when needed, improving the driving experience.

[0096] In an exemplary embodiment, detecting the gripping state of the steering wheel according to the hands-off steering wheel detection method includes:

[0097] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the steering wheel's grip status;

[0098] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system (EPS) to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel's grip state.

[0099] Specifically, the capacitive detection method detects whether the steering wheel is being held based on changes in capacitance. When the driver's hand touches the steering wheel, the capacitance of the human body couples with the capacitance of the steering wheel, causing the capacitance value to change. The capacitive sensor arranged on the surface of the steering wheel can detect the area of ​​contact between the steering wheel and the skin. If the contact area is greater than a preset threshold, the system will assume that the steering wheel is in a held state. The capacitive detection method can very accurately detect the position and contact area of ​​the hand, is not affected by gloves or wet hands, provides continuous detection, and can distinguish between single-handed or two-handed holding.

[0100] The torque-based detection method relies on the characteristics of the electronic power steering (EPS) system. EPS provides assistive torque when the driver operates the steering wheel, making steering easier. The EPS system applies a certain degree of torque to the steering wheel to simulate the driver's steering feel. The system monitors the similarity between the hands-off detection signal (i.e., the EPS system's operating status) and the hands-off feedback signal (i.e., the actual steering wheel movement). If the similarity is low, it indicates that the steering wheel is not under the driver's control, possibly indicating a hands-off state. The torque-based detection method can detect whether the driver is operating the steering wheel, even if they only lightly touch the steering wheel. This method is very effective in detecting whether the driver is paying attention to the road and preparing to take control.

[0101] In practical applications, these two methods can be used independently or in combination to improve detection accuracy and reliability. For example, capacitive detection can be used to continuously monitor whether the driver's hands are in contact with the steering wheel, while torque detection can provide additional monitoring when the driver needs to take over control.

[0102] In this embodiment, both detection methods are used to ensure that when the automatic driving or assisted driving function is enabled, the driver can respond to the system request in a timely manner and maintain control of the vehicle, thereby improving driving safety.

[0103] In an exemplary embodiment, when it is determined based on the steering wheel's gripping state that there is steering wheel abuse, executing a corresponding abuse handling strategy includes:

[0104] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0105] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0106] Specifically, when the vehicle's driving assistance system is not activated:

[0107] Send a fault flag: The system will record a fault code and usually display a warning light or message on the vehicle's dashboard to inform the driver that there is a problem.

[0108] Disabling driver assistance systems: To prevent the driver from relying on assistance systems at inappropriate times, the system disables the driver assistance features until it is determined that the driver has regained control of the steering wheel and eliminated the abuse.

[0109] When the vehicle's driving assistance system is activated:

[0110] Prompt the driver to take over the vehicle: The system will alert the driver through a warning signal (which may be visual, audible or tactile feedback), requiring them to take over vehicle control immediately.

[0111] Disabling driver assistance systems: If the driver does not respond to the system's prompts in a timely manner, or if the system detects that the driver is not properly gripping the steering wheel, the system may automatically disable the driver assistance feature until the driver re-grasps the steering wheel and holds it for a period of time, thereby demonstrating that they are ready to take control.

[0112] In this embodiment, the implementation of the above strategies helps prevent drivers from abusing or over-relying on driver assistance systems, especially when they may be distracted or unable to immediately respond to emergencies. In this way, the system can encourage drivers to remain alert and take quick action when necessary, thereby improving road safety. This ensures that drivers maintain control of the vehicle while driving and prevents potential dangers caused by the misuse of driver assistance systems.

[0113] The most detailed embodiment of this application is:

[0114] The hands-off steering wheel detection proposed in the present invention can be divided into three steps:

[0115] The first step is to detect the current vehicle status, such as Figure 3As shown: Based on the unlock status of the vehicle's anti-theft system, the door opening / closing motion, and the powertrain system status, it is determined whether the driver is allowed to enter the vehicle or has left the vehicle. If the anti-theft system transitions from an activated state to an inactivated state, when the driver's door is opened, the driver is deemed to have been allowed to enter the vehicle, and the driver enters the vehicle scenario, and the second step is executed. If the vehicle is in the starting state (high voltage power on), it is determined to be in driving mode, and the driving scenario is executed, and the second step is executed. If the vehicle is turned off (high voltage power off), when the main driver's door undergoes an opening -> closing motion, and the anti-theft system transitions from an inactivated state to an activated state, the driver is deemed to have left the vehicle, and the driver leaves the vehicle scenario is executed, and the second step is executed.

[0116] Step 2: If the scene is a driver entering a vehicle or a driver leaving a vehicle, refer to Figure 4 At this point, the driver has not yet entered the vehicle or has already left the vehicle, and the steering wheel should be in a free state. The EPS and HOD systems detect the hands-off state of the steering wheel. If the steering wheel is in the hands-off state, it is determined that there is no abuse, the program ends, and the controller enters a dormant state. If the steering wheel is in the grip state, it is determined that there is abuse, and the third step is entered.

[0117] In the second step, if the scene is a driving scene, see Figure 5 : If an event occurs in which important equipment in the vehicle is manipulated, such as the driver's window combination switch, light switch, driver's side air conditioning control, EPB switch, driver's side electric seat adjustment switch, gear selection switch, and other equipment that is controlled by the driver in most cases, the HOD will be used to determine the hands-off state when the event occurs. If the device is on the left and it is detected that the driver is holding the steering wheel with both hands or with his left hand, it is determined that there is abuse and the process goes to step 3. If the device is on the right and it is detected that the driver is holding the steering wheel with both hands or with his right hand, it is determined that there is abuse and the process goes to step S3. If it is detected that the driver's hands are off, the driver will be prompted to hold the steering wheel correctly.

[0118] In the third step, different abuse handling strategies are implemented according to different scenarios. Figure 6 If the driver assistance system is inactive, the anti-abuse system sends a fault flag and disables the driver assistance system until the next detection of no abuse, at which point the fault is cleared. If the driver assistance system is active, the driver is prompted to take over. After the driver takes over, the driver assistance system is disabled until the next detection of no abuse, at which point the fault is cleared.

[0119] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0120] Based on the same inventive concept, embodiments of the present application further provide a hands-off steering wheel detection device for implementing the aforementioned hands-off steering wheel detection method. The solution provided by this device is similar to the solution described in the aforementioned method. Therefore, the specific limitations of one or more of the following embodiments of the hands-off steering wheel detection device can be found in the aforementioned limitations of the hands-off steering wheel detection method and will not be further elaborated here.

[0121] In an exemplary embodiment, Figure 7 As shown, a steering wheel hands-off detection device is provided, comprising:

[0122] A scene determination module 702 is used to determine the scene associated with the driver and the vehicle based on the current vehicle state;

[0123] Detection mode selection module 706, for determining a corresponding hands-off steering wheel detection mode based on the associated scenario between the driver and the vehicle;

[0124] A detection module 706 is configured to detect a steering wheel holding state according to a hands-off detection method, where the holding state includes a single-handed holding state and a two-handed holding state.

[0125] The control module 708 is configured to execute a corresponding abuse handling strategy when it is determined that the steering wheel is abused based on the steering wheel's gripping state.

[0126] In an exemplary embodiment, the scene determination module 702 is further configured to determine whether the driver is in a cockpit scene or an exiting scene according to the current state of the vehicle's anti-theft system unlocking, door opening and closing, and powertrain system.

[0127] In an exemplary embodiment, the detection module 706 is further configured to determine that there is steering wheel abuse when the driver is in a leaving-the-vehicle scenario and the steering wheel is held in the driver's hands.

[0128] In an exemplary embodiment, the detection module 706 is further configured to determine that there is steering wheel abuse when the driver is in a cockpit scene, the driving assistance system of the vehicle is not activated, and the steering wheel is held by the driver.

[0129] In an exemplary embodiment, the detection module 706 is further configured to use a capacitive detection method to obtain a contact area between the steering wheel and the skin and detect the gripping state of the steering wheel;

[0130] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system (EPS) to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel's grip state.

[0131] In an exemplary embodiment, the control module 708 is further configured to, when the driving assistance system is not activated on the vehicle, send a fault flag to disable the driving assistance system until the steering wheel abuse is eliminated;

[0132] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0133] Each module in the aforementioned hands-off steering wheel detection device can be implemented in whole or in part through software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in hardware form, or stored in a computer device memory in software form, so that the processor can call and execute the corresponding operations of each module.

[0134] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 8As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, abbreviated as I / O) and a communication interface. The processor, memory and input / output interface are connected via a system bus, and the communication interface is connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The database of the computer device is used to store different steering wheel hands-off detection methods and abuse handling strategy data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a steering wheel hands-off detection method is implemented.

[0135] Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0136] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0137] Determine the driver-vehicle association scenario based on the current vehicle status;

[0138] Determine the corresponding hands-off steering wheel detection method based on the driver-vehicle interaction scenario;

[0139] According to the steering wheel hands-off detection method, the steering wheel holding state is detected, which includes a single-handed holding state and a two-handed holding state;

[0140] When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, a corresponding abuse handling strategy is executed.

[0141] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0142] Based on the current vehicle's anti-theft system unlocking status, door opening and closing status, and powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0143] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0144] When the driver is in a leaving-the-vehicle scenario and the steering wheel is held in a state where the driver holds the steering wheel with his hands, it is determined that there is steering wheel abuse.

[0145] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0146] When the driver is in the cockpit scene, the vehicle's driving assistance system is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

[0147] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0148] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the steering wheel's grip status;

[0149] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system (EPS) to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel's grip state.

[0150] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0151] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0152] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0153] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:

[0154] Determine the driver-vehicle association scenario based on the current vehicle status;

[0155] Determine the corresponding hands-off steering wheel detection method based on the driver-vehicle interaction scenario;

[0156] According to the steering wheel hands-off detection method, the steering wheel holding state is detected, which includes a single-handed holding state and a two-handed holding state;

[0157] When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, a corresponding abuse handling strategy is executed.

[0158] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0159] Based on the current vehicle's anti-theft system unlocking status, door opening and closing status, and powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0160] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0161] When the driver is in a leaving-the-vehicle scenario and the steering wheel is held in a state where the driver holds the steering wheel with his hands, it is determined that there is steering wheel abuse.

[0162] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0163] When the driver is in the cockpit scene, the vehicle's driving assistance system is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

[0164] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0165] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the steering wheel's grip status;

[0166] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system (EPS) to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel's grip state.

[0167] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0168] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0169] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0170] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0171] Determine the driver-vehicle association scenario based on the current vehicle status;

[0172] Determine the corresponding hands-off steering wheel detection method based on the driver-vehicle interaction scenario;

[0173] According to the steering wheel hands-off detection method, the steering wheel holding state is detected, which includes a single-handed holding state and a two-handed holding state;

[0174] When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, a corresponding abuse handling strategy is executed.

[0175] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0176] Based on the current vehicle's anti-theft system unlocking status, door opening and closing status, and powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0177] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0178] When the driver is in a leaving-the-vehicle scenario and the steering wheel is held in a state where the driver holds the steering wheel with his hands, it is determined that there is steering wheel abuse.

[0179] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0180] When the driver is in the cockpit scene, the vehicle's driving assistance system is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

[0181] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0182] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the steering wheel's grip status;

[0183] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system (EPS) to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel's grip state.

[0184] In one embodiment, when the computer program is executed by a processor, the following steps are further implemented:

[0185] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0186] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0187] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0188] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. In particular, any reference to memory, database, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The databases involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the various embodiments provided herein may be, but are not limited to, general-purpose processors, central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), programmable logic devices (PLDs), quantum computing-based data processing logic devices, artificial intelligence (AI) processors, and the like.

[0189] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0190] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A method for detecting hands-off steering wheel, characterized in that: The method comprises: Determine the driver-vehicle association scenario based on the current vehicle status; specifically, determine whether the driver is in the in-cabin scenario or out-of-vehicle scenario based on the current vehicle anti-theft system unlocking status, door opening and closing status, and powertrain system status; Determining a corresponding hands-off steering wheel detection method based on the associated scenario between the driver and the vehicle; According to the hands-off steering wheel detection method, the steering wheel holding state is detected, and the holding state includes a one-hand holding state and a two-hand holding state; wherein, when the driver is in an exiting vehicle scenario and the steering wheel holding state is the driver holding the steering wheel with one hand, it is determined that there is steering wheel abuse; when the driver is in a cockpit scenario, the vehicle driving assistance system is not activated, and the steering wheel holding state is the driver holding the steering wheel with one hand, it is determined that there is steering wheel abuse; When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, a corresponding abuse handling strategy is executed.

2. The method according to claim 1, characterized in that Detecting the gripping state of the steering wheel according to the hands-off steering wheel detection method includes: A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the steering wheel's grip status; Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system (EPS) to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel's grip state.

3. The method according to claim 1, characterized in that When it is determined based on the gripping state of the steering wheel that there is steering wheel abuse, executing a corresponding abuse handling strategy includes: If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated; Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

4. A steering wheel hands-off detection device, characterized in that: The device comprises: A scene determination module is used to determine the driver's associated scene with the vehicle based on the current vehicle state; in particular, the driver is determined to be in the cockpit scene or the exit scene based on the current vehicle anti-theft system unlocking state, door opening and closing state, and powertrain system state; a detection mode selection module, configured to determine a corresponding hands-off steering wheel detection mode according to the associated scenario between the driver and the vehicle; a detection module, configured to detect a steering wheel holding state according to the hands-off steering wheel detection method, the holding state including a single-handed holding state and a two-handed holding state; wherein, when the driver is in an exiting vehicle scenario and the steering wheel holding state is a case where the driver is holding the steering wheel with one hand, it is determined that steering wheel abuse has occurred; and when the driver is in a cockpit scenario, the vehicle has no driving assistance system activated, and the steering wheel holding state is a case where the driver is holding the steering wheel with one hand, it is determined that steering wheel abuse has occurred; The control module is configured to execute a corresponding abuse handling strategy when it is determined that there is steering wheel abuse based on the gripping state of the steering wheel.

5. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 3 are implemented.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 3 are implemented.

7. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 3 are implemented.

Citation Information

Patent Citations

  • Arrangement and method for safeguarding driver attentiveness

    CN103101536A

  • Method and device for reminding driver during lane keeping, electronic equipment and medium

    CN112918474A