Steering wheel out-of-hand detection method and device, computer equipment and storage medium

Abstract

The invention relates to the technical field of intelligent driving, in particular to a steering wheel out-of-hand detection method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: determining an associated scene of a driver and a vehicle according to a current vehicle state; according to the associated scene of the driver and the vehicle, determining a corresponding steering wheel out-of-hand detection mode; according to the steering wheel out-of-hand detection mode, the held state of the steering wheel is detected, and the held state comprises a single-hand holding state and a double-hand holding state; and executing a corresponding abuse processing strategy under the condition of determining the abuse phenomenon of the steering wheel based on the held state of the steering wheel. By adopting the method, the abuse behavior of the driver can be detected during the inactivation period of the driving assistance system, and the safety risk is reduced.

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to a method, device, computer equipment, computer-readable storage medium and computer program product for detecting hands-off steering wheel. Background Art

[0002] With the development of autonomous driving technology, driver assistance systems and conditional autonomous driving systems are increasingly used in modern vehicles. These systems assist drivers in driving operations through various sensors and algorithms, and even achieve partial or full autonomous driving functions in some cases. Among them, the hands-off steering wheel detection system is a key component of these systems. It is used to monitor whether the driver is in control of the vehicle and ensure that the driver can take over the control of the vehicle in time when necessary.

[0003] Current hands-off-steering detection systems mainly use capacitive detection, torque detection, or vision-based detection methods. Although these methods can achieve the function of hands-off-steering detection to a certain extent, they have limitations. For example, they cannot effectively detect human abuse of the system, such as deceiving the system by placing objects on the steering wheel to make it think that the driver is always holding the steering wheel. In addition, vision-based detection methods are expensive and difficult to apply on a large scale in mass-produced models. However, current technologies mainly perform online detection when the driver assistance system is activated, and it is difficult to detect abuse when the system is not activated.

[0004] Therefore, a method, apparatus, computer device, computer-readable storage medium and computer program product for detecting hands-off steering are needed, which can detect driver abuse during the inactivation of a driving assistance system and reduce safety risks. Summary of the invention

[0005] Based on this, it is necessary to provide a steering wheel hands-off detection method, device, computer equipment, computer-readable storage medium and computer program product that can detect driver abuse behavior during the inactivation period of the driving assistance system and reduce safety risks in response to the above technical problems.

[0006] In a first aspect, the present application provides a method for detecting a hands-off steering wheel, comprising:

[0007] Determine the driver-vehicle association scenario based on the current vehicle status;

[0008] Determining a corresponding steering wheel hands-off detection method according to the associated scenario between the driver and the vehicle;

[0009] According to the steering wheel hands-off detection method, detecting a holding state of the steering wheel, wherein the holding state includes a single-hand holding state and a double-hand holding state;

[0010] When it is determined that there is steering wheel abuse based on the gripping state of the steering wheel, a corresponding abuse handling strategy is executed.

[0011] In one embodiment, determining the association scenario between the driver and the vehicle according to the current vehicle state includes:

[0012] According to the current unlocking status of the vehicle's anti-theft system, the door opening and closing status, and the powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0013] In one embodiment, after detecting the steering wheel being held according to the steering wheel hands-off detection method, the method further includes:

[0014] When the driver is in a leaving-the-car scene and the steering wheel is held in the driver's hand, it is determined that there is steering wheel abuse.

[0015] In one embodiment, after detecting the steering wheel being held according to the steering wheel hands-off detection method, the method further includes:

[0016] When the driver is in a cockpit scene, the driving assistance system of the vehicle is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

[0017] In one embodiment, the detecting the steering wheel holding state according to the steering wheel hands-off detection method includes:

[0018] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the gripping state of the steering wheel;

[0019] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system EPS to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel holding state.

[0020] In one of the embodiments, when it is determined that there is steering wheel abuse based on the gripping state of the steering wheel, executing a corresponding abuse handling strategy includes:

[0021] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0022] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0023] In a second aspect, the present application further provides a steering wheel hands-off detection device, comprising:

[0024] A scene determination module, used to determine the scene of association between the driver and the vehicle according to the current vehicle state;

[0025] A detection mode selection module, used to determine a corresponding steering wheel hands-off detection mode according to the associated scenario between the driver and the vehicle;

[0026] A detection module, used for detecting a holding state of the steering wheel according to the steering wheel hands-off detection method, wherein the holding state includes a single-hand holding state and a double-hand holding state;

[0027] The control module is used to execute a corresponding abuse handling strategy when it is determined that there is steering wheel abuse based on the gripping state of the steering wheel.

[0028] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0029] Determine the driver-vehicle association scenario based on the current vehicle status;

[0030] Determining a corresponding steering wheel hands-off detection method according to the associated scenario between the driver and the vehicle;

[0031] According to the steering wheel hands-off detection method, detecting a holding state of the steering wheel, wherein the holding state includes a single-hand holding state and a double-hand holding state;

[0032] When it is determined that there is steering wheel abuse based on the gripping state of the steering wheel, a corresponding abuse handling strategy is executed.

[0033] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0034] Determine the driver-vehicle association scenario based on the current vehicle status;

[0035] Determining a corresponding steering wheel hands-off detection method according to the associated scenario between the driver and the vehicle;

[0036] According to the steering wheel hands-off detection method, detecting a holding state of the steering wheel, wherein the holding state includes a single-hand holding state and a double-hand holding state;

[0037] When it is determined that there is steering wheel abuse based on the gripping state of the steering wheel, a corresponding abuse handling strategy is executed.

[0038] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0039] Determine the driver-vehicle association scenario based on the current vehicle status;

[0040] Determining a corresponding steering wheel hands-off detection method according to the associated scenario between the driver and the vehicle;

[0041] According to the steering wheel hands-off detection method, detecting a holding state of the steering wheel, wherein the holding state includes a single-hand holding state and a double-hand holding state;

[0042] When it is determined that there is steering wheel abuse based on the gripping state of the steering wheel, a corresponding abuse handling strategy is executed.

[0043] The above-mentioned steering wheel hands-off detection method, device, computer equipment, computer-readable storage medium and computer program product can monitor in real time whether the driver is holding the steering wheel correctly, and the system can issue a warning in time when the driver's hands leave the steering wheel, thereby reducing traffic accidents caused by the driver's inattention. The technology can distinguish between single-handed and double-handed holding states, provide more personalized feedback, reduce false alarms and missed alarms, and enhance the user experience of using the assisted driving system. It can detect and handle the driver's abuse of the system, such as deceiving the system into thinking that the driver is holding the steering wheel by placing objects, thereby ensuring that the system can reliably remind the driver to take over control when necessary. The method can also perform detection when the driving assistance system is not activated, which improves the system's adaptability to various driving scenarios and ensures that the driver's behavior can be monitored when the system is not activated. Through accurate steering wheel hands-off detection technology, more reliable safety guarantees can be provided for the development of autonomous driving technology, and the transition of autonomous driving technology from assisted driving to fully autonomous driving can be promoted. Through compliance online monitoring technology, autonomous driving vehicles can better comply with road traffic regulations and improve the legality and safety of autonomous driving vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0045] FIG1 is a diagram showing an application environment of a method for detecting a hands-off steering wheel in one embodiment;

[0046] FIG2 is a schematic diagram of a process flow of a method for detecting a hands-off steering wheel in one embodiment;

[0047] FIG3 is a schematic diagram of a flow chart of scene determination in the most detailed embodiment;

[0048] FIG4 is a schematic diagram of a process flow of a driver entering and exiting a scene in the most detailed embodiment;

[0049] FIG5 is a schematic diagram of a first process flow of a driving scenario in the most detailed embodiment;

[0050] FIG6 is a schematic diagram of a second process flow of a driving scenario in the most detailed embodiment;

[0051] FIG7 is a structural block diagram of a steering wheel hands-off detection device in one embodiment;

[0052] FIG. 8 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0054] The steering wheel hands-off detection method provided in the embodiment of the present application can be applied in the application environment shown in FIG1 . The terminal 102 communicates with the server 104 via a network. The data storage system can store data that the server 104 needs to process. The data storage system can be integrated on the server 104, or placed on the cloud or other network servers.

[0055] The server 104 determines the association scenario between the driver and the vehicle based on the current vehicle state; determines the corresponding steering wheel hands-off detection method based on the association scenario between the driver and the vehicle; detects the steering wheel holding state according to the steering wheel hands-off detection method, and the holding state includes a one-hand holding state and a two-hand holding state; when it is determined that there is steering wheel abuse based on the steering wheel holding state, the corresponding abuse handling strategy is executed through the terminal 102.

[0056] The terminal 102 may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, IoT devices, and portable wearable devices. The IoT devices may be smart speakers, smart TVs, smart air conditioners, smart car devices, projection devices, etc. Portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc. Head-mounted devices may be virtual reality (VR) devices, augmented reality (AR) devices, smart glasses, etc. The server 104 may be an independent physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides cloud computing services.

[0057] In an exemplary embodiment, as shown in FIG2 , a method for detecting a hands-off steering wheel is provided, which is described by taking the method applied to the server in FIG1 as an example, and includes the following steps S202 to S208 . Among them:

[0058] Step S202, determining the association scenario between the driver and the vehicle according to the current vehicle state.

[0059] Specifically, whether the vehicle's anti-theft system is unlocked or locked, which usually means whether the driver is authorized to enter the vehicle. Whether the door is open or closed, which helps to determine whether the driver is inside the vehicle or entering / leaving the vehicle. Whether the vehicle is started or turned off, which helps to determine whether the vehicle is ready to drive or has stopped. Whether the vehicle is in motion or stationary, which is crucial to determine whether the driver needs to control the vehicle. Whether the driver is operating the vehicle's control devices, such as window switches, lights, air conditioning, electronic parking brake (EPB), seat adjustment, gear selection, etc. Record and analyze the time sequence of a series of events, such as whether the door is opened and then closed, and the association of these events with vehicle status changes.

[0060] Step S204, determining a corresponding steering wheel hands-off detection method according to the association scenario between the driver and the vehicle.

[0061] Specifically, the association scenario between the driver and the vehicle refers to the interaction status between the driver and the vehicle, including but not limited to whether the driver is in the vehicle, whether the vehicle is driving, whether the driver is operating the vehicle's control device, etc.

[0062] The corresponding steering wheel hands-off detection method refers to a detection method selected according to the above-mentioned scenarios to ensure that whether the steering wheel is held by the driver can be effectively monitored in different situations.

[0063] Step S206: Detect the holding state of the steering wheel according to the steering wheel hands-off detection method, where the holding state includes a single-hand holding state and a double-hand holding state.

[0064] Specifically, the steering wheel is detected according to the hands-off detection method to determine the steering wheel holding state, including the one-hand holding state and the two-hand holding state, in order to ensure that when the automatic driving or assisted driving function is enabled, the driver can take over the vehicle control in time, thereby ensuring driving safety. Different detection methods have their own advantages and application scenarios:

[0065] Torque-sensing steering wheel: This detects whether the driver's hands are on the steering wheel by detecting small turns of the steering wheel. This method is less expensive, but requires the driver to turn the steering wheel from time to time to avoid the system warning.

[0066] Grip-sensing steering wheel: Utilizes grip-sensing sensors to detect whether the driver is holding the steering wheel through a small ECU and sensor pad on the steering wheel. This method does not require turning the steering wheel, but requires a certain amount of grip.

[0067] Capacitive sensing steering wheel: It senses the driver's operating intention by detecting the microcurrent at the fingertips, and recognizes the fingers more accurately. It does not require strong grip, just a light touch.

[0068] In actual application, the system will use these detection methods to identify whether the driver's hands are on the steering wheel, and whether it is one hand or two hands.

[0069] Step S208: When it is determined that there is steering wheel abuse based on the steering wheel holding state, a corresponding abuse handling strategy is executed.

[0070] Specifically, when it is determined that there is steering wheel abuse based on the steering wheel holding state, the corresponding abuse handling strategy is executed, which means that when the system confirms that the driver is not holding the steering wheel correctly through the steering wheel hands-off detection technology, a series of measures will be taken to ensure driving safety. These measures may include:

[0071] Warning reminder: The system may remind the driver to hold the steering wheel through visual, auditory or tactile feedback (such as steering wheel vibration).

[0072] Limited Functionality: In certain situations, if it detects that the driver is not holding the steering wheel, the system may limit or disable certain automated driving features until the driver regains control of the steering wheel.

[0073] Emergency procedures: In extreme cases, if the driver fails to respond to the system's warning and hold the steering wheel within the specified time, the vehicle may automatically perform safety procedures such as slowing down, pulling over, etc. to avoid an accident.

[0074] Recording events: The system may record details of steering wheel abuse events, including time, date, and duration, which can be used for subsequent analysis or legal accountability.

[0075] In the above-mentioned steering wheel hands-off detection method, by real-time monitoring whether the driver is holding the steering wheel correctly, the system can issue a warning in time when the driver's hands leave the steering wheel, thereby reducing traffic accidents caused by the driver's inattention. This technology can distinguish between one-handed and two-handed holding states, provide more personalized feedback, reduce false alarms and missed alarms, and enhance the user experience of using the assisted driving system. It can detect and handle the driver's abuse of the system, such as deceiving the system into thinking that the driver is holding the steering wheel by placing objects, thereby ensuring that the system can reliably remind the driver to take over control when necessary. This method can also perform detection when the driving assistance system is not activated, which improves the system's adaptability to various driving scenarios and ensures that the driver's behavior can be monitored when the system is not activated. Through accurate steering wheel hands-off detection technology, more reliable safety guarantees can be provided for the development of autonomous driving technology, and the transition of autonomous driving technology from assisted driving to fully autonomous driving can be promoted. Through compliance online monitoring technology, autonomous driving vehicles can better comply with road traffic regulations and improve the legality and safety of autonomous driving vehicles.

[0076] In an exemplary embodiment, determining the association scenario between the driver and the vehicle according to the current vehicle state includes:

[0077] According to the current unlocking status of the vehicle's anti-theft system, the door opening and closing status, and the powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0078] Specifically, it involves a comprehensive analysis of the vehicle's current state in order to provide the driver with appropriate interaction and assistance. This usually includes the following aspects:

[0079] Immobilizer unlock status: The vehicle's immobilizer status can indicate whether the driver is authorized to enter the vehicle. For example, when the immobilizer changes from an activated state to an inactivated state, it usually means that the driver has unlocked the vehicle using a legitimate key or code.

[0080] Door opening / closing motion: The opening and closing status of the door can indicate whether the driver is inside the vehicle or entering / leaving the vehicle. If the main driver's door has experienced an opening and then closing motion, this may mean that the driver has entered the vehicle and is preparing to start.

[0081] Powertrain system status: The status of the powertrain system (start or stop) can indicate whether the vehicle is ready to drive or has stopped. For example, if the vehicle is in the start state, that is, the high voltage is powered on, it can be considered to be in the driving state.

[0082] In this embodiment, by analyzing this information, the system can determine whether the driver is in the cockpit (preparing to drive or driving) or has left the car. This judgment is crucial to achieving safe and intelligent human-vehicle interaction because it determines when the driver needs to take over control and when the automatic driving assistance function can be enabled.

[0083] In an exemplary embodiment, according to the steering wheel hands-off detection method, after detecting the steering wheel being held, the method further includes:

[0084] When the driver is in a leaving-the-car scenario and the steering wheel is held in the driver's hand, it is determined that there is steering wheel abuse.

[0085] Specifically, the out-of-vehicle scenario refers to a situation where the driver is not inside the vehicle or is not driving. This may include a state where the vehicle is turned off, the doors are closed, and the anti-theft system is activated. The held state of the steering wheel involves the steering wheel hands-off detection technology, which can be detected by torque, grip force, or capacitance to see whether the driver is actually touching the steering wheel. In the out-of-vehicle scenario, if the system detects that the steering wheel is held, this usually means that someone or an object has applied force to the steering wheel, and the driver should not be in contact with the steering wheel at this time, so the system will consider this to be an abuse.

[0086] Abuse may include the following:

[0087] The driver has left the vehicle but has not completely shut down the vehicle: For example, the driver has left the vehicle to run an errand but has not completely shut down or locked the vehicle, leaving it in a standby state.

[0088] Using objects to trick the system: Drivers may place objects on the steering wheel, such as hanging a weight, to trick the system into thinking they are still holding the wheel, even if they have left the vehicle.

[0089] In this embodiment, by monitoring in real time whether the driver is holding the steering wheel correctly, the system can issue a warning in time when the driver's hands leave the steering wheel, thereby reducing traffic accidents caused by the driver's inattention. It is possible to detect and handle the driver's abuse of the system, such as placing objects to deceive the system into thinking that the driver is always holding the steering wheel, thereby ensuring that the system can reliably remind the driver to take over control when necessary.

[0090] In an exemplary embodiment, according to the steering wheel hands-off detection method, after detecting the steering wheel being held, the method further includes:

[0091] When the driver is in the cockpit scene, the driving assistance system of the vehicle is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

[0092] Specifically, the cockpit scenario refers to the scenario where the driver is inside the vehicle and has the possibility to control the vehicle. The vehicle's unactivated driving assistance system means that the vehicle's automatic driving or assisted driving function is not turned on. In this case, the driver is usually required to hold the steering wheel so that he can take over the vehicle control at any time when needed.

[0093] The steering wheel is in a held state when the driver is holding the steering wheel: the hands-off steering wheel detection system is used to confirm that the driver is holding the steering wheel with both hands.

[0094] Under the above conditions, if the system detects that the driver has their hands on the steering wheel but is not actually driving or preparing to drive (for example, the vehicle is not started or is in park), this may be considered abuse. Abuse may mean that the driver deliberately makes the system think that they are in control of the vehicle to avoid system warnings or disable certain functions, when in fact they may not be ready to take over control. The purpose is to ensure that the driver still maintains control of the vehicle when the auxiliary driving system is not activated, in case the driver is distracted or unable to respond in time when the system needs them to take over. For example, if the driver has their hands on the steering wheel when waiting to stop or encountering traffic congestion, but the vehicle is not started or driving in autonomous mode, the system may consider this as abuse. The system may record this behavior or remind the driver to pay attention when this behavior is detected to ensure that they are ready to take over control of the vehicle at any time.

[0095] In this embodiment, by ensuring that the driver still holds the steering wheel when the assisted driving system is not activated, the safety of the vehicle is improved to prevent the driver from being unable to take over control in time in an emergency. It effectively prevents the driver from deceiving the system to avoid the hands-off warning, ensures that the driver can immediately control the vehicle when needed, and reduces the risk of accidents caused by the driver's inattention. Through accurate steering wheel holding state detection, the system can more reliably determine whether the driver is ready to take over the vehicle, so as to provide appropriate warnings or interventions when necessary. Reduce false alarms and missed alarms, avoid unnecessary warnings to disturb the driver, and ensure that the driver can respond quickly when needed, improving the driving experience.

[0096] In an exemplary embodiment, according to the steering wheel hands-off detection method, detecting the steering wheel holding state includes:

[0097] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the gripping state of the steering wheel;

[0098] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system EPS to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel holding state.

[0099] Specifically, the capacitive detection method detects whether the steering wheel is held based on changes in capacitance. When the driver's hand touches the steering wheel, the capacitance of the human body is coupled with the capacitance of the steering wheel, causing the capacitance value to change. The area of ​​contact between the steering wheel and the skin can be detected by the capacitive sensor arranged on the surface of the steering wheel. If the contact area is greater than the preset threshold, the system will assume that the steering wheel is in a held state. The capacitive detection method can detect the position and contact area of ​​the hand very accurately, is not affected by gloves or wet hands, provides continuous detection, and can distinguish between single-handed or double-handed holding.

[0100] The torque-based detection method relies on the characteristics of the electronic power steering system (EPS). EPS can provide auxiliary torque when the driver operates the steering wheel, making steering easier. The EPS system applies a certain degree of torque to the steering wheel to simulate the driver's feeling when steering. The system monitors the similarity between the hands-off detection signal (i.e. the working status of the EPS system) and the hands-off feedback signal (i.e. the actual rotation of the steering wheel). If the similarity between the two is low, it means that the steering wheel is not under the control of the driver, which means that it may be in a hands-off state. The torque-based detection method can detect whether the driver is operating the steering wheel, even if they only touch the steering wheel lightly. This method is very effective in detecting whether the driver is paying attention to the road conditions and is ready to take over control.

[0101] In practical applications, these two methods can be used alone or in combination to improve the accuracy and reliability of detection. For example, capacitive detection can be used to continuously monitor whether the driver's hands are in contact with the steering wheel, while torque detection can provide additional monitoring when the driver needs to take over control.

[0102] In this embodiment, both detection methods are used to ensure that when the automatic driving or assisted driving function is enabled, the driver can respond to the system request in a timely manner and maintain control of the vehicle, thereby improving driving safety.

[0103] In an exemplary embodiment, when it is determined that there is steering wheel abuse based on the steering wheel holding state, a corresponding abuse handling strategy is executed, including:

[0104] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0105] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0106] Specifically, when the vehicle's driving assistance system is not activated:

[0107] Send a fault flag: The system will record a fault code and usually display a warning light or message on the vehicle's dashboard to inform the driver that there is a problem.

[0108] Disabling driver assistance systems: To prevent the driver from relying on the assistance systems at inappropriate times, the system disables the driver assistance features until it is determined that the driver has resumed control of the steering wheel and eliminated the abuse.

[0109] When the vehicle's driving assistance system is activated:

[0110] Prompt the driver to take over the vehicle: The system will alert the driver through a warning signal (which may be visual, audible or tactile feedback), requiring them to take over vehicle control immediately.

[0111] Disabling driver assistance systems: If the driver does not respond to the system's prompts in a timely manner, or if the system detects that the driver is not properly gripping the steering wheel, the system may automatically disable the driver assistance feature until the driver re-grips the steering wheel and holds it for a period of time, thereby demonstrating that they are ready to take control.

[0112] In this embodiment, by implementing the above strategies, it helps prevent drivers from abusing or over-relying on the driver assistance system, especially when they may be distracted or unable to respond immediately to an emergency. In this way, the system can encourage drivers to stay alert and take quick action when necessary, thereby improving road safety. In order to ensure that the driver maintains control of the vehicle during driving and prevent potential dangers caused by the abuse of the driver assistance system.

[0113] The most detailed embodiment of this application is:

[0114] The hands-off steering wheel detection proposed by the present invention can be divided into three steps:

[0115] Step 1: Detect the current vehicle status, as shown in Figure 3: Based on the unlocking status of the vehicle anti-theft system, the door opening / closing action, and the powertrain system status, determine whether the driver is allowed to enter the vehicle or has left the vehicle. If the anti-theft system changes from an activated state to an inactivated state, when the driver's door is opened, it is determined that the driver is allowed to enter the vehicle, which is the driver entering the vehicle scene, and the second step is executed. If the vehicle is in the starting (high voltage power-on) state, it is determined that the current state is driving, which is the driving scene, and the second step is executed. If the vehicle is turned off (high voltage power-off) event occurs, when the main driver's door has experienced an opening->closing action, and the anti-theft system changes from an inactivated state to an activated state, it is determined that the driver has left the vehicle, which is the driver leaving the vehicle scene, and the second step is executed.

[0116] Step 2: If the scene is the driver entering the vehicle or the driver leaving the vehicle, see Figure 4: At this time, the driver has not entered the vehicle or has left the vehicle, and the steering wheel should be in a free state. The EPS system and the HOD system detect the hands-off state of the steering wheel. If the steering wheel is in the hands-off state, it is determined that there is no abuse, the program is terminated, and the controller enters the dormant state. If the steering wheel is in the grip state, it is determined that there is currently abuse, and the third step is entered.

[0117] In the second step, if the scene is a driving scene, see Figure 5: If an event occurs to manipulate important equipment in the car, such as the main driving window combination switch, light switch, main driving side air conditioning adjustment, EPB switch, main driving electric seat adjustment switch, gear selection switch, etc., which are mostly controlled by the driver, then when the event occurs, the HOD is used to determine the hands-off state. If the device is on the left and it is detected that the driver holds the steering wheel with both hands or the left hand, it is determined that there is abuse and enters the third step. If the device is on the right and it is detected that the driver holds the steering wheel with both hands or the right hand, it is determined that there is abuse and enters the S3 step. If it is detected that the driver's hands are off, the driver is prompted to hold the steering wheel correctly.

[0118] In the third step, different abuse handling strategies are implemented according to different scenarios, see Figure 6: If the driver assistance system is in an inactive state, the anti-abuse system sends a fault flag and disables the driver assistance system until the next time no abuse is detected, and the fault is cleared. If the driver assistance system is in an active state, the driver is prompted to take over. After the driver takes over, the driver assistance system is disabled until the next time no abuse is detected, and the fault is cleared.

[0119] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0120] Based on the same inventive concept, the embodiment of the present application further provides a steering wheel hands-off detection device for implementing the above-mentioned steering wheel hands-off detection method. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above-mentioned method, so the specific limitations of one or more steering wheel hands-off detection device embodiments provided below can refer to the above-mentioned limitations on the steering wheel hands-off detection method, and will not be repeated here.

[0121] In an exemplary embodiment, as shown in FIG7 , a steering wheel hands-off detection device is provided, comprising:

[0122] A scene determination module 702 is used to determine the scene associated with the driver and the vehicle according to the current vehicle state;

[0123] A detection mode selection module 706 is used to determine a corresponding steering wheel hands-off detection mode according to the associated scenario between the driver and the vehicle;

[0124] A detection module 706, configured to detect a holding state of the steering wheel according to a hands-off detection method, wherein the holding state includes a single-hand holding state and a double-hand holding state;

[0125] The control module 708 is used to execute a corresponding abuse handling strategy when it is determined that there is steering wheel abuse based on the steering wheel holding state.

[0126] In an exemplary embodiment, the scene determination module 702 is further used to determine whether the driver is in a cockpit scene or a leaving vehicle scene according to the unlocking state of the anti-theft system, the door opening and closing state, and the powertrain system state of the current vehicle.

[0127] In an exemplary embodiment, the detection module 706 is also used to determine that there is steering wheel abuse when the driver is in a leaving-the-car scenario and the steering wheel is held in the driver's hands.

[0128] In an exemplary embodiment, the detection module 706 is also used to determine that there is steering wheel abuse when the driver is in a cockpit scene, the driving assistance system of the vehicle is not activated, and the steering wheel is held in the driver's hand.

[0129] In an exemplary embodiment, the detection module 706 is further used to use a capacitive detection method to obtain the contact area between the steering wheel and the skin and detect the gripping state of the steering wheel;

[0130] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system EPS to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel holding state.

[0131] In an exemplary embodiment, the control module 708 is further configured to send a fault flag to disable the driving assistance system when the driving assistance system is not activated on the vehicle until the steering wheel abuse phenomenon is eliminated;

[0132] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0134] Each module in the above-mentioned steering wheel hands-off detection device can be implemented in whole or in part by software, hardware or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0135] In an exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be shown in FIG8. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface is connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store different steering wheel hand-off detection methods and abuse processing strategy data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a steering wheel hand-off detection method is implemented.

[0136] Those skilled in the art will understand that the structure shown in FIG. 8 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0137] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0138] Determine the driver-vehicle association scenario based on the current vehicle status;

[0139] Determine the corresponding steering wheel hands-off detection method based on the associated scenario between the driver and the vehicle;

[0140] According to the steering wheel hands-off detection method, detecting the holding state of the steering wheel, the holding state includes a single-hand holding state and a double-hand holding state;

[0141] When it is determined that there is steering wheel abuse based on the gripping state of the steering wheel, a corresponding abuse handling strategy is executed.

[0142] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0143] According to the current unlocking status of the vehicle's anti-theft system, the door opening and closing status, and the powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0144] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0145] When the driver is in a leaving-the-car scenario and the steering wheel is held in the driver's hand, it is determined that there is steering wheel abuse.

[0146] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0147] When the driver is in the cockpit scene, the driving assistance system of the vehicle is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

[0148] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0149] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the gripping state of the steering wheel;

[0150] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system EPS to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel holding state.

[0151] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0152] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0153] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0154] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0155] Determine the driver-vehicle association scenario based on the current vehicle status;

[0156] Determine the corresponding steering wheel hands-off detection method based on the associated scenario between the driver and the vehicle;

[0157] According to the steering wheel hands-off detection method, detecting the holding state of the steering wheel, the holding state includes a single-hand holding state and a double-hand holding state;

[0158] When it is determined that there is steering wheel abuse based on the gripping state of the steering wheel, a corresponding abuse handling strategy is executed.

[0159] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0160] According to the current unlocking status of the vehicle's anti-theft system, the door opening and closing status, and the powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0161] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0162] When the driver is in a leaving-the-car scenario and the steering wheel is held in the driver's hand, it is determined that there is steering wheel abuse.

[0163] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0164] When the driver is in the cockpit scene, the driving assistance system of the vehicle is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

[0165] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0166] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the gripping state of the steering wheel;

[0167] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system EPS to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel holding state.

[0168] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0169] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0170] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0171] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0172] Determine the driver-vehicle association scenario based on the current vehicle status;

[0173] Determine the corresponding steering wheel hands-off detection method based on the associated scenario between the driver and the vehicle;

[0174] According to the steering wheel hands-off detection method, detecting the holding state of the steering wheel, the holding state includes a single-hand holding state and a double-hand holding state;

[0175] When it is determined that there is steering wheel abuse based on the gripping state of the steering wheel, a corresponding abuse handling strategy is executed.

[0176] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0177] According to the current unlocking status of the vehicle's anti-theft system, the door opening and closing status, and the powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

[0178] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0179] When the driver is in a leaving-the-car scenario and the steering wheel is held in the driver's hand, it is determined that there is steering wheel abuse.

[0180] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0181] When the driver is in the cockpit scene, the driving assistance system of the vehicle is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

[0182] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0183] A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the gripping state of the steering wheel;

[0184] Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system EPS to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel holding state.

[0185] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0186] If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated;

[0187] Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

[0188] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0189] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0190] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0191] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for detecting a hands-off steering wheel, characterized in that: The method comprises: Determine the driver-vehicle association scenario based on the current vehicle status; Determining a corresponding steering wheel hands-off detection method according to the associated scenario between the driver and the vehicle; According to the steering wheel hands-off detection method, detecting a holding state of the steering wheel, wherein the holding state includes a single-hand holding state and a double-hand holding state; When it is determined that there is steering wheel abuse based on the gripping state of the steering wheel, a corresponding abuse handling strategy is executed.

2. The method according to claim 1, characterized in that Determining the association scenario between the driver and the vehicle according to the current vehicle state includes: According to the current unlocking status of the vehicle's anti-theft system, the door opening and closing status, and the powertrain system status, it is determined whether the driver is in the cockpit scene or the out-of-vehicle scene.

3. The method according to claim 2, characterized in that After detecting the steering wheel being held according to the steering wheel hands-off detection method, the method further includes: When the driver is in a leaving-the-car scene and the steering wheel is held in the driver's hand, it is determined that there is steering wheel abuse.

4. The method according to claim 2, characterized in that: After detecting the steering wheel being held according to the steering wheel hands-off detection method, the method further includes: When the driver is in a cockpit scene, the driving assistance system of the vehicle is not activated, and the steering wheel is held by the driver, it is determined that there is steering wheel abuse.

5. The method according to claim 1, characterized in that The detecting the steering wheel holding state according to the steering wheel hands-off detection method includes: A capacitive detection method is used to obtain the contact area between the steering wheel and the skin and detect the gripping state of the steering wheel; Alternatively, a torque detection method is used to apply the torque generated by the electronic power steering system EPS to the steering wheel, and the similarity between the hands-off detection signal and the hands-off feedback signal is compared to detect the steering wheel holding state.

6. The method according to claim 1, characterized in that In the case where it is determined based on the gripping state of the steering wheel that there is a steering wheel abuse phenomenon, executing a corresponding abuse handling strategy includes: If the vehicle's driver assistance system is not activated, a fault flag is sent to disable the driver assistance system until the steering wheel abuse is eliminated; Or, if the vehicle's driving assistance system is activated, prompt the driver to take over the vehicle and disable the driving assistance system until the steering wheel abuse is eliminated.

7. A steering wheel hands-off detection device, characterized in that: The device comprises: A scene determination module, used to determine the scene of association between the driver and the vehicle according to the current vehicle state; A detection mode selection module, used to determine a corresponding steering wheel hands-off detection mode according to the associated scenario between the driver and the vehicle; A detection module, used for detecting a holding state of the steering wheel according to the steering wheel hands-off detection method, wherein the holding state includes a single-hand holding state and a double-hand holding state; The control module is used to execute a corresponding abuse handling strategy when it is determined that there is steering wheel abuse based on the gripping state of the steering wheel.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images