Method for detecting the hand position of a driver of a vehicle on the steering wheel of the vehicle
The procedure for determining the driver's hand position on the steering wheel using electromagnetic sensors and depth image cameras addresses the challenge of imitated hand presence, enhancing the accuracy and safety of assisted driving systems.
Patent Information
- Application Number
- DE102023210910
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-11-03
- Publication Date
- 2025-05-08
AI Technical Summary
Current systems for assisted or automated driving struggle to accurately determine if a driver has their hands on the steering wheel, as they can be imitated by weights or objects, leading to continued active systems despite the driver being unable to take control.
A procedure that determines the steering wheel position and hand position, comparing them to assess if the driver has their hands on the steering wheel, using electromagnetic sensors and depth image cameras for non-invasive and accurate detection.
This solution enhances the accuracy and reliability of driver hand position detection, preventing systems from remaining active when the driver cannot take control, thus improving safety and security in assisted driving functions.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The present invention relates to a method for detecting the hand position of a driver of a vehicle on a steering wheel of the vehicle according to the independent patent claim. State of the art
[0002] In vehicles equipped with assisted or automated driving functions, the driver must always be ready to take control of the vehicle up to Level 2. Depending on the situation and function, it is necessary to determine the driver's readiness. Most systems check whether the driver has their hands on the steering wheel and could therefore immediately resume control of the vehicle. Currently, this is detected using sensors integrated into the steering wheel or torque sensors in the steering system. If it is detected that the driver does not have their hands on the steering wheel during assisted driving, they are prompted to take control of the vehicle, and the system is deactivated after a handover period. Interior cameras are also increasingly used in vehicles. These are employed for various assistance functions, such as driver drowsiness monitoring.Methods were also presented in which the steering angle is detected and evaluated by a camera using projected or attached markings.
[0003] Current systems that rely on additional sensors on the steering wheel or torque sensors in the steering system can simulate hands on the steering wheel. It is common practice to use weights or objects on the steering wheel to mimic hand detection, thus tricking the system into thinking the driver has their hands on the wheel. This results in the assisted driving systems remaining active even though the driver cannot immediately regain control of the vehicle.
[0004] Document DE 10 2016 211 209 A1 discloses a method for controlling a motor vehicle without a steering wheel, whereby the position of a hand of a driver of the motor vehicle is scanned.
[0005] The publication DE 10 2013 210 682 A1 describes a method and driver assistance system for assessing and / or maintaining the attention of a driver. Disclosure of the inventionAdvantages of the invention
[0006] A method for detecting the hand position of a driver of a vehicle on a steering wheel of the vehicle is disclosed, comprising the features of the independent patent claim.
[0007] The system determines the steering wheel position and the driver's hand position. These two positions are then compared. Based on this comparison, the system detects whether the driver has their hands on the steering wheel. The method can therefore be used for one or both hands. This increases safety when using the aforementioned driving functions without being intrusive or hindering for the driver in any way.
[0008] Further advantageous embodiments of the present invention are the subject of the dependent claims.
[0009] The procedure is expediently implemented using a computer.
[0010] Ideally, the steering wheel position and hand position should include depth information. This is advantageous because it allows for precise determination of whether, for example, the hand and steering wheel are in the same plane or whether they are separated by a certain predefined distance, enabling the driver to quickly regain control at any time.
[0011] Motion detection is preferably carried out using electromagnetic sensors. This is advantageous because it provides a non-invasive method for motion detection that does not distract the driver.
[0012] Advantageously, the electromagnetic sensor system includes a camera, in particular a depth camera. This is beneficial because it allows the use of a sensor that is already widely employed, thus simplifying the use of the method according to the invention. Furthermore, the depth information makes it easier to determine whether the driver's hand is near the steering wheel or not.
[0013] For position determination, it is advantageous to use pattern recognition, optical flow, and / or gesture recognition methods. This is beneficial because these are well-known methods that are easy to implement.
[0014] It is advantageous to determine the driver's gaze direction and to additionally detect that the driver's hands are not on the steering wheel, taking this gaze direction into account. This increases the detection accuracy, as an additional feature is incorporated into the detection process.
[0015] Furthermore, the invention comprises a computer program containing instructions that, when executed by a computer, cause the computer to perform a method according to the invention. Thus, the aforementioned advantages are achieved.
[0016] Furthermore, the invention relates to a machine-readable storage medium on which the computer program according to the invention is stored. This facilitates the distribution of the program.
[0017] Furthermore, the invention relates to a device for detecting the hand position of a driver of a vehicle on the vehicle's steering wheel, comprising an electronic control unit, wherein the device is configured to perform all steps of a method according to the invention. Thus, the method can be used easily and the aforementioned advantages are achieved. Short description of the drawings
[0018] Advantageous embodiments of the invention are shown in the figures and explained in more detail in the following description.
[0019] They show: Fig. 1 a flowchart of a method according to the invention in one embodiment; Fig. 2 a schematic representation of a device according to the invention in a first embodiment; Fig. 3 a schematic representation of a device according to the invention in a second embodiment. Embodiments of the invention
[0020] The same reference numerals denote the same device components or the same process steps in all figures.
[0021] Fig. Figure 1 shows a flowchart of a method according to the invention for detecting the hand position of a driver of a vehicle on the steering wheel of the vehicle according to one embodiment. In a first step S11, the steering wheel position is determined. In a second step S12, the hand position is determined.
[0022] In a third step, S13 compares the steering wheel position and hand position. Based on this comparison, a fourth step, S14, detects that the driver does not have their hands on the steering wheel.
[0023] This allows, for example, the system to determine whether a hand is near the steering wheel or how far away it is. This information could then be used to trigger an alarm or send another signal if the hand exceeds a predefined distance from the steering wheel, prompting the driver to at least move their hand closer to the wheel. Furthermore, the system could also determine the driver's gaze direction and use this gaze direction to detect when the driver's hands are off the wheel.
[0024] Fig. Figure 2 shows a schematic representation of a device 20 according to the invention for detecting the hand position of a driver of a vehicle on the steering wheel of the vehicle according to a first embodiment. The device 20 according to the invention comprises a camera 21 for position detection. The area of the steering wheel can be continuously detected by means of the camera 21. Within this area, the steering wheel, a hand or hands of the driver, and their contours can be detected by means of object recognition, pattern recognition methods, optical flow, and / or gesture recognition methods. Furthermore, the movements of the driver's hands and fingers can be tracked. This makes it possible to detect whether the driver's hands are not on the steering wheel and thus whether timely intervention by assistance and safety functions is possible.The device 20 further comprises an electronic control unit 22, which can, for example, perform one of the aforementioned methods for motion detection.
[0025] Fig. Figure 3 shows a schematic representation of a device according to the invention for detecting the hand position of a driver of a vehicle on the steering wheel of the vehicle according to a second embodiment. The device, which is not explicitly highlighted here, comprises a camera 34 and an electronic control unit 35. The device is installed in a vehicle 31. The vehicle 31 may have further components, for example, a steering wheel 32, a steering angle sensor 33 for detecting a steering angle, wheels 36, and an actuator 37 for adjusting the steering angle of the front wheels by means of a steering mechanism 38. The control unit 35 is configured to execute a method according to the invention, and hand position detection can be performed accordingly. QUOTES CONTAINED IN THE DESCRIPTION
[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature
[0000] DE 10 2016 211 209 A1
[0004] DE 10 2013 210 682 A1
[0005]
Claims
[1] Method for detecting the hand position of a driver of a vehicle (31) on a steering wheel (32) of the vehicle, comprising the steps - Determine the steering wheel position; - Determine the hand position; - Comparing the steering wheel position and the hand position; - Detecting that the driver does not have his hands on the steering wheel, depending on the comparison; [2] Method according to the preceding claim, wherein the steering wheel position and the hand position comprise depth information. [3] Method according to one of the preceding claims, wherein the movement is detected by means of an electromagnetic sensor. [4] Method according to the preceding claim, wherein the electromagnetic sensor system comprises a camera (21, 34), in particular a depth image camera. [5] Method according to one of the preceding claims, wherein methods for pattern recognition, optical flow and / or methods for gesture recognition are used to determine the position. [6] Method according to one of the preceding claims, wherein a viewing direction of the driver is further determined and the detection that the driver does not have his hands on the steering wheel is additionally carried out as a function of the determined viewing direction. [7] A computer program comprising instructions which, when executed by a computer, cause the computer to carry out the method according to any one of the preceding claims. [8] A machine-readable storage medium on which the computer program according to the preceding claim is stored. [9] Device (20) for detecting the hand position of a driver of a vehicle (31) on a steering wheel (32) of the vehicle (31), comprising an electronic control unit (22, 35), wherein the device (20) is configured to carry out the steps of the method according to one of claims 1 to 5.
Citation Information
Patent Citations
Methods for determining information relating to the direction of a driver's gaze and the position of the driver's hands in relation to the steering wheel in a motor vehicle and motor vehicle
DE102010013243A1
Operating apparatus for operating user interface of vehicle, outputs measurement signal of sensor such that information contained in transformed signal is independent of angle for detecting characteristics related to vehicle occupant
DE102012220653A1
Driving mode change in the driver assistance system
DE102013019141A1
Methods and driver assistance systems for assessing and / or maintaining the attention of a driver
DE102013210682A1
control of a motor vehicle
DE102016211209A1