Camera-Based Driver Hand Detection on Steering Wheel
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current driver assistance systems and autonomous driving systems face challenges in accurately determining whether a driver is holding the operating element, as existing sensor-based methods can be fooled by simulating the action with a knee, leading to unreliable monitoring of driver readiness.
Innovation Solution
A camera-based solution that calculates the distance between the driver's hands and the operating element, combined with classification information of the element and driver pose, to determine if the driver is effectively operating the element, using image processing and machine learning algorithms to enhance accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If sensor-based detection methods are used to determine driver holding of operating elements, then the system can detect driver presence, but the reliability is reduced because drivers can simulate holding with a knee
Solution Approach 1:
The patent replaces mechanical sensor-based detection with optical camera-based detection. The camera captures images of the driver and operating element, and image processing algorithms determine whether the driver is truly holding the operating element, eliminating the vulnerability to mechanical deception methods like knee simulation.
Solution Approach 2:
The patent introduces an intermediary processing system that analyzes the spatial relationship between the driver's hand and the operating element in images. By calculating distances and evaluating hand positions relative to the operating element, the system mediates between raw image data and the final determination of driver engagement, providing more reliable detection.
2Reliability
If camera-based solutions are used to detect driver hand position, then false positives are reduced, but the system complexity increases due to image processing requirements
Solution Approach 1:
The patent extracts only the essential features needed for detection from the full image data. By focusing specifically on the spatial relationship between the driver's hand and the operating element, and calculating only the relevant distance metrics, the system avoids the complexity of full image analysis while maintaining high detection accuracy.
Solution Approach 2:
The patent segments the detection task into distinct components: identifying the operating element in the image, locating the driver's hand, calculating the distance between them, and evaluating whether the hand is in a holding position. This segmentation allows each component to be processed independently with optimized algorithms, reducing overall system complexity.
Data Source
AI summary
A computer-implemented method for driving assistance in a vehicle. The method includes determining, based on an image capturing an operating element of the vehicle and a driver of the vehicle, a distance between the operating element and a hand of the driver. In response to the distance meeting a criterion being indicative of a possibility that the driver operates the operating element, the method includes: determining, based on a part of the image capturing the operating element, classification information of the operating element, determining, based on a part of the image capturing the driver, classification information of a pose of the driver, and determining, based on the distance, the classification information of the operating element and the classification information of the pose of the driver, whether the driver operates the operating element.