Driver Control Monitoring Using Gaze and Hand Posture Cues

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional systems for detecting a driver's level of control over a vehicle are limited in their ability to accurately assess attentiveness and control, particularly in scenarios involving touch-free interactions, as they often rely on pressure or visual cues alone, which can be misleading or insufficient.

Innovation Solution

A system utilizing machine learning algorithms and image sensors to detect the location and posture of a driver's hands and other body parts relative to the steering wheel, generating messages or commands based on the determined level of control, enabling more accurate assessment of driver attentiveness and response time in emergency situations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If pressure sensors on the steering wheel are used to detect driver control, then the system can detect whether the driver is holding the steering wheel, but the system can be fooled or bypassed and lacks precision in assessing actual attentiveness

Engineering Contradiction:
Improvedriver control detection reliabilityVSAvoiddriver attentiveness measurement precision
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent replaces mechanical pressure sensing systems with optical imaging systems (cameras) and machine learning algorithms. Instead of relying on physical contact detection, the system uses visual analysis of driver hand posture, orientation, and location relative to the steering wheel to determine actual control and attentiveness levels.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces machine learning algorithms as an intermediary between the raw image data from cameras and the driver control assessment. These algorithms process visual information to infer driver intent, attentiveness, and control level, providing a more accurate measurement than direct pressure detection alone.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If simple visual checks of driver eyes are performed, then the system can detect whether eyes are open and generally looking forward, but this information alone does not indicate whether the driver is attentive to the road and in full control

Engineering Contradiction:
Improvedriver monitoring ease of operationVSAvoiddriver attentiveness measurement precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent extends monitoring from a single dimension (eye position) to multiple dimensions by analyzing hand posture, hand orientation, hand location relative to the steering wheel, and body position. This multi-dimensional analysis provides comprehensive assessment of driver attentiveness and control rather than relying on eye position alone.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent segments the driver's body into multiple monitorable components (eyes, hands, arms, torso) and analyzes each separately. By examining hand posture, orientation, and location as distinct parameters, the system gains deeper insight into driver control and attentiveness beyond simple eye monitoring.

Inventive Principle:
Principle #1Segmentation

3Ease of operation

If touch-free user interaction systems are implemented, then user interaction convenience is improved, but driver control monitoring becomes more difficult as traditional contact-based detection methods are bypassed

Engineering Contradiction:
Improveuser interaction convenienceVSAvoiddriver control detection reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces mechanical contact-based detection with optical field-based detection. By using cameras to capture images of the driver's hands and body in relation to the steering wheel, the system maintains monitoring capability in touch-free interaction scenarios where traditional pressure sensors would register no contact.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the detection parameters from contact force (pressure) to spatial relationships (hand position, orientation, posture). This parameter transformation allows the system to assess driver control intent even when no physical contact with the steering wheel occurs, supporting touch-free interaction while maintaining detection reliability.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20240362931A1Systems and methods for determining driver control over a vehicle
Publication Date: 2024.10.31 RED BEND LTD
  • US20240362931A1 patent drawing
  • US20240362931A1 patent drawing
  • US20240362931A1 patent drawing

AI summary

Systems, methods, and non-transitory computer-readable media for detecting a driver's gaze direction while driving a vehicle are disclosed. At least one processor may be configured to receive image information from an image sensor, detect the vehicle driver in the image information, detect the driver's gaze direction toward a first direction in the image information, predict an amount of time it will take for the driver to shift the gaze direction toward a second direction, using information associated with the detected gaze direction of driver, and generate a message or a command based on the predicted amount of time.