Optical Hand Tracking for Autonomous Steering Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current steering systems in autonomous vehicles face challenges in accurately interpreting a driver's intention to take control or relinquish control, relying heavily on physical touch and torque, which is not reliable for initiating autonomous driving assistant systems.

Innovation Solution

The implementation of a human appendage tracking module using optical sensors and cameras to analyze hand position and pose characteristics, combined with data from pressure, touch, and torque sensors, to determine a driver's intention to intervene or relinquish control of the steering system, enabling seamless transition between manual and autonomous driving modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If optical sensors and cameras are used to track hand position and pose, then the accuracy of interpreting driver intent is improved, but the device complexity increases

Engineering Contradiction:
Improveaccuracy of interpreting driver intentVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the driver monitoring function into multiple independent sensing modalities: optical sensors for hand position tracking, cameras for pose analysis, pressure sensors for contact detection, and torque sensors for steering input measurement. Each sensor type handles a specific aspect of driver intent detection, allowing the system to achieve high measurement precision while maintaining modularity and manageable complexity through functional decomposition

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The steering wheel integrates multiple sensor types (optical sensors, cameras, pressure sensors, torque sensors) into a single multi-functional interface. This universal design allows the steering wheel to simultaneously perform steering control, hand presence detection, gesture recognition, and intent interpretation, reducing the need for separate dedicated devices and thereby managing overall system complexity while enhancing measurement accuracy

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If multiple sensor types are integrated in the steering system, then the reliability of detecting driver intention is improved, but the device complexity increases

Engineering Contradiction:
Improvereliability of detecting driver intentionVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system merges multiple sensor types (optical sensors, cameras, pressure sensors, torque sensors) into an integrated steering system that works synergistically. By combining these sensors in close proximity within the steering wheel assembly, the system achieves reliable multi-modal detection of driver intention while reducing the overall number of separate components and simplifying the system architecture compared to using distributed independent systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements cross-validation feedback mechanisms where data from multiple sensor types mutually reinforce each other. For example, optical sensor detection of hand position is validated by pressure sensor contact detection and torque sensor steering input, creating a feedback loop that enhances reliability through consistent multi-source verification while managing complexity through coordinated sensor fusion algorithms

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If hand gesture recognition is added to hand position detection, then the capability to interpret driver intention is improved, but the difficulty of detecting and measuring increases

Engineering Contradiction:
Improvecapability to interpret driver intentionVSAvoiddifficulty of detecting and measuring
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system performs preliminary detection of hand position using optical sensors before analyzing more complex pose characteristics. By first establishing baseline hand location and contact status, the system prepares the data foundation for subsequent gesture recognition, reducing the computational complexity and measurement difficulty of interpreting intentional gestures versus accidental movements

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system transitions from two-dimensional hand position detection to three-dimensional pose analysis by incorporating camera-based depth information and multi-angle viewing. This dimensional enhancement allows the system to distinguish between different gesture types (such as palm orientation, finger configuration, and motion trajectory) without proportionally increasing measurement difficulty, as the additional spatial dimensions provide natural discriminators for intent recognition

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances the accuracy and reliability of interpreting driver intent, allowing for smooth handover of control between human drivers and autonomous systems, reducing latency and improving the intuitive driving experience by using visual and haptic feedback.

Implementation Method 1

an optical sensor positioned to view a front face of the steering wheel

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS11608088B2Optics based detection of hands on-off and hand gesture based function selection for human driver
Publication Date: 2023.03.21 CONTINENTAL AUTOMOTIVE SYSTEMS INC
  • US11608088B2 patent drawing
  • US11608088B2 patent drawing
  • US11608088B2 patent drawing

AI summary

A number of illustrative variations may include a method or product for sensing driver intervention in an autonomous steering system.