Driver Gaze Detection Using Facial Feature Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Real-time gaze tracking in vehicles is challenging due to variations in driver height, facial features, unknown illumination conditions, and abrupt head pose changes, making it difficult to calibrate camera devices and accurately detect the driver's gaze direction.

Innovation Solution

A driver gaze tracking system that uses a monocular camera and processing device to detect facial feature points, estimate head pose, and calculate gaze direction, incorporating infrared illumination for low-light conditions and employing support vector machines and Supervised Local Subspace Learning for robust feature detection and tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If driver-monitoring camera devices are used to detect EOR conditions, then driver safety can be improved, but measurement precision of gaze direction deteriorates due to variations in driver height, facial features, and head pose changes

Engineering Contradiction:
Improvedriver safetyVSAvoidgaze direction detection accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The system performs preliminary calibration by detecting facial feature points and establishing a mapping between camera image coordinates and driver head coordinate system before actual gaze detection. This preliminary setup accounts for individual driver characteristics and camera positioning, enabling accurate subsequent measurements despite variations in driver anatomy and camera installation differences.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts measurement parameters by detecting head pose changes and compensating for them in real-time. By monitoring the positions of facial feature points and calculating head orientation, the system adapts the gaze detection algorithm to maintain precision despite abrupt head movements and varying driver anatomy.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If real-time gaze tracking is implemented, then driver attention monitoring is improved, but device complexity increases due to the need for facial feature detection, head pose estimation, and gaze calculation

Engineering Contradiction:
Improvedriver attention monitoring capabilityVSAvoidprocessing system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system divides the complex gaze detection task into distinct processing stages: facial feature point detection, head pose estimation, and gaze direction calculation. Each stage processes specific aspects of the problem independently, allowing for optimized algorithms at each step and simplifying the overall system architecture while maintaining real-time performance.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If facial feature detection is performed under unknown illumination conditions, then gaze detection robustness should be improved, but detection reliability deteriorates due to unreliable facial feature detection

Engineering Contradiction:
Improveillumination condition adaptabilityVSAvoidfacial feature detection reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system adapts to varying illumination conditions by dynamically adjusting detection parameters and using multiple facial feature points for robust estimation. The head pose calculation incorporates information from multiple facial landmarks, making the detection process resilient to changes in lighting while maintaining reliability across different environmental conditions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9405982B2Driver gaze detection system
Publication Date: 2016.08.02 GM GLOBAL TECHNOLOGY OPERATIONS LLC
  • US9405982B2 patent drawing
  • US9405982B2 patent drawing
  • US9405982B2 patent drawing

AI summary

A method for detecting an eyes-off-the-road condition based on an estimated gaze direction of a driver of a vehicle includes monitoring facial feature points of the driver within image input data captured by an in-vehicle camera device. A location for each of a plurality of eye features for an eyeball of the driver is detected based on the monitored facial features. A head pose of the driver is estimated based on the monitored facial feature points. The gaze direction of the driver is estimated based on the detected location for each of the plurality of eye features and the estimated head pose.