Head Pose Estimation for Driver Workload Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Drivers may become fatigued and fail to focus on the road or vehicle displays due to the need to monitor various information sources, leading to a challenge in ensuring driver attention and workload estimation without intrusive methods.

Innovation Solution

A system utilizing an optical head-mounted display (OHMD) with motion sensors to estimate head pose and activity, providing data to a vehicle system to adjust notifications and content display based on driver activity characteristics, thereby enhancing driver attention monitoring and workload estimation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple display screens and information sources are provided in the vehicle, then driver information access is improved, but driver attention and focus on the road deteriorates

Engineering Contradiction:
Improvedriver information accessVSAvoiddriver attention
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system continuously monitors driver head pose and activity characteristics, providing real-time feedback to dynamically adjust notification delivery. This feedback loop enables the system to adapt information presentation based on actual driver state, ensuring information is provided when the driver is attentive while preventing overload when fatigued

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The notification system transitions from static, fixed delivery methods to dynamic adaptation based on real-time driver monitoring. Head pose estimates and activity characteristics continuously inform how notifications are presented, allowing the system to optimize information delivery according to varying driver states throughout the drive

Inventive Principle:
Principle #15Dynamics

2Reliability

If driver monitoring and attention estimation are implemented, then driver safety is improved, but system complexity and intrusiveness increases

Engineering Contradiction:
Improvedriver safetyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The head-mounted display device performs multiple functions: providing navigation and infotainment content to the driver while simultaneously serving as a monitoring platform for head pose and activity detection. This multi-functionality eliminates the need for separate monitoring hardware, reducing overall system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The driver's own head movements and natural behavior serve as the monitoring signal. The system leverages the driver's inherent physical responses to fatigue and engagement without requiring additional sensors or intrusive equipment, allowing the driver to effectively monitor themselves through their own motion patterns

Inventive Principle:
Principle #25Self-service

3Measurement precision

If head pose monitoring is continuously performed, then driver activity detection is improved, but energy consumption and processing load increases

Engineering Contradiction:
Improvedriver activity detectionVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

Instead of continuous monitoring, the system performs head pose estimation and activity detection at periodic intervals sufficient to detect fatigue patterns and changes in driver state. This periodic approach maintains detection precision while significantly reducing computational load and energy consumption compared to continuous processing

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively monitors driver attention and workload by using OHMD data to adjust notifications and content, improving safety by ensuring the driver remains focused on the road and relevant information without intrusive methods.

Implementation Method 1

receive head pose indications determined according to movement data from a motion sensor of an optical head-mounted display

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Data Source

PatentUS9767373B2Head-mounted display head pose and activity estimation
Publication Date: 2017.09.19 FORD GLOBAL TECH LLC
  • US9767373B2 patent drawing
  • US9767373B2 patent drawing
  • US9767373B2 patent drawing

AI summary

A system may receive head pose indications determined according to movement data from a motion sensor of an optical head-mounted display worn by a vehicle driver, determine, according to the head pose indications, driver activity characteristics indicative of a history of movement of the head of the driver, and send the driver activity characteristics to a driver-aware vehicle system configured to adjust driver notification based on the driver activity characteristics. The system may also receive raw movement data from a motion sensor of an optical head-mounted display worn on a head of a vehicle driver, compute head velocity data based on the raw movement data, compute head displacement data based on the head velocity data, and update head pose indications indicative of head positioning upon determining that the head displacement data exceeds a predetermined threshold displacement.