Driver Fatigue Detection Using Adaptive Cognitive Tasks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges with driver fatigue and distraction, particularly in situations where a human driver is present but not fully engaged, leading to reduced ability to take over primary vehicle operations.

Innovation Solution

A self-driving system dynamically initiates interactive cognitive tasks based on primary task demand metrics, using gaze detection and response monitoring to engage drivers and mitigate fatigue, adjusting task complexity and frequency according to vehicle conditions and driver profiles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If the autonomous vehicle operates in fully autonomous mode with minimal driver interaction, then automation extent is improved, but driver vigilance deteriorates leading to fatigue

Engineering Contradiction:
Improveautonomous driving capabilityVSAvoiddriver vigilance
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The system implements periodic cognitive tasks at predetermined time intervals or distance milestones to periodically engage the driver's attention. This periodic intervention prevents continuous passive monitoring from leading to fatigue, while still allowing largely autonomous operation between tasks.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system monitors driver responses to cognitive tasks and adjusts task difficulty, frequency, or type based on driver performance and engagement levels. This feedback mechanism ensures the driver remains appropriately engaged without excessive burden, maintaining vigilance while supporting autonomous operation.

Inventive Principle:
Principle #23Feedback

2Reliability

If the system frequently engages the driver with cognitive tasks, then driver vigilance is improved, but productivity deteriorates due to increased task demand

Engineering Contradiction:
Improvedriver vigilanceVSAvoidtrip efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system dynamically adjusts the frequency, complexity, and timing of cognitive tasks based on real-time assessment of driver engagement, task performance, and current driving conditions. This dynamic adaptation optimizes the balance between maintaining vigilance and minimizing disruption to trip efficiency.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system modifies parameters of cognitive tasks such as difficulty level, response time requirements, and task type based on driver performance metrics and environmental factors. This parameter adjustment allows the system to maintain effective engagement while reducing burden when conditions permit.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the cognitive task complexity is increased to maintain driver engagement, then driver vigilance is improved, but device complexity increases

Engineering Contradiction:
Improvedriver engagementVSAvoidtask management system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The cognitive task system is segmented into modular task types and difficulty levels that can be independently selected and combined. This segmentation allows the system to build complex engagement strategies from simple, well-defined task components, managing overall system complexity while maintaining effective driver engagement.

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If the system monitors driver behavior continuously to detect fatigue, then driver fatigue detection is improved, but loss of time increases due to constant monitoring

Engineering Contradiction:
Improvefatigue detection accuracyVSAvoidmonitoring overhead
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Instead of continuous monitoring, the system implements periodic assessments of driver engagement through cognitive tasks at predetermined intervals. This periodic approach provides sufficient data to detect fatigue trends while minimizing the time overhead associated with constant monitoring.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses rapid, brief cognitive tasks that can be completed quickly to assess driver engagement levels. These short tasks provide efficient sampling points for fatigue detection without significantly interrupting the overall trip timeline.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentEP3898372B1Systems and methods for detecting and dynamically mitigating driver fatigue
Publication Date: 2025.08.13 WAYMO LLC
  • EP3898372B1 patent drawingFigure 1
  • EP3898372B1 patent drawingFigure 2
  • EP3898372B1 patent drawingFigure 3A

AI summary

This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed (610). If primary tasks or secondary tasks are not performed within given distance thresholds or time limits (620), then one or more secondary tasks are initiated by the computing device of the vehicle (630). In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver. For example, a detected gaze direction or pattern (810) may be compared to an expected gaze direction or pattern given the surrounding environment in a vicinity of the vehicle (860).