Driver Eye-Dynamics Profiling for Abnormal Event Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in predicting and responding to abnormal driving events due to driver fatigue, boredom, and varying cognitive states, which can lead to delayed or inaccurate human intervention, affecting passenger safety and vehicle control.

Innovation Solution

A method and system that utilize imaging sensors to monitor a driver's eye dynamics, analyzing patterns to update response profiles and predict imminent abnormal events, enabling the vehicle's control systems to initiate appropriate actions proactively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the autonomous vehicle system reduces the load on the human driver to improve comfort, then driver workload is reduced, but driver's passive fatigue increases due to low cognitive load or boredom, reducing response time and quality of performance

Engineering Contradiction:
Improvedriver workloadVSAvoiddriver response time and performance quality
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system continuously monitors driver eye dynamics and cognitive state in real-time, providing feedback to the control system. When fatigue or inattention is detected through eye movement patterns, the system adjusts automation levels or alerts the driver, creating a closed-loop feedback mechanism that maintains driver engagement while reducing overall workload

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts the level of automation and driver engagement based on real-time cognitive state assessment. When the driver is alert, higher automation levels are permitted; when fatigue or inattention is detected, the system reduces automation level or increases monitoring, creating a dynamic balance between workload reduction and performance maintenance

Inventive Principle:
Principle #15Dynamics

2Reliability

If the driver maintains high attention on the vehicle's performance to improve decision-making speed, then response time is reduced, but cognitive workload increases leading to slow reaction time, deterioration in task-performance and increased error rate

Engineering Contradiction:
Improvedecision-making speedVSAvoidcognitive workload
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system replaces continuous high-level cognitive monitoring with automated eye-tracking technology that objectively measures attention and cognitive state. This substitution allows the system to assess driver state without requiring the driver to consciously monitor their own performance, reducing cognitive workload while maintaining or improving decision-making speed through automated detection

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If the system continuously monitors driver eye dynamics to improve prediction accuracy of abnormal events, then measurement precision is improved, but device complexity increases due to additional imaging sensors and analysis systems

Engineering Contradiction:
Improveprediction accuracy of abnormal eventsVSAvoidimaging sensors and analysis systems
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system extracts only the most relevant features from eye dynamics data (such as pupil diameter, saccade patterns, and fixation duration) that are strongly correlated with abnormal driving events. By focusing on these specific extracted features rather than processing all eye movement data, the system achieves high prediction accuracy while minimizing computational complexity and sensor requirements

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12159470B2Driver predictive mental response profile and application to automated vehicle brain interface control
Publication Date: 2024.12.03 NEUCOGS LTD
  • US12159470B2 patent drawing
  • US12159470B2 patent drawing
  • US12159470B2 patent drawing

AI summary

A method for updating response profiles of drivers, comprising receiving a plurality of images captured by one or more imaging sensors deployed to monitor one or more eyes of a driver of a vehicle, analyzing at least some of the plurality of images to identify one or more eye dynamics signal patterns preceding one or more abnormal driving events occurring in an environment of the vehicle, updating a response profile of the driver based on an association of one or more of the abnormal driving event and the one or more of the identified eye dynamics signal patterns and providing information based on the updated response profile of the driver. The provided information is configured to enable one or more control systems of the vehicle to predict an imminent abnormal driving event based on an eye dynamics signal of the driver.