Driver State Detection Using DRTs and Physiological Driving Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for collecting data on human psychophysiological states during driving are prone to biases and inconsistencies, making it difficult to derive reliable results for developing advanced driver assistance systems (ADAS).

Innovation Solution

A structured method and system for collecting data involving non-stop driving in a monotonous simulated environment with detection response tasks (DRTs), using physiological and behavioral data collection, including heart rate, EEG, eye movement, and steer wheel activity, while minimizing distractions and biases.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data collection is conducted in real-life driving conditions, then ecological validity is improved, but control over experimental variables and reliability deteriorates

Engineering Contradiction:
Improvedata reliabilityVSAvoidexperimental control
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent uses a driving simulator as an intermediary environment that mediates between real-life driving conditions and laboratory control. The simulator reproduces realistic driving scenarios while allowing precise control over experimental variables such as road conditions, traffic patterns, and environmental factors, thus resolving the contradiction between ecological validity and experimental control.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple physiological sensors are deployed simultaneously, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvepsychophysiological state detection accuracyVSAvoiddata collection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent integrates multiple physiological sensors (EEG, ECG, EMG, eye tracking, respiration sensors) into a unified multi-functional data collection system. Each sensor serves multiple purposes: for example, EEG data detects both cognitive load and drowsiness, while ECG data provides information about both stress levels and overall physiological arousal. This multi-functionality approach improves measurement precision while managing system complexity through integrated processing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines multiple physiological measurement systems into a single integrated data collection framework. The system merges EEG, ECG, EMG, eye tracking, and respiration data into a unified psychophysiological profile, allowing simultaneous multi-parameter monitoring while centralizing data processing and analysis to manage complexity.

Inventive Principle:
Principle #5Merging (Combining)

3Quantity of substance

If driving session duration is extended to collect sufficient data, then data volume is improved, but driver fatigue and data quality deteriorate

Engineering Contradiction:
Improvedata volumeVSAvoiddata quality
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent structures the driving session with periodic detection response tasks (DRTs) inserted at regular intervals during the driving session. These periodic tasks serve dual purposes: they provide additional data collection opportunities to increase data volume, and they act as attention-checking mechanisms to monitor and maintain driver alertness, thereby preserving data quality throughout the extended session.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent implements continuous monitoring of driver physiological states with feedback mechanisms that can detect signs of fatigue or declining performance. The system uses physiological data and DRT performance metrics to provide feedback on driver state, allowing for dynamic adjustment of the experimental protocol or early termination if data quality deteriorates, thus maintaining reliability while maximizing data volume.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP4437939A1Driver psychophysiological state detection
Publication Date: 2024.10.02 HARMAN INT IND INC
  • EP4437939A1 patent drawingFigure 1~2B
  • EP4437939A1 patent drawingFigure 3A~3B
  • EP4437939A1 patent drawingFigure 4

AI summary

It is herein disclosed a method of collecting data for determining a psychophysiological state of a human driver, comprising collecting data throughout a driving session, wherein the driving session comprises a predetermined time period of non-stop driving by a driver in a monotonous driving environment and a plurality of detection response tasks (DRTs) performed by the driver in the predetermined time period, wherein each DRT comprises the driver reacting to at least one visual stimulus; wherein said collecting data comprises: collecting, by a plurality of detection means, physiological data on the driver throughout the predetermined time period; wherein the physiological data collected comprises at least one of heart rate data, electroencephalogram data, eye movement data, and respiration data; and collecting driver behaviour data, comprising recording steer wheel activity of the driver and recording a manner in which the driver reacts to the at least one visual stimulus during the plurality of DRTs.