Driver Status Detection Using Multi-Modal Physiological Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional safe driving assistance systems primarily rely on external sensors to detect dangerous situations, but they fail to effectively assess a driver's mental and physical condition, such as drowsiness or distraction, which can lead to unsafe driving.

Innovation Solution

An apparatus and method that acquire vehicle driving information, driver operation information, and driver status information using sensors like accelerators, cameras, ECG, EEG, and PPG sensors, calculate a driving load, and compare it to a preset margin to warn or control the vehicle when the driver is not in a safe state.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional safe driving assistance systems use external sensors (radar, cameras) to detect dangerous situations, then the system can recognize lane departures and expected collisions, but the system fails to assess the driver's mental and physical condition such as drowsiness or distraction

Engineering Contradiction:
Improvesafe driving assessmentVSAvoiddriver's mental and physical condition information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system segments the driver status monitoring into multiple independent sensing channels: eye state detection via cameras, drowsiness detection via EEG sensors, heart rate monitoring via ECG sensors, and breathing rate monitoring via PPG sensors. Each sensor targets a specific physiological or behavioral indicator, allowing comprehensive assessment of driver condition through aggregated data from these segmented monitoring streams.

Inventive Principle:
Principle #1Segmentation

2Reliability

If the system acquires multiple types of driver information (vehicle driving information, vehicle operation information, driver status information) to calculate driving load, then the system can comprehensively assess driver safety, but the device complexity increases with multiple sensors and processing units

Engineering Contradiction:
Improvedriver safety assessmentVSAvoidsystem structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system employs a multi-functional integrated architecture where a single controller coordinates multiple sensing modalities (cameras, EEG, ECG, PPG sensors) and processing functions (information acquisition, driving load calculation, threshold comparison, warning generation). This universal controller handles diverse input types and executes comprehensive safety assessment, reducing the need for separate dedicated systems for each monitoring function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges multiple information acquisition functions into a unified processing pipeline. The controller integrates data from vehicle driving information acquisition portions, vehicle operation information acquisition portions, and driver status information acquisition portions into a single driving load calculation process, combining heterogeneous data streams into a comprehensive safety assessment metric.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If the system continuously monitors driver status and calculates driving load to provide warnings, then the system can prevent unsafe driving, but the loss of time for data processing and analysis increases

Engineering Contradiction:
Improveunsafe driving preventionVSAvoiddata processing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary data processing by continuously acquiring and pre-processing driver status information in the background. The controller maintains ready-state data structures for eye state, drowsiness level, heart rate, and breathing rate, so that when driving load calculation is triggered, the system can quickly retrieve pre-processed data without performing intensive analysis from raw sensor data, significantly reducing real-time computation time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces complex mechanical data processing with electronic signal processing and algorithmic computations. Instead of physical analysis methods, the controller uses electronic sensors to capture physiological signals and applies computational algorithms to calculate driving load, compare against thresholds, and generate warnings, achieving rapid processing speeds that mechanical or manual methods cannot match.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Effectively monitors a driver's mental and physical condition to prevent unsafe driving by providing warnings and control measures, such as sound alerts, display warnings, and vehicle control, thereby enhancing safety.

Implementation Method 1

an ECG (electrocardiogram) sensor

Methodology Applied
Scientific EffectElectrocardiogram:

Implementation Method 2

an EEG (electroencephalogram) sensor

Methodology Applied
Scientific EffectElectroencephalogram:

Implementation Method 3

a PPG (photoplethysmography) sensor

Methodology Applied
Scientific EffectPhotoplethysmography:

Data Source

PatentUS9682711B2Apparatus and method for detecting driver status
Publication Date: 2017.06.20 HYUNDAI MOBIS CO LTD
  • US9682711B2 patent drawing
  • US9682711B2 patent drawing
  • US9682711B2 patent drawing

AI summary

An apparatus for detecting a driver status may include an information acquisition unit acquiring driver's vehicle driving information, driver's vehicle operation information, and driver status information, a calculation unit calculating a driving load indicated by converting a factor obstructing safe driving into a numerical value, based on the information acquired by the information acquisition unit, a comparison unit between the driving load calculated by the calculation unit and a preset load margin, and a warning unit warning the driver when the comparison unit determines that the calculated driving load exceeds the preset load margin.