Driver Abnormality Detection Using Multi-Signal State Differentiation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing abnormality detection devices for drivers cannot effectively distinguish between a warning state where a driver is about to become undrivable and an actual abnormal state where the driver is already undrivable.

Innovation Solution

An abnormality detection device that includes a control unit capable of detecting a warning state and an abnormal state based on acquired driver information, using a combination of image data from a camera, heart rate data from a heart rate meter, and voice data from a microphone, to differentiate between the two states.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a simple undrivable state prediction is implemented using past posture data, then the device complexity is reduced, but the measurement precision of driver state detection deteriorates because warning state and abnormal state cannot be distinguished

Engineering Contradiction:
Improvedetection system complexityVSAvoiddriver state detection precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The driver state detection is segmented into three distinct levels: normal state, warning state (undrivable within 10 minutes), and abnormal state (undrivable within 1 minute). This segmentation allows the system to differentiate between gradual deterioration and acute abnormalities, improving measurement precision without requiring overly complex hardware by using staged detection thresholds.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary detection of warning states before they progress to abnormal states. By detecting subtle changes in driver posture, facial expressions, and vehicle operation patterns early on, the system can issue warnings and take preventive measures before the driver becomes fully undrivable, thereby improving detection precision through early intervention capabilities.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple detection parameters (image data, heart rate, voice) are combined to improve driver state detection precision, then the measurement precision improves, but the device complexity increases

Engineering Contradiction:
Improvedriver state detection precisionVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges multiple detection parameters including image data from cameras, heart rate data from heart rate meters, and voice data from microphones into a unified driver state assessment. This combination allows the system to cross-validate signals and improve detection precision by considering multiple indicators of driver state simultaneously, while the integrated architecture manages complexity through coordinated processing.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The control unit serves multiple functions: it processes image data for posture and facial expression analysis, analyzes heart rate data for physiological state assessment, processes voice data for alertness evaluation, and integrates all these inputs to determine overall driver state. This multi-functionality allows a single control unit to handle diverse detection tasks, improving precision without proportionally increasing device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If real-time multi-parameter monitoring is implemented to distinguish warning and abnormal states, then the measurement precision improves, but the loss of time for data processing increases

Engineering Contradiction:
Improvestate differentiation precisionVSAvoiddata processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of detection parameters continuously in the background, pre-processing image, heart rate, and voice data to identify trends and patterns before critical states are reached. This preliminary action allows the system to maintain ready-to-use assessments, reducing the time required for real-time decision-making while preserving high measurement precision through ongoing multi-parameter monitoring.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

When a warning state is detected, the system accelerates processing by skipping less critical analysis steps and focusing directly on the parameters most indicative of the detected state. This rushed processing mode allows the system to quickly confirm and respond to critical states, reducing time loss during emergency situations while maintaining precision through targeted analysis of key parameters.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentEP4541679A1Abnormality detection device
Publication Date: 2025.04.23 YAZAKI CORP
  • EP4541679A1 patent drawingFigure 1
  • EP4541679A1 patent drawingFigure 2
  • EP4541679A1 patent drawing

AI summary

An abnormality detection device includes a control unit (5) configured to detect, based on information regarding a driver of a vehicle (1) that has been acquired by an input unit (2), a warning state indicating a warning that the driver is to become undrivable, and an abnormal state indicating that the driver is undrivable. The input unit (2) includes a camera (21) configured to generate image data, and the information is the image data obtained by capturing an image of the driver by the camera (21).