Driver Abnormality Detection Using Multi-Parameter Image Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional driver abnormality detection methods that rely on a single factor, such as gaze direction, are inadequate for accurately detecting driver abnormalities, including inattentive driving and potential health issues, and fail to address the increasing social concern of drivers experiencing episodes while driving.

Innovation Solution

A driver abnormality detection device that utilizes multiple factors, including gaze direction, eye height, and head position, to determine abnormal states, using a camera system with near-infrared lighting and processing units to capture and analyze images, and adjust determination criteria based on vehicle and environmental conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If single-factor detection methods (such as gaze direction only) are used, then the device complexity is reduced, but the measurement precision of driver abnormality detection deteriorates

Engineering Contradiction:
Improvedriver abnormality detection accuracyVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple detection factors (gaze direction, eye height, head position) into a single integrated detection system. The image processing unit simultaneously analyzes all three parameters from captured images, and the abnormality determination unit integrates these multiple factors to make a comprehensive abnormality judgment, thereby improving detection accuracy without requiring separate independent systems for each parameter.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The detection system is designed to perform multiple detection functions using a single camera and image processing unit. The same imaging device captures data for gaze direction, eye height, and head position detection, while the image processing unit processes all three parameters universally, reducing overall system complexity while maintaining multi-factor detection capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If multiple determination factors are used, then the reliability of abnormality detection is improved, but the device complexity increases

Engineering Contradiction:
Improveabnormality detection reliabilityVSAvoiddetermination system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges multiple determination factors (gaze direction within first predetermined range, eye height within second predetermined range, head position within third predetermined range) into a unified abnormality determination process. The abnormality determination unit simultaneously evaluates all three parameters and integrates their results, improving detection reliability while avoiding the need for separate determination systems for each factor.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses the same camera and image processing unit for all detection tasks, allowing the imaging device to serve multiple purposes. The captured images are reused for determining gaze direction, eye height, and head position, eliminating the need for separate sensors or detection devices for each parameter and thereby reducing overall system complexity.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If strict predetermined ranges are applied for all parameters, then the measurement precision is improved, but the adaptability to different driving situations deteriorates

Engineering Contradiction:
Improveparameter determination precisionVSAvoidadaptability to driving situations
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamic adjustment to the predetermined ranges based on vehicle speed. When the vehicle is stationary or moving slowly, wider ranges are applied to accommodate natural head movements. When the vehicle is moving at high speed, narrower ranges are applied to detect only significant deviations from the normal driving position, thereby maintaining measurement precision while adapting to different driving conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameters of the predetermined ranges (first, second, and third predetermined ranges) according to vehicle speed conditions. The ranges are dynamically adjusted to be more permissive at low speeds and more stringent at high speeds, allowing the detection system to maintain accuracy across varying driving situations without requiring completely different detection criteria for each condition.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves the accuracy of driver abnormality detection by considering multiple factors, enabling the detection of abnormalities that may not be identified by single-factor methods, while providing flexible camera placement and adaptable criteria for various driving situations.

Implementation Method 1

a camera lighting unit including a camera and near-infrared lighting

Methodology Applied
Scientific EffectNear-infrared radiation: Infrared Radiation

Data Source

PatentUS10417512B2Driver abnormality detection device and driver abnormality detection method
Publication Date: 2019.09.17 DENSO CORP
  • US10417512B2 patent drawing
  • US10417512B2 patent drawing
  • US10417512B2 patent drawing

AI summary

Provided is at least two of a direction determination unit which determines that the state is abnormal when a gaze direction of a driver of a vehicle is not within a first predetermined range based on a captured image of a head of the driver, a height determination unit which determines that the state is abnormal when a height of an eye of the driver is not within a second predetermined range based on the captured image, and a position determination unit which determines that the state is abnormal when a position of the head in a lateral direction is not within a third predetermined range based on the captured image; and an abnormal state determination unit which determines whether the state of the driver is abnormal based on the determination results of the determination units.