Vehicular Driver State Detection Using Eye, Gaze, and Operation Inputs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicular devices have insufficient determination accuracy for detecting when a driver's state deviates from a safe driving state, leading to unnecessary notifications or missed alerts, as they primarily rely on eye opening degree and line-of-sight movement without considering the driver's operation state for driving instruments.

Innovation Solution

A vehicular device that includes an eye opening degree determiner, line-of-sight movement determiner, operation state determiner, and notification controllers to assess the driver's state based on eye opening degree, line-of-sight movement, and operation state for instruments like the accelerator, brake, and steering, with different notification thresholds for inside and outside notifications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the vehicular device uses only eye opening degree and line-of-sight movement for determination, then the device complexity is low, but the determination accuracy is insufficient

Engineering Contradiction:
Improvedetermination accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple determination methods (eye opening degree determination, line-of-sight movement determination, and operation state determination) into a single integrated determination system. The determination unit synthesizes results from these different methods to comprehensively assess driver state, improving accuracy while managing complexity through systematic integration

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If the vehicular device uses multiple determination methods, then the determination accuracy improves, but the device complexity increases

Engineering Contradiction:
Improvedetermination accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The determination system is divided into separate functional modules: an eye opening degree determiner, a line-of-sight movement determiner, and an operation state determiner. Each module independently processes specific aspects of driver state, and their results are combined by the determination unit. This segmentation allows for improved accuracy through multiple determination methods while managing complexity through modular design

Inventive Principle:
Principle #1Segmentation

3Reliability

If the vehicular device performs frequent notifications, then the driver safety monitoring is enhanced, but unnecessary notifications increase

Engineering Contradiction:
Improvedriver safety monitoringVSAvoidunnecessary notifications
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The notification controller implements a feedback mechanism that continuously monitors the driver state determination results and adjusts notification behavior accordingly. By using the comprehensive determination results from multiple methods as feedback, the system can distinguish between genuine safety concerns requiring notification and transient states that do not warrant alerting, thereby reducing unnecessary notifications while maintaining reliable safety monitoring

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11440553B2Vehicular device and computer-readable non-transitory storage medium storing computer program
Publication Date: 2022.09.13 DENSO CORP
  • US11440553B2 patent drawing
  • US11440553B2 patent drawing
  • US11440553B2 patent drawing

AI summary

A vehicular device includes: an eye opening degree determiner that determines a driver eye opening degree; a line-of-sight movement determiner that determines frequency of a driver line-of-sight movement; an operation determiner that determines a driver operation state for a driving operation instrument; a deviation determiner that determines a possibility that a driving state of a subject vehicle driver deviates from a safe driving state; a vehicle inside notification controller that performs a notification operation for a vehicle inside; and a vehicle outside notification controller that performs a notification operation for a vehicle outside.