Driver Looking-Away Detection Using Missing-Face Image Ratios

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing looking away detection systems fail to determine if a driver is looking away during driving when a face is not visible in the captured image, leading to incomplete assessment of driving states.

Innovation Solution

A looking away determination device that assesses the proportion of images without a detected face based on driving state information, determining a looking away state when this proportion exceeds a predetermined value, and adjusts facial and line-of-sight direction condition ranges according to driving conditions such as turns and speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If looking away detection is performed based on face detection in captured images, then detection accuracy is improved when face is visible, but detection cannot be performed at all when face does not appear in the captured image

Engineering Contradiction:
Improvelooking away detection accuracyVSAvoiddetection capability under various driving conditions
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system changes the detection parameter from binary face detection to proportion-based assessment. By calculating the proportion of images without detected faces and comparing it against a predetermined threshold, the system adapts its detection criterion based on driving state information, enabling flexible detection across different driving conditions while maintaining accuracy.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If a fixed threshold is used for face detection proportion, then determination is simple, but it cannot adapt to different driving states such as turns and straight driving

Engineering Contradiction:
Improvedetermination simplicityVSAvoiddriving state adaptability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The predetermined value for face detection proportion is made dynamic rather than fixed. The system adjusts this threshold based on driving state information (such as whether the vehicle is turning or driving straight), allowing the determination criterion to adapt automatically to different driving scenarios while maintaining operational simplicity through automated adjustment.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11893806B2Looking away determination device, looking away determination system, looking away determination method, and storage medium
Publication Date: 2024.02.06 NEC CORP
  • US11893806B2 patent drawing
  • US11893806B2 patent drawing
  • US11893806B2 patent drawing

AI summary

A looking away determination device includes: a determination unit that determines that a driver is in a looking away state when a proportion of an image in which a face of the driver is not detected with respect to a plurality of images obtained by imaging the driver is equal to or greater than a first predetermined value, the first predetermined value being determined based on driving state information that indicates a state during driving by the driver.