Driver Gaze Reference Detection from Forward-Travel Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for detecting a driver's line of sight direction during straight travel of a moving body, such as an automobile, are not sufficiently efficient for easy and automatic detection.

Innovation Solution

An image processing device that acquires sensing information and captured images of a driver, identifies images taken while the vehicle is traveling forward, and detects a reference line of sight direction based on statistical values from multiple images, allowing for automatic detection when the driver is facing forward.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual detection methods are used to detect driver's line of sight direction, then detection accuracy can be maintained, but the ease of operation and automation are reduced

Engineering Contradiction:
Improveease of detectionVSAvoidautomation level
Core Design Contradiction:
Ease of operationVSExtent of automation

Solution Approach 1:

The system automatically detects the driver's line of sight direction by having the driver naturally gaze at the road during normal driving. The detection apparatus captures images and automatically processes them to determine line of sight direction without requiring the driver to perform any special actions or the operator to manually analyze each image, thus achieving self-service detection.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary detection by capturing multiple images of the driver's face during normal driving conditions before final analysis. By pre-capturing images and identifying candidate regions in advance, the system prepares the data needed for accurate line of sight detection without requiring manual intervention at the moment of detection.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple captured images are processed to improve detection accuracy, then measurement precision improves, but loss of time increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system extracts only the relevant portions of captured images that contain the driver's face and eyes, rather than processing entire images. By extracting and focusing on specific regions of interest (the driver's facial features), the system reduces processing time while maintaining detection accuracy based on multiple images.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system processes a plurality of captured images to ensure accurate detection of line of sight direction. By using multiple images rather than a single image, the system achieves higher measurement precision through statistical analysis of multiple data points, compensating for the additional processing time required.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12340601B2Image processing device, image processing method, and recording medium
Publication Date: 2025.06.24 NEC CORP
  • US12340601B2 patent drawing
  • US12340601B2 patent drawing
  • US12340601B2 patent drawing

AI summary

Sensing information indicating a state of a moving body is acquired. A plurality of captured images that capture a driver driving the moving body are acquired. From the plurality of captured images, captured images captured in a state of the moving body traveling forward based on the sensing information. A reference line of sight direction in a case of the driver facing forward is detected based on a statistical value of a line of sight direction of the driver indicated by each of the identified captured images.