Driver Monitor Camera Gaze Detection Without Precise Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing driver imaging devices require pre-setting and strict alignment of the driver monitor camera, which incur calibration costs and are prone to determination errors due to misalignment caused by vehicle vibration.

Innovation Solution

A driver imaging device with a driver monitor camera fixed to the vehicle's front side, utilizing a camera ECU that estimates the vehicle's traveling direction from acceleration and gyro sensors, and determines the driver's face orientation and gaze point based on captured images, eliminating the need for pre-setting and strict alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pre-setting and strict alignment of the driver monitor camera are performed, then determination accuracy of face orientation and gaze point is improved, but calibration cost increases and device complexity increases

Engineering Contradiction:
Improvedetermination accuracyVSAvoidcalibration process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses the vehicle's own acceleration sensor data to automatically estimate traveling direction and compensate for camera misalignment, eliminating the need for external calibration services or manual alignment procedures

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical alignment and calibration system with a computational approach using acceleration sensor data and image processing algorithms to dynamically determine camera orientation and compensate for misalignment

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If pre-setting and strict alignment of the driver monitor camera are performed, then determination accuracy of face orientation and gaze point is improved, but calibration cost increases

Engineering Contradiction:
Improvedetermination accuracyVSAvoidcalibration cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The system performs self-calibration by utilizing the vehicle's existing acceleration sensor data to estimate traveling direction and compensate for camera misalignment, eliminating the need for expensive external calibration services

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses data from the acceleration sensor as a proxy for direct camera alignment measurements, creating a computational model that replicates the effect of precise mechanical alignment without the associated costs

Inventive Principle:
Principle #26Copying

3Measurement precision

If the driver monitor camera is strictly aligned during mounting, then determination accuracy is improved, but the device becomes more sensitive to vibration-induced misalignment

Engineering Contradiction:
Improvedetermination accuracyVSAvoidvibration resistance
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system transitions from a static alignment approach to a dynamic compensation approach, continuously estimating traveling direction based on acceleration sensor data to adapt to changing vibration conditions and maintain determination accuracy

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses acceleration sensor data as feedback to continuously estimate traveling direction and adjust the determination of face orientation and gaze point, creating a closed-loop system that compensates for vibration-induced misalignment

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Reduces calibration costs and improves accuracy in determining the driver's face orientation and gaze point by estimating the vehicle's traveling direction and camera orientation using onboard sensors, enhancing the device's design flexibility and reducing misalignment errors.

Implementation Method 1

acceleration information of an acceleration sensor of the vehicle

Methodology Applied
Scientific EffectAcceleration sensing: Accelerometer

Implementation Method 2

acceleration information of an in-camera acceleration sensor built into the driver monitor camera

Methodology Applied
Scientific EffectAcceleration sensing: Accelerometer

Data Source

PatentUS12526388B2Driver imaging device
Publication Date: 2026.01.13 TOYOTA JIDOSHA KK
  • US12526388B2 patent drawing
  • US12526388B2 patent drawing
  • US12526388B2 patent drawing

AI summary

A driver imaging device 1 includes a driver monitor camera 10 fixed to a vehicle front side with respect to a driver's seat in a vehicle interior of a vehicle, and configured to capture an image of a driver. The driver monitor camera 10 includes a camera ECU 11. The camera ECU 11 estimates a traveling direction of the vehicle based on at least one of acceleration information of an acceleration sensor 2 of the vehicle and acceleration information of an in-camera acceleration sensor 12 built into the driver monitor camera 10, and determines a face orientation of the driver with respect to the traveling direction of the vehicle and a gaze point of the driver based on a face image of the driver captured by the driver monitor camera 10 and the traveling direction.