Driver Gaze Monitoring Around Mobile Terminal Position

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing driver monitoring systems require connection between a driver's mobile terminal and vehicle for determining inattentiveness, which is cumbersome and may fail if the connection is not established, preventing effective detection when the driver looks at the mobile terminal during vehicle operation.

Innovation Solution

An inattentiveness determination system using a driver monitor camera and an indoor camera to detect the driver's line-of-sight direction and mobile terminal position within the vehicle, setting an inattentiveness determination region without requiring direct connection to the mobile terminal, utilizing a line-of-sight direction detection unit, terminal position detection unit, and inattentiveness determination unit to determine if the driver is inattentive based on gaze direction relative to the mobile terminal's location.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the driver monitoring system uses image captured by mobile terminal camera to determine inattentiveness, then the detection accuracy is improved, but the device complexity and ease of operation deteriorate due to required connection between vehicle and mobile terminal

Engineering Contradiction:
Improveinattentiveness detection accuracyVSAvoidconnection requirement complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses an indoor camera to capture images of the mobile terminal's location and creates a visual map representation, rather than requiring direct access to the mobile terminal's camera. This copying approach allows the system to detect terminal position and driver inattentiveness independently of mobile terminal connection status.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The indoor camera acts as an intermediary device that captures images of the mobile terminal within the vehicle cabin. This intermediary approach enables the system to obtain terminal position information without establishing a direct connection with the mobile terminal, thus resolving the contradiction between detection accuracy and connection complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the system requires connection operation between vehicle and mobile terminal, then the detection reliability is improved when connected, but the ease of operation and adaptability deteriorate due to troublesome connection process

Engineering Contradiction:
Improvedetection reliabilityVSAvoidconnection operation ease
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs automatic recognition of the mobile terminal in captured images using image processing algorithms. The terminal position detection unit automatically identifies the terminal without requiring driver intervention or connection operations, making the system self-sufficient and eliminating the need for manual connection setup.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously captures images of the vehicle interior using the indoor camera and pre-processes these images to identify mobile terminal positions before inattentiveness detection is needed. This preliminary action ensures that terminal position information is always available without requiring connection operations at the moment of detection.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the system uses mobile terminal camera for detection, then the measurement precision is improved, but the adaptability deteriorates when mobile terminal does not support connection

Engineering Contradiction:
Improveline-of-sight detection precisionVSAvoidmobile terminal compatibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system separates the detection function into two independent components: the indoor camera captures terminal position information, while the driver monitor camera captures driver line-of-sight information. This segmentation allows each component to operate independently without requiring connection to the mobile terminal, thereby improving adaptability while maintaining detection precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The indoor camera serves multiple functions: it captures images for mobile terminal position detection, provides environmental context, and enables inattentiveness determination without being dependent on any specific mobile terminal model or connection capability, thus achieving universal applicability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250206319A1Inattentiveness determination device, inattentiveness determination system, and inattentiveness determination method
Publication Date: 2025.06.26 TOYOTA JIDOSHA KK
  • US20250206319A1 patent drawing
  • US20250206319A1 patent drawing
  • US20250206319A1 patent drawing

AI summary

An inattentiveness determination device which determines whether or not a driver of a vehicle is inattentive, includes: a line-of-sight direction detection unit for detecting a line-of-sight direction of the driver; a terminal position detection unit for detecting a position of a mobile terminal in an interior of the vehicle based on an image acquired from an indoor camera for capturing an image of the interior of the vehicle; an inattentiveness determination unit for determining whether the driver is in an inattentive state based on whether or not the line-of-sight direction of the driver is within an inattentiveness determination region; and a region setting unit for setting a region in which the mobile terminal is located as the inattentiveness determination region, when there is the mobile terminal in the interior of the vehicle.