Eye-Tracking Search Assistance for Camera Target Identification

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Operators face significant operational burdens when searching for detection targets using optical cameras, requiring repeated switching between wide and narrow angles of view to confirm targets, which is inefficient and labor-intensive.

Innovation Solution

A search assisting apparatus and method that includes a line-of-sight trajectory detector, gaze region extractor, and target presence determiner, using a stereo camera to detect and determine the presence of targets based on the operator's gaze region and distance information, reducing the need for manual angle adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the operator uses wide angle of view to search over a wide range, then the searching coverage is improved, but the identification precision deteriorates

Engineering Contradiction:

Improvesearching coverageVSAvoidtarget identification precision

Core Design Contradiction:

Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system performs preliminary action by automatically extracting the gaze region and determining target presence before the operator needs to confirm identification. The gaze region is extracted based on line-of-sight trajectory, and target presence is determined using distance information, so the operator doesn't need to manually switch to narrow angle view for confirmation.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary automated assistance mechanism between the wide angle search and narrow angle confirmation steps. This intermediary includes the gaze region extraction module and target presence determination module that use line-of-sight trajectory and distance information to automatically confirm targets, eliminating the need for manual camera angle switching.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If the operator switches between wide and narrow angles of view to confirm targets, then the target identification accuracy is improved, but the operation time increases

Engineering Contradiction:

Improvetarget identification accuracyVSAvoidoperation time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs self-service by automatically extracting gaze region and determining target presence using the operator's line-of-sight trajectory and distance information. This automation eliminates the need for the operator to manually switch camera angles, so the system serves itself in confirming target identification without additional operator input or time consumption.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system replaces the mechanical operation of manually switching camera angles with an automated electronic system. Instead of the operator physically adjusting the camera, the system electronically extracts gaze region and determines target presence based on line-of-sight trajectory data and distance measurements, substituting mechanical operations with automated processing.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If the operator manually confirms target presence by switching to narrow angle view, then the identification reliability is improved, but the ease of operation deteriorates

Engineering Contradiction:

Improveidentification reliabilityVSAvoidease of operation

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The system performs self-service automation where the gaze region extraction and target presence determination are executed automatically based on line-of-sight trajectory and distance information. This eliminates the need for manual camera angle switching, making the operation easier while maintaining reliability through automated confirmation.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system introduces an intermediary automated confirmation mechanism that bridges the search and identification processes. The gaze region extraction module and target presence determination module act as intermediaries that automatically verify targets without requiring the operator to manually switch to narrow angle view, thus improving ease of operation while maintaining identification reliability.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10176394B2Search assisting apparatus, search assisting method, and computer readable medium

Publication Date: 2019.01.08 SUBARU CORP

AI summary

A search assisting apparatus includes a line-of-sight trajectory detector, a gaze region extractor, and a target presence determiner. The line-of-sight trajectory detector that detects a line-of-sight trajectory of the operator on an image displayed on a display. The gaze region extractor that extracts, on a basis of the line-of-sight trajectory detected by the line-of-sight trajectory detector, a gaze region gazed by the operator in the image displayed on the display. The target presence determiner that determines, on a basis of a distance from a predetermined position, presence of a predetermined detection target in the gaze region.