Gaze-Driven Camera Orientation for Subject Tracking on UAV Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to effectively maintain a subject within the imaging region of a camera mounted on an unmanned vehicle, particularly when the user's gaze direction changes, leading to loss of focus or image quality.

Innovation Solution

An apparatus and method that includes a camera capable of controlling its orientation, a detection unit to identify the user's gaze direction, and an orientation changing unit to adjust the camera's orientation to keep the subject centered in the imaging region, utilizing a display control unit to adjust image size and focus based on user eye movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the camera orientation is fixed, then the device complexity is reduced, but the subject may fall out of the imaging region when the user's gaze direction changes

Engineering Contradiction:
Improvecamera orientation adaptabilityVSAvoidcamera control system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system detects the user's gaze direction and uses this feedback to automatically adjust the camera orientation, ensuring the subject remains within the imaging region without requiring complex manual control mechanisms

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The camera system automatically adjusts its own orientation based on detected gaze information, eliminating the need for external manual intervention while maintaining subject tracking capability

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If the camera zooms in to improve image quality, then the imaging region becomes smaller, but the subject may fall out of the imaging region

Engineering Contradiction:
Improveimage qualityVSAvoidimaging region area
Core Design Contradiction:
Manufacturing precisionVSArea of stationary object

Solution Approach 1:

The camera system dynamically adjusts both zoom level and orientation based on real-time gaze detection, allowing it to maintain optimal image quality while adapting the imaging region to keep the subject in view

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes multiple camera parameters simultaneously (zoom level, orientation angles) based on detected gaze direction, optimizing both image quality and subject positioning within the imaging region

Inventive Principle:
Principle #35Parameter changes

3Reliability

If the camera orientation changes frequently to track gaze, then the subject remains in the imaging region, but the system response time increases

Engineering Contradiction:
Improvesubject tracking reliabilityVSAvoidsystem response time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary gaze detection and predicts the required camera orientation adjustment, executing the orientation change proactively before the subject actually moves out of the imaging region

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces complex mechanical tracking mechanisms with computational gaze detection and electronic control, achieving faster response times through software-based orientation adjustment

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12108139B2Apparatus, system, method and storage medium
Publication Date: 2024.10.01 YOKOGAWA ELECTRIC CORP
  • US12108139B2 patent drawing
  • US12108139B2 patent drawing
  • US12108139B2 patent drawing

AI summary

An apparatus comprising an acquisition unit configured to acquire a captured image from a camera that is capable of controlling an orientation, a display control unit configured to display the captured image onto a display screen, a detection unit configured to detect, within the display screen, a subject at which a user is looking, and an orientation changing unit configured to change an orientation of the camera in such a way that the subject does not fall out of an imaging region of the camera is provided.