UAV Camera Display Control for Operator Gaze Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display control systems for unmanned aerial vehicles (UAVs) either continuously present aerial vehicle photographing images to operators, potentially obstructing their vision, or switch them frequently, causing discomfort when the operator looks away briefly.

Innovation Solution

A display control system that acquires aerial vehicle photographing images and determines whether the operator is viewing the UAV using sensing data, controlling the display state based on continuous non-viewing conditions, including time and distance, to minimize visual obstruction and provide necessary situational awareness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the aerial vehicle photographing image is always presented to the operator, then the operator can grasp the surrounding situation of the unmanned aerial vehicle, but the operator's eyesight is blocked

Engineering Contradiction:
Improvesurrounding situation awarenessVSAvoidvisual obstruction
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The display control system dynamically adjusts the display state of the aerial vehicle photographing image based on real-time detection of operator's viewing status. When the operator is detected to be viewing the UAV, the system suppresses or reduces the display of the photographing image. When the operator is not viewing the UAV, the system presents the photographing image to maintain situational awareness. This dynamic adaptation resolves the contradiction between maintaining information awareness and preventing visual obstruction.

Inventive Principle:
Principle #15Dynamics

2Object-affected harmful factors

If the aerial vehicle photographing image is frequently switched based on operator's viewing status, then visual obstruction is minimized, but the operator feels uncomfortable due to frequent switching

Engineering Contradiction:
Improvevisual obstructionVSAvoidoperator comfort
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The display control system incorporates a predetermined determination period during which the operator's non-viewing status must be confirmed continuously before switching to display the aerial vehicle photographing image. This preliminary confirmation period prevents premature or accidental switching due to brief glances away from the UAV. By requiring sustained non-viewing detection over a predetermined time interval, the system reduces frequent switching and thereby improves operator comfort while still maintaining safety.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If the aerial vehicle photographing image is presented when the operator is not viewing the UAV, then situational awareness is maintained, but visual obstruction occurs when the operator looks back at the UAV

Engineering Contradiction:
Improvesurrounding situation awarenessVSAvoidvisual obstruction
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The display control system continuously monitors the operator's viewing status through sensors (such as cameras or inertial sensors) and uses this feedback to adjust the display state of the aerial vehicle photographing image in real-time. When the operator's gaze or attention is detected to be directed toward the UAV, the system immediately suppresses or reduces the display of the photographing image to eliminate visual obstruction. This closed-loop feedback mechanism ensures that information is provided only when needed and does not interfere with direct observation of the UAV.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11492115B2Unmanned aerial vehicle display control system, display control device and display control method
Publication Date: 2022.11.08 RAKUTEN GROUP INC
  • US11492115B2 patent drawing
  • US11492115B2 patent drawing
  • US11492115B2 patent drawing

AI summary

Provided are a display control system, a display control device, and a display control method, which are capable of appropriately controlling a display state of an image photographed by a camera included in an unmanned aerial vehicle. A sensing data acquisition module acquires an aerial vehicle photographing image photographed by the camera included in the unmanned aerial vehicle in flight. A determiner determines whether an operator of the unmanned aerial vehicle is viewing the unmanned aerial vehicle with his or her eyes based on sensing data on at least one of the unmanned aerial vehicle or the operator. A display controller controls a display state of the aerial vehicle photographing image on a display depending on whether determination that the operator is not viewing the unmanned aerial vehicle with his or her eyes is continued.