See-Through HMD Display Control for UAV Spatial Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display systems for unmanned aerial vehicles (UAVs) lack an effective method to simultaneously display captured images and control the visibility of the outside scene, making it difficult for operators to visually recognize and operate the UAV while prioritizing important visual information.

Innovation Solution

A display system comprising a first and second display device, each with operation detecting, mobile-body control, and image data acquiring sections, allowing for real-time image display and control of visibility based on the captured images and operational states, enabling operators to prioritize visual recognition of the UAV in real space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the display section displays captured images to enable visual recognition, then the operator can confirm the captured image, but the visibility of the outside scene (real space) is reduced

Engineering Contradiction:
Improvecaptured image visibilityVSAvoidoutside scene visibility
Core Design Contradiction:
Loss of informationVSIllumination intensity

Solution Approach 1:

The display control section dynamically adjusts the visibility of the outside scene based on operational states. When the mobile body is stationary or moving slowly, the display shows captured images with high visibility. When the mobile body moves quickly or requires immediate spatial awareness, the display automatically increases outside scene visibility, creating a dynamic balance between information display and spatial awareness

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes display parameters (brightness, transparency, visibility) based on the operational state of the mobile body. The display control section modifies these parameters in response to speed, position, and operational mode changes, allowing the operator to prioritize either captured image information or real-space visibility depending on current operational needs

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If the display device displays captured images, then the operator can confirm the image, but the device complexity increases due to multiple display devices and control sections

Engineering Contradiction:
Improvecaptured image display capabilityVSAvoiddisplay system structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The first display device serves multiple functions: it displays captured images, shows operational information, and provides spatial awareness. The second display device similarly handles both image display and operational control. This multi-functionality reduces the need for separate dedicated devices for each function, thereby managing system complexity while maintaining comprehensive display capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The display control section acts as an intermediary that manages the complexity of displaying both captured images and operational information. It coordinates between the mobile body control section, operation detecting section, and display section, centralizing the control logic to manage system complexity rather than distributing it across multiple independent components

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If the display control section controls visibility of the outside scene, then the operator can prioritize visual recognition of the mobile body, but the ease of operation is reduced due to automatic visibility adjustments

Engineering Contradiction:
Improvemobile body visual recognitionVSAvoidmanual control flexibility
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The display control section continuously monitors the operational state of the mobile body and automatically adjusts outside scene visibility based on this feedback. When the mobile body is stationary, the system prioritizes captured image display. When movement is detected or spatial awareness is needed, the system automatically increases outside scene visibility, providing adaptive control that responds to operational needs without requiring manual intervention

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances operational ease and convenience by allowing operators to confirm captured images and control UAVs while prioritizing the visibility of the UAV in real space, improving the balance between image visibility and operational control.

Implementation Method 1

The first display section may display the image to enable visual recognition of an outside scene by transmitting external light

Methodology Applied
Scientific EffectLight transmission: Light

Data Source

PatentUS11025826B2Display system, display device, and control method for display device
Publication Date: 2021.06.01 SEIKO EPSON CORP
  • US11025826B2 patent drawing
  • US11025826B2 patent drawing
  • US11025826B2 patent drawing

AI summary

An HMD includes a display section configured to display an image to enable visual recognition of an outside scene by transmitting external light, an operation detecting section configured to detect operation, a HMD control section configured to generate, according to the operation detected by the operation detecting section, a command for operating a first mobile body, a communication control section configured to acquire first mobile body image data concerning a captured image captured by the mobile body, and a display control section configured to cause the display section to display an image based on the first mobile body image data acquired by the communication control section. The display control section controls visibility of the outside scene in the display section.