HMD Display Device for UAV Position Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing display devices for unmanned aerial vehicles (UAVs) do not effectively associate captured images with the vehicle's position in real space, limiting the usability of the images captured.

Innovation Solution

A display device worn by the user, equipped with a communication section to receive images from the UAV, a position estimating section to estimate the vehicle's position based on the images, and a display control section to show the images along with the estimated position information, allowing for improved association and usability of the captured images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the camera is provided in the unmanned aircraft to perform imaging, then the captured image can be transmitted to the remote control device, but the association between the captured image and the position of the vehicle during imaging is limited

Engineering Contradiction:
Improveposition information associationVSAvoidusability of captured image
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system provides feedback by displaying the estimated position of the unmanned aircraft overlaid on the captured image. The display control section superimposes position information (such as coordinates or location markers) onto the image captured by the camera, creating a feedback loop that continuously shows the relationship between the vehicle's position and the captured scene. This resolves the contradiction by maintaining full position information association while preserving ease of operation through intuitive visual display.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If only the relative angle and relative direction between the remote control device and the unmanned aircraft are calculated, then the position association can be determined, but the usability of the captured image remains limited

Engineering Contradiction:
Improveposition calculation accuracyVSAvoidusefulness of captured image
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system transitions from two-dimensional relative angle and direction calculations to three-dimensional absolute position information by incorporating GPS coordinates and altitude data. The position estimating section calculates the actual geographic position of the unmanned aircraft in real space, and this three-dimensional position information is then overlaid on the two-dimensional captured image. This dimensional enhancement preserves measurement precision while significantly improving the usefulness of the captured image by providing comprehensive spatial context.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10599142B2Display device and control method for display device
Publication Date: 2020.03.24 SEIKO EPSON CORP
  • US10599142B2 patent drawing
  • US10599142B2 patent drawing
  • US10599142B2 patent drawing

AI summary

An HMD includes an image display section worn on a head of a user, an HMD communication section configured to receive a captured image transmitted by a vehicle, a position estimating section configured to estimate a position of the vehicle in a real space on the basis of the captured image received by the HMD communication section, and a display control section configured to cause the image display section to display the captured image received by the HMD communication section and information concerning the position of the vehicle estimated by the position estimating section.