AR Drone Flight Display for Position and Orientation Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Human operators face challenges in maintaining situational awareness while flying drones due to the need to visually track the drone and operate a remote controller, especially in long distances or low light conditions, which can lead to hazardous situations and increased operational costs when a spotter is required.

Innovation Solution

An apparatus with an augmented reality display that superimposes drone position, orientation, and other aviation data onto the operator's field of view, using a head-mounted display to enhance situational awareness without the need for a spotter, by integrating real-time data from the drone and external sources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the operator looks at the drone in the air, then visual contact is maintained, but the operator cannot operate the remote controller effectively

Engineering Contradiction:
Improvevisual contact maintenanceVSAvoidremote controller operation
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces a third dimension by using augmented reality to overlay drone position information in the operator's field of view. This allows the operator to maintain visual contact with the drone while keeping hands on the controller, effectively adding a visual layer that provides drone location without requiring the operator to look up at the sky.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the operator looks at the remote controller display, then control information is visible, but situational awareness of the drone position is reduced

Engineering Contradiction:
Improvecontrol information visibilityVSAvoidsituational awareness
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent merges the control information display with the operator's view of the physical environment by projecting drone position indicators directly into the field of view. This combination allows the operator to see both the remote controller and drone position simultaneously without switching attention between separate displays and the physical drone location.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If a spotter is used to maintain visual contact, then operator safety is improved, but operational costs and complexity increase

Engineering Contradiction:
Improveoperator safetyVSAvoidoperational setup complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent enables the operator to self-monitor drone position and maintain situational awareness through the augmented reality display, eliminating the need for an external spotter. The system provides self-contained visual feedback about drone location, allowing the operator to independently maintain safety without additional personnel.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11669088B2Apparatus, method and software for assisting human operator in flying drone using remote controller
Publication Date: 2023.06.06 ANARKY LABS OY
  • US11669088B2 patent drawing
  • US11669088B2 patent drawing
  • US11669088B2 patent drawing

AI summary

Apparatus, method, and software for assisting human operator in flying drone using remote controller. The apparatus includes an internal data communication interface configured to receive data from the remote controller, an augmented reality display configured to display the data, one or more memories including computer program code, and one or more processors to cause the apparatus to: superimpose, on the augmented reality display, a target symbol indicating a position of the drone while the human operator is looking towards the drone; and superimpose, on the augmented reality display, an orientation symbol indicating an orientation of the drone while the human operator is looking towards the drone.