UAV Flight Data Augmented Reality Overlay for Pilots

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Unmanned aerial vehicle (UAV) pilots face challenges in maintaining visual contact while accessing flight data, leading to potential crashes and inefficient operations, as looking away from the UAV to view data can result in loss of sight and unsafe or uncontrolled flight.

Innovation Solution

A headset-based system that overlays critical flight data, such as energy levels, altitude, and video feeds, directly onto the pilot's view of the UAV using augmented reality, allowing pilots to monitor flight data without diverting their gaze from the UAV.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the pilot looks at a separate display device to view flight data, then the flight data can be displayed clearly, but the pilot loses visual contact with the UAV

Engineering Contradiction:
Improveflight data accessibilityVSAvoidvisual contact maintenance
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent merges the flight data display with the pilot's natural view of the UAV by using augmented reality technology. The display device projects flight information overlays directly onto the pilot's field of view, combining the UAV visual with data visualization in a single unified view, thereby eliminating the need to switch between separate displays.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from a two-dimensional separate display to a three-dimensional augmented reality overlay that integrates with the pilot's natural visual field. The flight data is rendered in spatial layers that can be positioned at different distances and angles, allowing the pilot to perceive both the UAV and flight information simultaneously in the same visual space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the pilot frequently checks flight data on a separate display, then comprehensive flight information can be monitored, but the pilot's attention is diverted from the UAV

Engineering Contradiction:
Improveflight data monitoringVSAvoidpilot attention maintenance
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system combines multiple flight data streams (altitude, speed, battery level, location, video feeds) into a single integrated augmented reality overlay that the pilot views simultaneously with the UAV, eliminating the need to switch between different data sources and maintaining continuous attention on the aircraft.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The augmented reality display acts as an intermediary between the flight data sources and the pilot's brain, processing and presenting information in a way that naturally integrates with the pilot's existing visual attention pattern, allowing data consumption without attentional switching.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If the overlay displays all flight data, then complete information is provided, but the overlay occupies too much of the real view

Engineering Contradiction:
Improveflight data completenessVSAvoidoverlay area in real view
Core Design Contradiction:
Loss of informationVSArea of stationary object

Solution Approach 1:

The patent segments flight data into multiple categories (altitude, speed, battery, location, video feeds) and presents each as separate overlay elements that can be independently positioned and sized. This allows the pilot to see all data types while maintaining flexibility in their spatial arrangement to minimize total overlay area.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The overlay elements are dynamically adjustable in size, position, and visibility based on flight conditions and pilot preferences. Critical data can be emphasized during critical phases of flight, while less critical data can be minimized or hidden, allowing the overlay area to adapt to maintain optimal view clarity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20240428692A1Displaying UAV flight data with augmented reality
Publication Date: 2024.12.26 NAT RES COUNCIL OF CANADA
  • US20240428692A1 patent drawing
  • US20240428692A1 patent drawing
  • US20240428692A1 patent drawing

AI summary

Flight data of an unmanned aerial vehicle or UAV is determined while the unmanned aerial vehicle is under control of a surface-based pilot. An overlay that describes the flight data is generated. The overlay may present operational data, such as altitude and speed; video, such as captured from a camera at the UAV; or a combination of such. The overlay combined with a real view of the unmanned aerial vehicle is displayed to the surface-based pilot.