AR Flight Route Overlay for Real-Time Aerial Hazard Guidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current aerial vehicle navigation systems lack intuitive and real-time visualization of flight routes, making it difficult for pilots to detect hazards and navigate safely, especially in urban environments with low flight altitudes, and there is a need for user-friendly navigation and route guidance in bad weather conditions.

Innovation Solution

A method and apparatus providing augmented reality (AR) guidance for aerial vehicles, which includes acquiring flight images, generating AR route guidance objects, and displaying them in real-time, with features such as slope correction, hazard detection, and risk level indication, to help pilots navigate safely and avoid deviations from designated routes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional multi-function display is used to provide route guidance, then route information can be displayed numerically or in radar form, but the information is not intuitive and only experienced pilots can acquire it effectively

Engineering Contradiction:
Improveroute guidance usabilityVSAvoidhazard detection capability
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent transitions from conventional 2D radar displays to a stereoscopic 3D map display that provides intuitive spatial representation of flight routes and surrounding environment. This dimensional enhancement allows pilots to visually perceive route information and hazards more naturally, eliminating the need for specialized interpretation skills while maintaining comprehensive situational awareness

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system creates a virtual copy of the real-world environment through stereoscopic 3D map visualization, overlaying flight route information onto a realistic geographic representation. This virtual copy enables pilots to perceive route deviations and hazards in an intuitive format that mirrors actual spatial relationships, improving both usability and hazard detection

Inventive Principle:
Principle #26Copying

2Device complexity

If pilot only confirms front view, then simple navigation is possible, but dangerous objects on rear surface or side surface cannot be detected

Engineering Contradiction:
Improvenavigation system simplicityVSAvoidhazard detection reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The stereoscopic 3D map display system serves multiple functions simultaneously: it shows the flight route, displays surrounding terrain and buildings, indicates dangerous objects from all directions, and provides spatial orientation. This multi-functional visualization replaces the need for separate instruments while enhancing comprehensive situational awareness including rear and side hazard detection

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system introduces a virtual reality intermediary layer that consolidates information from multiple sensors and sources into a unified 3D visualization. This intermediary representation mediates between the complex multi-directional sensor data and the pilot's perception, enabling intuitive understanding of hazards from all directions without requiring the pilot to actively scan multiple instruments

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If conventional 2D display is used, then device complexity is low, but route visualization is not intuitive and route deviation cannot be detected in real time

Engineering Contradiction:
Improvedisplay system complexityVSAvoidroute deviation detection time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The system employs stereoscopic 3D visualization to represent flight routes and terrain in true spatial relationships, allowing pilots to immediately perceive route deviations as visual separations between the aircraft icon and the designated route path. This dimensional enhancement eliminates the cognitive processing time required to interpret 2D radar coordinates while maintaining manageable system complexity through software-based rendering

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The stereoscopic 3D display provides continuous real-time feedback by dynamically updating the aircraft position relative to the flight route as the aircraft moves. This immediate visual feedback mechanism allows pilots to detect and correct route deviations instantly, with the system automatically refreshing the visualization to reflect current spatial relationships between the aircraft, route, and terrain

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20230315094A1Method, apparatus and computer program for providing augmented reality guidance for aerial vehicle
Publication Date: 2023.10.05 THINKWARE
  • US20230315094A1 patent drawing
  • US20230315094A1 patent drawing
  • US20230315094A1 patent drawing

AI summary

Disclosed is a method of providing augmented reality guidance for an aerial vehicle. A method of providing augmented reality guidance for an aerial vehicle includes acquiring an aerial vehicle flight image captured through a camera installed in the aerial vehicle, acquiring a flight route for a flight to a destination of the aerial vehicle, generating an augmented reality (AR) route guidance object corresponding to the flight route, generating an AR route guidance image by mapping the generated AR route guidance object to the aerial vehicle flight image, and displaying the generated AR route guidance image.