UAV Backup Navigation Using Visual Feature Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Unmanned aerial vehicles (UAVs) face navigation failures due to primary navigation system failures or malicious attacks, leading to potential crashes or loss of control, as existing backup navigation systems are inadequate for real-time navigation and are vulnerable to position errors and complexity issues.

Innovation Solution

A backup navigation system that uses real-time image data to generate and update a map of the UAV's flight path, transitioning from a feature localization mode to a UAV localization mode to navigate the UAV to a safe landing zone by identifying visual features and determining its current location using triangulation and feature matching algorithms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a backup navigation system is implemented to replace primary navigation functionality upon failure, then navigation reliability is improved, but device complexity increases

Engineering Contradiction:
Improvenavigation reliabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The navigation system is divided into two independent segments: a primary navigation system for normal operation and a backup navigation system for failure scenarios. Each segment operates independently with its own processing pipeline, allowing the backup system to take over without interfering with the primary system's normal functions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The backup navigation system performs preliminary actions by continuously capturing images and localizing visual features during normal flight operations before failure occurs. This pre-localization of features enables the system to quickly determine UAV position and generate safe flight paths immediately upon detecting primary system failure, without requiring time-consuming initialization.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 3:

Visual features in the environment serve as intermediaries between the backup camera system and the UAV's position determination. By localizing these features and matching them against pre-stored map data, the system indirectly determines the UAV's current location and orientation, enabling navigation without direct reliance on the failed primary navigation system.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If real-time image data is used for navigation, then measurement precision of position is improved, but use of energy increases

Engineering Contradiction:
Improveposition accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The backup navigation system uses periodic action by capturing images at specific intervals rather than continuously during normal operation. Image capture is activated only when needed - during normal flight for feature localization and immediately upon detecting primary system failure for position determination and safe path generation - reducing unnecessary energy consumption while maintaining position accuracy when required.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary action by pre-localizing visual features and storing them in a map database during normal flight operations. This pre-processing enables rapid position determination upon failure without requiring intensive real-time image processing, thereby reducing energy consumption during critical failure scenarios while maintaining high measurement precision.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If visual feature localization is performed continuously, then navigation response time is improved, but device complexity increases

Engineering Contradiction:
Improvenavigation response timeVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system performs preliminary action by continuously localizing visual features and storing them in a map database during normal flight operations. This pre-computation of feature locations enables the backup system to quickly determine UAV position by simple matching operations upon failure, achieving fast navigation response time without requiring complex real-time processing during critical scenarios.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system extracts and stores only the essential visual feature information (locations and characteristics) in a simplified map database during normal operations, separating the complex image processing tasks from the critical failure response phase. This extraction approach reduces the computational burden during failure scenarios while maintaining fast response time.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10908622B2Backup navigation system for unmanned aerial vehicles
Publication Date: 2021.02.02 WING AVIATION LLC
  • US10908622B2 patent drawing
  • US10908622B2 patent drawing
  • US10908622B2 patent drawing

AI summary

Described is a method that involves operating an unmanned aerial vehicle (UAV) to begin a flight, where the UAV relies on a navigation system to navigate to a destination. During the flight, the method involves operating a camera to capture images of the UAV's environment, and analyzing the images to detect features in the environment. The method also involves establishing a correlation between features detected in different images, and using location information from the navigation system to localize a feature detected in different images. Further, the method involves generating a flight log that includes the localized feature. Also, the method involves detecting a failure involving the navigation system, and responsively operating the camera to capture a post-failure image. The method also involves identifying one or more features in the post-failure image, and determining a location of the UAV based on a relationship between an identified feature and a localized feature.