UAV Image Localization Using Ground Map Matching Without GPS
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Unmanned aerial vehicles (UAVs) face challenges in determining their location and orientation when GPS signals are weak or erroneous, leading to potential operational failures and safety risks.
Innovation Solution
A camera-based navigation system is implemented as a backup, where images captured by a UAV are processed by a base station to match with terrestrial maps, determining the UAV's location and orientation using image registration algorithms, and this information is used to adjust the UAV's flight path.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If GPS-based navigation system is used for UAV location determination, then navigation simplicity is improved, but system reliability deteriorates due to signal weakness or equipment failure
Solution Approach 1:
The system changes the measurement parameters from GPS satellite signals to ground-based visual features. By capturing images and extracting visual landmarks, the system determines UAV position through image processing and feature matching algorithms, completely avoiding dependence on GPS signal parameters
Solution Approach 2:
The patent introduces an intermediary ground-based visual mapping system between the UAV and navigation objective. Instead of directly using GPS signals, the system uses ground images as intermediaries - capturing ground features, creating visual maps, and matching these maps with real-time images to determine position indirectly but reliably
2Reliability
If camera-based navigation system is implemented as backup, then system reliability is improved, but device complexity increases
Solution Approach 1:
The camera serves multiple functions: it acts as both a navigation sensor for location determination and potentially as a payload or observation device. The same imaging device is used for both backup navigation and primary mission objectives, eliminating the need for separate dedicated navigation equipment
Solution Approach 2:
The system creates a visual copy or map of the ground environment and stores it for later matching. By capturing and storing ground images as reference maps, the system can determine position through comparing current images with stored copies, avoiding the need for complex real-time calculation systems
3Productivity
If image processing is performed at base station, then processing speed is improved, but loss of time in transmitting images increases
Solution Approach 1:
The system performs preliminary actions by pre-processing and compressing images before transmission. By preparing images in advance and transmitting only essential data, the system reduces transmission time while ensuring base station has sufficient data for rapid processing when needed
Solution Approach 2:
The patent segments the navigation system into two parts: lightweight image capture and processing at UAV, and heavy computational mapping and matching at base station. This segmentation allows the UAV to remain simple while leveraging base station computing power, with time loss minimized through efficient data transmission protocols
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
Systems and methods for image based localization for unmanned aerial vehicles (UAVs) are disclosed. In one embodiment, a method for navigating a UAV includes: flying a UAV along a flight path; acquiring an image of a ground area along the flight path with a camera carried by the UAV; and sending the image to a base station. The method further includes receiving navigation data from the base station, based upon a comparison of the image of the ground area to at least one terrestrial map of the flight path.