UAV SfM Imaging with Real-Time Flight Path Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating accurate three-dimensional scans using camera-equipped UAVs are time-consuming and costly due to the need for pre-defined flight plans and subsequent flights to cover insufficient areas, as they do not allow for real-time adjustment of imaging based on image data analysis.

Innovation Solution

A system that processes images from a UAV's camera gimbal assembly to detect regions requiring additional imaging, dynamically updates the flight plan and gimbal position to maintain focus on desired regions of interest, using real-time positional and orientation information from the UAV's flight controller and inertial measurement unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pre-defined flight plans are used for UAV imaging, then accurate 3D scans can be generated, but the time and cost become prohibitive due to multiple required flights

Engineering Contradiction:
Improveaccuracy of 3D scanVSAvoidtime required for scanning
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system processes images in real-time during the flight to identify regions requiring additional imaging, then dynamically adjusts the flight plan and gimbal position to capture those regions, eliminating the need for multiple flights and reducing total scanning time while maintaining accuracy

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The flight plan and gimbal position plan are dynamically updated during the flight based on real-time image analysis, allowing the system to adapt to actual imaging needs rather than following a static pre-defined plan, thus reducing the number of flights required

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If pre-defined flight plans are used for UAV imaging, then accurate 3D scans can be generated, but the cost becomes prohibitive due to multiple required flights

Engineering Contradiction:
Improveaccuracy of 3D scanVSAvoidcost of scanning
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

Real-time image processing provides feedback on imaging quality and identifies gaps, allowing the system to complete the scan in fewer flights by dynamically adjusting the flight plan, thereby reducing operational costs while maintaining scan accuracy

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system automatically identifies regions requiring additional imaging and self-corrects by updating the flight and gimbal plans without requiring external intervention or multiple planned flights, reducing overall scanning cost

Inventive Principle:
Principle #25Self-service

3Productivity

If real-time image data analysis is performed to identify regions requiring additional imaging, then the time and cost of generating scans is reduced, but the system complexity increases

Engineering Contradiction:
Improvespeed of data collectionVSAvoidcomplexity of imaging system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The flight controller is given multiple functions: it controls UAV flight, processes images in real-time, identifies regions requiring additional imaging, and dynamically updates flight and gimbal plans. This multi-functionality reduces the need for separate dedicated systems, managing complexity while enabling real-time analysis and improving productivity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11086324B2Structure from motion (SfM) processing for unmanned aerial vehicle (UAV)
Publication Date: 2021.08.10 KING ABDULLAH UNIV OF SCI & TECH
  • US11086324B2 patent drawing
  • US11086324B2 patent drawing

AI summary

A method of imaging an area using an unmanned aerial vehicle (UAV) collects a plurality of images from a sensor mounted to the UAV. The plurality of images are processed to detect regions that require additional imaging and an updated flight plan and sensor gimbal position plan is created to capture portions of the area identified as requiring additional imaging.