UAV GPS Attitude Estimation for Real-Time Computer Vision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Unmanned autonomous vehicles (UAVs) face challenges in implementing real-time computer vision due to resource constraints, such as weight and energy limitations, making it difficult to perform precise attitude estimation and camera pose rotation for effective engagement with their environment.

Innovation Solution

The method involves using multiple GPS receivers mounted on the UAV to estimate the UAV's attitude by determining carrier phase and pseudo-range measurements, which are then used to calculate a 3D camera pose rotation matrix, enabling real-time computer vision image search computations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If computer vision heuristics are used for precise attitude estimation and camera pose rotation, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improveattitude estimation precisionVSAvoidcomputer vision processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces GPS attitude estimation as an intermediary mechanism that provides camera pose rotation information to computer vision processing. By using GPS receivers to determine UAV attitude and generating rotation matrices, the system creates a mediator that bridges the gap between raw sensor data and computer vision heuristics, reducing the computational burden while maintaining precision

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary attitude estimation using GPS receivers before computer vision processing occurs. By pre-calculating camera pose rotation matrices from GPS data, the system prepares transformation information in advance, allowing computer vision heuristics to operate more efficiently with reduced computational complexity

Inventive Principle:
Principle #10Preliminary action

2Productivity

If powerful back-end cloud compute systems are used for computer vision, then productivity is improved, but weight increases

Engineering Contradiction:
Improvereal-time data processing capabilityVSAvoidUAV weight
Core Design Contradiction:
ProductivityVSWeight of moving object

Solution Approach 1:

The patent implements self-service by enabling the UAV to perform computer vision processing locally using its own onboard resources. The system uses GPS attitude estimation and camera pose rotation to accelerate computer vision computations directly on the UAV platform, eliminating the need for external cloud compute systems and maintaining real-time processing capability while keeping the system lightweight

Inventive Principle:
Principle #25Self-service

3Measurement precision

If high performance server with GPUs is used for computer vision, then measurement precision is improved, but weight increases

Engineering Contradiction:
Improvecomputer vision analysis precisionVSAvoidcompute platform weight
Core Design Contradiction:
Measurement precisionVSWeight of moving object

Solution Approach 1:

The patent substitutes the mechanical/GPU-based computer vision processing system with a GPS-based attitude estimation approach. By replacing the need for heavy GPU computations with GPS receiver-based attitude determination and rotation matrix calculations, the system achieves comparable measurement precision with significantly reduced weight and computational hardware requirements

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11650334B2Acceleration of real time computer vision processing on UAVs through GPS attitude estimation
Publication Date: 2023.05.16 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11650334B2 patent drawing
  • US11650334B2 patent drawing
  • US11650334B2 patent drawing

AI summary

A method for applying GPS UAV attitude estimation to accelerate computer vision. The UAV has a plurality of GPS receivers mounted at fixed locations on the UAV. The method includes receiving GPS signals from each GPS satellite in view of the UAV, the GPS measurements comprising pseudo-range and carrier phase data representing the distance between each GPS receiver and each GPS satellite. Carrier phase and pseudo-range measurements are determined for each GPS receiver based on the pseudo-range and carrier phase data. The GPS carrier phase and pseudo-range measurements are compared pair-wise for each pair of GPS receiver and satellite. An attitude of the UAV is determined based on the relative distance measurements. A 3D camera pose rotation matrix is determined based on the attitude of the UAV. Computer vision image search computations are performed for analyzing the image data received from the UAV in real time using the 3D camera pose rotation matrix.