UAV Machine Vision for Package Autoloader Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing unmanned aerial vehicles (UAVs) face challenges in detecting and localizing package autoloaders due to the susceptibility of visual fiducial markers to environmental factors and human installation errors, which affect the reliability and aesthetics of package delivery operations.

Innovation Solution

Implementing a machine vision system that uses onboard cameras and neural networks to detect and localize autoloaders based on their physical structures, employing image classifiers to identify keypoints and utilize redundant detection methods such as infrared beacons or near-field wireless communications for accurate alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If visual fiducial markers are used for autoloader detection and localization, then the UAV can identify autoloaders, but the system becomes susceptible to environmental factors and human installation errors

Engineering Contradiction:
Improvedetection reliabilityVSAvoidenvironmental susceptibility
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent replaces the mechanical/visual fiducial marker system with a machine vision system that detects and localizes autoloaders based on their physical structures. The UAV uses onboard cameras and neural networks to identify autoloaders by their distinctive physical features rather than relying on attached markers, eliminating susceptibility to environmental factors and installation errors.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a digital model or representation of the autoloader's physical structure that can be recognized by the machine vision system. Instead of using physical fiducial markers, the system learns to identify and copy the essential structural features of autoloaders through neural network training, enabling reliable detection without external markers.

Inventive Principle:
Principle #26Copying

2Measurement precision

If large fiducial markers are used for detection, then detection accuracy improves, but the aesthetic appearance deteriorates

Engineering Contradiction:
Improvedetection accuracyVSAvoidaesthetic appearance
Core Design Contradiction:
Measurement precisionVSShape

Solution Approach 1:

The patent eliminates the need for large fiducial markers by substituting them with a machine vision system that detects autoloaders based on their inherent physical structures. This allows detection to proceed without adding any visible markers that would compromise the aesthetic appearance of the autoloaders.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The machine vision system focuses on detecting specific local features of the autoloader structure that are essential for identification. Rather than requiring large overall markers, the system identifies distinctive local characteristics of the autoloader's physical form, maintaining both detection accuracy and aesthetic appearance.

Inventive Principle:
Principle #3Local quality

3Reliability

If machine vision with neural networks is implemented, then reliability and aesthetics improve, but device complexity increases

Engineering Contradiction:
Improvedetection reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent employs a universal machine vision system with neural networks that can detect and localize multiple types of autoloaders using the same physical structure-based approach. This multi-functional system handles various autoloader designs without requiring separate marker systems, managing complexity through a unified detection framework.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The neural network system is trained to automatically identify and localize autoloaders by their physical structures without requiring manual marker placement or calibration. The system serves itself by learning from training data and autonomously performing detection and localization tasks, reducing operational complexity despite the sophisticated underlying technology.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12412301B2Visual detection and localization of package autoloaders by UAV
Publication Date: 2025.09.09 WING AVIATION LLC
  • US12412301B2 patent drawing
  • US12412301B2 patent drawing
  • US12412301B2 patent drawing

AI summary

A technique for a UAV includes: acquiring an aerial image of an area below a UAV that includes one or more instances of an object; analyzing the aerial image with an image classifier to classify select pixels of the aerial image as being keypoint pixels associated with keypoints of the object; grouping the keypoint pixels into one or more groups each associated with one of the instances of the object, wherein first keypoint pixels of the keypoint pixels are grouped into a first group of the one or more groups associated with a first instance of the one or more instances of the object; generating an estimate of a relative position of the UAV to the first instance of the object based at least upon a machine vision analysis of the first keypoint pixels; and navigating the UAV into alignment with the first instance based upon the estimate.