UAV Landing Tracking With Lightweight Twin Networks and Kalman Search

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional tracking algorithms for unmanned aerial vehicles face challenges in achieving high precision and real-time performance due to their computational intensity and inability to effectively handle transient target disappearances, leading to poor long-term tracking and inefficient resource utilization.

Innovation Solution

A lightweight twin network-based landing tracking control method that uses feature weight adjustment, enhanced feature fusion, and Kalman filtering to improve tracking precision and response speed, ensuring the target remains within the search region upon re-appearance, by employing lightweight SNet feature extraction modules, feature pyramid enhancement, and optimized loss functions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If deep learning-based tracking algorithms are used to improve tracking precision, then tracking precision is improved, but calculating amount increases and real-time performance deteriorates

Engineering Contradiction:
Improvetracking precisionVSAvoidreal-time performance
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The tracking algorithm is segmented into two independent networks: a template network for extracting target features and a search network for detecting targets in search regions. This segmentation allows each network to be optimized independently, reducing overall computational complexity while maintaining tracking precision through specialized feature extraction and detection mechanisms.

Inventive Principle:
Principle #1Segmentation

2Productivity

If related filtering algorithms are used to improve real-time performance, then real-time performance is improved, but tracking precision deteriorates due to inability to utilize deep image features

Engineering Contradiction:
Improvereal-time performanceVSAvoidtracking precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent replaces traditional filtering-based tracking mechanisms with a deep learning-based twin network system. The template network and search network utilize convolutional neural networks to extract and match deep image features, substituting mechanical filtering operations with intelligent feature-based matching that achieves both real-time performance and high precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If filter template is updated online in real time to maintain real-time performance, then real-time performance is maintained, but errors accumulate and tracking precision deteriorates

Engineering Contradiction:
Improvereal-time performanceVSAvoidtracking precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The template network extracts target features offline from a predefined target template before the tracking process begins. This preliminary feature extraction avoids the need for continuous online template updates during tracking, preventing error accumulation while maintaining real-time performance through efficient feature matching in the search network.

Inventive Principle:
Principle #10Preliminary action

4Device complexity

If conventional local region search policy is used to simplify search process, then device complexity is reduced, but tracking reliability deteriorates when target disappears transiently

Engineering Contradiction:
Improvesearch policy complexityVSAvoidtracking reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The search region is dynamically adjusted based on target detection results and movement predictions. When the target is successfully detected, the search region is concentrated around the detected position. When the target disappears transiently, the search region is expanded to increase the probability of re-detection, thereby improving tracking reliability without excessive complexity.

Inventive Principle:
Principle #15Dynamics

5Device complexity

If all feature channels are utilized equally to simplify feature processing, then device complexity is reduced, but tracking precision deteriorates as different tracked objects have different responses in different channels

Engineering Contradiction:
Improvefeature processing complexityVSAvoidtracking precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

Different feature channels are assigned different weights based on their effectiveness for specific target types. The system learns channel-specific weights through training, allowing important channels to contribute more to the matching process while less important channels contribute less. This differentiated feature utilization improves tracking precision for different target types without requiring complex manual feature selection.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11634227B2Landing tracking control method and system based on lightweight twin network and unmanned aerial vehicle
Publication Date: 2023.04.25 GUANGDONG UNIV OF TECH
  • US11634227B2 patent drawing
  • US11634227B2 patent drawing
  • US11634227B2 patent drawing

AI summary

A landing tracking control method comprises the following contents: a tracking model training stage and an unmanned aerial vehicle real-time tracking stage. The landing tracking control method extracts a network Snet by using a lightweight feature and makes modification, so that an extraction speed of the feature is increased to better meet a real-time requirement. Weight allocation on the importance of channel information is carried out to differentiate effective features more purposefully and utilize the features, so that the tracking precision is improved. In order to improve a training effect of the network, a loss function of an RPN network is optimized, a regression precision of a target frame is measured by using CIOU, and meanwhile, calculation of classified loss function is adjusted according to CIOU, and a relation between a regression network and classification network is enhanced.