Carrier-Assisted Payload Tracking With GPU-Guided Pose Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern mobile devices struggle to maintain fast-moving objects in view without requiring significant operator skill, as existing stabilization methods are inadequate for precise tracking of objects across multiple axes.

Innovation Solution

A system and method that utilize a carrier coupled to the mobile device, allowing it to move relative to the carrier along up to three axes, with image processing performed by a hardware-accelerated GPU to quickly adjust the device's pose and maintain the object's position within the image frame.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a carrier is introduced to enable multi-axis movement control, then tracking precision and speed improve, but device complexity increases

Engineering Contradiction:
Improvetracking precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the tracking function into two independent parts: the carrier handles physical multi-axis movement control, while the mobile device focuses on image capture and processing. This segmentation allows each component to specialize, improving overall tracking precision without requiring the mobile device itself to become more complex.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The carrier acts as an intermediary between the mobile device and the target object. It provides the mechanical multi-axis movement capability that the mobile device lacks, enabling precise tracking without modifying the mobile device's internal complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If hardware-accelerated GPU processing is used, then image processing speed improves, but energy consumption increases

Engineering Contradiction:
Improveimage processing speedVSAvoidenergy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent replaces software-based image processing with hardware-accelerated GPU processing. This substitution provides significant speedup for real-time tracking applications, as the GPU can parallelize image processing tasks much more efficiently than general-purpose CPU software.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP3465085B1Carrier-assisted tracking
Publication Date: 2021.12.29 SZ DJI OSMO TECH CO LTD
  • EP3465085B1 patent drawingFigure 1
  • EP3465085B1 patent drawingFigure 2
  • EP3465085B1 patent drawingFigure 3

AI summary

Techniques are provided for tracking objects using a payload in conjunction with a carrier that supports the payload. The payload can be configured to capture images with an image sensor and identify a target to be tracked in the images. The payload can also generate control signals for controlling the carrier so as to change a pose of the payload in order to keep the payload within a field of view of the payload.