Movable Imaging Assembly Subject Tracking via Sensor Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing subject tracking systems for movable imaging platforms face challenges in accurately tracking subjects, especially when the operator is also the subject, and in ensuring safety by limiting the operational region, particularly in situations where GPS is not ideal.

Innovation Solution

A method for tracking a subject using a movable imaging assembly that includes capturing image frames, determining the subject's location within a region of interest using a motion model and sensor data, and adjusting the imaging device's position to maintain the subject within the frame, while also defining restricted volumes to ensure safety and prevent collision.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manually operated controls are used to provide tracking commands to the movable imaging platform, then the operator can control the imaging device, but it becomes too difficult and complex when the operator is also the subject to be tracked

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system enables self-service tracking by automatically detecting and tracking the operator (who is also the subject) without requiring manual controls. The imaging device autonomously frames the subject based on sensor data and motion models, eliminating the complexity of manual operation when the operator is the subject.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Manual mechanical control is replaced with an automated electronic tracking system that uses sensors, motion models, and algorithms to provide tracking commands. This substitution eliminates the need for manual manipulation of controls while maintaining or improving tracking performance.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If GPS receivers are utilized to provide location accuracy for tracking, then location information can be obtained, but they are not ideal in all circumstances

Engineering Contradiction:
Improvelocation accuracyVSAvoidadaptability to different circumstances
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system employs multiple positioning methods including GPS, visual odometry, and sensor fusion to achieve location accuracy. This multi-functional approach ensures that the tracking system can operate effectively in various circumstances, not just when GPS is available, thereby improving both precision and adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Visual features and sensor data act as intermediaries to supplement or replace GPS information when GPS is unavailable or inaccurate. The system uses visual odometry and motion models as mediators to maintain location accuracy in circumstances where GPS receivers are not ideal.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Object-affected harmful factors

If the region in which an aerial-based subject tracking system operates is limited to ensure safety, then user safety is ensured, but the tracking system may be constrained in its operation

Engineering Contradiction:
ImprovesafetyVSAvoidoperational flexibility
Core Design Contradiction:
Object-affected harmful factorsVSAdaptability or versatility

Solution Approach 1:

The operational region boundaries are defined dynamically based on real-time factors such as subject location, imaging device position, and safety constraints. This dynamic adjustment allows the system to maintain safety while adapting to different operational scenarios, preserving both safety and operational flexibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system continuously monitors the positions of the imaging device and subject, and adjusts the operational region constraints based on feedback from these positions. This feedback mechanism ensures safety by preventing collisions while allowing maximum operational flexibility within safe boundaries.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240144669A1Subject tracking systems for a movable imaging system
Publication Date: 2024.05.02 GOPRO INC
  • US20240144669A1 patent drawing
  • US20240144669A1 patent drawing
  • US20240144669A1 patent drawing

AI summary

A method provides capturing successive video image frames with an imaging device to generate a video. Processing the successive video image frames to determine positions of multiple subjects with the successive video image frames. Obtaining information for the multiple subjects from one or more sensors physically attached to respective ones of the multiple subjects. Determining a region of interest containing the multiple subjects in the successive video image frames of the video. Obtaining additional video image frames that include the multiple subjects. Processing the additional video image frames so that the one or more multiple subjects are maintained within the additional video image frames. Identifying a single subject out of the multiple subjects within the additional video image frames. Providing live videos that include the single subject to a sharing service via an application in communication with the imaging device regarding the single subject.