Video Object Tracking via Feature Point Motion Clustering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques face challenges in accurately identifying and tracking objects in video and electronic content due to their varying appearances and positions across frames, making it difficult to determine their boundaries effectively.

Innovation Solution

The method involves identifying feature points and their motion paths within a video, grouping them based on these paths, and using location information to define sub-groups, which are then used to present object representations such as rectangles or well-defined objects, allowing for improved tracking and editing capabilities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If simple rectangle definitions are used for object boundaries, then device complexity is reduced, but manufacturing precision deteriorates because boundaries do not closely correspond to actual video object boundaries

Engineering Contradiction:
Improveobject boundary precisionVSAvoidtracking system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system segments the video content by identifying feature points and grouping them into sub-groups based on motion paths, creating well-defined object boundaries that closely correspond to actual object boundaries rather than using simple rectangle approximations

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes the parameter representation from simple rectangular coordinates to feature point coordinates with motion path information, enabling more precise object boundary definition while maintaining manageable system complexity through algorithmic processing

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If feature points are grouped into sub-groups using motion paths, then object identification accuracy is improved, but loss of information increases due to the complexity of tracking multiple feature points and their paths

Engineering Contradiction:
Improveobject identification accuracyVSAvoiddata processing overhead
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system extracts only the essential feature points and their motion paths from the video content, grouping them into sub-groups that represent objects, thereby achieving accurate object identification while managing information processing by focusing on key features rather than all pixels

Inventive Principle:
Principle #2Taking out (Extraction)

3Ease of operation

If object boundaries are precisely defined using well-defined objects, then ease of operation is improved for editing and effects application, but device complexity increases due to the sophisticated tracking and grouping algorithms required

Engineering Contradiction:
Improvevideo editing capabilityVSAvoidtracking algorithm complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs preliminary tracking and grouping of feature points into well-defined object boundaries before the editing operation occurs, so that when editing or effects application is needed, the objects are already precisely defined and ready for manipulation, simplifying the user operation while the complex processing occurs in advance

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8620029B2Systems and methods of tracking objects in video
Publication Date: 2013.12.31 ADOBE INC
  • US8620029B2 patent drawing
  • US8620029B2 patent drawing
  • US8620029B2 patent drawing

AI summary

Systems and methods for identifying, tracking, and using objects in a video or similar electronic content, including methods for tracking one or more moving objects in a video. This can involve tracking one or more feature points within a video scene and separating those feature points into multiple layers based on motion paths. Each such motion layer can be further divided into different clusters, for example, based on distances between points. These clusters can then be used as an estimate to define the boundaries of the objects in video. Objects can also be compared with one another in cases in which identified objects should be combined and considered a single object. For example, if two objects in the first two frames have significantly overlapping areas, they may be considered the same object. Objects in each frame can further be compared to determine the life of the objects across the frames.