Image Processing Device Tracking Feature Points by Matching Degree

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing technologies fail to ensure that feature points are tracked in a distribution suitable for the user's intended target, leading to suboptimal tracking control, especially as the scene changes due to factors like zooming or changes in composition.

Innovation Solution

An image processing apparatus that estimates the target of interest based on camera information and adjusts the distribution of feature points accordingly, using a processor to extract and track feature points, calculate a matching degree, and select which points to continue tracking based on this estimation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If tracking control is performed to maintain uniform distribution of feature points in the screen, then the tracking coverage is improved, but the suitability for user's target of interest deteriorates

Engineering Contradiction:

Improvetracking coverageVSAvoidtracking suitability

Core Design Contradiction:

Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent applies local quality by making different regions of the image have different tracking priorities. The target of interest region is identified and given higher tracking priority, while other regions have lower priority. This allows feature points in the target region to be tracked more reliably, improving tracking suitability for the user's interest while maintaining adequate coverage in other areas through the uniform distribution mechanism.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent implements dynamics by dynamically adjusting the tracking control based on the identified target of interest. The system continuously identifies the target region and adjusts tracking parameters accordingly, transitioning from a static uniform distribution approach to a dynamic adaptive approach that responds to changing scene content and user interest.

Inventive Principle:

Principle #15Dynamics

2Area of stationary object

If feature points are tracked uniformly across the screen, then the overall scene coverage is improved, but the reliability of tracking the user's target of interest deteriorates

Engineering Contradiction:

Improvescene coverageVSAvoidtracking reliability

Core Design Contradiction:

Area of stationary objectVSReliability

Solution Approach 1:

The patent enhances tracking reliability for the target of interest by applying local quality principles. Once the target region is identified, feature points within this region are assigned higher tracking priority and reliability weights. This ensures that tracking of the user's interest maintains high reliability while the uniform distribution mechanism preserves adequate scene coverage in non-target regions.

Inventive Principle:

Principle #3Local quality

3Stability of the object's composition

If the distribution of feature points is kept uniform in the screen, then the tracking stability is improved, but the adaptability to different scenes and user intentions deteriorates

Engineering Contradiction:

Improvetracking stabilityVSAvoidscene adaptability

Core Design Contradiction:

Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The patent resolves the contradiction between stability and adaptability by implementing a two-layer dynamic system. The underlying uniform distribution mechanism provides tracking stability, while the upper layer dynamically identifies target of interest and adjusts tracking priorities accordingly. This allows the system to adapt to different scenes and user intentions while maintaining overall tracking stability through the persistent uniform distribution framework.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent applies preliminary action by pre-establishing the uniform distribution framework for tracking stability, then performing preliminary identification of the target of interest to guide subsequent tracking adjustments. This preparatory identification allows the system to quickly adapt to new scenes without compromising the foundational stability provided by uniform distribution.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS10855918B2Image processing device, image processing method, image pickup apparatus, and program storage medium that calculates a matching degree between an estimated target of interest and tracked feature points, then selects a feature point to which tracking is continued according to the matching degree

Publication Date: 2020.12.01 CANON KK

AI summary

An image processing apparatus to perform tracking control of feature points estimated to a target of interest of a user. An image processing apparatus of the present invention acquires an image, extracts feature points of the image, tracks the feature points, estimates a target of interest in the image, calculates a matching degree indicating a degree of matching between the estimated target of interest and a distribution of the tracked feature points, and selects a feature point for which tracking will continue from the feature points according to the matching degree.