Image Processing Apparatus Motion Vector Region Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques, such as RANSAC, require numerous iterations to accurately estimate motion parameters from motion vectors, especially when the outlier ratio is high, leading to increased processing time and reduced efficiency in applications like digital image-stabilization.

Innovation Solution

An image processing apparatus that calculates representative motion vectors for each region of a frame and extracts similar motion vectors based on a predetermined tolerance, reducing the outlier ratio and shortening the processing time by using these vectors to estimate motion parameters.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If RANSAC is used to estimate motion parameters from motion vectors with high outlier ratio, then estimation accuracy is improved, but the number of iterations increases and processing time is extended

Engineering Contradiction:
Improvemotion parameter estimation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing region division and calculating representative motion vectors for each region before the main RANSAC estimation process. This preprocessing step organizes and filters motion vectors in advance, reducing the outlier ratio and enabling the subsequent RANSAC algorithm to converge faster with fewer iterations, thus resolving the contradiction between accuracy and processing time

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the image into multiple regions and calculates representative motion vectors for each region separately. This segmentation approach filters out inconsistent motion vectors at the regional level before global estimation, reducing the outlier ratio and improving RANSAC efficiency, thereby achieving both high accuracy and reduced processing time

Inventive Principle:
Principle #1Segmentation

2Reliability

If the number of iterations of RANSAC is increased to handle high outlier ratio, then robustness of estimation is improved, but productivity is reduced

Engineering Contradiction:
Improverobustness of estimationVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent performs preliminary region-based motion vector analysis to identify and filter outliers before the main estimation process. This preliminary action increases the robustness of the subsequent RANSAC algorithm by providing cleaner input data, allowing the system to achieve reliable estimation with fewer iterations and thus maintaining high productivity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

By segmenting the image into regions and analyzing motion vectors locally, the patent improves the reliability of motion parameter estimation by reducing the impact of outliers. This segmentation enables the system to maintain high robustness while reducing the number of RANSAC iterations needed, thereby preserving processing efficiency

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10051274B2Image processing apparatus, method of calculating information according to motion of frame, and storage medium
Publication Date: 2018.08.14 CANON KK
  • US10051274B2 patent drawing
  • US10051274B2 patent drawing
  • US10051274B2 patent drawing

AI summary

An image processing apparatus that calculates information according to a motion of a frame of a moving image based on a motion vector detected in the frame decides the representative motion vector of each of a plurality of regions in the frame based on the detected motion vector, and calculates the information according to the motion of the frame based on, out of the motion vectors in each of the plurality of regions, a motion vector whose difference from the representative motion vector of each region is smaller than a predetermined value.