Double Motion Vector Confirmation for Occluded Region Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing frame interpolation methods face difficulties in accurately estimating motion vectors for occluded regions in images, where background areas become covered or uncovered by moving objects, leading to flickering artifacts and poor image quality.

Innovation Solution

The method employs a double confirmation process of motion vectors by comparing vectors between phases to determine if a region is occluded, allowing for further processing and accurate selection of motion vectors, which involves Fourier transformation, phase plane correlation, and 3D recursive analysis to identify occluded regions and adjust motion vectors accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If motion estimation techniques are used to compensate for moving objects, then frame interpolation quality is improved, but difficulty in selecting correct motion vectors increases in occluded regions

Engineering Contradiction:
Improveframe interpolation qualityVSAvoidmotion vector selection difficulty
Core Design Contradiction:
Manufacturing precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent divides the image into multiple blocks and processes each block independently to determine motion vectors. By segmenting the image, the system can identify occluded regions at the block level and apply different motion vector selection strategies for occluded versus non-occluded areas, reducing the overall difficulty of motion vector selection while maintaining interpolation quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary processing by analyzing motion vectors from previous frames and identifying potential occluded regions before final motion compensation. This preliminary action allows the system to prepare alternative motion vector candidates and processing strategies in advance, making the final motion vector selection easier and more accurate in occluded regions.

Inventive Principle:
Principle #10Preliminary action

2Ease of manufacture

If frame rate is increased by repeating the most recent frame, then frame interpolation is simplified, but flickering artifacts appear in moving object regions

Engineering Contradiction:
Improveframe interpolation simplicityVSAvoidflickering artifacts
Core Design Contradiction:
Ease of manufactureVSObject-generated harmful factors

Solution Approach 1:

The patent uses feedback from motion vector analysis to dynamically adjust the frame interpolation process. By continuously monitoring motion vectors and identifying occluded regions, the system can provide feedback to modify the interpolation algorithm, eliminating flickering artifacts while maintaining a relatively simple processing architecture.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes key parameters in the motion compensation process, such as adjusting motion vector weights, modifying block size parameters, and varying interpolation factors based on region type. These parameter changes enable the system to produce smooth transitions in moving object regions without flickering, while keeping the overall frame interpolation process simple and efficient.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9106926B1Using double confirmation of motion vectors to determine occluded regions in images
Publication Date: 2015.08.11 PIXELWORKS INC
  • US9106926B1 patent drawing
  • US9106926B1 patent drawing
  • US9106926B1 patent drawing

AI summary

An apparatus includes a phase plane conversion module to convert image data into at least two phases, a current phase and a previous phase, a first phase motion vector calculation module to generate a first phase motion vector field, a second phase motion vector calculation module to generate a second phase motion vector field, and a double check module to determine which vectors in the first and second phase motion vector fields are double confirmed and to identify regions in which the motion vectors are not double confirmed as occluded.