Motion Compensation for Periodic Structures in Video

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Motion compensation circuits in picture rate converters often result in visual disruptions, such as temporal discontinuities or breaks, due to the presence of periodic structures in video frames, leading to suboptimal image quality during frame rate up-conversion.

Innovation Solution

A system and method for estimating motion in video signals that identifies segments with periodic structures, determines a dominant motion representation, and modifies motion vectors using autocorrelation and random sample consensus to correct incorrect motion vectors, thereby eliminating visual disruptions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If motion compensation circuits are used in picture rate converters to reduce blur and judder, then image quality is improved, but visual disruptions such as temporal discontinuities or breaks occur due to periodic structures

Engineering Contradiction:

Improveimage qualityVSAvoidvisual disruptions

Core Design Contradiction:

ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The image is divided into multiple blocks, and each block is independently analyzed for periodic structures. This segmentation allows the system to identify and handle periodic patterns in specific regions without affecting the entire image, thereby reducing visual disruptions while maintaining motion compensation benefits.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different processing approaches are applied to different regions of the image based on local characteristics. Blocks containing periodic structures receive specialized handling through modified motion vector selection, while other blocks use standard motion compensation. This local differentiation resolves the contradiction by applying corrections only where needed.

Inventive Principle:

Principle #3Local quality

2Productivity

If standard motion vector estimation is used for frame rate up-conversion, then processing speed is maintained, but incorrect motion vectors are selected due to periodic structures causing visual disruptions

Engineering Contradiction:

Improveprocessing speedVSAvoidmotion vector accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary detection of periodic structures in each block before final motion vector selection. By identifying periodic patterns in advance and adjusting motion vector candidates accordingly, the system prevents incorrect vector selection without requiring extensive post-processing, thus maintaining processing speed while improving accuracy.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from periodic structure detection to adjust motion vector estimation. When periodic structures are detected in a block, the motion vector selection process incorporates this information to avoid selecting incorrect vectors that would cause visual disruptions. This feedback mechanism improves accuracy while maintaining efficiency through targeted corrections.

Inventive Principle:

Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enhances the smoothness and quality of up-converted video by accurately estimating motion vectors, reducing visual disruptions and improving picture quality during frame rate conversion.

Implementation Method 1

detecting periodic structure information for the image using autocorrelation. The periodic structure information includes a pitch value and a confidence value for each of a plurality of regions of the image

Methodology Applied

Scientific EffectAutocorrelation:

Implementation Method 2

determines a dominant motion representation of the segment using random sample consensus. The dominant motion representation is used to modify certain motion vectors of the plurality of motion vectors

Methodology Applied

Scientific EffectRandom sample consensus:

Data Source

PatentUS9197891B1Systems and methods for periodic structure handling for motion compensation

Publication Date: 2015.11.24 SYNAPTICS INC

AI summary

Systems and methods for estimating motion in an image of a video signal are provided. A plurality of motion vectors for the image are estimated. A segment of the image is identified, where the segment is a portion of the image including a periodic structure. A dominant motion representation of the segment is determined. The dominant motion representation is used to modify certain motion vectors of the plurality of motion vectors.