Image Interpolation via Motion Fidelity Classification

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Motion compensation systems fail to accurately interpolate images due to imperfect motion estimation, particularly in areas with complex motion or occlusion, leading to decreased perceptual quality of interpolated images.

Innovation Solution

A method that determines fidelity information for motion vectors to assess their accuracy and classification information to identify motion types, allowing for the selection of appropriate interpolation methods for complex and uniform motion areas, thereby improving the interpolation process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a single interpolation method is used for all image areas, then the device complexity is low, but the perceptual quality of interpolated images deteriorates in complex motion areas

Engineering Contradiction:

Improveperceptual quality of interpolated imagesVSAvoidcomplexity of interpolation system

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies different interpolation methods to different image areas based on motion complexity classification. Complex motion areas use robust interpolation methods while uniform motion areas use standard motion compensation, achieving local optimization of image quality without applying complex methods globally

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The image is segmented into different motion types (complex and uniform) based on motion vector analysis. This segmentation allows the system to select appropriate interpolation methods for each segment, improving overall quality while managing computational complexity

Inventive Principle:

Principle #1Segmentation

2Manufacturing precision

If robust interpolation methods are applied to all image areas, then the perceptual quality improves, but the computing time and memory resources increase significantly

Engineering Contradiction:

Improveperceptual quality of interpolated imagesVSAvoidcomputing time and processing efficiency

Core Design Contradiction:

Manufacturing precisionVSProductivity

Solution Approach 1:

Robust interpolation methods are applied only to complex motion areas where they are needed, while uniform motion areas use simpler standard methods. This local application maintains image quality where necessary while preserving processing efficiency in simpler areas

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent applies the more computationally intensive robust interpolation method only partially - specifically to complex motion areas identified through motion vector analysis - rather than applying it excessively to the entire image, thus balancing quality improvement with processing efficiency

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS8340186B2Method for interpolating a previous and subsequent image of an input image sequence

Publication Date: 2012.12.25 SONY DEUT GMBH

AI summary

A method for interpolating a previous and subsequent image of an input image sequence, including: determining fidelity information for at least one motion vector that is descriptive for motion between a previous and subsequent image, wherein the fidelity information is descriptive for the level and accuracy of the motion, determining classification information for the at least one motion vector, wherein the classification information depends on the fidelity information, the classification information being descriptive for the motion type of the motion, and selecting an interpolation method in dependence of the determined classification information.