Image Interpolation Motion Vector Determination Using Similar Triangles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional picture interpolation mechanisms fail to accurately determine motion vectors for blocks in covered or uncovered areas, leading to image distortion and degraded output quality during frame rate conversion.

Innovation Solution

An image processing method and apparatus that generates first and second motion vectors for blocks within an interpolated picture, calculates a reference vector using the principle of similar triangles, and determines the correct motion vector based on whether the block is in a covered or uncovered area, using these vectors to find matching blocks in previous or next interpolated pictures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If block matching algorithm is used to determine motion vectors, then motion vectors can be calculated for visible blocks, but motion vectors cannot be determined for blocks in covered or uncovered areas, leading to image distortion

Engineering Contradiction:
Improvemotion vector determination accuracyVSAvoidapplicability to covered/uncovered areas
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent performs preliminary classification of blocks into covered/uncovered areas and visible blocks before motion vector calculation. By identifying which blocks are in covered or uncovered regions in advance, the system can apply different processing strategies: using reference vectors from adjacent visible blocks for covered/uncovered areas, and using block matching for visible blocks. This preliminary action enables accurate motion vector determination across all block types without distortion.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If conventional picture interpolation is performed, then frame rate conversion can be achieved, but image quality significantly degrades due to incorrect motion vectors in interpolated regions

Engineering Contradiction:
Improveframe rate conversion capabilityVSAvoidoutput image quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies different motion vector determination methods to different local regions: for visible blocks, block matching algorithm is used; for blocks in covered or uncovered areas, reference vectors from adjacent visible blocks are used. This local differentiation ensures that each region receives the most appropriate processing method, maintaining high image quality throughout the interpolated frame while enabling frame rate conversion.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If block matching algorithm finds background images in sequential pictures, then correct motion vectors can be determined for visible blocks, but the algorithm fails to find background images covered by foreground objects, resulting in incorrect motion vectors

Engineering Contradiction:
Improvemotion vector accuracy for visible blocksVSAvoidbackground images in covered areas
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent uses adjacent visible blocks as intermediaries to provide reference vectors for blocks in covered or uncovered areas. Instead of attempting to directly find background images in covered areas (which fails because they are occluded), the system uses motion vectors from neighboring visible blocks as reference vectors. These reference vectors act as intermediaries that carry the background motion information into the covered/uncovered regions, preventing information loss and ensuring accurate motion compensation throughout the entire frame.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8447126B2Image processing method and related apparatus
Publication Date: 2013.05.21 MEDIATEK INC
  • US8447126B2 patent drawing
  • US8447126B2 patent drawing
  • US8447126B2 patent drawing

AI summary

An image processing method is used for determining a motion vector of a covered/uncovered area within an interpolated picture when picture interpolation is performed. The interpolated picture includes a plurality of blocks, and the image processing method includes: generating a first motion vector and a second motion vector of a block within the interpolated picture; determining which one of the covered and uncovered areas the block is located in, and calculating a reference vector according to the first and second motion vectors; and determining a motion vector of the block according to the reference vector, wherein the reference vector is obtained from vector calculation of the first and second motion vectors using the principle of similar triangles.