Motion Vector Correction for Low-Reliability Blocks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing devices face challenges in efficiently calculating motion vectors between frames due to complexity and computational requirements, leading to longer processing times and larger circuit scales, especially when dealing with low-reliability blocks.

Innovation Solution

An image processing device that includes a motion vector calculator, reliability calculator, and corrector to set and correct motion vectors based on similarities and reliability distributions between frames, allowing for improved motion compensation and image processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion vectors are calculated for all pixels in a frame using block matching, then motion vector accuracy is improved, but processing time and circuit scale increase significantly

Engineering Contradiction:
Improvemotion vector accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The frame is divided into multiple blocks, and motion vectors are calculated for each block rather than all pixels. This segmentation reduces the computational load while maintaining acceptable motion vector accuracy for image processing tasks.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Motion vectors are calculated for only a representative subset of blocks rather than all pixels. This partial action approach provides sufficient motion information for noise reduction and other image processing functions without the excessive computational cost of full pixel-level calculation.

Inventive Principle:
Principle #16Partial or excessive action

2Reliability

If motion vectors are calculated for all pixels in a frame, then motion vector reliability is improved, but circuit scale increases

Engineering Contradiction:
Improvemotion vector reliabilityVSAvoidcircuit scale
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The calculation is segmented to process only representative blocks rather than all pixels. This reduces the circuit scale required for motion vector calculation while maintaining sufficient reliability for the intended image processing applications.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Motion vectors calculated for representative blocks are used as copies for corresponding pixels within those blocks. This copying approach avoids the need for complex circuits to calculate individual pixel motion vectors while maintaining adequate motion information reliability.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If motion compensation is performed using calculated motion vectors, then position alignment between frames is improved, but processing complexity increases

Engineering Contradiction:
Improveposition alignment accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Motion compensation is performed using motion vectors from a partial set of representative blocks rather than all pixels. This provides sufficient position alignment accuracy for noise reduction while avoiding excessive processing complexity.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10516825B2Image processing device, image processing method, and computer program product for correcting a motion vector of a low-reliability block
Publication Date: 2019.12.24 OLYMPUS CORPORATION(JP)
  • US10516825B2 patent drawing
  • US10516825B2 patent drawing
  • US10516825B2 patent drawing

AI summary

Motion vector calculator sets motion vector of block corresponding to partial area of first image based on the block and similarity between the block and partial area of second image, motion vector reliability calculator calculates reliability of the motion vector based on distribution of the similarities, motion vector corrector corrects motion vector of low-reliability block having reliability lower than predetermined reliability based on motion vector of high-reliability block different from the low-reliability block and having reliability equal to or higher than the predetermined reliability, and image processor sets second pixel of the second image and corresponds to first pixel of the first image based on the motion vector corrected by the motion vector corrector, and performs image processing using signal value of the first pixel and signal value of the second pixel.