Digital Image Error Concealment via Edge-Aware Pixel Replacement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital image processing systems face errors due to coarse motion estimation algorithms and occlusion issues, leading to artifacts like 'haloing' around object boundaries, as they fail to accurately measure motion at pixel level and handle occlusion effectively.

Innovation Solution

A method that compares pixel values in a current frame to modified reference values based on motion vectors, determining error pixel locations and performing edge or texture searches to find replacement values, improving image quality by using in-painting techniques and motion vector profiles to decide between foreground and background information for error concealment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If coarse motion estimation algorithms are used, then device complexity is reduced, but measurement precision and image quality deteriorate

Engineering Contradiction:
Improvemotion estimation algorithm complexityVSAvoidmotion measurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent divides the image into multiple blocks (e.g., 8x8 or 16x16 pixel blocks) and performs motion estimation independently on each block. This segmentation allows the use of simpler, coarser motion estimation algorithms on smaller units while maintaining overall measurement precision through the accumulation of block-level motion information.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If block based motion estimation is used, then device complexity is reduced, but measurement precision around object boundaries deteriorates

Engineering Contradiction:
Improvemotion estimation complexityVSAvoidmotion measurement precision around boundaries
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies different motion estimation strategies to different regions of the image based on their characteristics. Regions with smooth motion are processed with standard block-based estimation, while regions around object boundaries use enhanced techniques that consider temporal information and edge detection to maintain precision despite the coarser block-based approach.

Inventive Principle:
Principle #3Local quality

3Productivity

If motion compensated interpolation is used, then productivity is improved, but reliability of occluded region handling deteriorates

Engineering Contradiction:
Improveframe generation speedVSAvoidocclusion handling reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent performs preliminary actions by analyzing motion vectors and identifying potential occlusion regions before generating the final interpolated frame. By detecting when an object is moving across the frame boundary and predicting occlusion events in advance, the system can apply special handling techniques to maintain reliability while still benefiting from the speed of motion compensated interpolation.

Inventive Principle:
Principle #10Preliminary action

4Reliability

If error concealment is applied to all pixels, then reliability is improved, but device complexity and processing time increase

Engineering Contradiction:
Improveimage quality reliabilityVSAvoiderror concealment processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies error concealment selectively only to pixels that are identified as erroneous or problematic, rather than processing all pixels uniformly. By first identifying which pixels need correction (those with large motion estimation errors or in occluded regions) and then applying concealment techniques only to those specific pixels, the system improves reliability without the excessive computational cost of processing the entire image.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8787696B1Method and apparatus for replacing a block of pixels in a digital image frame to conceal an error associated with the block of pixels
Publication Date: 2014.07.22 SYNAPTICS INC
  • US8787696B1 patent drawing
  • US8787696B1 patent drawing
  • US8787696B1 patent drawing

AI summary

In one embodiment the present invention includes a digital image processing method for concealing errors. The method includes determining error pixel locations based on motion vectors and determining if the error pixel locations in a current frame are on an edge of an object in the current frame. If an error pixel location is on an edge, then a search of pixel values is performed in the current frame along the edge for a replacement pixel value. If the error pixel location is not on an edge, then a search of pixel values is performed in a region adjacent to the edge for the replacement pixel value.