Digital Image Error Concealment via Edge-Aware Pixel Replacement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Digital image processing systems face errors due to coarse motion estimation algorithms and occlusion issues, leading to artifacts like 'haloing' around object boundaries, as they fail to accurately measure motion at pixel level and handle occlusion effectively.
Innovation Solution
A method that compares pixel values in a current frame to modified reference values based on motion vectors, determining error pixel locations and performing edge or texture searches to find replacement values, improving image quality by using in-painting techniques and motion vector profiles to decide between foreground and background information for error concealment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If coarse motion estimation algorithms are used, then device complexity is reduced, but measurement precision and image quality deteriorate
Solution Approach 1:
The patent divides the image into multiple blocks (e.g., 8x8 or 16x16 pixel blocks) and performs motion estimation independently on each block. This segmentation allows the use of simpler, coarser motion estimation algorithms on smaller units while maintaining overall measurement precision through the accumulation of block-level motion information.
2Device complexity
If block based motion estimation is used, then device complexity is reduced, but measurement precision around object boundaries deteriorates
Solution Approach 1:
The patent applies different motion estimation strategies to different regions of the image based on their characteristics. Regions with smooth motion are processed with standard block-based estimation, while regions around object boundaries use enhanced techniques that consider temporal information and edge detection to maintain precision despite the coarser block-based approach.
3Productivity
If motion compensated interpolation is used, then productivity is improved, but reliability of occluded region handling deteriorates
Solution Approach 1:
The patent performs preliminary actions by analyzing motion vectors and identifying potential occlusion regions before generating the final interpolated frame. By detecting when an object is moving across the frame boundary and predicting occlusion events in advance, the system can apply special handling techniques to maintain reliability while still benefiting from the speed of motion compensated interpolation.
4Reliability
If error concealment is applied to all pixels, then reliability is improved, but device complexity and processing time increase
Solution Approach 1:
The patent applies error concealment selectively only to pixels that are identified as erroneous or problematic, rather than processing all pixels uniformly. By first identifying which pixels need correction (those with large motion estimation errors or in occluded regions) and then applying concealment techniques only to those specific pixels, the system improves reliability without the excessive computational cost of processing the entire image.
Data Source
AI summary
In one embodiment the present invention includes a digital image processing method for concealing errors. The method includes determining error pixel locations based on motion vectors and determining if the error pixel locations in a current frame are on an edge of an object in the current frame. If an error pixel location is on an edge, then a search of pixel values is performed in the current frame along the edge for a replacement pixel value. If the error pixel location is not on an edge, then a search of pixel values is performed in a region adjacent to the edge for the replacement pixel value.


