Image Inpainting for Compression Artifact Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image and video processing technologies suffer from artifacts caused by video compression, particularly around objects, and misalignment of depth information with object boundaries, leading to decreased image quality and interference with subsequent processing tasks.
Innovation Solution
A method that performs foreground/background segmentation based on depth or disparity information, creates an area around segmentation transitions, and applies foreground/background-dependent processing to correct artifacts by inpainting background or foreground information, thereby reducing compression artifacts and depth misalignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If lossy video compression schemes are used, then video compression efficiency is improved, but compression artifacts are introduced around objects
Solution Approach 1:
The patent extracts and isolates the problematic regions (areas around objects) where compression artifacts occur. By segmenting the image into foreground and background based on depth information, the system identifies specific regions that require special processing to remove artifacts while preserving compression efficiency for the overall video stream.
Solution Approach 2:
The patent applies different processing qualities to different regions of the image. Instead of uniformly processing the entire image, it applies enhanced artifact removal only to local regions around objects where artifacts are present, while maintaining standard compression for other areas, thus balancing quality and efficiency.
2Measurement precision
If semi-automated depth creation through annotation-and-propagation is used, then depth map generation is improved, but depth misalignment with object boundaries occurs
Solution Approach 1:
The patent uses feedback from the segmented image and depth information to iteratively refine the depth map. By analyzing the segmentation transitions and comparing them with the depth data, the system identifies misalignments and corrects them through inpainting techniques, progressively improving depth accuracy.
Solution Approach 2:
The patent performs preliminary segmentation based on depth information before performing the actual depth correction. This preliminary action identifies which regions require depth adjustment, allowing the subsequent inpainting process to target specific areas and improve alignment efficiency.
3Object-affected harmful factors
If inpainting techniques are applied to correct artifacts, then image quality is improved, but processing complexity increases
Solution Approach 1:
The patent segments the image into foreground and background regions based on depth information before applying inpainting. This segmentation allows the complex inpainting process to be divided into manageable regions, each processed independently with appropriate techniques, reducing overall computational complexity while maintaining quality.
Solution Approach 2:
The patent applies inpainting only to the extent necessary to correct artifacts in specific regions rather than processing the entire image uniformly. By targeting only the problematic areas around objects, the system reduces processing complexity and computational load while achieving the desired quality improvement.
Data Source
Figure 1a~1b
Figure 2~3
Figure 4a~4b
AI summary
A method of processing an image signal comprising image and depth information is provided. The method is configured to perform segmentation on an image based on depth/disparity information present in the image signal comprising said image, and subsequently inpaint background for correction of the errors in the image around the foreground objects into a region that extends beyond the segment boundary of the foreground object and/or inpaint foreground for correction of errors in the image into a region that extends inside the segment boundary of the foreground object. In this way compression and other artifacts may be reduced.