Image Interpolation Using Auxiliary Information Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image interpolation methods face challenges in maintaining subjective image quality, especially when interpolating large or complex missing regions, as they often receive insufficient input information, leading to degraded output quality.
Innovation Solution
A coding device and system that utilize a network configuration including an auxiliary information extraction network, a missing image reference network, and a reconfiguration network to generate and refine intermediate images, minimizing pixel differences and optimizing learning parameters for improved interpolation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If a simple prediction rule is used for image compression, then the coding amount is reduced, but the prediction efficiency deteriorates for images with high-frequency components
Solution Approach 1:
The patent introduces an artificial reconfiguration process as an intermediary between the original image and the prediction process. By reconfiguring the image to concentrate high-frequency components in specific regions before prediction, the simple prediction rule can achieve better efficiency without increasing coding complexity
Solution Approach 2:
The patent transforms the image parameters by applying artificial reconfiguration that concentrates high-frequency components. This changes the spatial distribution of frequency components, making the image more suitable for simple prediction rules while maintaining prediction efficiency
2Area of stationary object
If the area of missing region to be interpolated is increased, then the interpolation coverage is improved, but the amount of input information to the interpolation network decreases, degrading estimation accuracy
Solution Approach 1:
The patent performs preliminary encoding and transmits auxiliary information about the missing region before interpolation. This preliminary action provides the interpolation network with essential input information even when the missing region is large, maintaining estimation accuracy while achieving comprehensive coverage
Solution Approach 2:
The patent introduces auxiliary information as an intermediary that bridges the gap between the encoded data and the interpolation process. This auxiliary information contains essential cues about the missing region, enabling accurate interpolation even with limited direct input
3Adaptability or versatility
If the missing region includes complicated elements that cannot be estimated from reference regions, then the interpolation challenge increases, but the subjective image quality deteriorates
Solution Approach 1:
The patent introduces auxiliary information extraction and transmission as an intermediary mechanism that captures essential features of complicated elements before interpolation. This allows the interpolation network to reconstruct complex structures with higher fidelity, maintaining subjective image quality even for challenging regions
Solution Approach 2:
The patent transforms the representation of complicated elements by extracting and transmitting auxiliary information that encodes their essential characteristics. This parameter transformation enables accurate reconstruction of complex structures that cannot be directly estimated from reference regions
Data Source
AI summary
A coding device of the present invention for coding an image includes: a region acquiring unit configured to acquire a region of a first image that matches a predetermined condition; an image acquiring unit configured to obtain a second image by associating the first image, the acquired region, and a region obtained by removing the acquired region from the first image with each other; and a coding unit configured to code the second image. Also, an image interpolation system of the present invention for interpolating a first image includes: an acquiring unit configured to acquire the first image and auxiliary information by associating a second image, a matching region of the second image that matches a predetermined condition, and a region obtained by removing the matching region from the second image with each other; and an interpolating unit configured to interpolate the first image using the auxiliary information, and obtain an image that approximates the second image. With the present invention, it is possible to execute image interpolation processing while suppressing degradation of the subjective image quality.