Image Interpolation Using Reference Band Selection for High-Frequency Component Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging devices face challenges in generating high-resolution interpolated images with a large amount of high-frequency components while maintaining frame rate, especially when using multiband image sensors with low sampling density bands that have high correlation with object color characteristics.
Innovation Solution
An image processing device that acquires data from multiple frames with a color filter array, performs alignment and interpolation processes to select a reference band based on color characteristics, and generates interpolated images using integrated data, allowing for high-frequency component reproduction regardless of object color characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a multiband image sensor with low sampling density bands is used to capture images, then the device complexity is reduced and frame rate is maintained, but the measurement precision of high-frequency components deteriorates
Solution Approach 1:
The patent performs alignment processing on multiple frames before interpolation to pre-align the low sampling density band data with high sampling density band data. This preliminary alignment ensures that when interpolation is performed, the high-frequency components can be accurately reconstructed despite the low sampling density, resolving the contradiction between simplified sensor structure and measurement precision.
Solution Approach 2:
The patent introduces high sampling density band data as an intermediary to assist in reconstructing the low sampling density band data. By using the high sampling density band as a reference during interpolation, the system can recover high-frequency components that would otherwise be lost due to low sampling density, thereby maintaining measurement precision while using a simplified multiband sensor.
2Productivity
If interpolation is performed on low sampling density band data without reference to other bands, then the processing speed is maintained, but the manufacturing precision of the interpolated image deteriorates
Solution Approach 1:
The patent merges multiple bands (high sampling density band and low sampling density band) into a single interpolation process. By combining the strengths of different bands and performing joint interpolation with alignment, the system achieves both high processing speed and high interpolated image quality, resolving the contradiction between productivity and manufacturing precision.
3Reliability
If multiple frames are acquired and aligned to generate integrated captured image data, then the reliability of high-frequency component reproduction is improved, but the loss of time increases
Solution Approach 1:
The patent performs alignment processing as a preliminary step before interpolation, organizing the multiple frame data in advance. This preliminary action enables the subsequent interpolation to proceed efficiently with pre-aligned data, reducing the overall processing time while maintaining reliable high-frequency component reproduction through the use of multiple frames.
Data Source
AI summary
An image processing device includes: an image acquisition section that acquires captured image data captured using an image sensor including color filters corresponding to bands, and corresponding to a plurality of frames; an alignment processing section that performs an alignment process on the captured image data to generate integrated captured image data; a reference band selection section that selects a reference band from the bands using an output image in a preceding frame; a reference image generation section that performs an interpolation process on image data included in the integrated captured image data and corresponding to the color filter corresponding to the reference band; and an interpolated image generation section that performs an interpolation process on image data included in the integrated captured image data and corresponding to the color filter corresponding to a band differing from the reference band based on a reference image to generate an interpolated image.