Deinterleaving Interleaved High Dynamic Range Image Using YUV Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional high dynamic range (HDR) image processing techniques face challenges in preserving the dynamic range of scenes with high contrast, leading to saturation in bright regions and under-exposure in dark regions, and the deinterleaving process of interleaved images results in lower spatial resolution and sampling artifacts.
Innovation Solution
A computer-implemented method that demosaics source image data into an intermediate color space (YUV) before deinterleaving and interpolation, allowing for higher frequency sampling and improved image quality by blending short and long exposure frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If deinterleaving is performed in Bayer mosaic space, then the deinterleaving process can be implemented, but the spatial resolution significantly decreases and sampling artifacts increase
Solution Approach 1:
The patent introduces an intermediary color space (YUV) as a mediator between the Bayer mosaic space and the final deinterleaved image. By converting Bayer data to YUV color space before deinterleaving, the process maintains higher spatial resolution while still achieving effective separation of long and short exposure data. The YUV color space serves as a transitional domain that preserves more spatial information than direct Bayer space deinterleaving.
2Productivity
If deinterleaving is performed in Bayer mosaic space, then the process can be completed, but sampling artifacts and aliasing effects increase
Solution Approach 1:
The YUV color space acts as an intermediary that reduces sampling artifacts. The conversion to YUV before deinterleaving allows for better preservation of spatial frequencies and reduces aliasing effects that would otherwise appear in the final image. This intermediary step maintains processing efficiency while significantly reducing harmful sampling artifacts.
3Ease of operation
If one performs arithmetic operations between components of the same color filter value in Bayer space, then deinterleaving can be achieved, but only 1/4 of the possible image information is available
Solution Approach 1:
The patent changes the parameter space from RGB color components in Bayer mosaic to YUV color space components. This parameter transformation allows for more efficient utilization of available image information during deinterleaving. By operating in YUV space, the method can access and process all available pixel information rather than being restricted to only 1/4 of the information that would be available through same-color-filter arithmetic operations in Bayer space.
Data Source
AI summary
Systems and methods for generating high dynamic images from interleaved Bayer array data with high spatial resolution and reduced sampling artifacts. Bayer array data are demosaiced into components of the YUV color space before deinterleaving. The Y component and the UV components can be derived from the Bayer array data through demosiac convolution processes. A respective convolution is performed between a convolution kernel and a set of adjacent pixels of the Bayer array that are in the same color channel. A convolution kernel is selected based the mosaic pattern of the Bayer array and the color channels of the set of adjacent pixels. The Y data and UV data are deinterleaved and interpolated into frames of short exposure and long exposures in the second color space. The short exposure and long exposure frames are then blended and converted back to a RGB frame representing a high dynamic range image.