Image Sensor Polarization Color Mosaic Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional techniques fail to obtain a color image and a polarized image representing the degree of partial polarization of an object simultaneously without time lag, leading to imperfect polarized images and color differences due to the use of single-type polarization pixels and inadequate pixel arrangements.
Innovation Solution
An image processing apparatus using a patterned polarizer with multiple types of polarizer units combined with a color mosaic filter, allowing for simultaneous acquisition and processing of color intensity and polarization information by interpolating data from surrounding polarization pixels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a liquid crystal polarizer is used to control polarization, then color moving picture and polarization information can be obtained, but a time lag of several frames occurs between color image and polarized image
Solution Approach 1:
The image capture device divides the sensor array into multiple pixel groups, where some pixels are equipped with polarization filters while others are not. This segmentation allows simultaneous capture of both polarized and non-polarized light information in a single frame, eliminating the time lag inherent in sequential capture methods using liquid crystal polarizers.
Solution Approach 2:
The patent transitions from temporal multiplexing (sequential frame-based polarization control) to spatial multiplexing (pixel-based parallel polarization measurement). By distributing polarization and non-polarization pixels across the sensor array, the system captures polarization information and color information simultaneously in the spatial domain, eliminating time lag.
2Loss of time
If a patterned polarizer with multiple polarization axes is used, then color image and polarized image can be obtained simultaneously, but only monochrome image and polarized image are obtained
Solution Approach 1:
The sensor is divided into polarization pixels and non-polarization pixels. Non-polarization pixels capture full color information using standard color filters, while polarization pixels capture polarized light intensity. This segmentation enables simultaneous acquisition of both color and polarization data without the monochrome limitation.
Solution Approach 2:
Different regions of the sensor array have different functional properties: some pixels are optimized for polarization measurement while others are optimized for color capture. This local differentiation allows the system to maintain color information quality in non-polarization pixels while obtaining polarization data from polarization pixels.
3Loss of time
If polarization filter is arranged for only G pixels in Bayer mosaic, then color image and polarization information can be obtained simultaneously, but perfect polarization information and accurate color information cannot be obtained
Solution Approach 1:
The patent extends polarization pixel distribution beyond just green pixels to include red and blue pixels as well. This broader segmentation allows polarization information to be captured across the entire visible spectrum, enabling accurate calculation of polarization degree and phase while maintaining color information integrity.
Solution Approach 2:
Instead of limiting polarization measurement to only green pixels (partial action), the patent implements polarization measurement across multiple color channels (excessive action). This over-sampling of polarization information across R, G, and B pixels enables more accurate polarization calculation and provides redundancy for better measurement precision.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and simultaneous capture of color and polarization information, reducing color differences and improving the resolution of polarized images by utilizing multiple polarizer units and advanced interpolation methods.
Implementation Method 1
a patterned polarizer with multiple types of polarizer units combined with a color mosaic filter, allowing for simultaneous acquisition and processing of color intensity and polarization information
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An image processing apparatus according to the present invention includes: a color and polarization obtaining section 101 including a single-chip color image capture device that has a color mosaic filter 201 and a patterned polarizer 202 in which a number of polarizer units, having polarization transmission planes defining mutually different angles, are provided for multiple pixels of the same color (G) in the color mosaic filter 201; a polarization information processing section 103 for approximating, as a sinusoidal function, a relation between the intensities of light rays that have been transmitted through the polarizer units for the G pixels and the angles of the polarization transmission planes of the polarizer units; and a color mosaic interpolation section 103 for generating a color intensity image by performing color intensity interpolation and getting a color intensity that cannot be obtained at a pixel of interest.