Image Component Separation Using Polarization and Color Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image separation techniques using polarization and color information face inaccuracies, particularly near occluding edges and when the object color vector is unknown, leading to insufficient accuracy in separating specular and diffuse reflection components, which is exacerbated by the expanding dynamic range of cameras.
Innovation Solution
An image processing apparatus that projects linearly polarized light and uses a combination of color and polarization information to separate images into components, employing a polarizer with multiple polarization principal axis directions, a color filter, and an image sensor to generate color and polarization information, allowing for accurate separation of specular and diffuse reflection components by considering the polarization component of diffuse reflection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional image separation techniques using polarization information are used, then the separation of specular and diffuse reflection components can be performed, but the accuracy deteriorates near occluding edges and when object color vector is unknown
Solution Approach 1:
The patent combines polarization information and color information into a unified image separation framework. By merging these two types of information, the system achieves accurate separation of specular and diffuse reflection components across all regions including occluding edges, and without requiring knowledge of the object color vector. The combined approach leverages the complementary strengths of polarization (for distinguishing reflection types) and color (for capturing spectral characteristics), resolving the limitations of using either method alone.
2Device complexity
If only polarization information is used for image separation, then the device complexity is reduced, but the measurement precision deteriorates in certain regions
Solution Approach 1:
The patent merges polarization information acquisition with color information acquisition in a single integrated system. The image capturing device includes both a polarizer and color filters, allowing simultaneous capture of polarization and color data. This combination enables accurate separation near occluding edges where polarization-only methods fail, while maintaining reasonable device complexity through shared optical paths and processing infrastructure.
3Productivity
If conventional image separation techniques are used, then processing can be performed on separated components, but the loss of information occurs when object color vector is unknown
Solution Approach 1:
The patent employs feedback mechanisms in the image separation process. The separation algorithm iteratively refines the decomposition of image components by comparing the separated results with the original image and adjusting the separation parameters accordingly. This feedback loop allows the system to recover accurate specular and diffuse reflection components even when the object color vector is initially unknown, preventing information loss that would otherwise occur in single-pass separation methods.
Solution Approach 2:
By combining polarization and color information, the system gains additional constraints and data for the separation process. The color information provides spectral characteristics that complement the polarization information, enabling more accurate recovery of reflection components without losing information about the object's appearance. This merged information set allows for complete reconstruction of the original image from its separated components.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables precise separation of image components, improving the accuracy of model-based image synthesis and enhancing the fidelity of object images by utilizing both polarization and color information effectively.
Implementation Method 1
a polarizer with multiple polarization principal axis directions
Implementation Method 2
a color filter
Implementation Method 3
an image sensor to generate color and polarization information
Implementation Method 4
a specular reflection component, which is a part of incoming light that has been reflected from the object
Implementation Method 5
a diffuse reflection component, which is sensed after the incoming light has been scattered a number of times inside the object
Data Source
AI summary
An image processing apparatus captures an object's image and separates the object's image into multiple components. The apparatus includes: a light projecting section 101 for projecting light emitted from a light source toward the object; a color and polarization obtaining section 102 for getting a color polarized image of the object; a polarization information processing section 104 for generating color and polarization information based on an association between the intensity of the light that has been transmitted through a polarizer with three or more polarization principal axis directions and the polarization principal axis directions for each of unit pixels that form the color polarized image; a light source color information collecting section 105 for collecting color information of the light source; and an image component separating section 106 for separating the color image into multiple components based on the polarization information and the color information of the light source.