Polarization Camera High-Resolution Imaging Without Moving Light Source
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing technologies face challenges in increasing image resolution beyond the limits of existing image sensors, particularly in capturing high-resolution images without moving the light source over a long distance, which is impractical for portable devices.
Innovation Solution
An image processor that uses polarized light with a polarization plane changing between 0 to 135 degrees to estimate normals within a single pixel, allowing for high-resolution image generation without moving the light source, utilizing a polarization camera with patterned polarizers and a resolution increasing processing section to separate specular and diffuse reflections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the resolution of image sensors is increased to meet high-resolution imaging demands, then the image quality and resolution are improved, but the size of the camera becomes larger and more difficult to miniaturize
Solution Approach 1:
The patent replaces the mechanical/optical approach of increasing sensor resolution with a computational image processing approach. By using resolution increasing processing that analyzes intensity variations across multiple images taken with different polarization planes, the system achieves high-resolution output without requiring higher-resolution physical sensors, thus maintaining compact camera size.
Solution Approach 2:
The patent changes the polarization plane parameter of light to extract additional information from the same physical pixel. By capturing images with polarization planes at different angles (0°, 45°, 90°, 135°) and processing the intensity variations, the system generates high-resolution normal images without physically subdividing the pixel structure.
2Ease of manufacture
If conventional intensity-based association techniques are used to detect motion between image frames, then the technique is simple to implement, but it becomes difficult to detect motion magnitude in areas with specular reflection
Solution Approach 1:
The patent uses polarization plane angle changes as an additional dimension of light property variation (analogous to color changes). By analyzing how intensity varies with polarization angle rather than relying solely on temporal intensity changes, the system can detect surface normals even in specular reflection areas where conventional motion detection fails.
3Measurement precision
If a dedicated lighting system with moved light source is used to capture images from various angles, then the resolution increasing accuracy is improved, but the device complexity and portability are worsened
Solution Approach 1:
The patent replaces the mechanical lighting system that physically moves the light source with a computational approach using polarization filtering. By using a polarization camera or adding polarization filters to existing images, the system achieves the effect of viewing the object from different lighting angles without any physical movement of light sources or cameras.
Solution Approach 2:
The patent introduces polarization filters as an intermediary between the light source and the image sensor. These filters selectively transmit light based on polarization plane orientation, enabling the extraction of surface normal information without requiring physical repositioning of the lighting system.
4Measurement precision
If multiple images are captured with the light source moved to estimate surface normals, then the normal estimation accuracy is improved, but the time required for image capture increases
Solution Approach 1:
The patent uses periodic variation of the polarization plane angle to capture multiple views of the same scene. By rotating the polarization filter through fixed angles (0°, 45°, 90°, 135°) and capturing images at each position, the system obtains the necessary data for normal estimation in a systematic, time-efficient manner compared to physically moving the light source.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the estimation of microscopic surface structures within a single pixel, achieving high-resolution images without the need for a dedicated lighting system, suitable for both still and moving images, and applicable to various imaging devices.
Implementation Method 1
a polarized light source for irradiating a surface of an object with polarized light which is linearly polarized light of which a polarization plane changes sequentially
Implementation Method 2
detecting a magnitude of variation in intensity of the intensity image when the polarization plane changes
Implementation Method 3
separate specular and diffuse reflections
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
An image processor (101) according to a preferred embodiment of the present invention includes a polarized light source (102) and a polarization camera (103). In shooting an object (104), the object is irradiated with polarized light (105) that rotates its polarization plane. The polarized light is reflected from the object's surface and the polarized reflected light (106) reaches the polarization camera (103), thereby recording an image there. The polarization camera (103) includes a polarization image sensor (201), an intensity and polarization information processing section (202), a polarization plane control section (204), and an image capturing control section (205). By capturing an image every time the polarization plane control section (204) changes the polarization state of the polarized light, an intensity image Y and a polarization phase image P are obtained in association with each polarization state. Using these images, a resolution increasing processing section (203) generates a high-resolution normal image (208) and a high resolution intensity image (209).