Structured-Stereo Imaging Assembly with Separate Wavelength Imagers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Structured-stereo imaging assemblies face challenges with crosstalk between IR and RGB pixels, misalignment of imagers, and reduced accuracy in low-light and low-texture scenes, particularly due to ambient IR interference and the inability to project IR patterns over long distances.
Innovation Solution
The use of separate imager sub-arrays for different wavelengths, including IR, UV, and RGB sensors, with dedicated optical elements to reduce crosstalk and aberrations, and processors to align and process images for improved depth information and accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If combined IR/RGB CFA is used to capture both IR and visible light, then depth information can be obtained in various lighting conditions, but crosstalk between IR and RGB pixels reduces image quality
Solution Approach 1:
The patent divides the imaging system into separate IR-sensitive imager and RGB-sensitive imager sub-arrays, physically segmenting the pixel arrays to eliminate crosstalk between IR and RGB pixels while maintaining the capability to capture depth information in various lighting conditions
2Device complexity
If combined IR/RGB CFA is used, then a single imager captures multiple wavelengths, but dedicated wavelength-specific optical elements cannot be incorporated leading to chromatic aberrations
Solution Approach 1:
The patent segments the imager into separate sub-arrays for IR and RGB wavelengths, allowing each sub-array to have its own dedicated optical elements (IR lens for IR pixels, RGB lens for RGB pixels) optimized for specific wavelength ranges, thereby eliminating chromatic aberrations
Solution Approach 2:
Different optical elements with wavelength-specific properties are assigned to different regions (IR sub-array vs RGB sub-array), allowing each region to have optimal optical characteristics for its designated wavelength range
3Adaptability or versatility
If combined IR/RGB CFA is used without IR-cut filters, then IR radiation can be captured, but RGB pixels sense excessive IR radiation causing significant noise
Solution Approach 1:
The patent segments the pixel array into IR-sensitive pixels and RGB-sensitive pixels, with the IR sub-array positioned to receive IR radiation through an IR lens, while the RGB sub-array is protected from excessive IR by its wavelength-specific lens, preventing IR-induced noise in RGB pixels
4Measurement precision
If stereoscopic image capture is used, then depth information can be obtained, but pixel matching becomes challenging in low-texture or low-light scenes
Solution Approach 1:
The patent uses the projected IR pattern (which appears as intensity variations to the IR imager) to create artificial texture in low-texture scenes, enabling reliable pixel matching for stereoscopic depth extraction in conditions where natural texture is insufficient
5Measurement precision
If projected IR pattern is used for structured light, then depth information can be obtained in low-light and low-texture objects, but the technique cannot be used when ambient IR is high (outdoors)
Solution Approach 1:
The patent segments the imaging system to include both structured-light capability (IR pattern projection with IR imager) and passive stereoscopic capability (RGB imagers), allowing the system to switch between active structured-light mode for indoor low-texture objects and passive stereoscopic mode for outdoor scenes with high ambient IR
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables high-quality 3D imaging under low-light conditions and in low-texture environments, correcting for misalignment and enhancing depth map accuracy by using separate wavelength imagers and advanced image processing techniques.
Implementation Method 1
a first imager to sense light of a first wavelength or range of wavelengths
Implementation Method 2
a second imager to sense light of a different second wavelength or range of wavelengths
Implementation Method 3
the projected pattern often uses infra-red (IR) radiation
Data Source
AI summary
The present disclosure describes structured-stereo imaging assemblies including separate imagers for different wavelengths. The imaging assembly can include, for example, multiple imager sub-arrays, each of which includes a first imager to sense light of a first wavelength or range of wavelengths and a second imager to sense light of a different second wavelength or range of wavelengths. Images acquired from the imagers can be processed to obtain depth information and/or improved accuracy. Various techniques are described that can facilitate determining whether any of the imagers or sub-arrays are misaligned.