Combined Imaging And Depth Module With Spatial Pixel Separation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging systems face challenges in co-locating RGB and depth sensors, leading to spectral cross-talk, infrared light leakage, and inefficient power consumption due to the need for simultaneous and high-resolution RGB and depth data acquisition, which results in latency and distortion.
Innovation Solution
A combined RGBD module with co-located RGB and depth sensors, utilizing a dual-passband filter and separate acquisition times for RGB and depth data, along with shared processing circuitry across multiple SPAD pixels, to minimize spectral cross-talk and reduce power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If RGB and depth sensors are co-located to enable simultaneous acquisition, then imaging and depth sensing resolution are improved, but spectral cross-talk and infrared light leakage occur
Solution Approach 1:
The sensor array is segmented into distinct depth pixels and image pixels, with depth pixels containing SPADs for near-infrared detection and image pixels containing photodiodes for visible light detection. This spatial segmentation allows simultaneous acquisition while preventing spectral cross-talk through physical separation of sensor types.
Solution Approach 2:
Different regions of the sensor array are assigned different spectral sensitivities: depth pixels are optimized for near-infrared detection while image pixels are optimized for visible light detection. This local differentiation of sensor properties enables simultaneous multi-spectral acquisition without mutual interference.
2Object-affected harmful factors
If separate acquisition times are used for RGB and depth data, then spectral cross-talk is minimized, but latency increases
Solution Approach 1:
The patent merges RGB and depth acquisition into a single simultaneous operation using a unified sensor array where depth pixels and image pixels capture their respective data at the same time. This eliminates the latency inherent in sequential acquisition while maintaining spectral separation through the mixed pixel architecture.
3Measurement precision
If high-resolution RGB and depth data are acquired simultaneously, then imaging quality is improved, but power consumption increases
Solution Approach 1:
The patent combines depth sensing and imaging functions into a single integrated sensor array that operates simultaneously, eliminating the need for separate sensor systems and reducing total power consumption. The shared readout circuitry and unified control architecture further reduce energy requirements compared to separate systems.
Solution Approach 2:
The sensor array performs multiple functions (depth sensing and imaging) simultaneously using a unified hardware platform, making the system more energy-efficient than separate dedicated systems would require.
4Measurement precision
If separate processing circuitry is used for depth and image pixels, then processing accuracy is improved, but device complexity increases
Solution Approach 1:
The patent implements universal processing circuitry that handles both depth and image data through a shared readout and processing architecture. This multi-functional approach reduces device complexity while maintaining processing accuracy through software-based differentiation of data types.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables simultaneous, high-resolution RGB imaging and depth sensing with reduced latency and power consumption, enhancing accuracy and reducing computational overhead.
Implementation Method 1
utilizing a dual-passband filter
Implementation Method 2
depth pixels configured to image near-infrared illumination light... depth-processing circuitry for processing depth-signals generated by the depth pixels
Implementation Method 3
image pixels configured to image visible light... image-processing circuitry to process image signals generated by the image pixels
Data Source
AI summary
A depth sub-frame is captured with a first region of depth pixels configured to image a first zone of a field illuminated by near-infrared illumination light. A visible-light sub-frame is captured with a second region of image pixels that is distanced from the first region of the depth pixels. The second region of the image pixels is configured to image a second zone of the field while the first region of the depth pixels images the first zone of the field while the near-infrared illumination light illuminates the first zone.