Selective 3D Imaging With Steerable ROI Illumination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Three-dimensional (3D) cameras are less power efficient due to active illumination and resource-intensive processing, while two-dimensional (2D) cameras rely on ambient illumination and are more power efficient, leading to a trade-off in imaging efficiency and power consumption.
Innovation Solution
A hybrid 2D/3D imaging system that combines a steerable illumination source with a sensor array to selectively illuminate zones in a scene using active illumination, allowing for power-efficient 3D imaging by individually addressing pixels based on passive and active light measurements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If active illumination is used for 3D imaging, then depth measurement capability is improved, but power consumption increases
Solution Approach 1:
The field of view is divided into multiple zones, with only the region of interest receiving active illumination. The illumination source is selectively directed to specific zones rather than illuminating the entire scene, thereby reducing overall power consumption while maintaining depth measurement capability for the area of interest.
Solution Approach 2:
Different regions of the scene receive different treatment: the region of interest receives active illumination for 3D imaging, while other regions rely on ambient light for 2D imaging. This local differentiation allows the system to optimize power consumption by applying active illumination only where depth information is needed.
2Measurement precision
If active illumination is applied to the entire scene, then complete 3D coverage is achieved, but power efficiency decreases
Solution Approach 1:
The system extracts only the necessary portion of the scene (region of interest) for active illumination and 3D imaging. By identifying and isolating the specific area requiring depth information, the system avoids wasting energy illuminating and processing the entire scene, thus improving power efficiency while maintaining adequate 3D coverage for the area of interest.
Solution Approach 2:
Instead of applying active illumination to the entire scene, the system applies partial illumination only to the region of interest. This partial action is sufficient to achieve the imaging goal while significantly reducing energy loss compared to full-scene illumination.
3Loss of information
If full scene 3D imaging is performed, then comprehensive depth information is obtained, but processing complexity increases
Solution Approach 1:
The imaging process is segmented into two stages: initial passive 2D imaging to identify the region of interest, followed by active 3D imaging only of that specific region. This segmentation reduces processing complexity by limiting 3D depth calculation to a smaller subset of pixels rather than processing the entire scene.
Solution Approach 2:
The system performs preliminary passive 2D imaging to identify the region of interest before conducting active 3D imaging. This preliminary action allows the system to pre-determine which areas require depth information, thereby reducing subsequent processing complexity and avoiding unnecessary 3D calculations for regions where depth data is not needed.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system achieves power-efficient 3D imaging by minimizing unnecessary active illumination and processing, optimizing power consumption through selective zone illumination and differential pixel measurements.
Implementation Method 1
determining a depth value of an object locus in the scene reflecting the active illumination back to the pixel
Data Source
Figure 1
Figure 2A~2C
Figure 3
AI summary
An imaging method includes acquiring one or more passive light images of a scene (202). A region of interest in the scene (202) is identified based on the one or more passive light images. One or more illumination zones (224) of a plurality of illumination zones that collectively cover the region of interest is determined. Each illumination zone is sized according to active illumination emitted from a steerable illumination source (214). For a determined illumination zone of the one or more illumination zones, the illumination zone is individually illuminated with the active illumination from the steerable illumination source (214). For a pixel (206) of a sensor array (204) that maps to the illumination zone, a depth value of an object locus in the scene (202) reflecting the active illumination back to the pixel (206) is determined. Microlens array (208) may be arranged directly over sensor array (204). Optical shutter (212) may be arranged over sensor array (204). The steerable illumination source (214) comprises a steering element (216) configured to steer the active illumination light to individually actively illuminate different illumination zones of the plurality of illumination zones (224), and may include one or more optical elements (218). A controller (220) may individually control the pixels (206) of the sensor array (204) and the steerable illumination source (214) and may output a matrix of pixels (226). The sensor array (204) relies on ambient illumination of the scene (202) to acquire a 2D passive light image.