Depth Camera Illumination Control for Overlap-Aware Depth Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing depth cameras in artificial reality systems face challenges in quickly and accurately determining depth of objects in a local area while minimizing power consumption.
Innovation Solution
A depth camera assembly (DCA) that dynamically controls illumination using structured light patterns, selectively illuminating only non-overlapping regions of a local area based on changes in camera pose, thereby reducing power usage by avoiding continuous illumination of the entire field of view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If continuous illumination of the entire field of view is used, then depth information can be determined for all regions, but power consumption increases
Solution Approach 1:
The field of view is divided into multiple image frames, and further into overlapping and non-overlapping regions. Depth determination is performed selectively on non-overlapping regions only, segmenting the illumination and processing workload to reduce power consumption while maintaining overall depth map accuracy.
Solution Approach 2:
Instead of illuminating and processing the entire field of view, the system performs partial action by illuminating only the non-overlapping regions that contain new information. This partial illumination approach reduces power consumption while still achieving complete depth coverage through frame integration.
2Measurement precision
If the entire field of view is illuminated continuously, then complete depth coverage is achieved, but processing time and computational load increase
Solution Approach 1:
The depth processing task is segmented by identifying and separating non-overlapping regions from overlapping regions in consecutive image frames. Only non-overlapping regions require new depth calculation, while overlapping regions can be carried forward, significantly reducing computational time and processing load.
Solution Approach 2:
The system performs preliminary identification of non-overlapping regions before depth calculation. By pre-determining which regions need processing based on frame overlap analysis, the system avoids unnecessary computational work on regions that will be covered by subsequent frames.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The DCA efficiently generates depth information with reduced power consumption by illuminating only necessary regions, maintaining accuracy and computational efficiency in determining depth maps.
Implementation Method 1
The projector assembly is configured to emit, into a region of the local area, a projection of a structured light pattern
Implementation Method 2
The camera assembly configured to capture one or more images the region as the region is illuminated
Data Source
AI summary
A depth camera assembly (DCA) optimizes illumination and image capture of a local area to generate depth information of the local area. The DCA determines depth information for a first portion of the local area viewable at a first pose. The DCA is moved from the first pose to a second pose, where a second portion of the local area is viewable and overlaps with the first portion. The overlapping region is not illuminated by the DCA. A non-overlapping portion of the second portion is illuminated, captured, and depth information determined.