Adaptive 3D Sensing via Distributed Laser Beam Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D sensing technologies for augmented and virtual reality applications consume excessive energy, generate heat, and pose eye safety concerns due to the need to illuminate and scan entire real-world scenes, which limits their efficiency and safety in wearable devices.
Innovation Solution
An adaptive 3D sensing system that uses a distributed laser beam to selectively illuminate and capture images of specific areas of a real-world scene based on attention masks, reducing energy consumption and increasing eye safety by projecting a lower power laser for longer durations, employing a MEMS+DOE or SLM-based projector to direct the laser beam to areas of interest.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a high-power laser is used to illuminate the entire real-world scene for 3D sensing, then the sensing coverage and speed are improved, but energy consumption increases and eye safety is compromised
Solution Approach 1:
The patent divides the field of view into multiple regions of interest (ROIs) and selectively illuminates only those regions using a distributed laser beam pattern, rather than illuminating the entire scene. This segmentation approach maintains sensing speed for critical areas while reducing overall energy consumption and laser exposure to safe levels.
Solution Approach 2:
The system applies different illumination strategies to different regions of the scene based on their importance. High-priority regions receive focused laser illumination for accurate depth sensing, while low-priority regions receive no illumination or use alternative sensing methods, optimizing both safety and performance.
2Area of stationary object
If the entire real-world scene is illuminated for 3D sensing, then complete scene coverage is achieved, but energy consumption increases
Solution Approach 1:
The patent segments the scene into multiple regions of interest and selectively illuminates only those regions using a distributed laser beam pattern, rather than illuminating the entire scene. This segmentation approach maintains sensing coverage for critical areas while reducing overall energy consumption.
Solution Approach 2:
The system performs partial illumination of the scene by focusing laser energy only on regions that require depth sensing, rather than illuminating the entire field of view. This partial action approach reduces energy consumption while maintaining adequate coverage for important areas.
3Measurement precision
If a high-power laser is used for 3D sensing, then signal-to-noise ratio is improved, but eye safety is compromised
Solution Approach 1:
The patent divides the field of view into multiple regions of interest and selectively illuminates only those regions using a distributed laser beam pattern. This segmentation maintains high signal-to-noise ratio in illuminated regions while reducing overall laser exposure to safe levels.
Solution Approach 2:
The system changes the spatial distribution parameter of the laser beam from a uniform high-power illumination across the entire scene to a distributed pattern with multiple lower-power beams targeted at specific regions. This parameter change maintains measurement precision in ROIs while reducing eye safety risks.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The adaptive 3D sensing system reduces energy usage, enhances eye safety, and improves signal-to-noise ratio by focusing laser energy on specific areas, thereby extending battery life and ensuring safer operation in wearable devices.
Implementation Method 1
commands a projector to send a distributed laser beam into one or more specified areas of a real-world scene
Implementation Method 2
A moveable MEMS mirror is used to deflect the laser beam to a specified area of the real-world scene that is to be sensed
Data Source
AI summary
An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.