Adaptive 3D Sensing With Attention-Guided Laser Scanning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D sensing methodologies in mobile devices and wearables consume excessive energy and pose eye safety concerns due to high energy consumption and concentrated laser exposure, particularly in full and line scanning methods.

Innovation Solution

An adaptive 3D sensing system that selectively illuminates specific areas of a real-world scene using a distributed laser beam based on attention masks, computed from depth estimates and confidence values, reducing energy consumption and enhancing eye safety by extending exposure duration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If full or line scanning laser methods are used for 3D sensing, then depth mapping coverage is improved, but energy consumption increases and eye safety deteriorates

Engineering Contradiction:
Improvedepth mapping coverageVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent divides the field of view into multiple regions of interest (ROIs) based on depth uncertainty and selective attention needs. Instead of scanning the entire scene, the system segments and targets only specific areas that require 3D sensing, thereby reducing energy consumption while maintaining necessary measurement precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies different sensing strategies to different regions of the scene. High-priority regions with depth uncertainty receive focused laser scanning, while low-priority regions use alternative sensing methods or are excluded from scanning. This local differentiation optimizes energy usage while preserving measurement quality where needed.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If full or line scanning laser methods are used for 3D sensing, then depth mapping coverage is improved, but eye safety deteriorates due to concentrated laser exposure

Engineering Contradiction:
Improvedepth mapping coverageVSAvoideye safety
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

By segmenting the scanning task into discrete, targeted ROIs rather than continuous full-field scanning, the system reduces the temporal concentration of laser exposure to any single location. The segmented approach allows for longer exposure durations at lower intensities, improving eye safety while maintaining depth mapping coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses periodic, intermittent scanning of selected regions rather than continuous scanning. This periodic action with extended exposure duration at reduced power levels decreases peak laser intensity, thereby improving eye safety while still achieving necessary depth mapping coverage through repeated measurements.

Inventive Principle:
Principle #19Periodic action

3Area of stationary object

If conventional 3D sensing is used, then complete scene coverage is achieved, but energy efficiency deteriorates

Engineering Contradiction:
Improvescene coverageVSAvoidenergy efficiency
Core Design Contradiction:
Area of stationary objectVSUse of energy by moving object

Solution Approach 1:

The patent segments the scene into multiple regions of interest based on depth uncertainty and attention priority. Only these segmented regions are subjected to energy-intensive laser scanning, while other areas are excluded or use alternative sensing. This segmentation achieves effective scene coverage where needed while dramatically improving energy efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs partial scanning of the scene by selecting only the necessary regions for 3D sensing based on depth uncertainty and application requirements. This partial action approach achieves sufficient scene coverage for the intended application while avoiding the excessive energy consumption of complete scene scanning.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The adaptive 3D sensing system reduces energy usage and improves eye safety by focusing laser beams only on necessary areas, achieving energy-efficient and safer 3D data capture.

Implementation Method 1

sends a distributed laser beam into specified areas of a real-world scene

Methodology Applied
Scientific EffectLaser: Laser

Data Source

PatentUS12498579B2Energy-efficient adaptive 3D sensing
Publication Date: 2025.12.16 SNAP INC
  • US12498579B2 patent drawing
  • US12498579B2 patent drawing
  • US12498579B2 patent drawing

AI summary

An energy-efficient adaptive 3D sensing system. The adaptive 3D sensing system includes one or more cameras and one or more projectors. The adaptive 3D sensing system captures images of a real-world scene using the one or more cameras and computes depth estimates and depth estimate confidence values for pixels of the images. The adaptive 3D sensing system computes an attention mask based on the one or more depth estimate confidence values and commands the one or more projectors to send a distributed laser beam into one or more areas of the real-world scene based on the attention mask. The adaptive 3D sensing system captures 3D sensing image data of the one or more areas of the real-world scene and generates 3D sensing data for the real-world scene based on the 3D sensing image data.