Depth Sensor Power Savings via Subset Activation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Depth sensors in extended reality environments consume a large amount of power, particularly when generating detailed depth maps to accurately determine the occlusion of virtual objects by opaque objects in physical environments.

Innovation Solution

Selecting and activating only a subset of depth sensor elements to generate a depth map, focusing on relevant areas such as where occlusion occurs or where the user is looking, to reduce power consumption while maintaining accurate occlusion estimation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If all depth sensor elements are activated to generate a complete depth map, then measurement precision of occlusion boundaries is improved, but power consumption increases

Engineering Contradiction:

Improveocclusion boundary accuracyVSAvoiddepth sensor power consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent divides the depth sensor array into multiple groups or regions, activating only specific segments corresponding to areas where occlusion is likely to occur. This segmentation allows the system to maintain measurement precision in critical areas while reducing overall power consumption by leaving non-critical segments inactive.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system applies different activation states to different regions of the depth sensor array. Areas with high occlusion probability receive full activation for precise measurement, while areas with low occlusion probability remain inactive. This local differentiation optimizes the balance between measurement precision and power consumption.

Inventive Principle:

Principle #3Local quality

2Use of energy by moving object

If a subset of depth sensor elements is activated to reduce power consumption, then energy efficiency is improved, but measurement precision may deteriorate

Engineering Contradiction:

Improvedepth sensor power consumptionVSAvoidocclusion boundary accuracy

Core Design Contradiction:

Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The system performs preliminary analysis using other sensors (such as RGB cameras or inertial sensors) to predict where occlusion is likely to occur before activating depth sensor elements. This preliminary action allows the system to pre-identify critical measurement areas and activate only those specific depth sensor elements, ensuring measurement precision is maintained while reducing power consumption.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system continuously monitors occlusion events and adjusts depth sensor element activation dynamically. When occlusion is detected in a particular region, the system activates depth sensor elements in that region to improve measurement precision. When no occlusion is present, those elements remain inactive to save power, creating a feedback loop that adapts to real-time conditions.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11715220B1Method and device for depth sensor power savings

Publication Date: 2023.08.01 APPLE INC

AI summary

In one implementation, a method of activating a depth sensor is performed by a device including a depth sensor including a plurality of depth sensor elements, a display, one or more processors, and non-transitory memory. The method includes obtaining content to be displayed on the display in association with a physical environment. The method includes selecting a subset of the plurality of depth sensor elements. The method includes activating the subset of the plurality of depth sensor elements to obtain a depth map of the physical environment. The method includes displaying, on the display, at least a portion of the content based on the depth map of the physical environment.