Context-Based Depth Sensor Control for Power Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional depth sensors using modulated light for machine vision face challenges with high power consumption and interference with visible-light imaging, limiting their implementation in battery-powered devices and environments with limited power.

Innovation Solution

The implementation of a processing architecture that selectively enables and controls a modulated light-based depth sensor using a collimating lens-based or VCSEL diode-based modulated light projector, allowing for efficient power management and reduced interference by adjusting the activation configuration based on ambient light, motion, and geometric uncertainty.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If modulated light-based depth sensor is continuously activated, then depth sensing accuracy is improved, but power consumption increases

Engineering Contradiction:
Improvedepth sensing accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The depth sensor is activated periodically rather than continuously, with activation triggered by detected events such as motion detection or changes in ambient light conditions. This periodic activation maintains depth sensing capability when needed while significantly reducing overall power consumption during normal operation.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts the activation state of the depth sensor based on real-time environmental conditions and operational requirements. The controller monitors various parameters and adaptively enables or disables the depth sensor, optimizing the balance between measurement precision and power consumption.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If modulated light projector is activated, then depth measurement capability is improved, but interference with visible-light imaging occurs

Engineering Contradiction:
Improvedepth measurement capabilityVSAvoidinterference with visible-light imaging
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system extracts and separates the depth sensing function from the visible-light imaging function by using different spectral bands. The modulated light projector emits infrared or near-infrared light that is outside the visible spectrum, allowing depth measurement without interfering with visible-light camera operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The modulated light acts as an intermediary carrier for depth information, using a different wavelength range (infrared) than visible light. This intermediary approach allows simultaneous operation of depth sensing and visible-light imaging without mutual interference, as the two systems operate in separate spectral domains.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces power consumption and minimizes interference, enabling effective depth sensing in various environments while extending battery life and improving the accuracy of depth data collection.

Implementation Method 1

VCSEL diode-based modulated light projector

Methodology Applied
Scientific EffectLight emission from VCSEL diode: Light Emitting Diode

Implementation Method 2

depth sensors rely on the capture of reflections of known spatially-modulated or temporally-modulated light

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 3

collimating lens-based modulated light projector

Methodology Applied
Scientific EffectLight collimation: Lens

Implementation Method 4

depth sensors rely on the capture of reflections of known spatially-modulated or temporally-modulated light projected at the object

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP2962062B1Context-based depth sensor control
Publication Date: 2019.10.30 GOOGLE TECHNOLOGY HOLDINGS LLC
  • EP2962062B1 patent drawingFigure 1
  • EP2962062B1 patent drawingFigure 2~3
  • EP2962062B1 patent drawingFigure 4

AI summary

An electronic device (100) includes a depth sensor (120), a first imaging camera (114, 116), and a controller (802). The depth sensor (120) includes a modulated light projector (119) to project a modulated light pattern (500). The first imaging camera (114, 116) is to capture at least a reflection of the modulated light pattern (500). The controller (802) is to selectively modify (1004) at least one of a frequency, an intensity, and a duration of projections of the modulated light pattern by the modulated light projector responsive to at least one trigger event (1002). The trigger event can include, for example, a change (1092) in ambient light incident on the electronic device, detection (1094) of motion of the electronic device, or a determination (1096) that the electronic device has encountered a previously-unencountered environment.