Depth Imaging System Selective Illumination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current depth imaging technologies, such as stereo vision, structured light, and time-of-flight sensing, face limitations including dependency on textured surfaces, high computational complexity, and difficulty in capturing depth maps of featureless surfaces, long exposure times for moving objects, and challenges in isolating reflected signals under ambient conditions, leading to low resolution and high power consumption.

Innovation Solution

A depth imaging system that combines two-dimensional image processing for object identification and semantic segmentation with three-dimensional time-of-flight (TOF) imaging, using an optical image sensor and an optical beam steering device to direct an optical signal to specific objects, reducing computational complexity by processing only the area of interest, and employing digital micromirror devices or phase spatial light modulators for efficient illumination and background rejection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If time-of-flight sensors illuminate the entire scene to capture depth information, then depth coverage is improved, but power consumption increases and depth resolution decreases

Engineering Contradiction:
Improvedepth coverage areaVSAvoidpower consumption
Core Design Contradiction:
Area of stationary objectVSUse of energy by moving object

Solution Approach 1:

The patent segments the scene into regions of interest based on 2D image data, then applies time-of-flight illumination only to those specific segments rather than the entire scene. This selective illumination reduces power consumption while maintaining depth coverage for important areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies different illumination qualities to different regions - full illumination to regions of interest identified by 2D imaging, and no illumination to other areas. This local differentiation optimizes power usage while preserving depth information where needed.

Inventive Principle:
Principle #3Local quality

2Area of stationary object

If time-of-flight sensors illuminate the entire scene, then depth coverage is improved, but depth resolution decreases

Engineering Contradiction:
Improvedepth coverage areaVSAvoiddepth resolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent segments the scene into regions of interest based on 2D image data, then applies time-of-flight illumination only to those specific segments rather than the entire scene. This selective illumination reduces power consumption while maintaining depth coverage for important areas.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies different illumination qualities to different regions - full illumination to regions of interest identified by 2D imaging, and no illumination to other areas. This local differentiation optimizes power usage while preserving depth information where needed.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If computational algorithms process the entire image to extract depth information, then measurement completeness is improved, but computational complexity increases

Engineering Contradiction:
Improvedepth measurement completenessVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and processes only the relevant portions of the image that contain objects of interest, rather than processing the entire image. This extraction approach reduces computational complexity while maintaining depth measurement completeness for important regions.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the scene into regions of interest based on 2D image data, then applies time-of-flight illumination only to those specific segments rather than the entire scene. This selective illumination reduces power consumption while maintaining depth coverage for important areas.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces computational complexity and power consumption while increasing depth resolution, enabling effective depth imaging in various applications such as advanced driver assistance systems and facial recognition by focusing depth processing on specific objects of interest.

Implementation Method 1

an optical beam steering system, configured to direct the optical signal to a selected object in the scene based on the location of the object

Methodology Applied
Scientific EffectOptical beam steering:

Implementation Method 2

a photodiode, configured to detect a reflection of the optical signal

Methodology Applied
Scientific EffectPhotoelectric detection: Photoelectric Effect

Implementation Method 3

determine a distance to the object based on a time-of-flight or phase of the optical signal

Methodology Applied
Scientific EffectTime-of-flight measurement: Time of Flight

Data Source

PatentUS11280907B2Depth imaging system
Publication Date: 2022.03.22 TEXAS INSTRUMENTS INC
  • US11280907B2 patent drawing
  • US11280907B2 patent drawing
  • US11280907B2 patent drawing

AI summary

A depth imaging system includes an optical image sensor, an optical beam steering system, an object identification system, and a depth measurement system. The object identification system is coupled to the optical image sensor. The object identification system is configured to identify an object in an image captured by the optical image sensor. The depth measurement system is coupled to the optical beam steering device. The depth measurement system is configured to, responsive to identification of the object by the object identification system: direct an optical signal, via the optical beam steering device, to the object, and to determine a distance to the object based on a time-of-flight of the optical signal.