Structured Light Depth Map Using Non-Uniform Codeword Intensities

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Structured light systems face challenges in balancing power efficiency, depth map resolution, and depth map distance, as increasing depth map quality and sensing distances require higher laser intensity and power consumption, leading to computational expenses that hinder commercialization.

Innovation Solution

A method and apparatus that project a codeword pattern with varying light point intensities, generating a hybrid depth map with high-resolution layers for close distances and lower-resolution layers for farther distances, optimizing power consumption and depth map quality across different distances.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Length of stationary object

If laser intensity is increased to improve depth map sensing distance, then depth map distance is improved, but power consumption increases

Engineering Contradiction:
Improvedepth map sensing distanceVSAvoidpower consumption
Core Design Contradiction:
Length of stationary objectVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by using different light intensities for different spatial regions of the codeword pattern. High-intensity light points are used in regions corresponding to farther distances, while low-intensity light points are used in regions corresponding to closer distances. This allows the system to extend sensing distance for far objects without unnecessarily increasing power consumption across the entire scene.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the light intensity parameter of the projected codeword pattern based on spatial location. By varying the intensity parameter of different light points according to their intended sensing distance, the system optimizes power efficiency while maintaining extended depth map sensing capability for distant objects.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If computation time is reduced to improve processing speed, then productivity is improved, but depth map quality may deteriorate

Engineering Contradiction:
Improveprocessing speedVSAvoiddepth map quality
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments the depth map generation process into multiple layers with different resolutions. A first depth map layer is generated at high resolution using low-intensity light points for close distances, while a second depth map layer is generated at lower resolution using high-intensity light points for farther distances. This segmentation allows efficient processing by matching computational resources to the actual information needs at different depth ranges.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by generating depth map layers at different resolutions rather than computing a single high-resolution depth map for the entire scene. This reduces the total computational burden while maintaining high quality where needed (close objects) and accepting lower quality where less detail is critical (far objects).

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of high-quality depth maps at various distances with balanced power efficiency, allowing for extended battery life and reduced device size while maintaining high-resolution depth information for closer objects and lower-resolution information for farther objects.

Implementation Method 1

projecting, onto the scene, a codeword pattern including a plurality of light points including a first set of light points projected at a first intensity and a second set of light points projected at a second intensity greater than the first intensity

Methodology Applied
Scientific EffectLight: Light

Implementation Method 2

detecting, from the scene, a reflection of the codeword pattern

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS10620316B2Systems and methods for generating a structured light depth map with a non-uniform codeword pattern
Publication Date: 2020.04.14 QUALCOMM INC
  • US10620316B2 patent drawing
  • US10620316B2 patent drawing
  • US10620316B2 patent drawing

AI summary

Systems, methods, and devices for generating a depth map of a scene are provided. The method comprises projecting, onto the scene, a codeword pattern including a plurality of light points including a first set of light points projected at a first intensity and a second set of light points projected at a second intensity greater than the first intensity. The method further comprises detecting, from the scene, a reflection of the codeword pattern. The method further comprises generating a first depth map layer at a first resolution. The method further comprises generating a second depth map layer at a second resolution lower than the first resolution. The method further comprises generating the depth map of the scene, wherein the depth map includes depth information for the scene according to each of the first depth map layer and the second depth map layer.