Blending Depth Images from Multiple Exposures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Depth imagers face limitations in dynamic range, leading to image artifacts such as contouring when attempting to capture objects at a wide range of distances, as their fixed exposure levels restrict the depth range they can accurately measure.

Innovation Solution

The solution involves using multiple exposures with overlapping depth ranges, where the depths from each exposure are combined using exposure weights and interpolation weights to produce a blended depth image that avoids artifacts, extending the dynamic range of the depth imager.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single exposure level is used in depth imaging, then the device complexity is reduced, but the dynamic range is limited causing image artifacts such as contouring

Engineering Contradiction:
Improveexposure control mechanismVSAvoiddepth measurement accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The depth imaging process is segmented into multiple exposures with different exposure levels. Each exposure captures depth information for a specific range, and the results are combined to achieve extended dynamic range. This segmentation allows the system to maintain simplicity at each exposure level while achieving high reliability through combination of multiple measurements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts exposure levels based on the depth range being measured. By varying the exposure level according to the target depth range, the system optimizes measurement accuracy for different distances without requiring a completely different device configuration, thus maintaining simplicity while improving reliability.

Inventive Principle:
Principle #15Dynamics

2Reliability

If multiple exposures with overlapping depth ranges are used, then the dynamic range is extended, but the device complexity increases due to multiple measurements and blending operations

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system changes the exposure level parameter across multiple measurements to extend the measurable depth range. By systematically varying this parameter and applying corresponding blending operations, the system achieves extended dynamic range while managing processing complexity through structured parameter-based approaches.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system performs multiple copies of the depth measurement process at different exposure levels, then blends the results. This copying approach allows reuse of the same measurement and processing algorithms across different exposure conditions, reducing the need for entirely separate processing pipelines and managing complexity through algorithmic reuse.

Inventive Principle:
Principle #26Copying

3Device complexity

If multiple exposures are combined without proper weighting, then the processing is simplified, but image artifacts such as contouring appear due to discontinuities at boundaries

Engineering Contradiction:
Improveblending algorithmVSAvoidimage artifacts
Core Design Contradiction:
Device complexityVSObject-generated harmful factors

Solution Approach 1:

The blending algorithm uses feedback from the depth values and their uncertainties to determine appropriate weighting for each exposure. By continuously adjusting weights based on the quality and range of each measurement, the system eliminates discontinuities and contouring artifacts while maintaining a relatively simple blending structure.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically changes the weighting parameters during blending based on the depth range and exposure level. This parameter adjustment ensures smooth transitions between different exposure ranges, eliminating artifacts while keeping the blending algorithm manageable through systematic parameter control.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively extends the dynamic range of depth imagers, reducing image artifacts and enabling accurate depth measurement across a broader range of distances without introducing discontinuities.

Implementation Method 1

Depth imaging techniques can pulse light sources and measure reflected light to sense the presence, distance information, depth information, and/or speed information of an object

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS10708514B2Blending depth images obtained with multiple exposures
Publication Date: 2020.07.07 ANALOG DEVICES INC
  • US10708514B2 patent drawing
  • US10708514B2 patent drawing
  • US10708514B2 patent drawing

AI summary

To extend dynamic range, a depth imager can expose a scene with two different exposures to obtain two depths. The two different exposures are selected to have respective depth ranges that overlap each other. The two depths can be combined by taking into account the difference in exposures and where the two depths are located with respect to boundaries of an overlapping range of the two depth ranges. The combination of the two depths in this manner can help avoid image artifacts such as contouring.