Depth Map Blooming Correction via Active Brightness Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Highly reflective objects in a scene can cause blooming effects in depth maps, leading to erroneous distance calculations not only for themselves but also for adjacent objects, due to overwhelming light reflections that overwhelm sensors and create inaccuracies in depth data.

Innovation Solution

The implementation recognizes blooming effects by identifying saturated pixels in the active brightness image and invalidating the corresponding depth values, thereby reducing the impact of blooming on the accuracy of depth maps by assigning 'null' or 'not available' values to affected pixels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If sensors gather reflected light from highly reflective objects, then depth information can be obtained for these objects, but the sensors become overwhelmed causing erroneous depth distances to be calculated

Engineering Contradiction:
Improvedepth distance accuracyVSAvoidblooming effect from highly reflective objects
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent uses an active brightness image as an intermediary to detect blooming effects. The brightness image serves as a mediator between the depth map and the blooming correction process, allowing the system to identify saturated pixels and their corresponding depth values without directly processing the overwhelming reflected light signals.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent extracts and removes erroneous depth values from the depth map by identifying pixels corresponding to saturated regions in the brightness image. The blooming correction component extracts the depth values associated with blooming-affected pixels and removes or replaces them with default values, effectively separating the harmful blooming effects from the valid depth data.

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If sensors capture light reflections to generate depth maps, then depth information is obtained, but erroneous depth distances are calculated for adjacent objects due to blooming

Engineering Contradiction:
Improvedepth map accuracyVSAvoiderroneous depth data propagation to adjacent objects
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The active brightness image serves as an intermediary to detect blooming effects that affect adjacent objects. By processing the brightness image separately and using it to identify affected regions, the system can correct depth values for adjacent objects without losing the spatial relationship information.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements a feedback mechanism where the brightness image information is fed back into the depth map processing pipeline. The blooming correction component uses the brightness data to identify and correct erroneous depth values, creating a closed-loop system that continuously improves depth map reliability by eliminating propagated errors.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11721032B2Error reduction in depth maps
Publication Date: 2023.08.08 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11721032B2 patent drawing
  • US11721032B2 patent drawing
  • US11721032B2 patent drawing

AI summary

The described implementations relate to reducing distance errors in depth maps. One example can detect blooming in a depth map. This example can identify a depth range affected by the blooming and take an action relating to the identified depth range to address the blooming.