Depth Map Processing Using Bottom-to-Top Pixel Iteration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing depth map processing techniques face challenges in generating accurate and consistent depth information, particularly when combining multiple depth cues, leading to artefacts and inconsistencies, which affect the quality of three-dimensional image rendering.

Innovation Solution

A method that processes depth maps using a bottom-to-top approach with localized constraints, iteratively modifying depth values based on nearby pixels to improve consistency and reduce artefacts, while maintaining low computational complexity and resource requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If depth maps are generated by combining multiple depth cues, then depth information coverage is improved, but consistency and accuracy deteriorate due to artefacts and noise

Engineering Contradiction:
Improvedepth information coverageVSAvoiddepth map consistency
Core Design Contradiction:
Loss of informationVSManufacturing precision

Solution Approach 1:

The patent applies preliminary filtering and processing to depth maps before they are used for 3D rendering. By pre-processing depth information to remove artefacts and inconsistencies, the system ensures high-quality depth maps are available in advance, resolving the contradiction between comprehensive depth coverage and consistency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms where processed depth maps are evaluated and refined iteratively. Depth information from multiple cues is combined, processed, and re-evaluated to eliminate artefacts while maintaining comprehensive depth coverage, thus improving both consistency and accuracy.

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If traditional filtering methods are applied to depth maps, then some artefacts are reduced, but computational complexity and processing time increase significantly

Engineering Contradiction:
Improvedepth map qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts and removes only the harmful artefacts and inconsistencies from depth maps while preserving the essential depth information. By selectively removing only what is harmful rather than applying comprehensive complex filtering, the system improves depth map quality without excessive computational complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The processing approach applies local quality enhancement by targeting specific artefacts and inconsistencies in their local contexts rather than applying global complex filtering. This localized processing reduces computational complexity while maintaining depth map quality by addressing only where improvements are needed.

Inventive Principle:
Principle #3Local quality

3Loss of information

If depth information from multiple sources is combined, then depth coverage is enhanced, but noise and artefacts increase leading to rendering errors

Engineering Contradiction:
Improvedepth coverageVSAvoidnoise and artefacts
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent converts the harmful effect of combining multiple depth sources (which introduces noise and artefacts) into a benefit by using the combined depth information as input for specialized processing. The system takes the noisy combined depth maps and applies processing that extracts the useful depth coverage while eliminating the noise, thus converting the harmful combination into a beneficial comprehensive depth source.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentEP3616399B1Apparatus and method for processing a depth map
Publication Date: 2022.08.17 KONINKLIJKE PHILIPS NV
  • EP3616399B1 patent drawingFigure 1(a)~1(c)
  • EP3616399B1 patent drawingFigure 2
  • EP3616399B1 patent drawingFigure 3

AI summary

An apparatus for processing a depth map comprises a receiver (203) receiving an input depth map. A first processor (205) generates a first processed depth map by processing pixels of the input depth map in a bottom to top direction. The processing of a first pixel comprises determining a depth value for the first pixel for the first processed depth map as the furthest backwards depth value of: a depth value for the first pixel in the input depth map, and a depth value determined in response to depth values in the first processed depth map for a first set of pixels being below the first pixel. The approach may improve the consistency of depth maps, and in particular for depth maps generated by combining different depth cues.