Depth Map Generation Using ARWR Algorithm and Segmented Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current depth estimation methods in machine vision applications face challenges in achieving high accuracy and speed, particularly in real-time applications such as automatic vehicle braking, due to the complexity of stereo correspondence and the presence of noise and occlusions in image data.

Innovation Solution

A stochastic approach combining iterative refinements and advanced processing techniques, including the Adaptive Random Walk with Restart (ARWR) algorithm, is employed to optimize disparity map generation, addressing discontinuities and occlusions through a series of processing blocks such as Local Matching, Cost Aggregation, Optimization, Mutual Structure, Dynamic Joint Weighted Median Filter, and Multi-Dimensional Convolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional stereo matching algorithms are used for depth estimation, then the process can be executed relatively quickly, but the accuracy is insufficient due to noise and occlusions in image data

Engineering Contradiction:
Improvedepth estimation accuracyVSAvoidprocessing algorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the depth estimation process into multiple distinct processing blocks: cost computation block, cost aggregation block, optimization block, mutual structure block, filtering block, and convolution block. Each block performs a specific function to progressively refine the depth map, allowing complex processing to be divided into manageable stages that improve accuracy while maintaining organizational clarity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary actions by performing cost aggregation and optimization before final depth map generation. The mutual structure block pre-processes the depth map to identify and preserve important structural information before subsequent filtering and convolution operations, ensuring that critical depth relationships are maintained throughout the processing pipeline

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If iterative refinements are applied to improve depth map accuracy, then measurement precision increases, but processing time increases

Engineering Contradiction:
Improvedepth map accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements periodic action through the optimization block that iteratively refines the depth map by alternating between updating depth values and recalculating costs. This periodic refinement process systematically improves accuracy by cycling through multiple passes of cost computation and depth optimization, with each iteration building upon the previous results

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent applies dynamics by making the processing pipeline adaptive through the mutual structure block, which dynamically identifies and preserves important depth structures. The system adjusts its processing focus based on the characteristics of the input images and intermediate results, allocating computational resources more efficiently to areas that most benefit from iterative refinement

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If advanced processing techniques like ARWR algorithm are used, then depth estimation accuracy improves, but device complexity increases

Engineering Contradiction:
Improvedisparity map accuracyVSAvoidalgorithm implementation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The complex ARWR algorithm is segmented into distinct functional blocks: the optimization block implements the core random walk with restart logic, while separate blocks handle cost computation, aggregation, and result integration. This segmentation makes the sophisticated algorithm more manageable and easier to implement by isolating the complex probabilistic computations from the surrounding processing steps

Inventive Principle:
Principle #1Segmentation

4Reliability

If multiple processing blocks are applied to address discontinuities and occlusions, then reliability of depth estimation improves, but device complexity increases

Engineering Contradiction:
Improvedepth estimation reliabilityVSAvoidprocessing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges multiple specialized processing functions into an integrated pipeline where the mutual structure block combines depth information with structural information from input images, and the filtering block integrates results from multiple sources. This merging approach improves reliability by combining complementary information sources while presenting a unified processing interface that manages complexity

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10839535B2Systems and methods for providing depth map information
Publication Date: 2020.11.17 TOBII TECHNOLOGIES LTD
  • US10839535B2 patent drawing
  • US10839535B2 patent drawing
  • US10839535B2 patent drawing

AI summary

A method for providing depth map information based on image data descriptive of a scene. In one embodiment, after generating an initial sequence of disparity map data, performing a smoothing operation or an interpolation to remove artifact introduced in the disparity map data as a result of segmenting the image data into superpixels.