Stereo Imaging Depth Map Generation Using Time-of-Flight Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Stereoscopic imaging techniques face challenges in efficiently identifying matching pixel clusters across images, especially in scenes with limited texture, leading to resource-intensive and time-consuming processes.

Innovation Solution

The integration of Time-of-Flight (ToF) techniques within a stereo imaging system to aid in depth map and disparity map generation by using ToF sensors to measure distances and match pixel clusters across stereoscopic image pairs, even in low-texture environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional stereo matching algorithms are used to identify corresponding pixel clusters, then depth information can be obtained, but the process becomes resource-intensive and time-consuming, especially in low-texture environments

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the stereo matching problem by dividing pixel clusters into regions and using ToF sensors to provide depth information for specific regions of interest, rather than processing the entire image. This segmentation allows the system to focus computational resources on critical areas while maintaining depth measurement accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary depth estimation using ToF sensors before executing the full stereo matching algorithm. This preliminary action provides initial depth information that guides and constrains the subsequent stereo matching process, reducing the search space and computational requirements while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If traditional stereo matching algorithms are used to identify corresponding pixel clusters, then depth information can be obtained, but the process requires significant computational resources and time

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the stereo matching problem by dividing pixel clusters into regions and using ToF sensors to provide depth information for specific regions of interest, rather than processing the entire image. This segmentation allows the system to focus computational resources on critical areas while maintaining depth measurement accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary depth estimation using ToF sensors before executing the full stereo matching algorithm. This preliminary action provides initial depth information that guides and constrains the subsequent stereo matching process, reducing the search space and computational requirements while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If stereo matching is performed in scenes with limited texture, then depth information can still be obtained, but the matching process becomes significantly more difficult and resource-intensive

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidalgorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces ToF sensors as an intermediary that provides direct depth measurements to assist the stereo matching process. This intermediary depth information acts as a guide for matching pixel clusters in low-texture regions, reducing the complexity of the matching algorithm while maintaining measurement accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary depth estimation using ToF sensors before executing the full stereo matching algorithm. This preliminary action provides initial depth information that guides and constrains the subsequent stereo matching process, reducing the search space and computational requirements while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach significantly reduces the time and resource requirements for matching pixel clusters by providing accurate distance measurements, enabling efficient generation of depth and disparity maps even in challenging imaging conditions.

Implementation Method 1

a time-of-flight (ToF) sensor configured for estimating distance measurements

Methodology Applied
Scientific EffectTime of Flight: Time of Flight

Data Source

PatentUS11391843B2Using time-of-flight techniques for stereoscopic image processing
Publication Date: 2022.07.19 AMS INTERNATIONAL AG
  • US11391843B2 patent drawing
  • US11391843B2 patent drawing
  • US11391843B2 patent drawing

AI summary

The current disclosure describes a stereo imaging system that is configured to use Time-of-Flight (“Tof”) techniques to aid in stereoscopic image processing. One process disclosed uses ToF to aid in identifying the same elements (e.g., pixel clusters) in stereo image pairs by narrowing down search areas for matching. Another process uses ToF to aid in identifying the same elements in stereo image pairs where there a small amount texture making it difficult to find a match.