Stereo Matching Module Interval Disparity Calculation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional stereoscopic photography techniques using dual cameras require extensive computation for stereo matching, hindering commercialization due to the complexity and resource limitations of current semiconductor technology.

Innovation Solution

A stereoscopic photography system and method that employs interval-based disparity calculation and sub-pixel interpolation, utilizing synchronized image sensors, a combination module, calibration module, and a stereo matching module to reduce computational load and improve accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional stereo matching algorithm is used to calculate disparity for each pixel, then measurement precision of 3D depth is improved, but device complexity and computation amount increase significantly

Engineering Contradiction:
Improve3D depth measurement precisionVSAvoidcomputation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the image into multiple blocks and processes each block independently to find matching blocks between left and right images. This segmentation approach reduces the computational complexity from calculating disparities for every individual pixel to calculating disparities for block centers only, while still maintaining acceptable 3D depth measurement precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent calculates disparities only at block centers rather than for all pixels, which is a partial action approach. This significantly reduces the number of disparity calculations needed while the overall 3D depth map can still be reconstructed by interpolating or propagating the block center disparities to surrounding pixels.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If dual camera system is implemented for stereoscopic photography, then measurement capability for 3D depth is improved, but ease of manufacture deteriorates due to semiconductor technology restrictions

Engineering Contradiction:
Improve3D depth measurement capabilityVSAvoidmanufacturability under semiconductor restrictions
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

By segmenting the image into blocks and processing only block centers, the patent reduces the computational burden to a level that can be handled by current semiconductor technology, making dual camera stereoscopic photography systems manufacturable and commercially viable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the processing parameter from individual pixel-level disparity calculation to block-level disparity calculation. This parameter change reduces the computational complexity to a manageable level that fits within current semiconductor technology constraints, enabling practical manufacturing of stereoscopic photography systems.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If comprehensive image processing is performed for stereoscopic conversion, then measurement precision of 3D model is improved, but loss of time in processing increases

Engineering Contradiction:
Improve3D model accuracyVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent processes images in discrete blocks rather than continuously processing all pixels, which reduces the total processing time required for stereoscopic conversion while maintaining sufficient 3D model accuracy through block-level matching.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

By performing disparity calculation only at block centers rather than for all pixels, the patent achieves a partial processing approach that significantly reduces processing time while still enabling reconstruction of the complete 3D model through interpolation of block center data.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9538161B2System and method for stereoscopic photography
Publication Date: 2017.01.03 LIPS NV
  • US9538161B2 patent drawing
  • US9538161B2 patent drawing
  • US9538161B2 patent drawing

AI summary

A stereoscopic photography is provided, which includes a first image sensor, a second image sensor, a synchronization module, a combination module, a calibration module, and a stereo matching module. The first image sensor is utilized to capture a first image. The second image sensor is utilized to capture a second image. The calibration module is utilized to perform an image calibration and a horizontal rectification for the first image and the second image. The stereo matching module is utilized to calculate a distance difference between a reference pixel of the first image and a corresponding pixel of the second image. The stereo matching module compares costs of multiple pixels relative to the reference pixel in a pixel row of the second image in an interval manner. A method for performing stereoscopic photography and a stereo matching method are also provided.