Dynamic Vision Sensor Disparity Acquisition via Event Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image disparity calculation technologies are complex and time-consuming due to the need to process all pixels, which results in long calculation times and reduced efficiency in applications like 3D image modeling and driving assistance.

Innovation Solution

A method and apparatus for acquiring image disparity using dynamic vision sensors, where a cost is calculated within a preset disparity range for events in both images, intermediate disparities are determined, and optimal disparities are predicted based on matched events, reducing the complexity by processing events rather than pixels and removing noise from the images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If all pixels are processed to calculate image disparity, then measurement precision is improved, but calculation time increases significantly

Engineering Contradiction:
Improvedisparity calculation accuracyVSAvoidcalculation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the image processing task by dividing pixels into multiple blocks and selecting representative pixels within each block. Instead of processing all pixels individually, the method processes only the selected representative pixels from each block, significantly reducing the total number of pixels to be processed while maintaining disparity calculation accuracy through the representative nature of selected pixels.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by differentiating the processing approach between different regions. Representative pixels are selected based on local characteristics within each block, and different matching strategies are applied: exhaustive search for representative pixels and gradient descent for non-representative pixels. This localized differentiation optimizes calculation efficiency while preserving measurement precision.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If all pixels are processed to calculate image disparity, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvedisparity calculation accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent reduces processing complexity by segmenting the image into blocks and selecting only representative pixels from each block for exhaustive matching. This segmentation approach simplifies the overall processing complexity while maintaining accuracy by focusing computational resources on key representative pixels rather than all pixels uniformly.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by performing exhaustive search only for selected representative pixels while using gradient descent for non-representative pixels. This partial application of the more complex exhaustive search method reduces overall device complexity while maintaining measurement precision through the strategic selection of which pixels receive intensive processing.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If exhaustive search is performed for all pixels, then disparity prediction precision is improved, but productivity decreases

Engineering Contradiction:
Improvedisparity prediction precisionVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent improves productivity by segmenting pixels into representative and non-representative categories within blocks. Only representative pixels undergo exhaustive search, while non-representative pixels use gradient descent. This segmentation maintains disparity prediction precision for critical pixels while significantly improving overall processing efficiency by reducing the number of pixels requiring intensive exhaustive search.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial exhaustive search action only to representative pixels rather than all pixels. This partial application of exhaustive search maintains disparity prediction precision where it matters most (at representative pixels) while improving productivity by using the faster gradient descent method for remaining pixels, achieving a balance between precision and efficiency.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10341634B2Method and apparatus for acquiring image disparity
Publication Date: 2019.07.02 SAMSUNG ELECTRONICS CO LTD
  • US10341634B2 patent drawing
  • US10341634B2 patent drawing
  • US10341634B2 patent drawing

AI summary

A method and apparatus for acquiring an image disparity are provided. The method may include acquiring, from dynamic vision sensors, a first image having a first view of an object and a second image having a second view of the object; calculating a cost within a preset disparity range of an event of first image and a corresponding event of the second image; calculating an intermediate disparity of the event of the first image and an intermediate disparity of the event of the second image based on the cost; determining whether the event of the first image is a matched event based on the intermediate disparity of the event of the first image and the intermediate disparity of the event of the second image; and predicting optimal disparities of all events of the first image based on an intermediate disparity of the matched event of the first imaged.