Dynamic Vision Sensor Disparity Acquisition via Event Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image disparity calculation technologies are complex and time-consuming due to the need to process all pixels, which results in long calculation times and reduced efficiency in applications like 3D image modeling and driving assistance.
Innovation Solution
A method and apparatus for acquiring image disparity using dynamic vision sensors, where a cost is calculated within a preset disparity range for events in both images, intermediate disparities are determined, and optimal disparities are predicted based on matched events, reducing the complexity by processing events rather than pixels and removing noise from the images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If all pixels are processed to calculate image disparity, then measurement precision is improved, but calculation time increases significantly
Solution Approach 1:
The patent segments the image processing task by dividing pixels into multiple blocks and selecting representative pixels within each block. Instead of processing all pixels individually, the method processes only the selected representative pixels from each block, significantly reducing the total number of pixels to be processed while maintaining disparity calculation accuracy through the representative nature of selected pixels.
Solution Approach 2:
The patent applies local quality by differentiating the processing approach between different regions. Representative pixels are selected based on local characteristics within each block, and different matching strategies are applied: exhaustive search for representative pixels and gradient descent for non-representative pixels. This localized differentiation optimizes calculation efficiency while preserving measurement precision.
2Measurement precision
If all pixels are processed to calculate image disparity, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent reduces processing complexity by segmenting the image into blocks and selecting only representative pixels from each block for exhaustive matching. This segmentation approach simplifies the overall processing complexity while maintaining accuracy by focusing computational resources on key representative pixels rather than all pixels uniformly.
Solution Approach 2:
The patent applies partial action by performing exhaustive search only for selected representative pixels while using gradient descent for non-representative pixels. This partial application of the more complex exhaustive search method reduces overall device complexity while maintaining measurement precision through the strategic selection of which pixels receive intensive processing.
3Measurement precision
If exhaustive search is performed for all pixels, then disparity prediction precision is improved, but productivity decreases
Solution Approach 1:
The patent improves productivity by segmenting pixels into representative and non-representative categories within blocks. Only representative pixels undergo exhaustive search, while non-representative pixels use gradient descent. This segmentation maintains disparity prediction precision for critical pixels while significantly improving overall processing efficiency by reducing the number of pixels requiring intensive exhaustive search.
Solution Approach 2:
The patent applies partial exhaustive search action only to representative pixels rather than all pixels. This partial application of exhaustive search maintains disparity prediction precision where it matters most (at representative pixels) while improving productivity by using the faster gradient descent method for remaining pixels, achieving a balance between precision and efficiency.
Data Source
AI summary
A method and apparatus for acquiring an image disparity are provided. The method may include acquiring, from dynamic vision sensors, a first image having a first view of an object and a second image having a second view of the object; calculating a cost within a preset disparity range of an event of first image and a corresponding event of the second image; calculating an intermediate disparity of the event of the first image and an intermediate disparity of the event of the second image based on the cost; determining whether the event of the first image is a matched event based on the intermediate disparity of the event of the first image and the intermediate disparity of the event of the second image; and predicting optimal disparities of all events of the first image based on an intermediate disparity of the matched event of the first imaged.


