3D Sensing Device Fusing High Precision and High Sampling Rate Depth Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D sensing technologies struggle to achieve both high resolution and high depth precision simultaneously, with current fusion methods only capable of generating fused information at the level of an object, rather than a pixel or point, limiting the fineness of the resulting 3D image in virtual and augmented reality applications.
Innovation Solution
A sensing device comprising a first sensor and a second sensor, each generating depth information with different sampling rates and precisions, where a computing unit performs a fusion operation by mapping and weighting the depth information to achieve fused depth information with the first precision and second sampling rate, using error weights, distance weights, area weights, and confidence weights to integrate the data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a first sensor generates depth information with high precision, then depth precision is improved, but sampling rate deteriorates
Solution Approach 1:
The patent combines the output of two different sensors: a first sensor that provides high precision depth information and a second sensor that provides high sampling rate depth information. The computing unit fuses these two data sources to produce combined depth information that achieves both high precision and high sampling rate, resolving the contradiction between these two performance parameters.
2Device complexity
If existing fusion technology generates fused information at object level, then processing complexity is reduced, but fineness of fused results deteriorates
Solution Approach 1:
The patent segments the fusion process into multiple stages: first mapping depth information from the second sensor to the coordinate system of the first sensor, then performing pixel-level fusion by identifying corresponding pixels between the two depth maps. This segmentation allows the system to achieve fine-grained pixel-level fusion results while managing processing complexity through systematic breakdown of the fusion task.
Solution Approach 2:
The patent applies local quality by performing fusion operations at the pixel level rather than at the object level. Each pixel in the depth information is processed individually to determine the most accurate depth value, allowing different regions of the image to have optimized fusion results based on their specific characteristics and requirements.
Data Source
AI summary
A sensing device comprises a first sensor, a second sensor and a computing unit. The first sensor generates a plurality of first depth information with a first sampling rate and a first precision. The second sensor generates a plurality of second depth information with a second sampling rate and a second precision. The second sampling rate is greater than the first sampling rate, and the second precision is less than the first precision. The computing unit performs a fusion operation according to the first depth information and the second depth information to obtain a fused depth information. The fused depth information has the first precision and the second sampling rate.