ToF Depth Map Correction Using Shared Structured Light Motion Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Time-of-flight (ToF) imaging is affected by target and sensor motion, as well as intermittent objects, leading to errors in depth map construction and interference with tasks like flickering detection, due to the reliance on intrinsic correlations between sub-frames for correction, which often fails when these correlations are already exploited for other tasks.
Innovation Solution
An imaging apparatus and method that perform depth analysis using ToF imaging and motion analysis using structured light imaging, sharing identical sensor data to reliably identify motion and correct depth maps without additional measurements, by projecting a single light pattern and using a ToF sensor to detect changes in the pattern for both analyses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If intrinsic correlation between sub-frames is used for motion correction in ToF imaging, then motion errors can be corrected, but this strategy fails when correlations are already exploited for other tasks like flickering detection and multicamera detection
Solution Approach 1:
The patent segments the analysis by performing motion detection using structured light imaging (disparity analysis) separately from depth map construction using ToF imaging. This segmentation allows each method to use the sensor data independently according to its strengths, avoiding correlation conflicts between multiple tasks.
Solution Approach 2:
The patent makes the sensor data universal by using identical sensor data for both ToF depth analysis and structured light motion analysis. This multi-functional use of the same data source enables both depth mapping and motion detection to benefit from the same measurements without requiring separate sensor systems.
2Productivity
If ToF imaging is performed with a single light pattern, then measurement speed is improved, but motion of target and sensor during filming introduces errors in depth map construction
Solution Approach 1:
The patent introduces structured light disparity analysis as an intermediary method to detect motion. This intermediary motion detection mechanism identifies target and sensor motion, which then enables correction of the ToF depth measurements, resolving the precision issue while maintaining high imaging speed.
Solution Approach 2:
The patent implements feedback by using motion information detected through structured light analysis to correct the ToF depth maps. The motion detection results feed back into the depth mapping process, allowing real-time correction of motion-induced errors and improving measurement precision.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for accurate motion detection and correction of depth maps, enhancing the reliability of ToF imaging by using structured light information to augment and correct depth analysis, thereby improving the accuracy and functional safety of imaging systems.
Implementation Method 1
The depth map is typically constructed based on a roundtrip time of light emitted by a projection device and reflected at the target
Implementation Method 2
performing motion analysis in the scene by structured light imaging... by projecting a single light pattern and using a ToF sensor to detect changes in the pattern
Data Source
AI summary
An imaging apparatus includes a circuitry configured to perform depth analysis of a scene by time-of-flight imaging and to perform motion analysis in the scene by structured light imaging, wherein identical sensor data is used for both, the depth analysis and the motion analysis.