Fused Depth Map Generation Using Multiple Sensing Modules
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing depth mapping systems in imaging equipment face challenges in generating accurate and reliable depth maps, especially in dynamic scenes or when objects are moving, leading to difficulties in autofocusing, object detection, and other features, due to limitations in range, accuracy, and computational intensity.
Innovation Solution
The implementation of a system that uses multiple depth sensing modules, such as stereo camera, depth from shading, and structured light systems, to generate individual depth maps which are then fused into a single, spatially dependent depth map, leveraging the strengths of each method while mitigating their weaknesses.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single depth mapping method is used, then device complexity is reduced, but depth map accuracy and reliability deteriorate
Solution Approach 1:
The patent combines multiple depth mapping methods (stereo vision, structured light, time of flight) into a unified depth mapping system. The processing component fuses depth maps from multiple sources to produce a composite depth map, thereby improving accuracy and reliability while managing system complexity through integrated architecture.
Solution Approach 2:
The patent creates a composite depth mapping system that integrates different depth sensing technologies. Each method contributes its strengths (stereo for texture-rich areas, structured light for pattern recognition, time of flight for direct measurement) to form a robust composite system that overcomes individual method limitations.
2Reliability
If multiple depth mapping methods are used, then depth map reliability is improved, but computational intensity increases
Solution Approach 1:
The patent applies different depth mapping methods to different regions of the field of view based on their suitability. The system identifies which regions benefit from which methods and processes only the necessary portions, reducing overall computational load while maintaining reliability in critical areas.
Solution Approach 2:
The system performs partial depth mapping by applying multiple methods only where needed rather than uniformly across the entire field of view. This selective approach reduces computational intensity while maintaining depth map reliability in regions where it matters most.
3Measurement precision
If multiple depth mapping methods are used, then coverage of accurate depth measurements is improved, but processing time increases
Solution Approach 1:
The system performs preliminary analysis to identify regions requiring accurate depth measurements and pre-selects the most appropriate depth mapping methods for those regions. This preliminary planning reduces processing time by avoiding unnecessary computations in areas where multiple methods are not needed.
Solution Approach 2:
The patent dynamically adjusts processing parameters such as resolution, sampling rate, and method selection based on scene characteristics and required accuracy levels. This adaptive parameter adjustment maintains comprehensive coverage of accurate depth measurements while optimizing processing time through selective detail levels.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach results in a more accurate and reliable depth map that can capture objects at the desired depth with improved focus and detection capabilities, even in complex scenes, by combining the strengths of different depth mapping techniques and compensating for their individual limitations.
Implementation Method 1
stereo camera
Implementation Method 2
depth from shading
Implementation Method 3
structured light systems
Data Source
AI summary
Systems, apparatus, and methods for generating a fused depth map from one or more individual depth maps, wherein the fused depth map is configured to provide robust depth estimation for points within the depth map. The methods, apparatus, or systems may comprise components that identify a field of view (FOV) of an imaging device configured to capture an image of the FOV and select a first depth sensing method. The system or method may sense a depth of the FOV with respect to the imaging device using the first selected depth sensing method and generate a first depth map of the FOV based on the sensed depth of the first selected depth sensing method. The system or method may also identify a region of one or more points of the first depth map having one or more inaccurate depth measurements and determine if additional depth sensing is needed.