Hybrid Depth Estimation System Using Switchable Projector
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional depth estimation systems face challenges with energy dispersion and high power consumption in Time-of-flight sensors and bulkiness in structured light systems, necessitating a hybrid approach that balances power efficiency, quality, and distance.
Innovation Solution
A hybrid depth estimation system incorporating a switchable projector that alternates between dot and surface light, a sensor for capturing images, dot and surface ToF depth generators, a denoise processor, and a fusion processor to generate enhanced depth maps, leveraging context-aware adaptive optimization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional Time-of-flight depth sensors with surface light projectors are used, then depth information can be obtained, but energy dispersion and high power consumption occur
Solution Approach 1:
The system segments the light projection into two distinct modes: dot light projection and surface light projection. The switchable projector alternates between these modes, using dot light for power-efficient operation and surface light for high-quality depth mapping, thereby resolving the contradiction between power consumption and depth information quality
Solution Approach 2:
The system implements periodic switching between dot light mode and surface light mode. The projector projects dot light for a first period to capture dot images with lower power consumption, then switches to surface light for a second period to capture surface images for high-quality depth mapping, achieving both power efficiency and measurement precision through time-multiplexed operation
2Use of energy by moving object
If conventional structured light systems are used, then depth information is obtained with low power consumption, but the system becomes bulky due to required baseline
Solution Approach 1:
The system merges ToF depth generation with structured light patterns by projecting dot light patterns through the switchable projector. This combination allows the system to achieve structured light's power efficiency while using ToF measurement principles, eliminating the need for bulky baseline structures required by conventional structured light systems
3Use of energy by moving object
If dot light mode is used, then power consumption is reduced, but depth map quality and working range are limited
Solution Approach 1:
The system periodically switches between dot light mode and surface light mode. During dot light periods, power consumption is reduced while capturing dot images. During surface light periods, high-quality depth mapping is performed. The periodic switching ensures both power efficiency and depth map quality are achieved over the complete measurement cycle
Solution Approach 2:
The system uses an intermediary fusion process that combines depth maps from both dot light mode and surface light mode. The fusion processor integrates the power-efficient dot depth maps with the high-quality surface depth maps, producing a final depth map that achieves both low power consumption characteristics and high measurement precision
4Measurement precision
If surface light mode is used, then high quality depth maps are generated, but power consumption increases
Solution Approach 1:
The system limits surface light projection to specific periodic intervals rather than continuous operation. Surface light is activated only during the second period when high-quality depth mapping is required, while dot light handles routine power-efficient operation during the first period, thereby achieving high depth map quality only when necessary and reducing overall power consumption
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system achieves improved detectable size, enhanced working range, robustness to optical phenomena, and reduced power consumption while maintaining high quality, outperforming conventional systems in both Time-of-flight and structured light technologies.
Implementation Method 1
The sensor receives reflected dot light or reflected surface light from the object
Implementation Method 2
Time-of-flight (ToF) depth sensors are widely used to obtain depth information by measuring elapsed time taken for projected light to reflect off a scene object and captured by the ToF depth sensor
Data Source
AI summary
A hybrid depth estimation system includes a switchable projector that controllably projects either dot light or surface light onto an object; a sensor that receives reflected dot light or reflected surface light from the object to capture a first image or a second image respectively; a dot time-of-flight (ToF) depth generator that generates a dot depth map and an associated dot confidence map according to the first image; a surface ToF depth generator that generates a surface depth map according to the second image; and a denoise processor that processes the surface depth map according to a plurality of points on the dot depth map with high confidence, thereby generating a denoised depth map.