ToF and Image Sensor Fusion for High-Resolution Depth Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing depth sensing technologies using dual cameras are costly, prone to high error rates, alignment issues, and thermal problems, making them inefficient for accurate depth information generation.
Innovation Solution
A combination of a time-of-flight (ToF) sensor and an image sensor with a phase detection function, utilizing a light source with patterned shapes to project and detect structured light, allowing for accurate alignment and combination of distance and phase information to generate high-resolution depth maps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If dual cameras are used for depth sensing, then depth information can be obtained, but the cost increases and error rates become high
Solution Approach 1:
The patent combines a time-of-flight (ToF) sensor and an image sensor with phase detection function into a single depth sensing system. The ToF sensor provides absolute distance measurements while the image sensor provides relative depth information, and their data is merged to generate high-resolution depth maps with reduced error rates compared to dual camera systems
2Measurement precision
If dual cameras are used for depth sensing, then depth information can be obtained, but alignment issues and thermal problems occur
Solution Approach 1:
By integrating ToF and image sensors in close proximity on the same substrate, the patent eliminates the alignment issues between separate camera units. The sensors share common optical paths and processing circuits, reducing mechanical alignment requirements and thermal management complexity while maintaining depth sensing accuracy
3Measurement precision
If a ToF sensor is used alone, then absolute distance information is obtained, but the resolution is low
Solution Approach 1:
The patent merges the absolute distance measurements from the ToF sensor with the high-resolution relative depth information from the image sensor's phase detection function. This combination produces depth maps that have both the accuracy of absolute measurement and the high resolution of the image sensor, overcoming the resolution limitation of standalone ToF sensors
4Manufacturing precision
If an image sensor with phase detection is used alone, then high resolution depth information is obtained, but absolute distance accuracy is reduced
Solution Approach 1:
The patent combines the high-resolution relative depth measurements from the image sensor with the absolute distance information from the ToF sensor. The processing circuitry integrates these two data sources to generate depth maps that maintain both the high resolution of phase detection and the absolute accuracy of time-of-flight measurements
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution provides a cost-effective, low-power, and accurate method for depth sensing, reducing error rates and alignment issues, resulting in high-resolution depth maps with improved precision.
Implementation Method 1
One example of the ranging sensor includes a time of flight (ToF) sensor which can accurately detect a distance from the sensor to an object or objects being imaged
Implementation Method 2
The image sensor includes a sensor having a phase detection function, phase detect autofocus function, or similar functions
Implementation Method 3
a light source having patterned shapes (e.g., a vertical-cavity surface-emitting laser (VCSEL) having a diffractive optical element (DOE) on the VCSEL)
Implementation Method 4
The ToF may include single-photon avalanche diodes (SPADs), which provide accurate depth information
Data Source
AI summary
The present disclosure provides a device and method for depth sensing by utilizing the combination of a ranging sensor and an image sensor. The ranging sensor can accurately detect distance measurement from an object. The image sensor can take images with high resolution of the object. By combining each sensor data from the ranging sensor and the image sensor, accurate depth information with high resolution of the object may be obtained. A structured light having patterned shapes are used in conjunction with the ranging sensor to receive reflected patterned shapes of the object. These reflected patterned shapes are used to analyze distance measurements associated with the specific patterned shapes. These distance measurements from both the ranging sensor and the image sensor is aligned and combined to generate an accurate depth map with high resolution using a processor of an electronic device including the ranging sensor and the image sensor.