Depth Sensor Frame Signal Grouping for Omission Error Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Depth sensors using the time-of-flight principle experience errors in depth calculation due to the omission of frame signals, particularly at high-speed operations with 1-tap or 2-tap pixel structures.
Innovation Solution
A depth estimation method and device that group frame signals into groups based on the existence and pattern of omitted signals, using a depth sensor with a light source, depth pixel, digital circuit, and memory to estimate depth without errors by sharing frame signals between groups and detecting phase differences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a depth sensor operates at high speed with 1-tap or 2-tap pixel structure, then the frame rate is improved, but frame signal omission occurs causing depth calculation error
Solution Approach 1:
The system performs preliminary detection of frame signal existence before using them for depth calculation. By checking whether each frame signal is present in advance, the system can prevent errors from omitted signals while maintaining high frame rates
Solution Approach 2:
The system uses feedback information about frame signal existence to adjust the depth calculation process. Based on which frame signals are present and which are omitted, the system dynamically selects appropriate signal combinations, ensuring accurate depth measurement even at high frame rates
2Measurement precision
If all frame signals are used for depth estimation, then measurement precision is improved, but computational complexity increases when handling omitted signals
Solution Approach 1:
The system segments the frame signals into valid and invalid groups based on their existence. By dividing the signals into these segments, the system can process only the valid ones for depth estimation, maintaining precision while reducing complexity from handling missing data
Solution Approach 2:
The system changes the parameter of frame signal usage based on their existence status. When frame signals are omitted, the system adjusts which signals are used for calculation, changing the effective parameter set to maintain accurate depth estimation without processing nonexistent signals
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach compensates for errors caused by omitted frame signals, providing accurate depth estimation and more natural depth images by utilizing a moving window grouping method.
Implementation Method 1
generating a plurality of frame signals based on a reflected optical signal from the object and a plurality of gate signals periodically applied to a depth pixel
Implementation Method 2
measures a time that a pulse signal has taken to travel from a source to an object (or a target to be measured) and back using the TOF principle
Data Source
AI summary
A depth estimation apparatus and method are provided. The depth estimation method includes grouping a plurality of frame signals generated by a depth pixel into a plurality of frame signal groups which are used to estimate a depth to an object without a depth estimation error caused by an omission of a frame signal, the grouping of the a plurality of frame signals based on whether an omitted frame signal exists in the plurality of frame signals and based on a continuous pattern of the plurality of frame signals; and estimating the depth to the object using each of the plurality of frame signal groups.