Time-of-Flight Camera Blur Detection and Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Time-of-Flight (ToF) cameras experience image blur due to movement during the integration time, leading to inaccurate depth information, which is distinct from the blur phenomenon in color cameras, and existing methods are inadequate for effectively addressing this issue.
Innovation Solution
An apparatus and method that generate control signals with different phases to integrate reflected light signals, determining blur by comparing electric charge quantities using a diamond-shaped graph for reference relationships, and deblurring by replacing pixel values with adjacent non-blurred pixel values or filtering in R-Theta space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the integration time is extended to improve depth measurement accuracy, then the measurement precision is improved, but the image blur increases due to movement during the integration period
Solution Approach 1:
The patent applies periodic action by using multiple control signals with different phases (first phase, second phase, third phase, fourth phase) to periodically sample the reflected light signal. This allows the system to acquire depth information through periodic phase comparisons while avoiding the need for long continuous integration that causes motion blur. The periodic sampling at different phases enables accurate depth measurement without requiring the sensor to be exposed for an extended continuous period.
2Measurement precision
If multiple control signals with different phases are used to improve depth accuracy, then the measurement precision is improved, but the device complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the depth measurement process into multiple discrete phase sampling steps. Instead of using a single complex continuous measurement, the system segments the integration period into multiple sub-periods, each controlled by a different phase control signal. This segmentation allows the complex measurement task to be broken down into simpler, manageable steps that can be processed sequentially, reducing overall system complexity while maintaining high measurement precision.
3Illumination intensity
If the integration time is extended to capture more light signal, then the signal-to-noise ratio is improved, but the temporal resolution decreases due to motion blur
Solution Approach 1:
The patent uses periodic action to achieve both high signal-to-noise ratio and high temporal resolution. By periodically switching between multiple phase control signals during the integration period, the system accumulates light signal over an extended time (improving signal strength) while simultaneously sampling at discrete phase points (maintaining temporal resolution). This periodic multiphase sampling allows the sensor to capture sufficient light energy without suffering from motion blur that would occur with continuous long-duration integration.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Efficiently determines and deblurs blur in ToF camera images by accurately calculating phase differences and replacing blurred values, improving depth information accuracy and image clarity.
Implementation Method 1
integrate, based on the generated control signal, electrons generated by a reflected light signal corresponding to a radiated light signal reflected and returned from an object
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Provided is a blur processing method and apparatus that may determine whether a blur occurs in an image generated by a Time of Flight (ToF) camera, and may deblur a blur using a value of a normal adjacent pixel in which the blur is absent when the blur occurs.