ToF Camera Blur Detection and Deblurring via Electron Phase Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Time-of-Flight (ToF) cameras experience image blurring due to phase changes in reflected light signals when the camera or subject moves during integration time, leading to inaccurate depth information and blurred images, which differ from the blurring phenomenon in color cameras.
Innovation Solution
An apparatus and method that include a control unit to generate control signals, a sensor unit to integrate electrons from reflected light signals, and a blur determining unit to assess the relationship between integrated electron quantities, determining blur by comparing these to reference information and calculating phase differences, with an image processing unit that deblurs images by replacing pixel values with adjacent non-blurred pixel values or filtering in R-Theta space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the integration time is increased to improve depth measurement accuracy, then the measurement precision is improved, but the image becomes more blurred when the camera or subject moves
Solution Approach 1:
The patent applies preliminary action by determining whether a blur occurs before final image processing. The blur determining unit analyzes the relationship between quantities of electrons integrated for each control signal to predict blur occurrence, allowing the system to prepare appropriate processing strategies in advance. This is reflected in the technical solution where the blur determining unit compares electron quantity relationships to reference information to assess blur risk before completing the depth map generation.
Solution Approach 2:
The patent implements feedback by using the determined blur occurrence information to adjust subsequent image processing operations. When blur is detected, the system selectively applies deblurring algorithms or adjusts integration parameters for subsequent frames. The technical solution shows that the blur determination result feeds into the image processing pipeline, enabling dynamic adjustment of processing strategies based on actual blur conditions.
2Measurement precision
If multiple control signals with different phases are used to calculate depth information, then the measurement precision is improved, but the device complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the depth measurement process into distinct phases corresponding to different control signal phases. Each control signal phase (e.g., 0°, 90°, 180°, 270°) processes a specific portion of the modulated light signal, and the results are combined to calculate final depth information. This segmentation allows parallel processing of different phase components, improving measurement precision while managing complexity through structured division of the measurement task.
Solution Approach 2:
The patent utilizes periodic action by employing control signals that cycle through different phases in a periodic manner. The control signals are applied sequentially with regular timing intervals, allowing the system to sample reflected light at multiple phase points during each modulation cycle. This periodic approach enables accurate depth calculation through phase difference measurement while maintaining a regular, predictable processing rhythm that simplifies control logic.
3Quantity of substance
If the integration time is extended to capture more reflected light signals, then the quantity of substance (electron quantity) is improved, but the loss of time increases
Solution Approach 1:
The patent applies periodic action by using pulsed control signals that modulate the integration process in regular cycles. Instead of continuous integration, the system performs periodic integration windows synchronized with the control signal phases, allowing electron accumulation during specific time intervals. This periodic approach maximizes electron quantity capture during active integration periods while minimizing total time expenditure by eliminating idle integration periods.
Solution Approach 2:
The patent implements continuity of useful action by ensuring that the integration process continuously accumulates electron quantities across multiple control signal cycles. Rather than performing discrete, separate measurements, the system maintains continuous electron accumulation throughout the measurement period, with each control signal phase contributing to the overall depth information. This continuous accumulation maximizes the quantity of electrons captured per unit time.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Efficiently determines and deblurs blurs in ToF camera images by analyzing electron quantities and phase differences, effectively addressing the unique blurring issues in ToF cameras and improving image clarity.
Implementation Method 1
a sensor unit to integrate, based on the generated control signal, electrons generated by a reflected light signal
Data Source
AI summary
Provided is a blur processing method and apparatus that may determine whether a blur occurs in an image generated by a Time of Flight (ToF) camera, and may deblur a blur using a value of a normal adjacent pixel in which the blur is absent when the blur occurs.