Time-of-Flight Camera Blur Detection and Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Time-of-Flight (ToF) cameras experience image blur due to movement during the integration time, leading to inaccurate depth information, which is distinct from the blur phenomenon in color cameras, and existing methods are inadequate for effectively addressing this issue.

Innovation Solution

An apparatus and method that generate control signals with different phases to integrate reflected light signals, determining blur by comparing electric charge quantities using a diamond-shaped graph for reference relationships, and deblurring by replacing pixel values with adjacent non-blurred pixel values or filtering in R-Theta space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the integration time is extended to improve depth measurement accuracy, then the measurement precision is improved, but the image blur increases due to movement during the integration period

Engineering Contradiction:
Improvedepth information accuracyVSAvoidimage blur
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent applies periodic action by using multiple control signals with different phases (first phase, second phase, third phase, fourth phase) to periodically sample the reflected light signal. This allows the system to acquire depth information through periodic phase comparisons while avoiding the need for long continuous integration that causes motion blur. The periodic sampling at different phases enables accurate depth measurement without requiring the sensor to be exposed for an extended continuous period.

Inventive Principle:
Principle #19Periodic action

2Measurement precision

If multiple control signals with different phases are used to improve depth accuracy, then the measurement precision is improved, but the device complexity increases

Engineering Contradiction:
Improvephase difference calculation accuracyVSAvoidcontrol signal generation and processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the depth measurement process into multiple discrete phase sampling steps. Instead of using a single complex continuous measurement, the system segments the integration period into multiple sub-periods, each controlled by a different phase control signal. This segmentation allows the complex measurement task to be broken down into simpler, manageable steps that can be processed sequentially, reducing overall system complexity while maintaining high measurement precision.

Inventive Principle:
Principle #1Segmentation

3Illumination intensity

If the integration time is extended to capture more light signal, then the signal-to-noise ratio is improved, but the temporal resolution decreases due to motion blur

Engineering Contradiction:
Improvereflected light signal strengthVSAvoidtemporal resolution
Core Design Contradiction:
Illumination intensityVSSpeed

Solution Approach 1:

The patent uses periodic action to achieve both high signal-to-noise ratio and high temporal resolution. By periodically switching between multiple phase control signals during the integration period, the system accumulates light signal over an extended time (improving signal strength) while simultaneously sampling at discrete phase points (maintaining temporal resolution). This periodic multiphase sampling allows the sensor to capture sufficient light energy without suffering from motion blur that would occur with continuous long-duration integration.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Efficiently determines and deblurs blur in ToF camera images by accurately calculating phase differences and replacing blurred values, improving depth information accuracy and image clarity.

Implementation Method 1

integrate, based on the generated control signal, electrons generated by a reflected light signal corresponding to a radiated light signal reflected and returned from an object

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentEP2733928B1Device and method for blur processing
Publication Date: 2021.09.22 SAMSUNG ELECTRONICS CO LTD
  • EP2733928B1 patent drawingFigure 1
  • EP2733928B1 patent drawingFigure 2
  • EP2733928B1 patent drawingFigure 3

AI summary

Provided is a blur processing method and apparatus that may determine whether a blur occurs in an image generated by a Time of Flight (ToF) camera, and may deblur a blur using a value of a normal adjacent pixel in which the blur is absent when the blur occurs.