Time-of-Flight Sensor Motion Blur Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for obtaining depth images, such as stereo vision and structured light, face accuracy issues as distance increases and are dependent on surface conditions, while time-of-flight (TOF) methods suffer from motion blur, which affects the precision of depth information.

Innovation Solution

A method and apparatus using a TOF sensor that emits light with multiple phases, detects and corrects motion blur by compensating intensity differences between images using a cumulative distribution function and the PatchMatch algorithm, generating accurate depth images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If TOF method is used to obtain depth image, then depth information can be obtained, but motion blur occurs which affects precision

Engineering Contradiction:
Improvedepth information precisionVSAvoidmotion blur
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent divides the depth image into multiple regions based on motion blur detection, and applies different correction strategies to different regions. The image is segmented into motion blur areas and non-motion blur areas, allowing selective correction that preserves depth information precision while removing motion blur artifacts.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements an iterative correction process where motion blur detection and correction are performed multiple times with increasing iterations. Each iteration refines the correction based on feedback from the previous results, progressively improving the quality of depth information while reducing motion blur effects.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If light emission and detection processes are performed, then depth information is obtained, but processing time increases

Engineering Contradiction:
Improvedepth information accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary motion blur detection and classification before executing the full correction process. By pre-identifying motion blur areas and their severity levels, the system can prepare correction parameters in advance and execute corrections more efficiently, reducing overall processing time while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial correction to less severe motion blur cases and full correction only when necessary. For regions with minor motion blur, simplified correction algorithms are used, while only severe cases receive intensive processing, thereby reducing total processing time while maintaining sufficient accuracy for most applications.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively corrects motion blur in depth images, improving the accuracy of depth information by identifying and adjusting for intensity differences and phase variations, resulting in more precise depth data even at increased distances.

Implementation Method 1

The TOF method measures the flight time of an illumination light reflected from the object and received by a light receiver after the light is emitted to the object

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

emitting light having a plurality of phases toward an object, the light being reflected from the object

Methodology Applied
Scientific EffectPhase modulation: Phase Modulation

Data Source

PatentUS10516875B2Method and apparatus for obtaining depth image by using time-of-flight sensor
Publication Date: 2019.12.24 SAMSUNG ELECTRONICS CO LTD
  • US10516875B2 patent drawing
  • US10516875B2 patent drawing
  • US10516875B2 patent drawing

AI summary

A method and an apparatus for obtaining a depth image by using a time-of-flight sensor may generate a depth image based on a plurality of images in which a motion blur area caused by a movement of an object was corrected. In this case, since the motion blur area is corrected after an initial phase difference of emitted light is compensated, an accuracy of the depth image may be enhanced.