ToF Depth Computation Motion Blur Mitigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Time-of-flight ranging technologies face challenges in accurately computing depth information due to motion blur, which can result in inaccurate or blurred frames, especially with longer exposure times.

Innovation Solution

A computation device and processing method that evaluates intensity information from multiple phases to determine if motion blur is present, allowing for the abandonment of affected pixels and re-photography or the use of valid pixels only, thereby alleviating the influence of motion blur on depth information estimation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If exposure time is increased to receive more modulation light data, then the amount of received data increases, but motion blur occurs causing inaccurate depth information

Engineering Contradiction:
Improveamount of received modulation light dataVSAvoiddepth information accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by evaluating intensity information from multiple phases before final depth computation to identify pixels affected by motion blur. The system performs phase difference analysis and intensity comparison in advance to flag problematic pixels, then excludes them from depth calculation, preventing motion blur from compromising measurement precision while maintaining longer exposure times for sufficient light data collection.

Inventive Principle:
Principle #10Preliminary action

2Use of energy by moving object

If exposure time is extended to improve signal reception, then more light data is captured, but the frame becomes blurred due to object movement

Engineering Contradiction:
Improvesignal reception efficiencyVSAvoidframe stability
Core Design Contradiction:
Use of energy by moving objectVSStability of the object's composition

Solution Approach 1:

The patent introduces an intermediary evaluation mechanism that uses intensity information from multiple phases as a mediator between signal reception and frame stability. By analyzing phase differences and intensity variations, the system identifies pixels where motion blur has occurred, then excludes these pixels from depth computation. This intermediary step allows the system to maintain extended exposure times for improved signal reception while preserving frame stability through selective pixel validation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If multiple phase intensity measurements are performed to detect motion blur, then motion blur detection accuracy improves, but processing complexity increases

Engineering Contradiction:
Improvemotion blur detection accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by utilizing intensity information from multiple phases (different time delays) as additional parameters for motion blur detection. The system compares intensity values across phases and evaluates phase differences to identify motion blur. While this multi-parameter approach improves detection accuracy, it increases processing complexity. The patent balances this by implementing efficient evaluation algorithms that process phase information systematically.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Effectively reduces the impact of motion blur on depth information estimation by identifying and mitigating blurred pixels, improving the accuracy of depth computation in ToF ranging systems.

Implementation Method 1

time-of-flight (ToF) ranging is now a common active depth sensing technology. The basic principle of the ToF ranging technology is that modulation light (e.g., infrared light or laser light, etc.) is reflected by an object after being emitted, and the distance of the object being photographed is calculated through conversion based on a reflection time difference or a phase difference of the reflected modulation light

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS11467258B2Computation device, sensing device and processing method based on time of flight
Publication Date: 2022.10.11 LITE ON ELECTRONICS (GUANGZHOU) LTD
  • US11467258B2 patent drawing
  • US11467258B2 patent drawing
  • US11467258B2 patent drawing

AI summary

A computation device, a sensing device and a processing method based on time-of-flight (ToF) ranging are provided. In the method, intensity information of at least two phases corresponding to at least one pixel is obtained. The intensity information is generated by sensing a modulation light with time delays using these phases. Whether to abandon the intensity information of the at least two phases corresponding to the pixel is determined according to the difference between the intensity information of the at least two phases. Accordingly, the influence caused by motion blur would be reduced on depth information estimation.