Indirect ToF Distance Measurement Motion Blur Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In the Indirect ToF method for distance measurement, motion blur occurs in depth maps due to the movement of the light receiving sensor while capturing four luminance images at different phases, leading to accuracy degradation in applications like SLAM and three-dimensional model generation.

Innovation Solution

A distance measuring device and method that includes a light receiving unit, a motion sensor, and a correction unit to acquire and correct luminance images based on the sensor's position and attitude, ensuring all images are captured from the same viewpoint, thereby reducing motion blur and improving depth map accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If four luminance images are acquired at different phases using the Indirect ToF method, then distance measurement capability is achieved, but motion blur occurs when the light receiving sensor moves during acquisition

Engineering Contradiction:
Improvedistance measurement accuracyVSAvoiddepth map quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies preliminary action by acquiring sensing data from the motion sensor before correcting the luminance images. The motion sensor captures position and attitude information during the phase acquisition process, which is then used to correct the images and eliminate motion blur, ensuring high-quality depth maps while maintaining distance measurement capability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by using the motion sensor to continuously monitor the position and attitude of the light receiving sensor during image acquisition. This feedback information is processed by the correction unit to dynamically adjust and correct the luminance images, creating a closed-loop system that maintains image quality despite sensor movement

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If the light receiving sensor moves during image acquisition, then device adaptability is improved, but the composition of captured images changes causing motion blur

Engineering Contradiction:
Improvesensor movement toleranceVSAvoidimage composition consistency
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent uses copying by creating a virtual reference image from the sensed position and attitude data. The correction unit generates corrected luminance images that represent what the sensor would have captured if it had remained in the reference position, effectively copying the ideal image composition despite actual sensor movement

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent applies parameter changes by transforming the luminance images using position and attitude parameters obtained from the motion sensor. The correction unit adjusts image parameters (position, orientation) based on sensed movement, compensating for sensor displacement and maintaining consistent image composition across all phases

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively suppresses motion blur in depth maps, enhancing the accuracy and quality of distance measurements, which is beneficial for applications such as SLAM, three-dimensional modeling, and augmented reality.

Implementation Method 1

a light receiving unit that receives light having a predetermined irradiation pattern reflected by a target object while sequentially shifting the light by a predetermined phase with reference to the irradiation pattern

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

a motion sensor that detects a position and an attitude of the light receiving unit

Methodology Applied
Scientific EffectInertial Sensing:

Data Source

PatentUS20240168159A1Distance measuring device, distance measuring system, and distance measuring method
Publication Date: 2024.05.23 SONY GROUP CORP
  • US20240168159A1 patent drawing
  • US20240168159A1 patent drawing
  • US20240168159A1 patent drawing

AI summary

A distance measuring device is provided that includes a first acquisition unit (232) that acquires a plurality of luminance images from a light receiving unit that receives light having a predetermined irradiation pattern reflected by a target object while sequentially shifting the light by a predetermined phase with reference to the irradiation pattern, a second acquisition unit (234) that acquires sensing data from a motion sensor that detects a position and an attitude of the light receiving unit, a correction unit (240) that corrects the luminance image on the basis of the position and the attitude obtained from the sensing data, and a calculation unit (260) that calculates a distance to the target object on the basis of the plurality of corrected luminance images.