Time-of-Flight Circuitry Motion Compensation Multipath Artifacts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Time-of-flight imaging systems face challenges such as multipath artifacts and limited resolution due to the discrete nature of light sources, which degrade the accuracy of depth maps and three-dimensional models.

Innovation Solution

A time-of-flight imaging circuitry and method that utilizes a spotted light source and image sensor to obtain and merge image data from different positions, estimating motion between frames to reduce multipath effects and increase resolution by recognizing and compensating for multipath artifacts through motion of the light source and image sensor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If spotted light is used to illuminate the scene, then the device complexity is reduced, but multipath artifacts and limited resolution deteriorate the measurement precision

Engineering Contradiction:
Improvedevice complexityVSAvoidmeasurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by intentionally moving the spotted light source between different positions during the imaging process. Instead of using a static light source, the system dynamically changes the illumination positions to capture multiple views of the scene, which enables motion estimation and multipath artifact reduction while maintaining the simplicity of the spotted light approach

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent transitions from a single static illumination position to multiple dynamic positions in space. By adding the spatial dimension of light source movement, the system captures additional information about the scene from different viewpoints, enabling the separation of direct and indirect light paths and thereby improving measurement precision without significantly increasing device complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple image data are merged to increase resolution, then the measurement precision is improved, but the device complexity and processing complexity increase

Engineering Contradiction:
Improvemeasurement precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent employs feature-based motion estimation that leverages the natural features present in the captured image data. The system identifies features in the first and second image data and automatically estimates motion between them, allowing the data itself to provide the information needed for alignment and merging without requiring complex external calibration or control mechanisms

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances image quality and resolution by accounting for motion between frames, effectively reducing multipath artifacts and improving the accuracy of depth measurements in time-of-flight imaging systems.

Implementation Method 1

obtain first image data from an image sensor, the first image data being indicative of a scene, which is illuminated with spotted light

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

time-of-flight imaging systems are known. Such systems typically measure a roundtrip delay of emitted light

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS20230003894A1Time-of-flight imaging circuitry, time-of-flight imaging system, time-of-flight imaging method
Publication Date: 2023.01.05 SONY SEMICON SOLUTIONS CORP
  • US20230003894A1 patent drawing
  • US20230003894A1 patent drawing
  • US20230003894A1 patent drawing

AI summary

The present disclosure generally pertains to a time-of-flight imaging circuitry configured to: obtain first image data from an image sensor, the first image data being indicative of a scene, which is illuminated with spotted light; determine a first image feature in the first image data; obtain second image data from the image sensor, the second image data being indicative of the scene; determine second image feature in the second image data; estimate a motion of the second image feature with respect to the first image feature; and merge the first and the second image data based on the estimated motion.