Depth Image Generation via Phase Difference Signal Combination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Time of flight (TOF) methods for generating depth images often result in motion artifacts and offsets due to object or camera movement during integration time, leading to incorrect depth information.

Innovation Solution

A method and apparatus that acquire multiple phase difference signals with varying phase differences, generate a first depth image and a second depth image by removing motion artifacts, and combine these images using weight factors and wavelet transforms to produce a third depth image with corrected depth and shape information, eliminating motion artifacts and offsets.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple phase difference signals are acquired and combined to generate depth images, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvedepth information accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the depth image generation process into multiple independent phase difference signal acquisitions (e.g., 4-phase signals with different phase differences). Each phase difference signal is processed separately to generate individual depth images, which are then combined. This segmentation allows for more accurate depth measurement by capturing multiple perspectives while maintaining manageable processing complexity through modular computation.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If integration time is increased to improve depth measurement accuracy, then measurement precision is improved, but motion artifacts increase

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidmotion artifact
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent employs periodic modulation of the light source at different phase differences during the integration time. By acquiring multiple phase difference signals through periodic sampling (e.g., 4-phase modulation), the system achieves accurate depth measurement without requiring excessively long integration time. This periodic action allows the system to capture sufficient information while minimizing the impact of object motion during integration.

Inventive Principle:
Principle #19Periodic action

3Reliability

If phase difference signals are processed to remove motion artifacts, then reliability is improved, but processing time increases

Engineering Contradiction:
Improvedepth image qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary processing by generating multiple phase difference signals with different phase offsets during the acquisition phase. These pre-acquired signals are then combined using mathematical operations (such as phase unwrapping and interpolation) to remove motion artifacts. By preparing the phase difference signals in advance and using efficient combination algorithms, the system achieves reliable motion artifact removal without excessive processing time.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively removes motion artifacts and offsets from depth images, providing accurate depth and shape information by combining corrected depth values from multiple phase difference signals, enhancing the quality of depth images generated by TOF cameras.

Implementation Method 1

acquiring a plurality of phase difference signals which have different phase differences from one another, by sensing a reflection light reflected from the object

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

measuring a distance between a capturing apparatus and an object by measuring a turnaround time of light

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS9746547B2Method and apparatus for generating depth image
Publication Date: 2017.08.29 SAMSUNG ELECTRONICS CO LTD
  • US9746547B2 patent drawing
  • US9746547B2 patent drawing
  • US9746547B2 patent drawing

AI summary

A method of generating a depth image includes irradiating an object with a light which is generated from a light source, acquiring a plurality of phase difference signals which have different phase differences from one another, by sensing a reflection light reflected from the object, generating a first depth image based on the plurality of phase difference signals, generating a second depth image based on phase difference signals in which a motion artifact has not occurred, among the plurality of phase difference signals, generating a third depth image by combining the first depth image and the second depth image.