Depth Camera Synchronization via Self-Adjusted Demodulation Clock

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In multi-Time of Flight (ToF) depth camera systems, synchronization of multiple depth cameras is challenging due to distance deviations and interference between cameras, leading to reduced frame rates and increased depth errors, especially when using different frequencies or pulse widths for emitting lights.

Innovation Solution

A depth camera system that includes a sensor unit and a synchronization information calculation unit to adjust the frequency and phase of the demodulation clock based on performance indices derived from the electrical sensing signals, ensuring accurate synchronization of the cameras.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a trigger for initialization is periodically applied to synchronize multiple depth cameras, then synchronization is achieved, but the frame rate of the three-dimensional image is reduced and deviation occurs due to distance difference between host and cameras

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidframe rate
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements feedback by having each depth camera measure its own distance to the host and use this information to automatically adjust its operation timing. The camera calculates a time compensation value based on its measured distance and applies this to synchronize its frame capture without requiring external trigger signals, thereby eliminating the trade-off between synchronization accuracy and frame rate.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Each depth camera performs self-synchronization by measuring its own distance to the host and independently calculating the appropriate time compensation. This self-service mechanism eliminates the need for centralized triggering by the host, allowing each camera to autonomously adjust its frame capture timing based on its specific position, thus maintaining high frame rates while achieving accurate synchronization.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If emitting lights having different frequencies or pulse widths are used in multi-ToF method, then depth measurement capability is improved, but depth error increases due to interference between depth cameras

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidinterference between cameras
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent segments the light emission by assigning different time windows or time slots to each depth camera based on their positions relative to the host. Each camera operates in a designated time interval, preventing temporal overlap and thus eliminating interference between cameras while maintaining the ability to use different frequencies for improved depth measurement.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts the emission timing and parameters of light sources based on the measured distances of individual cameras. By making the emission schedule adaptive rather than static, the system can optimize frequency and pulse width assignments for each camera without causing interference, thereby maintaining high measurement precision.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the synchronization of depth cameras, reducing distance-related deviations and interference, thereby improving the accuracy and resolution of three-dimensional image capture while maintaining high frame rates.

Implementation Method 1

a sensor unit configured to receive a reflected light and in response thereto to output an electrical sensing signal

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

a method of measuring a time taken until an emitted light returns after it is reflected by an object is widely used. The time is referred to as 'time of flight (ToF)'

Methodology Applied
Scientific EffectTime of Flight: Time of Flight

Data Source

PatentUS9253471B2Depth camera, multi-depth camera system and method of synchronizing the same
Publication Date: 2016.02.02 SAMSUNG ELECTRONICS CO LTD
  • US9253471B2 patent drawing
  • US9253471B2 patent drawing
  • US9253471B2 patent drawing

AI summary

A depth camera includes a sensor unit receiving a reflected light and in response thereto outputting an electrical sensing signal; and a synchronization information calculation unit calculating a performance index with reference to the sensing signal, and with reference to the performance index, generating synchronization information for synchronizing a demodulation clock for sensing the received reflected light. The sensor unit adjusts the frequency and/or phase of the demodulation clock with reference to the synchronization information.