3D Time-of-Flight Camera Rectification Operator

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D time-of-flight cameras require multiple samples to determine depth images, which limits their frame rate and introduces systematic errors due to inhomogeneous detection units, making real-time applications challenging.

Innovation Solution

The use of rectification operators to correct samples based on implicit real-time estimation, compensating for the different characteristic curves of detection units, allowing for fewer samples to be used while eliminating the need for averaging techniques and reducing systematic errors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple samples are used to determine depth images, then measurement precision is improved, but productivity deteriorates due to limited frame rate

Engineering Contradiction:
Improvedepth measurement precisionVSAvoidframe rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies preliminary action by performing rectification of detection unit characteristics before depth calculation. The rectification operator corrects systematic errors from inhomogeneous detection units in advance, allowing accurate depth computation from fewer samples. This preliminary correction enables using only 2-3 samples per pixel instead of multiple samples, thereby increasing frame rate while maintaining measurement precision.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple samples are used to compensate sensor inhomogeneities, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improvephase shift measurement precisionVSAvoidacquisition time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The rectification operator is computed once beforehand to characterize detection unit inhomogeneities. This preliminary computation stores correction factors that are then applied during depth image acquisition. By performing the complex compensation calculation in advance rather than during each measurement, the system achieves accurate phase shift measurement from minimal samples, significantly reducing acquisition time and eliminating the need for multiple redundant samples.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If averaging techniques are used to compensate sensor inhomogeneities, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvedepth image accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transforms the problem from spatial averaging across multiple detection units to temporal parameter correction using a rectification operator. Instead of averaging multiple samples from inhomogeneous detection units, the system applies a pre-computed rectification operator that corrects each detection unit's output based on its individual characteristics. This parameter transformation simplifies the processing pipeline by replacing complex averaging operations with direct correction calculations.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the computation of scene-related information, such as phase shifts and depth maps, with increased frame rates and reduced motion artifacts, without additional systematic errors, facilitating real-time applications.

Implementation Method 1

a radiation source (12) that generates and emits electromagnetic radiation (13) for illuminating a scene (2)

Methodology Applied
Scientific EffectElectromagnetic radiation emission: Light

Implementation Method 2

a radiation detector (14) that detects electromagnetic radiation (15) reflected from the scene (2)

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 3

3D time-of-flight (ToF) cameras acquire depth images by determining the time which radiation, preferably light, needs from a source to an object and back to the camera

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS8786678B23D time-of-flight camera and method
Publication Date: 2014.07.22 SONY GROUP CORP
  • US8786678B2 patent drawing
  • US8786678B2 patent drawing
  • US8786678B2 patent drawing

AI summary

3D time-of-flight camera and a corresponding method for acquiring information about a scene. To increase the frame rate, the proposed camera comprises a radiation source, a radiation detector comprising one or more pixels, wherein a pixel comprises two or more detection units each detecting samples of a sample set of two or more samples and an evaluation unit that evaluates said sample sets of said two or more detection units and generates scene-related information from said sample sets. Said evaluation unit comprises a rectification unit that rectifies a subset of samples of said sample sets by use of a predetermined rectification operator defining a correlation between samples detected by two different detection units of a particular pixel, and an information value calculator that determines an information value of said scene-related information from said subset of rectified samples and the remaining samples of the sample sets.