TOF Depth Camera Charge Saturation Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The Time of Flight (TOF) method for obtaining depth images can generate distortion due to saturation caused by insufficient photographing distance or high reflection from objects, leading to inaccurate depth values.

Innovation Solution

An image processing apparatus and method that includes a compensation unit to calculate a first charge quantity from a second charge quantity when the first charge quantity exceeds a predetermined saturation level, using charge quantities stored at different phases, such as 0 degrees, 90 degrees, 180 degrees, and 270 degrees, to generate accurate depth images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the TOF method is used to obtain depth images, then real-time depth image generation is achieved, but saturation distortion occurs due to insufficient photographing distance or high reflection

Engineering Contradiction:
Improvereal-time depth image generationVSAvoiddepth value accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent changes the parameter used for depth calculation by switching between first charge quantity (Q1) and second charge quantity (Q2) based on saturation detection. When Q1 exceeds saturation level, the system uses Q2 instead, effectively changing the measurement parameter to maintain accuracy while preserving real-time performance

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements a feedback mechanism where the system continuously monitors the first charge quantity Q1 for saturation and dynamically adjusts the charge quantity used for depth calculation. The determination unit detects saturation and provides feedback to the compensation unit, which then selects appropriate charge quantities to eliminate saturation distortion while maintaining real-time operation

Inventive Principle:
Principle #23Feedback

2Device complexity

If the first charge quantity is used for depth calculation, then depth image generation is simplified, but saturation causes distortion and measurement errors

Engineering Contradiction:
Improvedepth calculation processVSAvoiddepth measurement reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent prepares multiple charge quantities (Q1 and Q2) in advance at different phases before depth calculation is needed. The second charge quantity Q2 is pre-acquired at a different phase, so when saturation is detected in Q1, the system can immediately use Q2 without complex real-time adjustments, maintaining reliability while keeping the process relatively simple

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a determination unit as an intermediary that monitors charge quantity saturation and a compensation unit that mediates between different charge quantities. This intermediary mechanism automatically selects the appropriate charge quantity based on saturation conditions, ensuring reliable depth measurements without significantly complicating the overall process

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively compensates for saturation errors in depth image calculations, ensuring accurate depth image generation by using alternative charge quantities when saturation occurs, thereby improving the reliability of depth measurements.

Implementation Method 1

a sensor to measure intensity of the reflected light and generate electrical charges according to the intensity of the reflected light

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

The other one is a time of flight (TOF) method that emits light to an object and measured the time taken for the light to be reflected from the object to determine depth of the object

Methodology Applied
Scientific EffectTime of Flight: Time of Flight

Data Source

PatentUS9628774B2Image processing method and apparatus
Publication Date: 2017.04.18 SAMSUNG ELECTRONICS CO LTD
  • US9628774B2 patent drawing
  • US9628774B2 patent drawing
  • US9628774B2 patent drawing

AI summary

An image processing apparatus is provided. The image processing apparatus determines whether a first charge quantity of charges stored in a first charge storage is greater than or equal to a predetermined saturation level, the first charge storage among a plurality of charge storages configured to store charges generated by a sensor of a depth camera. According to the determination result, when the first charge quantity is greater than or equal to the saturation level, the image processing apparatus may calculate the first charge quantity from at least one second charge quantity of charges stored in at least one second charge storage which is different from the first charge storage among the plurality of charge storages.