Depth Camera Integration Time Control for Motion Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The accuracy of depth images acquired from Time-of-Flight (TOF) depth cameras is limited by the integration time, which is constrained by the desired frame rate, and is affected by object motion, requiring a dynamic adjustment mechanism to optimize image quality.

Innovation Solution

An apparatus and method that dynamically control the integration time of a depth camera based on measured motion, using a motion measurement unit and integration time controller to adjust the integration time and apply temporal filtering with an exponential weighting scheme to improve image accuracy, even with limited memory capacity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the integration time is increased to improve depth image accuracy, then the measurement precision improves, but the frame rate decreases

Engineering Contradiction:
Improvedepth image accuracyVSAvoidframe rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent implements dynamic adjustment of integration time based on detected motion levels. When motion is detected, the integration time is reduced to maintain frame rate; when motion is minimal, integration time is increased to improve accuracy. This dynamic adaptation resolves the contradiction by making the integration time flexible rather than fixed, allowing the system to optimize between accuracy and frame rate based on real-time conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the integration time parameter dynamically based on motion detection results. By monitoring motion levels and adjusting the integration time parameter accordingly, the system can shift between prioritizing accuracy (longer integration) and maintaining frame rate (shorter integration), effectively resolving the trade-off between these two competing requirements.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If the integration time is shortened to maintain frame rate, then the productivity improves, but the measurement precision deteriorates

Engineering Contradiction:
Improveframe rateVSAvoiddepth image accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system dynamically adjusts integration time based on motion detection, shortening it only when necessary to maintain frame rate while minimizing the impact on accuracy. When motion is low, the system uses longer integration times for high accuracy, and only reduces integration time when motion detection indicates it's necessary for frame rate maintenance.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses motion detection as feedback to determine appropriate integration time settings. By continuously monitoring motion levels and using this information to adjust integration time, the system can maintain frame rate when needed while preserving accuracy when possible, resolving the contradiction through closed-loop control.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If temporal filtering with multiple frames is applied to improve accuracy, then the measurement precision improves, but the memory requirement increases

Engineering Contradiction:
Improvedepth image accuracyVSAvoidmemory capacity
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts and applies only the essential temporal filtering operations needed for accuracy improvement, rather than storing and processing all possible historical frames. By selectively using previous frames for exponential weighting filtering and discarding others, the system achieves accuracy enhancement with minimal memory consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system applies partial temporal filtering using a limited number of previous frames with exponential weighting, rather than using all available historical data. This partial action provides sufficient accuracy improvement while keeping memory requirements manageable by not storing excessive frame data.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances depth image accuracy by dynamically adjusting integration time based on motion, maintaining a constant frame rate while efficiently interpolating lost data and improving image quality without requiring large memory resources.

Implementation Method 1

An accuracy of a depth image acquired from a depth camera employing a Time-of-Flight (TOF) scheme

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS8670593B2Apparatus and method for dynamically controlling integration time of depth camera for accuracy improvement
Publication Date: 2014.03.11 SAMSUNG ELECTRONICS CO LTD
  • US8670593B2 patent drawing
  • US8670593B2 patent drawing
  • US8670593B2 patent drawing

AI summary

An integration time dynamic control apparatus and method for dynamically controlling an integration time of a depth camera based on a motion of a depth image, are provided to improve an accuracy of the depth image. The integration time dynamic control apparatus may measure a motion of a depth image acquired from the depth camera, may determine whether the measured motion is greater than or equal to a reference value set in advance, and may control the integration time of the depth camera based on a result of the determination, thereby improving the accuracy of the depth image.