Depth Image Generation Using Segmented Photogates for High Frame Rates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D image sensing technologies face challenges in enhancing frame rates for real-time depth image acquisition, which affects picture quality and application performance in fields like face tracking, gaming, digital cameras, and navigation.

Innovation Solution

A method and apparatus that emit light to an object for a predetermined time, detect light information using a sensor unit with photogates, and calculate depth using the accumulated electric charge, allowing for quick depth image generation by determining the time when light is received relative to the photogate activation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional 3D image sensing technology is used to acquire depth information, then depth image can be obtained, but the frame rate is low and picture quality deteriorates

Engineering Contradiction:
Improveframe rateVSAvoidpicture quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The sensor unit is divided into multiple photogates within each pixel, with each photogate independently detecting light at different time intervals. This segmentation allows parallel processing of depth information for multiple time points, significantly increasing the frame rate while maintaining accurate depth measurement for each pixel

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The photogates are activated in periodic time intervals to detect light at different moments. By using periodic activation patterns, the system captures depth information at multiple time points within a single measurement cycle, enabling high frame rate depth image acquisition without sacrificing measurement precision

Inventive Principle:
Principle #19Periodic action

2Measurement precision

If light detection time is extended to improve depth measurement accuracy, then measurement precision improves, but acquisition time increases and frame rate decreases

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidacquisition time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Multiple photogates are pre-configured with different activation times before the measurement process begins. This preliminary arrangement allows the system to simultaneously capture depth information at multiple time intervals without sequential processing, reducing total acquisition time while maintaining precise depth measurement through multiple temporal samples

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If multiple time points are measured to improve depth image quality, then picture quality improves, but the complexity of the detection system increases

Engineering Contradiction:
Improvedepth image qualityVSAvoiddetection system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Multiple photogates are integrated within a single pixel structure, sharing common optical paths and signal processing circuits. This merging approach allows the system to perform multi-time-point depth measurement without proportionally increasing system complexity, as the photogates utilize shared hardware resources while maintaining independent detection capabilities

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables faster depth image acquisition, enhancing frame rates and improving picture quality by reducing the time required for depth image capture, thereby increasing the number of frames that can be acquired in a given time.

Implementation Method 1

emitting light to an object for a first predetermined time period; detecting first light information of the object for the first predetermined time period from the time when the light is emitted

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

detecting second light information of the object for the first predetermined time period a second predetermined time period after the time when the light is emitted; by using the detected first and second light information, generating a depth image of the object

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 3

detecting first light information of the object for the first predetermined time period from the time when the light is emitted; detecting second light information of the object

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS8305562B2Depth image generating method and apparatus
Publication Date: 2012.11.06 SAMSUNG ELECTRONICS CO LTD
  • US8305562B2 patent drawing
  • US8305562B2 patent drawing
  • US8305562B2 patent drawing

AI summary

A method of and apparatus for generating a depth image are provided. The method of generating a depth image includes: emitting light to an object for a first predetermined time period; detecting first light information of the object for the first predetermined time period from the time when the light is emitted; detecting second light information of the object for the first predetermined time period a second predetermined time period after the time when the light is emitted; and by using the detected first and second light information, generating a depth image of the object. In this way, the method can generate a depth image more quickly.