Depth Image Generation Using Multi-Position Light Source Transition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current depth image generation methods, such as the time of flight (TOF) method, face challenges with saturation regions when light intensity exceeds sensor capabilities, leading to indeterminable distances and reduced signal-to-noise ratio (SNR), which compromises image quality.

Innovation Solution

A depth image generation apparatus and method that utilize multiple intensity images from varying light source positions to determine surface information and generate output depth images, removing saturation regions by matching and combining depth information from multiple original depth images, thereby enhancing image accuracy and reducing noise and saturation region size.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If integration time is reduced to reduce saturation region, then saturation region size is reduced, but signal to noise ratio decreases

Engineering Contradiction:
Improvesaturation region sizeVSAvoidsignal to noise ratio
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The system uses multiple light sources that are activated periodically and alternately to illuminate different regions of the object. By switching between multiple light sources in a periodic manner, the patent achieves comprehensive coverage of the object surface while controlling saturation effects, as each light source is active only during specific time intervals.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent divides the illumination task into multiple segments by using several light sources instead of one continuous light source. Each light source illuminates a specific region or aspect of the object, and the system processes multiple depth images corresponding to different light source positions to reconstruct the complete depth information, thereby avoiding saturation in any single region.

Inventive Principle:
Principle #1Segmentation

2Reliability

If multiple depth images from different light source positions are processed, then saturation regions are removed and image quality is improved, but processing complexity increases

Engineering Contradiction:
Improvedepth image qualityVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system captures multiple copies (depth images) of the object from different light source positions. These depth images serve as redundant information sources, allowing the system to identify and remove saturation regions by comparing corresponding regions across multiple images. The matching process leverages the fact that non-saturated regions should appear consistent across images.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces an intermediary processing step that uses surface information and matching algorithms to reconcile data from multiple depth images. This intermediary process identifies saturation regions by detecting inconsistencies between images and recovers valid depth information from non-saturated regions, thereby mediating between the raw multi-image data and the final cleaned depth image.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If light source position is varied to capture different intensity images, then surface information accuracy is improved, but system complexity increases

Engineering Contradiction:
Improvesurface information accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system employs dynamic positioning of light sources to illuminate the object from different angles and positions. The light sources are moved or switched to create varied illumination conditions, which enhances the accuracy of surface information extraction by providing multiple perspectives on the object's geometry and surface properties.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively eliminates saturation regions and minimizes noise, resulting in improved depth image quality by leveraging the positional and numerical variations of light sources to recover indeterminable regions and enhance SNR.

Implementation Method 1

a plurality of intensity images generated according to position of light sources

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

a time of flight (TOF) method determines a distance between an object and a depth camera using a phase difference between an output light emitted from a light source and a received light received by a sensor of the depth camera

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS9554120B2Apparatus and method for generating depth image using transition of light source
Publication Date: 2017.01.24 SAMSUNG ELECTRONICS CO LTD
  • US9554120B2 patent drawing
  • US9554120B2 patent drawing
  • US9554120B2 patent drawing

AI summary

An apparatus and method for generating a depth image using transition of light sources may include a surface information determination unit to determine surface information related to a surface of an object, using a plurality of intensity images generated according to position of light sources; and an output depth image generation unit to generate an output depth image, using an original depth image and the surface information.