3D Image Acquisition Apparatus Single-Shot Depth Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D image acquisition technologies, such as time-of-flight (TOF) methods, require multiple shooting operations to obtain a depth image, which increases exposure time and is not suitable for capturing moving objects, and also face challenges in achieving precise depth information and compact configuration due to the need for multiple infrared images and complex optical setups.

Innovation Solution

A 3D image acquisition apparatus with a light source, a lens unit comprising multiple object lenses, and an image sensor with separate sensing regions, where optical shutters modulate incident light with specific gain waveforms to generate both color and depth images in a single shooting operation, allowing for a compact configuration and high-speed image capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If TOF technology uses at least three infrared images to obtain one depth image, then depth information can be extracted, but total exposure time increases and capture speed decreases

Engineering Contradiction:
Improvedepth information accuracyVSAvoidexposure time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the image sensor into multiple sensing regions, with at least one region dedicated to capturing infrared images for depth measurement and other regions for color images. This segmentation allows simultaneous capture of multiple infrared images needed for TOF depth calculation without sequentially exposing the entire sensor, thereby reducing total exposure time while maintaining depth measurement accuracy through phase-modulated infrared capture

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs periodic modulation of the infrared light source and corresponding periodic gating of the image sensor to capture multiple phase-shifted infrared images simultaneously in different sensing regions. By using periodic action at the same exposure time, the system obtains multiple phase information needed for accurate depth calculation without extending the total exposure duration, thus resolving the contradiction between measurement precision and time loss

Inventive Principle:
Principle #19Periodic action

2Productivity

If optical triangulation method is used to obtain depth information, then color image and depth image are simultaneously obtained in single shooting operation, but compact configuration cannot be achieved due to sufficient distance requirement between light source and light detector

Engineering Contradiction:
Improveimage acquisition speedVSAvoidapparatus size
Core Design Contradiction:
ProductivityVSVolume of moving object

Solution Approach 1:

The patent places the infrared light source and image sensor in a nested or integrated configuration where the light source is positioned within or adjacent to the housing that contains the image sensor. This nesting approach allows the sufficient optical distance for triangulation to be achieved within a compact form factor, as the light path is optimized within the constrained space rather than requiring external separation, thus enabling both compact configuration and simultaneous color-depth capture

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The patent utilizes the depth dimension (z-axis) by directing infrared light at specific angles and capturing reflected light at corresponding angles, creating a triangular measurement geometry within the compact housing. This dimensional approach allows the light source and detector to be positioned close together physically while still maintaining the necessary optical path length for accurate triangulation, resolving the contradiction between apparatus size and acquisition speed

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If multiple object lenses are used to capture infrared images, then depth information can be obtained, but device complexity increases

Engineering Contradiction:
Improvedepth measurement accuracyVSAvoidoptical system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent assigns different functions to different parts of the image sensor by dividing it into multiple sensing regions. At least one sensing region is dedicated to infrared capture for depth measurement, while other regions capture color images. This local quality differentiation allows depth measurement functionality to be integrated into the sensor itself rather than requiring separate optical paths and lenses for each function, thereby reducing overall device complexity while maintaining measurement precision

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent makes the image sensor multi-functional by enabling it to simultaneously perform color image capture and infrared-based depth measurement through different sensing regions. This universality eliminates the need for separate dedicated sensors or complex optical switching mechanisms, as a single sensor handles both functions, thereby reducing device complexity while preserving the depth measurement accuracy required for precise 3D reconstruction

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables simultaneous acquisition of color and depth images in a single shot, improving the speed and accuracy of 3D image capture while maintaining a compact design, suitable for capturing moving objects and reducing exposure time.

Implementation Method 1

an image sensor including at least one first sensing region for receiving light focused by the at least one first object lens and generating an image and at least three second sensing regions for individually receiving light focused by the at least three second object lenses and generating images

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

a time-of-flight (TOF) technology has been introduced. According to TOF technology, a TOF until light illuminates an object and light reflected from the object reaches a light receiving part and is measured

Methodology Applied
Scientific EffectTime of Flight: Time of Flight

Data Source

PatentUS9451240B23-dimensional image acquisition apparatus and 3D image acquisition method for simultaneously obtaining color image and depth image
Publication Date: 2016.09.20 SAMSUNG ELECTRONICS CO LTD
  • US9451240B2 patent drawing
  • US9451240B2 patent drawing
  • US9451240B2 patent drawing

AI summary

A 3-dimensional (3D) image acquisition apparatus capable of simultaneously obtaining a color image and a depth image in a single shooting operation is provided. The apparatus includes a light source for radiating illumination light having a predetermined wavelength onto an object; a lens unit having at least four object lenses; an image sensor including at least four sensing regions for individually receiving light focused by the object lenses and for generating images; and at least three optical shutters individually facing at least three of the at least four object lenses and for modulating incident light with predetermined gain waveforms.