Multi-layer 3D Reconstruction Camera with Multi-wavelength Illumination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional cameras fail to capture the depth dimension of a three-dimensional view, leading to a loss of depth information in two-dimensional images, and existing stereo imaging methods are limited in accurately reconstructing three-dimensional objects with surface and sub-surface characteristics.

Innovation Solution

A camera system comprising two imaging systems with different optical paths, multiple illumination sources of varying wavelengths, and a processor that acquires and processes multiple image pairs to create a multi-layer three-dimensional reconstruction, including depth, hemoglobin, and melanin measurements, using techniques like edge enhancement and image correlation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional cameras are used to capture images, then the imaging process is simple, but the depth dimension information is lost

Engineering Contradiction:
Improvedepth informationVSAvoidimaging system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent transitions from conventional 2D imaging to multi-layer 3D reconstruction by introducing multiple imaging layers (surface and sub-surface) through multi-wavelength illumination and multi-aperture detection, thereby recovering the depth dimension information that is normally lost in standard photography

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If stereo imaging methods are used to capture depth, then depth information is recovered, but the ability to capture sub-surface characteristics is limited

Engineering Contradiction:
Improvesub-surface characteristicsVSAvoidoptical system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent employs parameter changes by utilizing multiple illumination wavelengths (e.g., blue, green, red LEDs) to probe different depths within the object. Shorter wavelengths penetrate less deeply and reveal surface features, while longer wavelengths penetrate deeper and reveal sub-surface characteristics, enabling multi-layer reconstruction without complex optical hardware

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The imaging process is segmented into multiple wavelength-specific imaging channels, each capturing different depth layers. The mask divides the detection path into multiple apertures that can be selectively activated for different wavelengths, allowing independent optimization of surface and sub-surface imaging

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If multiple illumination sources are used to capture different wavelengths, then color and depth characterization is improved, but the acquisition time increases

Engineering Contradiction:
Improvecolor and depth measurementVSAvoidimage acquisition time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent uses sequential periodic illumination with different wavelengths (blue, green, red LEDs activated in sequence) to capture multi-wavelength images. This time-multiplexed approach allows the use of a single sensor for all wavelengths, avoiding the need for simultaneous multi-sensor systems while still achieving comprehensive color and depth characterization

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

A single imaging sensor is designed to handle multiple wavelengths and multiple aperture configurations, making it a universal detector that replaces what would otherwise require separate specialized sensors for each wavelength and depth layer, thereby reducing overall system complexity and acquisition time

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate multi-layer three-dimensional reconstruction of objects, capturing both surface and sub-surface characteristics, such as skin features and hemoglobin levels, with improved depth measurement and color characterization.

Implementation Method 1

The multiple illumination sources may include one or more illumination sources, having a wavelength beyond the visible light spectrum

Methodology Applied
Scientific EffectLight Emitting Diode: Light Emitting Diode

Implementation Method 2

a mask comprising multiple pairs of apertures, wherein each aperture of each aperture pair corresponds to a different one of the imaging systems

Methodology Applied
Scientific EffectLight transmission through apertures: Light

Implementation Method 3

at least one detector configured to acquire multiple image pairs of the object from the two imaging systems via the multiple pairs of apertures

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS11412204B2Three-dimensional image reconstruction using multi-layer data acquisition
Publication Date: 2022.08.09 EVA ESTHETIC VISUAL ANALYTICS LTD
  • US11412204B2 patent drawing
  • US11412204B2 patent drawing
  • US11412204B2 patent drawing

AI summary

A camera, including: two imaging systems each comprising a different optical path corresponding to a different viewing angle of an object; one or more illumination sources; a mask disposed with multiple pairs of apertures, wherein each aperture of each aperture pair corresponds to a different one of the imaging systems; at least one detector configured to acquire multiple image pairs of the object from the two imaging systems via the multiple pairs of apertures; and a processor configured to produce from the multiple acquired image pairs a multi-layer three dimensional reconstruction of the object.