3D mmW Scene Reconstruction via Optical Up-Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mmW imaging technologies fail to capture three-dimensional images, as they primarily provide two-dimensional representations of the scene, lacking a method to effectively utilize the depth information encoded in the radiation patterns.

Innovation Solution

The proposed solution involves sparse-aperture capture of mmW radiation, up-conversion to the optical domain, measurement of cross-correlation terms, and digital reconstruction of the original mmW scene from these terms, allowing for the recovery of three-dimensional information without active illumination.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If optical beams from all fibers are allowed to propagate in free space and interfere to form an optical image on a CCD array, then a two-dimensional image of the mmW scene is obtained, but three-dimensional information is lost

Engineering Contradiction:
Improveimage reconstruction capabilityVSAvoiddepth information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent segments the optical measurement process into two distinct components: (1) direct intensity measurement for 2D image formation, and (2) cross-correlation measurement for depth information extraction. By separating these measurement functions, the system recovers 3D information that would otherwise be lost in conventional direct imaging approaches.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces cross-correlation terms as an intermediary measurement that bridges the gap between 2D intensity data and 3D scene reconstruction. These cross-correlation measurements serve as additional information carriers that encode depth relationships between mmW sources and antenna elements, enabling 3D reconstruction without requiring active illumination.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If a sparse aperture array is used for mmW radiation capture, then device complexity is reduced, but measurement precision for 3D reconstruction is improved through cross-correlation detection

Engineering Contradiction:
Improveantenna array configurationVSAvoidscene reconstruction accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent changes the measurement parameter from direct intensity detection to cross-correlation detection. This parameter transformation allows the system to extract depth information from sparse aperture data by measuring the correlation between signals from different antenna elements, thereby maintaining measurement precision while using a simpler, sparser array configuration.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If conventional optical imaging is used for mmW scene representation, then ease of operation is maintained, but adaptability for three-dimensional imaging is limited

Engineering Contradiction:
Improveoptical imaging processVSAvoid3D imaging capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent makes the optical imaging system multi-functional by enabling it to perform both traditional 2D intensity imaging and 3D cross-correlation-based reconstruction using the same optical up-conversion hardware. This universality allows the system to adapt between different imaging modes without requiring separate dedicated systems, thereby improving versatility while maintaining ease of operation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the full reconstruction of a three-dimensional mmW scene, improving imaging capabilities by leveraging the encoded depth information in cross-correlations between channels, as demonstrated through numerical simulations and computational experiments.

Implementation Method 1

an electro-optic (EO) modulator that converts the captured signal to the optical domain

Methodology Applied
Scientific EffectElectro-optic modulation: Electro-Optic Effects

Implementation Method 2

The optical beams from the fibers may then be allowed to propagate in free space, and interfere to form an optical image corresponding to the mmW scene on a CCD array

Methodology Applied
Scientific EffectOptical interference: Interference

Data Source

PatentUS9544510B2Three-dimensional reconstruction of a millimeter-wave scene by optical up-conversion and cross-correlation detection
Publication Date: 2017.01.10 PHASE SENSITIVE INNOVATIONS INC
  • US9544510B2 patent drawing
  • US9544510B2 patent drawing
  • US9544510B2 patent drawing

AI summary

An apparatus and method may be used to create images, e.g., three-dimensional images, based on received radio-frequency (RF), e.g., millimeter wave, signals carrying image data. The RF signals may be modulated onto optical carrier signals, and the resulting modulated optical signals may be cross-correlated. The resulting cross-correlations may be used to extract image data that may be used to generate three-dimensional images.