Metasurface Lens Phase Encoding for Snapshot 4D Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional multi-dimensional visual perception systems are bulky, power-intensive, and sacrifice temporal and spatial resolution, making it difficult to obtain simultaneous two-dimensional light intensity, depth, polarization, and spectrum information, which is necessary for advanced applications like robotics and autonomous driving.

Innovation Solution

A monocular snapshot four-dimensional imaging method using a metasurface lens with optimized phase distribution and point spread function to encode and decode four-dimensional light field information, including two-dimensional light intensity, depth, and polarization, from a single image shot, without the need for laser illumination or multiple lenses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional multi-dimensional visual perception systems use multiple lenses and active laser illumination to acquire depth information, then depth measurement precision is improved, but device complexity and volume increase

Engineering Contradiction:
Improvedepth measurement precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple imaging functions (intensity, depth, polarization) into a single integrated lens system. The lens simultaneously performs focusing, depth encoding through point spread function modulation, and polarization analysis, eliminating the need for separate depth sensors and multiple lenses while maintaining measurement precision

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging lens is designed as a multi-functional element that performs intensity imaging, depth mapping, and polarization detection all in one optical component. The lens parameters are optimized to encode multiple light field dimensions simultaneously, making the system more compact and less complex

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If traditional polarization imaging systems use amplitude division or focal plane division to acquire polarization information, then polarization measurement precision is improved, but device complexity and volume increase

Engineering Contradiction:
Improvepolarization measurement precisionVSAvoidsystem volume
Core Design Contradiction:
Measurement precisionVSVolume of stationary object

Solution Approach 1:

The patent encodes polarization information in the angular dimension of the point spread function rather than requiring separate optical paths or focal plane divisions. Different polarization states produce characteristic angular distributions of light intensity, allowing polarization measurement through single-pixel detection and computational analysis

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent replaces mechanical or optical division methods with computational imaging. Instead of physically dividing the optical path for different polarization measurements, the system uses a single detector and computationally decodes polarization information from the angular-encoded point spread function

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If traditional spectral detection systems use scanning by bulk dispersive light-splitting elements to acquire spectrum information, then spectrum measurement precision is improved, but productivity decreases

Engineering Contradiction:
Improvespectrum measurement precisionVSAvoidacquisition speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent uses periodic angular modulation of the point spread function to encode spectral information. By varying the angular distribution periodically with wavelength, the system captures spectral data in a single snapshot rather than requiring sequential scanning, dramatically improving acquisition speed while maintaining precision

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The optical system pre-encodes spectral information into the angular point spread function before detection. This preliminary encoding allows all spectral information to be captured simultaneously in a single measurement, eliminating the need for time-consuming sequential scanning

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If traditional imaging systems use multiple lenses and scanning mechanisms to acquire multi-dimensional light field information, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improvelight field information accuracyVSAvoidacquisition time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent achieves continuous capture of all light field dimensions (intensity, depth, polarization, spectrum) in a single uninterrupted snapshot. The optical system continuously encodes all information simultaneously through the angular point spread function, eliminating time losses associated with sequential measurements or scanning

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent merges multiple measurement functions into a single integrated optical path and detector. All light field dimensions are captured simultaneously through one lens and one detector, eliminating the time required for multiple separate measurements or scanning operations

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables high-precision, miniaturized, and cost-effective acquisition of four-dimensional light field information with reduced complexity and energy consumption, facilitating integration into compact systems for various applications.

Implementation Method 1

a phase distribution of an entrance pupil plane of the imaging system is optimized to determine a point spread function dependent on depth and polarization

Methodology Applied
Scientific EffectPhase modulation: Phase Modulation

Implementation Method 2

metasurface has become a focus of research, which flexibly tunes amplitude, phase, and polarization of electromagnetic waves by designing sub-wavelength structure

Methodology Applied
Scientific EffectMetasurface optical control:

Implementation Method 3

optimizing a phase distribution of an entrance pupil plane of the imaging system to determine a point spread function dependent on depth and polarization of a target scene

Methodology Applied
Scientific EffectPoint spread function encoding:

Data Source

PatentUS12056889B2Monocular snapshot four-dimensional imaging method and system
Publication Date: 2024.08.06 TSINGHUA UNIVERSITY
  • US12056889B2 patent drawing
  • US12056889B2 patent drawing
  • US12056889B2 patent drawing

AI summary

A monocular snapshot four-dimensional imaging method and system are provided. The method includes constructing a numerical simulation model of an imaging system, and optimizing a phase distribution of an entrance pupil plane of the imaging system to determine a point spread function and a lens parameter corresponding to the phase distribution; building the imaging system, calibrating the point spread function, and obtaining a distortion parameter of the imaging system; taking a single shot on a target scene to obtain a single encoded image containing four-dimensional light field information of the target scene, and correcting the single encoded image according to the distortion parameter of the imaging system; and decoding the four-dimensional light field information of the target scene from the single encoded image according to the calibrated point spread function to obtain an intensity image, a polarization contrast image and a depth map of the target scene.