Light Field Imaging System Near-Infrared Spot Projection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional remote sensing and photogrammetry methods face limitations in 3D reconstruction efficiency and accuracy, especially for weak-texture objects, due to limited depth-of-field range and lack of texture information, which are exacerbated by the need for multi-view shooting and calibration, and are not well-suited for portable and efficient 3D imaging applications.

Innovation Solution

A light field imaging system using a multifocal microlens array and a near-infrared spot projection apparatus to extend the depth-of-field range and add texture information, enabling high-precision 3D reconstruction of weak-texture objects by projecting an eye-safe near-infrared band texture pattern onto the object surface, combined with a microlens array that samples light rays to reconstruct 3D information from a single image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional multi-view shooting method is used for 3D reconstruction, then complete 3D information can be obtained, but shooting time and reconstruction time increase significantly

Engineering Contradiction:
Improve3D reconstruction accuracyVSAvoidshooting time and reconstruction time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the light field information by using a microlens array to divide incoming light rays into multiple sub-images, each containing directional information. This allows simultaneous capture of multiple views in a single exposure, eliminating the need for sequential multi-view shooting while preserving complete 3D reconstruction capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from traditional 2D image capture to 4D light field capture by adding spatial and angular dimensions. The microlens array captures not only intensity but also directional information of light rays, enabling 3D reconstruction from a single 2D sensor plane through light field computation

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If monocular camera is used for multiple observations to simulate multi-lens camera, then 3D reconstruction may be performed, but it cannot effectively reconstruct moving objects

Engineering Contradiction:
Improve3D reconstruction capabilityVSAvoidreconstruction reliability for moving objects
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent enables continuous capture of light field information from moving objects within a single exposure period. The microlens array continuously samples light rays from different directions simultaneously, capturing the complete light field of moving objects without requiring multiple discrete observations, thus maintaining reconstruction reliability for dynamic scenes

Inventive Principle:
Principle #20Continuity of useful action

3Ease of operation

If traditional camera is used for weak-texture objects, then imaging is possible, but 3D reconstruction precision deteriorates due to lack of texture information

Engineering Contradiction:
Improveimaging capabilityVSAvoid3D reconstruction precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent performs preliminary action by projecting near-infrared spot patterns onto the weak-texture object before capturing the light field. This pre-adds artificial texture information to the object surface, ensuring that when the light field is captured and processed, sufficient texture features are available for accurate 3D reconstruction without compromising the original visible appearance

Inventive Principle:
Principle #10Preliminary action

4Device complexity

If single imaging device is used, then device simplicity is maintained, but depth-of-field range is limited

Engineering Contradiction:
Improvesingle device structureVSAvoiddepth-of-field detection range
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent makes the single imaging device universal by integrating a microlens array that enables multiple functions: capturing focused images, capturing defocused images for depth estimation, and capturing light field information for 3D reconstruction. This single device structure adapts to various depth ranges and imaging requirements without requiring multiple specialized devices

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively enhances 3D reconstruction precision and depth measurement accuracy by extending the depth-of-field range and enriching texture information, making it suitable for remote sensing and photogrammetry applications, particularly with small unmanned aerial vehicles, and achieving accurate 3D imaging of objects with limited textures.

Implementation Method 1

The multifocal microlens array can receive a light ray from the main lens and generates an image on the photosensitive sensor

Methodology Applied
Scientific EffectLight ray sampling and refraction: Refraction

Implementation Method 2

A near-infrared spot projection apparatus is used to project an eye-safe near-infrared band texture pattern onto a surface of a detected object

Methodology Applied
Scientific EffectNear-infrared light projection: Infrared Radiation

Data Source

PatentUS11632535B2Light field imaging system by projecting near-infrared spot in remote sensing based on multifocal microlens array
Publication Date: 2023.04.18 PEKING UNIV
  • US11632535B2 patent drawing
  • US11632535B2 patent drawing
  • US11632535B2 patent drawing

AI summary

The present disclosure provides a light field imaging system by projecting near-infrared spot in remote sensing based on a multifocal microlens array. The light field imaging system includes a near-infrared spot projection apparatus (100) and a light field imaging component (200), where the near-infrared spot projection apparatus (100) is configured to scatter near-infrared spots on a to-be-observed object to add texture information to a target image, and the light field imaging component (200) is configured to image a target scene light ray with additional texture information. The present disclosure can extend a target depth-of-field (DOF) detection range, and particularly, reconstruct a surface of a weak-texture object.