Plenoptic Microscope MLA Integration for Standard-Camera 3D Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing plenoptic microscope systems face challenges in implementing microlens arrays (MLAs) due to geometric and optical characteristics mismatch with microscope optical systems, requiring expensive plenoptic cameras and complex configurations, and are difficult to manufacture.

Innovation Solution

Position the MLA between the object and the microscope optical system, using a general microscope camera as an image sensor, and adjust the NA of the light source to match the MLA's NA with the objective lens, allowing for a simpler configuration and improved depth and spatial resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If an MLA is positioned between the tube lens and image sensor in a conventional plenoptic microscope system, then 3D information can be acquired, but the system requires expensive plenoptic cameras and has complex configuration due to geometric and optical characteristics mismatch

Engineering Contradiction:
Improve3D information acquisitionVSAvoidsystem configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a beam splitter as an intermediary component that enables the MLA to be positioned in the optical path between the objective lens and tube lens without requiring a dedicated plenoptic camera. The beam splitter directs light to both the MLA and the standard microscope camera, allowing 3D information acquisition while maintaining compatibility with conventional microscope systems and reducing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent makes the microscope system universal by allowing it to perform both conventional 2D imaging and plenoptic 3D imaging using the same optical path. The MLA is integrated into the existing microscope optical system, enabling the system to acquire 3D information without requiring a separate plenoptic camera, thus making the system multi-functional and reducing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If an MLA is positioned between the tube lens and image sensor, then parallax information can be extracted, but the MLA manufacturing becomes difficult due to geometric and optical characteristics mismatch

Engineering Contradiction:
Improveparallax information extractionVSAvoidMLA manufacturing
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent changes the optical parameters of the system by positioning the MLA at a specific location in the optical path where the light cone angle matches the MLA's numerical aperture. This parameter adjustment allows the MLA to be manufactured with standard specifications rather than requiring custom-designed lenses with mismatched parameters, thereby easing manufacturing difficulties.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If a plenoptic camera with embedded MLA is used, then 3D imaging is achieved, but the cost increases significantly

Engineering Contradiction:
Improve3D imaging capabilityVSAvoidsystem cost
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts the MLA from the expensive plenoptic camera and integrates it directly into the conventional microscope optical system. This separation allows the use of a standard, low-cost microscope camera instead of a dedicated plenoptic camera, significantly reducing system cost while maintaining 3D imaging capability through the MLA's parallax information extraction.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the expensive plenoptic camera with a combination of a standard microscope camera and an independently positioned MLA. This substitution uses cheaper, off-the-shelf components that can be easily replaced or adjusted, reducing the overall system cost while achieving the same 3D imaging function.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Facilitates the use of a general image camera, simplifies MLA implementation, and enhances 3D imaging capabilities with improved depth and spatial resolution without the need for expensive plenoptic cameras.

Implementation Method 1

an MLA is interposed at a location between the backend of the tube lens and the image sensor, acquiring 3D information of an object output through the microscope optical system

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

information on one point of an object 32 is subjected to optical processing by a microscope optical system 35

Methodology Applied
Scientific EffectFocusing: Focusing

Implementation Method 3

unlike a general microscope including a light source

Methodology Applied
Scientific EffectLight emission: Light

Data Source

PatentUS12429682B2Plenoptic microscope system and plenoptic image processing apparatus
Publication Date: 2025.09.30 ELECTRONICS & TELECOMM RES INST
  • US12429682B2 patent drawing
  • US12429682B2 patent drawing
  • US12429682B2 patent drawing

AI summary

Provided are a plenoptic microscope system having a structure in which a microlens array (MLA) is installed between an object and a microscope optical system and a general microscope camera is used as an image sensor, and an image processing apparatus for performing plenoptic imaging with information acquired from the same. In the plenoptic microscope system, an MLA including at least one microlens having a number of apertures (NA) similar to that of an objective lens of a microscope optical system is positioned at the front end of an incidence part of the microscope optical system and the objective lens is positioned at a focal length of the MLA or on an image plane of the MLA. The plenoptic image processing apparatus generates Plenoptic 1.0 and/or 2.0 images.