Micro-camera array for gigapixel 3D video imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current microscopy systems fail to provide 3D video imaging capabilities at high resolution and low cost, as they are cost-prohibitive and lack the ability to capture gigapixel images, multi-channel fluorescence, and polarization channels in a single snapshot, while also being unable to record movement of organisms or cells within a specimen effectively.

Innovation Solution

A re-imaging microscopy system using a macro-camera lens as the primary lens and a planar array of micro-cameras focused towards infinity, with overlapping fields of view, enabling 3D video imaging, multi-channel fluorescence, and polarimetry functionality by capturing unique angular distributions of light from a target area.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a scanning microscope is used to acquire a sequence of images over time, then composite image generation is achieved, but movement information of organisms and cells is lost

Engineering Contradiction:
Improvecomposite image resolutionVSAvoidmovement information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system divides the imaging task into multiple simultaneous micro-camera units, each capturing a portion of the specimen. By using multiple micro-cameras instead of a single scanning system, the entire specimen is imaged at once in a snapshot, preserving movement information while maintaining composite image capability through spatial segmentation of the field of view.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If a primary lens with gigapixel capabilities is used, then centimeter-scale area at micrometer resolution is achieved, but the cost becomes prohibitive

Engineering Contradiction:
Improvemicrometer resolution at centimeter scaleVSAvoidsystem cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

Instead of using a single expensive gigapixel lens, the system segments the imaging function across multiple low-cost micro-camera modules. Each micro-camera uses a standard lens, and the collective array achieves gigapixel resolution through spatial arrangement and image stitching, dramatically reducing per-unit cost while maintaining the required resolution and field of view.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple standard micro-camera modules are combined into an array configuration. By merging the imaging capabilities of multiple inexpensive cameras, the system achieves the equivalent performance of a single expensive gigapixel lens, leveraging economies of scale and standard component availability to reduce overall system cost.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If traditional digital image sensors are used, then micrometer resolution is captured, but the imaging frame rate is very low

Engineering Contradiction:
Improvemicrometer resolutionVSAvoidimaging frame rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The imaging load is segmented across multiple micro-camera sensors operating in parallel. By distributing the capture of different spatial regions to multiple sensors simultaneously, the system achieves high temporal resolution (video frame rates) while maintaining micrometer spatial resolution, as each sensor captures its portion at full frame rate without the bottleneck of sequential scanning.

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If a curved micro-camera array is used to avoid spherical aberration, then image quality is improved, but expensive opto-mechanical calibration is required and sensors cannot be arranged on a single PCB

Engineering Contradiction:
Improveimage qualityVSAvoidopto-mechanical calibration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of curving the sensor array to match the lens field of view (traditional approach), the system uses a planar array and corrects for spherical aberration and field curvature through computational image processing. This inverts the problem-solving approach: rather than adapting the sensor geometry to the optical constraints, the solution adapts the image processing to accommodate the simpler planar sensor geometry, eliminating complex calibration requirements.

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The system replaces complex opto-mechanical calibration and curved sensor mounting with computational correction algorithms. By using software-based aberration correction and image stitching, the system eliminates the need for expensive precision mechanical alignment and curved PCB substrates, substituting computational processing for mechanical complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system achieves hundreds of megapixels to gigapixels capability, allowing for high-resolution 3D video imaging and multi-channel functionality at a relatively low cost, enabling observation of organisms and cells moving unconstrained within a specimen.

Implementation Method 1

a primary lens disposed in a path of the light between the planar array of micro-cameras and the target area

Methodology Applied
Scientific EffectLight: Light

Implementation Method 2

a primary lens disposed in a path of the light between the planar array of micro-cameras and the target area

Methodology Applied
Scientific EffectLens focusing: Lens

Implementation Method 3

each capturing a unique angular distribution of light reflected from a corresponding portion of a target area

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS20230247276A1Re-imaging microscopy with micro-camera array
Publication Date: 2023.08.03 DUKE UNIV
  • US20230247276A1 patent drawing
  • US20230247276A1 patent drawing
  • US20230247276A1 patent drawing

AI summary

A microscopy system includes a planar array of micro-cameras with at least three micro-cameras of the planar array of micro-cameras each capturing a unique angular distribution of light reflected from a corresponding portion of a target area. The corresponding portions of the target area for the at least three micro-cameras contain an overlapping area of the target area. The microscopy system further includes a primary lens disposed in a path of the light between the planar array of micro-cameras and the target area. This microscopy system is capable of producing 3D imaging and/or video imaging of the target area. In some cases, the microscopy system is configured to generate a 3D image from the captured unique angular distribution of light reflected from the corresponding portions of the target area of the at least three micro-cameras of the planar array of micro-cameras.