Multi-Aperture Microscope for High-Resolution Multi-Organism Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current microscope technologies face challenges in simultaneously tracking multiple small model organisms at high resolution over a large area without constraining their movement, due to the tradeoff between field-of-view and optical resolution, and existing mechanical tracking systems can only track one organism at a time.

Innovation Solution

The Multi-Aperture Microscope (MCAM) system uses an array of micro-cameras to capture high-resolution images over a large field-of-view, processing and compressing data in real-time to track multiple organisms independently across a large area without moving parts, enabling 3D tracking through photogrammetry.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a large field of view is captured by a lens, then organisms can move freely within an arena, but optical resolution is reduced

Engineering Contradiction:
Improvefield of viewVSAvoidoptical resolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent divides the imaging system into multiple micro-cameras arranged in an array, where each camera captures a smaller portion of the overall field of view at high resolution. The individual images are then computationally stitched together to form a composite high-resolution image of the entire large field of view, thereby resolving the contradiction between large FOV and high resolution

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single 2D imaging plane to a multi-dimensional array of cameras, adding spatial distribution as an additional dimension. This allows the system to capture multiple high-resolution views simultaneously across a large field of view, overcoming the traditional tradeoff

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If standard microscope resolution is used, then high resolution imaging is achieved, but only one organism can be tracked at a time

Engineering Contradiction:
Improveimaging resolutionVSAvoidnumber of organisms tracked simultaneously
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the monitoring task across multiple independent micro-cameras, allowing simultaneous tracking of multiple organisms in different regions of the field of view. Each camera maintains high resolution while the collective system tracks multiple organisms concurrently, resolving the contradiction between resolution and multi-organism tracking capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal imaging system where each micro-camera serves multiple purposes: capturing high-resolution images of individual organisms, tracking multiple organisms simultaneously, and providing data for both individual and群体 behavior analysis, thereby increasing productivity without sacrificing resolution

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Speed

If mechanical tracking systems are used to follow organism movement, then real-time tracking is achieved, but the system can only track one organism at a time

Engineering Contradiction:
Improvetracking speedVSAvoidnumber of organisms tracked simultaneously
Core Design Contradiction:
SpeedVSProductivity

Solution Approach 1:

The patent replaces mechanical tracking systems with a computational approach using multiple fixed micro-cameras. Image processing algorithms automatically identify and track organism positions across camera views, enabling simultaneous tracking of multiple organisms at high speed without mechanical movement, resolving the contradiction between tracking speed and multi-organism capability

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses multiple cameras to create redundant visual copies of the experimental arena from different positions. This allows the system to track multiple organisms simultaneously by processing parallel image streams, achieving both high tracking speed and multi-organism productivity

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution allows for real-time high-resolution imaging and tracking of multiple organisms, expanding the field of view without sacrificing resolution, and enabling detailed analysis of their behavior and morphological changes, overcoming the limitations of existing technologies.

Implementation Method 1

an array of micro-cameras to capture high-resolution images over a large field-of-view

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

capture high-resolution images over a large field-of-view

Methodology Applied
Scientific EffectLight transmission: Refraction

Implementation Method 3

enabling 3D tracking through photogrammetry

Methodology Applied
Scientific EffectPhotogrammetry: Photogrammetry

Data Source

PatentUS20230045152A1System and method to simultaneously track multiple organisms at high resolution
Publication Date: 2023.02.09 RAMONA OPTICS INC
  • US20230045152A1 patent drawing
  • US20230045152A1 patent drawing
  • US20230045152A1 patent drawing

AI summary

A microscopy includes multiple cameras working together to capture image data of a sample having a group of organisms distributed over a wide area, under the influence of an excitation instrument. A first processor is coupled to each camera to process the image data captured by the camera. Outputs from the multiple first processors are aggregated and streamed serially to a second processor for tracking the organisms. The presence of the multiple cameras capturing images from the sample, configured with 50% or more overlap, can allow 3D tracking of the organisms through photogrammetry.