Lensless Microscope Image Generation via Virtual Focal Plane

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing lensless microscope methods for observing cultured cells suffer from image quality deterioration due to discontinuity when fragmentary images are connected, leading to reduced sharpness and image quality in pseudo-sectional images.

Innovation Solution

An image generating system that includes multiple illuminators and an image sensor, where the system calculates and applies luminance values from each illuminator position to generate a high-quality focal image on a virtual focal plane, eliminating the need for a focusing lens and improving image resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If fragmentary images are cut out and connected to generate pseudo-sectional images, then the sectional shape of cells can be evaluated, but discontinuity appears at connection portions causing image quality deterioration

Engineering Contradiction:
Improvesectional shape evaluation capabilityVSAvoidimage quality
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent transitions from 2D image connection to 3D light propagation modeling. By calculating luminance values along light paths from multiple illuminators through the sample to the image sensor, the system constructs focal images on virtual focal planes without connecting fragmentary 2D images, thereby eliminating discontinuity artifacts while preserving sectional shape evaluation capability

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces light path calculation as an intermediary process between image acquisition and image generation. By computing luminance values along straight lines from illuminators through the sample to sensor pixels, the system creates continuous focal images without directly connecting fragmentary images, resolving the discontinuity problem

Inventive Principle:
Principle #24Intermediary (Mediator)

2Stability of the object's composition

If blurring processing is applied to discontinuous portions to reduce image quality deterioration, then continuity is improved, but sharpness of the pseudo-sectional image decreases

Engineering Contradiction:
Improveimage continuityVSAvoidimage sharpness
Core Design Contradiction:
Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

The patent eliminates the need for blurring processing by transitioning from 2D image connection to 3D light propagation modeling. The calculated luminance values inherently provide continuous information across the entire focal plane, achieving both continuity and sharpness simultaneously without compromise

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Manufacturing precision

If a lens is used to focus light for image capture, then image quality can be improved, but the device becomes complex and cannot be used in restricted spaces like incubators

Engineering Contradiction:
Improveimage qualityVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent extracts the focusing function from the optical domain to the computational domain. By removing the lens and using multiple illuminators combined with light path calculations, the system achieves focal image generation without mechanical optical components, reducing device complexity while maintaining image quality

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical optical system (lens) with a computational approach. Instead of using a physical lens to focus light, the system uses multiple illuminators and calculates luminance values along light paths to generate focal images computationally, eliminating mechanical complexity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system produces high-quality focal images of cultured cells without the limitations of discontinuity, enhancing image resolution and maintaining sharpness, suitable for continuous observation in high-humidity environments.

Implementation Method 1

a first image and a second image are captured by sequentially illuminating a target object with a plurality of illuminators and detecting transmitted light

Methodology Applied
Scientific EffectLight transmission: Light

Implementation Method 2

calculates a position of a target point, the target point being a point of intersection of a straight line connecting a position of the pixel on the focal plane and a position of the illuminator and a light receiving surface of the image sensor

Methodology Applied
Scientific EffectGeometric optics: Geometry

Implementation Method 3

calculates a luminance value of a target point in the captured image acquired while the target object is illuminated from the position of the illuminator on the basis of the position of the target point on the light receiving surface of the image sensor

Methodology Applied
Scientific EffectPhotoelectric detection: Photoelectric Effect

Data Source

PatentUS10168523B2Image generating system, image generating method, and image generating apparatus
Publication Date: 2019.01.01 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • US10168523B2 patent drawing
  • US10168523B2 patent drawing
  • US10168523B2 patent drawing

AI summary

An image generating system that generates a focal image of a target object on a virtual focal plane located between a plurality of illuminators and an image sensor (b) carries out the following (c) through (f) for each of a plurality of pixels constituting the focal image, (c) carries out the following (d) through (f) for each of the positions of the plurality of illuminators, (d) calculates a position of a target point that is a point of intersection of a straight line connecting a position of the pixel on the focal plane and a position of the illuminator and a light receiving surface of the image sensor, (e) calculates a luminance value of the target point in the captured image by the illuminator on the basis of the position of the target point, (f) applies the luminance value of the target point to the luminance value of the pixel, and (g) generates the focal image of the target object on the focal plane by using a result of applying the luminance value at each of the plurality of pixels.