Fourier laminated microscope pupil recovery method based on neural network

A technology of neural network and restoration method, which is applied in the field of microscope image reconstruction based on Fourier stack imaging technology, can solve the problems of low reconstruction accuracy and poor versatility of reconstruction models, and achieve good reconstruction results, good universality, and suppression The effect of optical aberrations

Active Publication Date: 2019-10-25
CHANGCHUN INST OF OPTICS FINE MECHANICS & PHYSICS CHINESE ACAD OF SCI
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to solve the problems of low reconstruction accuracy caused by the existing Fourier stack imaging model under the influence of optical aberration and the poor versatility of the current reconstruction model based on deep convolutional neural network, the present invention provides a neural network-based Pupil Restoration Method of Fourier Stack Microscope

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fourier laminated microscope pupil recovery method based on neural network
  • Fourier laminated microscope pupil recovery method based on neural network
  • Fourier laminated microscope pupil recovery method based on neural network

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach 1

[0046] Specific implementation mode 1. Combination Figure 1 to Figure 3 Describe this embodiment, based on the neural network pupil restoration method of the Fourier stack microscope, this embodiment has a better ability to suppress the influence of aberrations, can reconstruct the clearer complex amplitude information of the sample, and at the same time can restore The pupil function of the output system.

[0047] In this embodiment, based on the machine learning platform TensorFlow, a Fourier stacked forward imaging network (Forward imaging neural network with pupil recovery) embedded in pupil recovery is built. The Fourier stacked imaging technology used is a classic FPM system structure , the system setup includes a 2X objective lens with NA=0.1, a CCD sensor with 6.5 μm pixel size and a programmable LED matrix, in which 21×21 elements are placed 87.5 μm in front of the sample, between two adjacent LEDs The lateral distance is 2.5mm. The initial guess for the high-resol...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Fourier laminated microscope pupil recovery method based on a neural network in the field of computer imaging. The problem that the reconstruction precision of the existingFourier laminated imaging model is low under the influence of optical phase difference is solved. A neural network model is established based on a TensorFlow deep learning framework in combination with a forward imaging mode of an FPM system. The problem that the universality of a reconstruction model based on a deep convolutional neural network is poor is solved; a recovery process for a pupil function of the system is introduced, so that the influence of optical aberration in the system on a reconstruction result can be better suppressed, and a better result is obtained. According to the invention, the frequency spectrum and the pupil function of the sample are set as a trainable two-dimensional network layer in the network; complex amplitude information and a pupil function of a sampleare obtained at the same time by minimizing a loss function in the training process. The method has good universality and can still obtain a reconstruction result better than that of a traditional algorithm under the condition that aberration exists in the system.

Description

technical field [0001] The invention relates to the field of computational imaging, in particular to a microscope image reconstruction method based on Fourier stack imaging technology. Background technique [0002] Fourier stack imaging microscopy (FPM) is a newly developed imaging method designed to circumvent the limitation of spatial bandwidth product (SBP) and obtain complex images with wide field of view and high resolution. Since 2013, Fourier stack imaging technology has been applied in optical microscopy, biomedicine, life sciences and other fields to obtain microscopic images with large field of view and high resolution. However, in FPM imaging systems, pupil aberrations of the used optical elements and incoherent light imaging significantly degrade the quality of the reconstruction results. Contents of the invention [0003] In order to solve the problems of low reconstruction accuracy caused by the existing Fourier stack imaging model under the influence of opt...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T11/00
CPCG06T11/00
Inventor 李大禹穆全全宣丽孙铭璐陈雄刘永刚鲁兴海王启东杨程亮张杏云
Owner CHANGCHUN INST OF OPTICS FINE MECHANICS & PHYSICS CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products