High-speed artifact-free super-resolution structured illumination microscopy imaging method

Through the high-speed artifact-free super-resolution structured light-illumination micro-imaging method, using striped illumination light field and image processing technology, the problems of slow reconstruction speed and low image fidelity in the existing technology are solved, and efficient and false-free Super-resolution microscopy of shadows has enhanced the application potential in fields such as biomedicine.

CN115308185BActive Publication Date: 2024-11-19XI AN JIAOTONG UNIV
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202211122046.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-15
Publication Date
2024-11-19
Estimated Expiration
2042-09-15

AI Technical Summary

Technical Problem

The existing super-resolution structured light-illuminated microimaging methods have insufficient reconstruction speed and image fidelity, resulting in the inability to achieve real-time high-resolution imaging and quantitative fluorescence analysis, limiting its inability to biomedical, microelectronics and materials science Widely used in fields such as

Method used

High-speed artifact-free super-resolution structured illumination micro-imaging method is adopted. By generating a striped illumination light field and using weighted images, attenuation functions and spectrum optimization functions for image processing, the computational artifact is reduced, and the reconstruction speed and image quality are improved.

Benefits of technology

Without sacrificing reconstruction speed, significantly reduce computational artifacts, improve image fidelity and resolution, and achieve efficient super-resolution microscopic image reconstruction, improving imaging efficiency and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115308185B_ABST
    Figure CN115308185B_ABST
Patent Text Reader

Abstract

The present invention discloses a high-speed artifact-free super-resolution structured illumination microscopic imaging method, comprising: 1) generating a stripe-shaped illumination light field; 2) using the stripe-shaped illumination light field to illuminate and excite a sample to be tested at different stripe directions and different phase shift steps to generate a fluorescence signal; 3) collecting the fluorescence signal to obtain an original fluorescence image excited by different stripe-shaped illumination light fields; 4) using a high-speed artifact-free reconstruction algorithm to process the original fluorescence image to obtain a super-resolution image. The present invention can greatly suppress computational artifacts in super-resolution structured illumination microscopic images and significantly improve the fidelity of super-resolution images; at the same time, it also has a millisecond-level reconstruction speed, which provides great convenience for real-time imaging. The method can provide a powerful means for achieving high-fidelity, real-time super-resolution microscopic imaging.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of optical technology and relates to a structured light illumination microscopic imaging method, and in particular to a high-speed artifact-free super-resolution structured light illumination microscopic imaging method which can be widely used in research in the fields of biology, medicine, microelectronics and material science. Background Art

[0002] Super-resolution fluorescence microscopy can break through the diffraction limit of optical systems and is one of the important research topics in the field of optical microscopy. Among the many super-resolution imaging methods, super-resolution structured illumination microscopy (SR-SIM) has the highest imaging rate and the lowest excitation power density (~1W / cm 2 ), which can perform long-term dynamic super-resolution observations. In addition, linear SR-SIM is compatible with traditional fluorescent molecules and fluorescent dyes, and does not require special photoswitchable dyes or proteins, which greatly expands the application range of super-resolution imaging. These advantages make SR-SIM very popular in the observation of the dynamic behavior of organelles, biomacromolecules and their assemblies. In recent years, various new technologies, equipment and algorithms have been introduced into SR-SIM, and its spatiotemporal resolution and imaging depth have been greatly improved.

[0003] However, the application of SR-SIM in biomedical laboratories is still very limited, and it is even more difficult to be widely used in various fields such as biomedicine, microelectronics, and materials science like confocal microscopy. The main reasons are mainly two points: First, the image reconstruction algorithm of mainstream SR-SIM (process such as Figure 2 The SR-SIM images are based on frequency domain reconstruction and contain a lot of complex frequency domain post-processing operations. The operation usually takes several seconds, so real-time super-resolution imaging is impossible, which greatly reduces the imaging efficiency and user experience of users. Secondly, the super-resolution images reconstructed by SR-SIM often contain a lot of computational artifacts, which greatly reduces the fidelity of fine structures, making SR-SIM images unusable for quantitative fluorescence analysis. This is because its synthetic optical transfer function (OTF) does not match the ideal OTF with double resolution.

[0004] In order to solve the problem of slow SR-SIM reconstruction speed, Wang et al. proposed a hybrid reconstruction algorithm based on space-frequency domain (hereinafter referred to as space-frequency domain hybrid reconstruction algorithm, JSFR, patent number: ZL202110985056.7), which greatly simplified the reconstruction workflow (process such as Figure 3), which increases the reconstruction speed to more than 80 times that of the traditional method. This method simplifies most of the steps in the traditional reconstruction process into simple multiplication and summation operations in real space, greatly shortening the execution time of the reconstruction algorithm without sacrificing image quality. The significance of this improved reconstruction method is that microscope users can use SR-SIM like using a traditional confocal microscope, without switching back and forth between widefield mode and SR-SIM mode, which greatly improves their work efficiency, and thus solves the first problem mentioned above. However, the reconstruction results of this method are essentially completely equivalent to the traditional frequency-domain-based reconstruction algorithm, and there is also a significant difference between its synthetic optical transfer function (OTF) and the ideal OTF with double resolution. More precisely, its synthetic OTF also has a kinked distribution in the "intermediate frequency" region, so it will also produce sidelobe-like computational artifacts in the image, thereby greatly reducing the fidelity of the image. This makes it difficult to apply the images obtained by SR-SIM to quantitative fluorescence analysis, thus limiting its wide application in various fields. Summary of the invention

[0005] In order to solve the above-mentioned technical problems existing in the background technology, the present invention provides a high-speed, artifact-free super-resolution structured illumination microscopy imaging method which has both high reconstruction speed and high fidelity and can solve the problem of mismatch between the OTF synthesized by the JSFR algorithm and the ideal OTF without sacrificing the reconstruction speed.

[0006] In order to achieve the above object, the present invention adopts the following technical solution:

[0007] A high-speed artifact-free super-resolution structured illumination microscopy imaging method, characterized in that: the high-speed artifact-free super-resolution structured illumination microscopy imaging method comprises the following steps:

[0008] 1) Generate a stripe-shaped illumination light field, the intensity distribution of which is expressed as:

[0009]

[0010] in:

[0011] r is the coordinate in two-dimensional real space;

[0012] d is the different stripe directions, d = 1, 2, 3;

[0013] i is the number of different phase shift steps, i = 1, 2, 3;

[0014] I d is the average light intensity of the stripe-shaped illumination light field;

[0015] m dis the modulation degree of the stripe-shaped illumination light field;

[0016] k d is the wave vector of the fringe;

[0017] is the phase corresponding to the current illumination light field;

[0018] 2) using the stripe-shaped illumination light field obtained in step 1) to illuminate and excite the sample to be tested to generate a fluorescence signal under different stripe directions and different phase shift steps;

[0019] 3) collecting fluorescence signals to obtain original fluorescence images excited by different stripe-shaped illumination light fields;

[0020] 4) The original fluorescence image is processed using a high-speed artifact-free super-resolution reconstruction method to obtain an artifact-free super-resolution image.

[0021] The specific implementation of the above step 4) is:

[0022] 4.1) Calculate the weight image w corresponding to each original fluorescence image d,i (r):

[0023] According to the modulation degree m of each stripe illumination light field d , the wave vector k of the stripe illumination light field d And the phase of each stripe illumination light field Calculate the weight image w corresponding to each original fluorescence image d,i (r);

[0024] 4.2) Calculate the attenuation function a(k) and the spectrum optimization function

[0025] The attenuation function a(k) is a Gaussian distribution, where k is the coordinate in the spectrum space; the optical transfer function of the optical system is Spectrum optimization function It is obtained by the two attenuation functions of parameter fine-tuning, the optical transfer function of the optical system and the light field parameters in step 4.1);

[0026] 4.3) Preprocess and filter the original fluorescence image:

[0027] Through the pre-processing filter The original fluorescence images collected in step 3) are preprocessed and filtered to obtain filtered images.

[0028] 4.4) Dot product:

[0029] The filtered image obtained in step 4.3) Respectively with the weight image w calculated in step 4.1) d,i (r) Multiply the points and add up all the multiplication results to get the unoptimized super-resolution image I SR_woOpt (r);

[0030] 4.5) Perform spectrum optimization:

[0031] Using the spectrum optimization function calculated in step 4.2) For the unoptimized super-resolution image I obtained in step 4.4) SR_woOpt (r) Spectrum optimization is performed and transformed into real space to obtain the final artifact-free super-resolution image I SR (r).

[0032] The weight image w corresponding to the original fluorescence image in step 4.1) above d,i The expression for (r) is:

[0033]

[0034] in:

[0035] m d is the modulation degree of the stripe-shaped illumination light field;

[0036] k d is the wave vector of the stripe illumination light field;

[0037] is the initial phase of the stripe-shaped illumination light field;

[0038] is the phase shift.

[0039] The expression of the attenuation function in step 4.2) above is:

[0040]

[0041] in:

[0042] k is the coordinate in the spectrum space;

[0043] a att is the attenuation amplitude parameter, and its value range is from 0 to 1;

[0044] k σ is an adjustable empirical parameter;

[0045] The spectrum optimization function in step 4.2) There are two spectrum optimization sub-functions and The product of The expressions of the two spectrum optimization sub-functions are:

[0046]

[0047]

[0048] in:

[0049] Said is the optical transfer function of the traditional wide-field optical microscope, and its expression is:

[0050]

[0051] in Optical system cutoff frequency k c =2NA / λ; k is the frequency space coordinate; NA is the numerical aperture of the optical system;

[0052] Said is the optical transfer function of an ideal super-resolution system, and its expression is:

[0053]

[0054] The a1(k) and a2(k) are attenuation functions of parameter fine-tuning in the spectrum optimization sub-function, and the expressions of a1(k) and a2(k) are respectively:

[0055]

[0056]

[0057] The empirical parameter a att and k σ Keep consistent with the parameters in the decay function a(k);

[0058] Said is the toe-cutting function, and its expression is: The expression is:

[0059]

[0060] Of which: FWHM Apo is the full width at half maximum of the apodization function;

[0061] The w1 and w2 are Wiener filter parameters corresponding to the spectrum optimization sub-function, and both are empirical parameters.

[0062] The pre-processing filter in step 4.3) above The specific expression is:

[0063]

[0064] The w3 is the Wiener filter parameter corresponding to the preprocessing filter, which is an empirical parameter;

[0065] Said is the optical transfer function of the traditional wide-field optical microscope, * indicates taking the complex conjugate;

[0066] The attenuation function a(k) is a Gaussian distribution;

[0067] The specific implementation method of filtering in step 4.3) is: pre-process and filter the original fluorescence images taken in step 3) one by one to obtain a filtered image

[0068]

[0069] in:

[0070] The D d,i (r) is the original fluorescence image taken by the camera under structured light field illumination conditions;

[0071] fft() and ifft() represent Fourier transform and inverse Fourier transform of the image in the brackets respectively.

[0072] The unoptimized super-resolution image I in step 4.4) above SR_woOpt The expression for (r) is:

[0073]

[0074] The final artifact-free super-resolution image in step 4.5) above is expressed as:

[0075]

[0076] The specific implementation of the above step 2) is:

[0077] 2.1) Setting the initial phase of the stripe illumination light field

[0078] 2.2) Control the stripe illumination light field to rotate and move in the plane of the sample to be tested. The rotation directions are 0°, 120° and 240°. Each direction is a three-step phase shift, and the movement amount of each step is A total of 3×3 different stripe-shaped illumination light fields are generated;

[0079] 2.3) Using the different stripe-shaped illumination light fields obtained in step 2.2) to illuminate and excite the sample to be tested to generate a fluorescence signal.

[0080] The specific implementation method of the above step 3) is: the area array digital camera collects the fluorescence signals generated by step 2) respectively to obtain the original fluorescence images D excited by different stripe illumination light fields.d,i (r), where: r is the coordinate of the two-dimensional plane; d is the different stripe directions, d = 1, 2, 3; i refers to the different phase shift steps, i = 1, 2, 3.

[0081] A computer-readable storage medium, characterized in that: the computer-readable storage medium stores a computer program capable of running the high-speed artifact-free super-resolution structured illumination microscopy imaging method as described above.

[0082] Compared with the prior art, the advantages of the present invention are:

[0083] In order to fundamentally solve the problem of computational artifacts and slow reconstruction speed of SR-SIM images, the present invention discloses a high-speed artifact-free super-resolution structured illumination microscopy imaging method (process as shown in FIG Figure 4 As shown), without sacrificing the JSFR imaging speed, the problem of the mismatch between the synthetic OTF and the ideal OTF of the JSFR algorithm has been overcome. Compared with the classical super-resolution reconstruction algorithm, the high-speed artifact-free reconstruction algorithm disclosed in the present invention has a simpler reconstruction step, which can reduce the amount of calculation required for the reconstruction process by more than two times without sacrificing any image quality, and has extremely high parallelism. With the support of GPU acceleration, the algorithm can increase the reconstruction speed to more than 80 times that of the classical super-resolution reconstruction algorithm. In addition, the reconstruction results obtained by this method are comparable to those of the classical frequency domain reconstruction algorithm and the space-frequency domain hybrid reconstruction algorithm in terms of resolution, while the computational artifacts are significantly less than those of the classical super-resolution reconstruction algorithm and the space-frequency domain hybrid reconstruction algorithm. This high-speed, artifact-free reconstruction method provides an important means for achieving high-fidelity, real-time super-resolution microscopic image reconstruction. BRIEF DESCRIPTION OF THE DRAWINGS

[0084] Figure 1 This is the optical path diagram of the interferometric fringe SIM super-resolution microscopy system based on spatial light modulator SLM modulation and laser illumination;

[0085] Figure 2 This is the flowchart of the classic frequency domain reconstruction algorithm;

[0086] Figure 3 It is the flow chart of the space-frequency domain hybrid reconstruction algorithm;

[0087] Figure 4 This is a flow chart of the high-speed artifact-free reconstruction algorithm of the present invention;

[0088] Figure 5 Comparison of the super-resolution image effects of nano fluorescent spheres reconstructed by the classic frequency domain reconstruction algorithm, the space-frequency domain hybrid reconstruction algorithm, and the high-speed artifact-free reconstruction algorithm of the present invention;

[0089] in:

[0090] 1-Laser illumination light source; 2-Polarization beam splitter; 3-Half-wave plate; 4-Spatial light modulator SLM; 5-Quarter-wave plate; 6-First lens; 8-Second lens; 9-Third lens; 7-Spatial filter; 10-Dichroic mirror; 11-Reflector; 12-Objective lens; 13-Sample and stage; 14-Emission filter; 15-Tube lens; 16-Area array digital camera. DETAILED DESCRIPTION

[0091] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments.

[0092] The present invention can be directly implemented on mainstream SIM super-resolution microscopy systems, including but not limited to interferometric fringe SIM super-resolution microscopy systems based on SLM modulation and laser illumination, projection fringe SIM super-resolution microscopy systems based on DMD modulation and LED illumination, projection fringe SIM super-resolution microscopy systems based on fringe diffraction grating and LED illumination, etc. In principle, no hardware changes are required. The following will take a self-built interferometric fringe illumination SIM super-resolution microscopy system based on spatial light modulator modulation and laser illumination as an example to explain in detail the specific implementation of the method.

[0093] The optical path diagram of the system is as follows: Figure 1 As shown, it includes a laser illumination light source 1 after beam expansion and collimation, a beam splitter 2 arranged behind the beam expansion and collimation laser beam, a half-wave plate 3 and a spatial light modulator 4 arranged in sequence on the transmission light path of the polarization beam splitter 2, a quarter-wave plate 5 and a first lens 6 arranged on the reflection light path of the polarization beam splitter 2, a spatial filter 7 arranged at the rear end of the first lens 6, a telescope system composed of a second lens 8 and a third lens 9 arranged behind the spatial filter 7, a dichroic mirror 10 arranged behind the telescope system, a reflector 11 arranged on the transmission light path of the dichroic mirror 10, a microscope objective 12 and a sample and stage 13, an emission light filter 14 and a tube lens 15 arranged on the reflection light path of the dichroic mirror 10, and a scientific-grade CMOS camera 16 arranged behind the tube lens 15. The spatial light modulator 6 is a reflective ferroelectric liquid crystal spatial light modulator. As with the mainstream structured illumination microscopy method, the rotation and phase shift of the stripes are achieved by switching the pattern on the spatial light modulator. The original images under different illumination stripes are collected by the area array camera and transmitted to the PC. The hardware synchronization control, image acquisition and processing software involved in the system are all designed and developed independently.

[0094] Example 1

[0095] In this embodiment, the interferometric fringe illumination SIM super-resolution microscopy system based on spatial light modulator SLM modulation and laser illumination images the nano fluorescent spheres. Since the distribution of the nano fluorescent spheres is relatively dispersed, the local area can be processed as a non-defocused background, which is specifically achieved by the following steps:

[0096] Step 1: Use Figure 1 The interferometric fringe SIM super-resolution microscopy system based on spatial light modulator SLM modulation and laser illumination shown in the figure uses a collimated and expanded 488nm wavelength laser to enter the polarization beam splitter 2, pass through the half-wave plate 3, vertically illuminate the spatial light modulator SLM4 and return along the original path, and generate a vertical linear polarized diffraction beam in the reflection light path of the polarization beam splitter 2. The vertically polarized diffraction beam is converted into circularly polarized light by the quarter-wave plate 5 and converged by the lens 6. The zero-order and other high-order diffraction beams of the converged multi-order diffraction are filtered by a customized spatial filter 7 (such as Figure 1 The two beams are then relayed to the objective rear pupil by the telescope system and enter the microscope objective 12. The two tilted circularly polarized lights interfere with each other at the focal plane and form a stripe-shaped illumination light field for illuminating the sample.

[0097] The intensity of the stripe illumination light field can be expressed in the form of a cosine function, satisfying the distribution of formula (1):

[0098]

[0099] Where r is the coordinate of the two-dimensional plane, the subscript d (= 1, 2, 3) indicates different stripe directions, the subscript i (= 1, 2, 3) indicates different phase shift steps, and I d Represents the average light intensity of the stripe illumination light field, m d is the modulation degree of the stripe illumination light field, k d represents the wave vector of the fringe, is the phase corresponding to the current fringe light field;

[0100] Step 2: Place the nano fluorescent ball sample on the stage and adjust it to the focal plane of the objective lens, illuminate it with a stripe-shaped illumination light field, and excite the labeled nano fluorescent balls to emit fluorescence; after the fluorescence is collected by the objective lens, it passes through the emission light filter 14 and the tube lens 15, and is finally imaged on the sensor of the area array digital camera 16.

[0101] Assume that the initial phase of the light field is The spatial light modulator (SLM) is controlled to rotate and translate the stripe illumination pattern by loading and refreshing, so that the stripe illumination light field rotates and moves in the sample plane in three directions (0°, 120°, 240°), and each direction is three-step phase shift. Usually, equal interval phase shift is used, and the movement amount of each step is The phase shifts of the three illumination patterns in each direction are set to 0, 2π / 3, and 4π / 3, respectively, which are used to illuminate and excite the sample to generate fluorescence signals.

[0102] Step 3: The area array digital camera 16 collects 9 corresponding original fluorescence images respectively. Assuming that the magnification ratio between the object space and the image space is 1, the original fluorescence images captured by the camera can be recorded as: D 1,1 (r), D 1,2 (r), D 1,3 (r), D 2,1 (r), D 2,2 (r), D 2,3 (r)

[0103] D 3,1 (r), D 3,2 (r), D 3,3 (r); These raw fluorescence images are stored in computer memory, hard disk, or floppy disk.

[0104] Step 4: Process the original fluorescence image using the high-speed artifact-free reconstruction algorithm disclosed in the present invention. The processing result is as follows: Figure 5 The specific processing methods are as follows:

[0105] First, according to the modulation degree m of the structured light field in each stripe direction d , wave vector k d , initial phase And the phase shift Calculate the weight image w corresponding to each original fluorescence image d,i (r), the weight image is calculated by the following formula:

[0106]

[0107] At the same time, pre-calculate the attenuation function that will be used later

[0108]

[0109] where a att is the attenuation amplitude parameter, the value range is 1 to 0, and the value here is 0.99; k σ is an adjustable empirical parameter, here it is 1.2 cycles / micrometer; at the same time, two attenuation functions for parameter fine-tuning used in the spectrum optimization sub-function are calculated

[0110]

[0111]

[0112] The empirical parameter aatt and k σ Keep consistent with the parameters in the decay function a(k).

[0113] Assume that the optical transfer function of the optical system is Generally, it is a rotationally symmetrical distribution, and theoretically has a variety of representations, typically:

[0114]

[0115] in Optical system cutoff frequency k c =2NA / λ.

[0116] From this, the optical transfer function of the ideal super-resolution system can be calculated:

[0117]

[0118] In addition, the apodization function is calculated

[0119]

[0120] FWHM Apo is the full width at half maximum of the apodization function.

[0121] According to the above results, the spectrum optimization function can be calculated The two spectrum optimization sub-functions The expressions are:

[0122]

[0123]

[0124] At this point, all the intermediate variables that need to be pre-calculated have been calculated.

[0125] Then, use the preprocessing filter The 9 original fluorescence images taken in step 2) are pre-processed and filtered to obtain filtered images.

[0126]

[0127] Among them, the preprocessing filter

[0128]

[0129] Next, the 9 filtered images are compared with the pre-calculated weight image w d,i (r) Multiply the points and add up all the multiplication results to get the unoptimized super-resolution image I SR_woOpt (r);

[0130]

[0131] Finally, using the unoptimized super-resolution image I SR_woOpt (r) and spectrum optimization function Complete the spectrum optimization operation to obtain the final high-fidelity super-resolution image

[0132]

[0133] Figure 5 The wide-field illumination image and the fringe SIM super-resolution image of the nanofluorescent spheres obtained by the interferometric fringe illumination SIM super-resolution microscopy system based on spatial light modulator SLM modulation and laser illumination are compared. The experiment uses a 100× microscope objective with a numerical aperture NA of 1.49. Figure 5 (a) is a normal wide-field fluorescence image. Figure 5 (b) is a super-resolution image obtained using the classical frequency domain reconstruction method. Figure 5 (c) is a super-resolution image obtained using a spatial-frequency hybrid reconstruction method. Figure 5 (d) is a super-resolution image obtained using the high-speed artifact-free algorithm proposed in the present invention. By comparison, it can be seen that the resolution of the image obtained by the method of the present invention is significantly higher than that of an ordinary wide-field image. In addition, in the images reconstructed by the classical frequency domain reconstruction method and the space-frequency domain hybrid reconstruction method, six symmetrically distributed sidelobe artifacts will be generated around the sphere. These sidelobe artifacts are very easy to be mistaken for real spheres. In the super-resolution image obtained by the high-speed artifact-free algorithm proposed in the present invention, these artifacts are well suppressed, and the credibility of the image is greatly improved. At the same time, with the support of the GPU, the reconstruction speed of the high-speed artifact-free reconstruction algorithm is close to that of the method based on space-frequency domain hybrid reconstruction, which is more than 80 times higher than the classical frequency domain reconstruction method (see Table 1).

[0134] Table 1 Comparison of execution time of several reconstruction algorithms at different original image sizes

[0135]

[0136] The present invention also provides a super-resolution imaging system using a stripe-shaped illumination light field for illumination, comprising a processor and a memory, wherein a computer program is stored in the memory, and when the computer program runs in the processor, the super-resolution image reconstruction processing method of step 4 is executed.

[0137] The present application also provides a computer-readable storage medium for storing a program, which implements the above-mentioned super-resolution image reconstruction processing method when the program is executed. In some possible implementations, the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above method section of this specification.

[0138] The program product for implementing the above method may adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device.

[0139] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

Claims

1. A high-speed artifact-free super-resolution structured illumination microscopic imaging method, characterized by: The high-speed artifact-free super-resolution structured illumination microscopic imaging method comprises the following steps: 1) Generate a stripe-shaped illumination light field, the intensity distribution of which is expressed as: in: r is the coordinate in two-dimensional real space; d is the different stripe directions, d = 1, 2, 3; i is the number of different phase shift steps, i = 1, 2, 3; I d is the average light intensity of the stripe-shaped illumination light field; m d is the modulation degree of the stripe-shaped illumination light field; k d is the wave vector of the fringe; is the phase corresponding to the current illumination light field; 2) using the stripe-shaped illumination light field obtained in step 1) to illuminate and excite the sample to be tested to generate a fluorescence signal under different stripe directions and different phase shift steps; 3) collecting fluorescence signals to obtain original fluorescence images excited by different stripe-shaped illumination light fields; 4) Processing the original fluorescence image using a high-speed artifact-free super-resolution reconstruction method to obtain an artifact-free super-resolution image; The specific implementation method of step 4) is: 4.1) Calculate the weight image w corresponding to each original fluorescence image d,i (r): According to the modulation degree m of each stripe illumination light field d , the wave vector k of the stripe illumination light field d And the phase of each stripe illumination light field Calculate the weight image w corresponding to each original fluorescence image d,i (r); where r is the coordinate in two-dimensional real space; 4.2) Calculate the attenuation function a(k) and the spectrum optimization function The attenuation function a(k) is a Gaussian distribution, where k is the coordinate in the spectrum space; the optical transfer function of the optical system is Spectrum optimization function Two attenuation functions fine-tuned by parameters, optical transfer function of the optical system And the light field parameters in step 4.1) are obtained; 4.3) Preprocess and filter the original fluorescence image: Through the pre-processing filter The original fluorescence images collected in step 3) are preprocessed and filtered to obtain filtered images. 4.4) Dot product: The filtered image obtained in step 4.3) Respectively with the weight image w calculated in step 4.1) d,i (r) Multiply the points and add up all the multiplication results to get the unoptimized super-resolution image I SR_woOpt (r); 4.5) Perform spectrum optimization: Using the spectrum optimization function calculated in step 4.2) For the unoptimized super-resolution image I obtained in step 4.4) SR_woOpt (r) Spectrum optimization is performed and transformed into real space to obtain the final artifact-free super-resolution image I SR (r); The weight image w corresponding to the original fluorescence image in step 4.1) d,i The expression for (r) is: in: m d is the modulation degree of the stripe-shaped illumination light field; k d is the wave vector of the stripe illumination light field; is the initial phase of the stripe-shaped illumination light field; is the phase shift; The expression of the attenuation function in step 4.2) is: in: k is the coordinate in the spectrum space; a att is the attenuation amplitude parameter, and its value range is from 0 to 1; k σ is an adjustable empirical parameter; The spectrum optimization function in step 4.2) There are two spectrum optimization sub-functions and The product of The expressions of the two spectrum optimization sub-functions are: in: m = -1, 0, 1 represents the order of the spectrum; k d is the wave vector of the stripe illumination light field; Said is the optical transfer function of the traditional wide-field optical microscope, and its expression is: in Optical system cutoff frequency k c =2NA / λ; k is the frequency space coordinate; NA is the numerical aperture of the optical system; Said is the optical transfer function of an ideal super-resolution system, and its expression is: The a1(k) and a2(k) are attenuation functions of parameter fine-tuning in the spectrum optimization sub-function, and the expressions of a1(k) and a2(k) are respectively: The empirical parameter a att and k σ Keep consistent with the parameters in the decay function a(k); Said is the toe-cutting function, and its expression is: The expression is: Of which: FWHM Apo is the full width at half maximum of the apodization function; The w1 and w2 are Wiener filter parameters corresponding to the spectrum optimization sub-function, both of which are empirical parameters; The pre-processing filter in step 4.3) The specific expression is: The w3 is the Wiener filter parameter corresponding to the preprocessing filter, which is an empirical parameter; Said is the optical transfer function of the traditional wide-field optical microscope, * represents the complex conjugate; The attenuation function a(k) is a Gaussian distribution; The specific implementation method of filtering in step 4.3) is: pre-process and filter the original fluorescence images taken in step 3) one by one to obtain a filtered image in: The D d,i (r) is the original fluorescence image taken by the camera under structured light field illumination conditions; fft() and ifft() represent Fourier transform and inverse Fourier transform of the image in brackets respectively; The unoptimized super-resolution image I in step 4.4) SR_woOpt The expression for (r) is: The final artifact-free super-resolution image in step 4.5) is expressed as:

2. The high-speed artifact-free super-resolution structured illumination microscopy imaging method according to claim 1, characterized in that: Said The specific implementation of step 2) is: 2.1) Setting the initial phase of the stripe illumination light field 2.2) Control the stripe illumination light field to rotate and move in the plane of the sample to be tested. The rotation directions are 0°, 120° and 240°. Each direction is a three-step phase shift, and the movement amount of each step is A total of 3×3 different stripe-shaped illumination light fields are generated; 2.3) Using the different stripe-shaped illumination light fields obtained in step 2.2) to illuminate and excite the sample to be tested to generate a fluorescence signal.

3. The high-speed artifact-free super-resolution structured illumination microscopy imaging method according to claim 2, characterized in that: The specific implementation method of step 3) is: the area array digital camera collects the fluorescence signals generated by step 2) respectively to obtain the original fluorescence images D excited by different stripe illumination light fields. d,i (r), where: r is the coordinate of the two-dimensional plane; d is the different stripe directions, d = 1, 2, 3; i refers to the different phase shift steps, i = 1, 2, 3.

4. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program capable of running the high-speed artifact-free super-resolution structured illumination microscopy imaging method as described in any one of claims 1 to 3.

Citation Information

Patent Citations

  • Super-resolution Bessel micro-imaging device and method based on multi-focus light illumination

    CN110487762A

  • Wide-field super-resolution microscopic imaging method and system thereof

    CN110954521A

  • Rapid method and system for directly reconstructing structured light illumination super-resolution image in airspace

    CN111077121A

  • Super-resolution imaging method and system by utilizing square lattice structure light illumination

    CN111458318A

  • Super-resolution structure illumination obvious micro-imaging method based on space-frequency domain hybrid reconstruction

    CN113670878A