Near-infrared speckle structured light super-resolution imaging method and device based on high-order nonlinearity
Through the high-order nonlinear near-infrared speckle structured light super-resolution imaging method, the random speckle illumination light field and high-order nonlinear fluorescence probe are used to solve the problem of prior knowledge and scattering in traditional microscope reconstruction, and high-resolution is achieved super-resolution imaging of rate.
Patent Information
- Application Number
- CN202411199351.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-29
- Publication Date
- 2024-11-15
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Traditional structured light microscopes rely on prior knowledge when reconstructing images, which are prone to artifacts, and when imaging biological tissues are imaged, imaging distortion due to scattering of illumination light, making it difficult to break through the diffraction limit, limiting imaging resolution and depth.
Using the method of ultra-resolution imaging based on high-order nonlinearity, a stable laser is generated through a laser and adjusted through a filter, a half-wave plate and a polarization speckle prism, and a random speckle illumination light field is generated using digital micromirror devices. , excited fluorescent probes to achieve higher-order nonlinear responses, and processing image sequences in combination with blind SIM algorithms to obtain high/super resolution images.
No prior knowledge parameter estimation is required, artifact generation is reduced, and the random speckle illumination light field is not prone to distortion, which significantly improves imaging resolution, breaks through the diffraction limit, and achieves super-resolution imaging of 110-140nm.
Smart Images

Figure CN118961668A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of optical microscopy, and in particular to a near-infrared speckle structured light super-resolution imaging method and device based on high-order nonlinearity. Background Art
[0002] For a long time, far-field optical fluorescence microscopy has become the most commonly used observation tool in life sciences due to its advantages of non-contact, non-destructive, and the ability to detect the inside of samples. Some traditional optical microscopy systems use wide-field illumination, but due to the existence of the optical diffraction limit, their imaging depth and imaging resolution are limited. Therefore, many researchers have conducted extensive research on how to break through the diffraction limit and improve resolution under wide-field illumination.
[0003] Some researchers have proposed traditional structured illumination microscopy (SIM), which uses a stripe-structured illumination beam to excite fluorescence, excites the mixed frequency of the pattern and fluorophore density, and carries high-frequency information that is usually invisible in the sample to the visible low-pass band of the microscope; by changing the direction and phase of the pattern, recording the fluorescence results and appropriately processing the multiple image data sets obtained, the high-frequency information carried is extracted and a super-resolution image is reconstructed.
[0004] Theoretically, the lateral resolution of SIM can reach twice that of traditional fluorescence microscopes. However, when performing SIM reconstruction, it is necessary to rely on prior knowledge. If the parameter estimation is inaccurate, it is easy to cause artifacts in the reconstructed image, affecting the reconstruction quality. In addition, when imaging biological tissues, since the illumination light is a stripe structure, it is easy to scatter when passing through biological tissues, causing the illumination light to be distorted and the reconstruction result to be distorted.
[0005] Therefore, if we can overcome the defects of traditional structured light illumination microscopy and develop a microscopy method whose reconstruction does not rely on parameter estimation and is not affected by scattering during deep imaging, this will be of great significance for enhancing my country's international influence in basic research and instrument development of super-resolution microscopy and even in biological applications. Summary of the invention
[0006] In view of the deficiencies in the prior art, the present invention aims to provide a near-infrared speckle structured light super-resolution imaging method and device based on high-order nonlinearity.
[0007] In order to achieve the above object, the present invention adopts the following technical solution:
[0008] A near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity, the method comprising the following steps:
[0009] The S1 laser generates a stable, single-peak laser beam, which is filtered out by a filter to remove other wavelengths of laser light, and then adjusted by a half-wave plate and a polarization beam splitter prism. Finally, it is reflected by a reflector into the speckle modulation system, and amplitude modulated by a digital micromirror device to generate a time-varying, irregularly distributed random speckle illumination light field. The random speckle illumination light field is emitted from the objective end of the multiphoton wide-field imaging module and irradiated onto the sample.
[0010] The upconversion fluorescence emission intensity of the S2 sample generated by the random speckle illumination field has a high-order nonlinear response relationship with the excitation light intensity. This multi-photon nonlinear fluorescence effect greatly compresses the initial fluorescence point spread function, thereby improving the imaging resolution and breaking through the diffraction limit;
[0011] S3 places the fluorescent probe (probe-specifically labeled sample) on the surface of the slide, scans it in the X and Y directions using a changing random speckle illumination light field, and then uses a high-sensitivity camera to collect the corresponding fluorescent signal of each frame, collects the image sequence and records it by the data processing end;
[0012] S4 processes the acquired image sequences using a blind SIM algorithm to ultimately obtain a high / super-resolution fluorescence image.
[0013] It should be noted that the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that a filter, a half-wave plate, a polarization beam splitter prism and a reflector are arranged between the laser light source and the digital micromirror device. The half-wave plate and the polarization beam splitter prism are used to receive the laser beam generated by the excitation light generation module and adjust the output power of the laser beam, and the reflector is used to reflect the laser beam into the digital micromirror device.
[0014] It should be noted that the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that, when modulating the random speckle illumination light field, it is necessary to first load a sequence of N speckle binary images with digital signals of "0" and "1" to the digital micromirror device, and the laser beam needs to be irradiated at the center of the digital micromirror device at an incident angle of 24°.
[0015] It should be noted that the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that the speckle binary image sequence is randomly generated and distributed irregularly, and the digital signal of each pixel after the superposition and summation of the speckle binary image sequence should be greater than "0".
[0016] It should be noted that the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that when modulating the random speckle illumination light field, not only the digital micromirror device can be used for modulation, but also scattering media, spatial light modulators and other methods can be used for modulation.
[0017] It should be noted that the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that the random speckle illumination light field is projected onto the sample surface in the form of parallel light to generate a speckle fluorescence signal, and the multi-photon wide-field imaging module performs N surface scans in the X and Y directions, and the corresponding fluorescence signals are collected by the high-sensitivity camera, and the high-sensitivity camera sends the signal to the computer after receiving each detection signal.
[0018] It should be noted that the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that a plurality of collected image sequences are processed using a blind SIM algorithm to ultimately obtain a high / super-resolution fluorescence image.
[0019] It should be noted that the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that the fluorescent probe comprises rare earth doped up-conversion nanoparticles, whose nonlinear order n≥2, and can be matched to its activated ion Tm by continuous / femtosecond near-infrared light. 3+ The excited state absorption energy of Nd 3+ or Yb 3+ As a sensitizer, co-doped upconversion nanoparticles can be excited by lasers with wavelengths of 980nm, 795nm, and 730nm respectively to produce a four-photon fluorescence radiation process, which greatly compresses the fluorescence point spread function, breaks through the diffraction limit, and achieves 110-140nm super-resolution imaging.
[0020] It should be noted that the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that the fluorescent probe can also use an avalanche fluorescent nanoprobe to generate photon avalanche up-conversion fluorescence, generating a high-order nonlinear effect n≥10, so as to obtain a higher-order nonlinear effect, so that the fluorescence point spread function is greatly compressed, breaking through the diffraction limit, and achieving 70-110nm ultra-high resolution imaging.
[0021] The beneficial effects of the present invention are:
[0022] 1. Compared with the traditional speckle structured light microscope, the present invention introduces upconversion nanoparticles, utilizes the high-order nonlinear characteristics of upconversion nanoparticle fluorescence, and combines it with the random speckle illumination light field to achieve uniform compression of the point spread function in the XY direction of the illumination light field, further improving the imaging resolution on the basis of the traditional speckle structured light microscope;
[0023] 2. Compared with the traditional structured light microscope, the present invention introduces an illumination light field with a speckle structure, which can be directly modulated by a digital micromirror device. The illumination light field is random, and the prior knowledge required for reconstruction is low, and no parameter estimation is required;
[0024] 3. Compared with the traditional structured light microscope, the present invention introduces a speckle structured illumination light field. When the traditional structured light microscope is used for biological tissue imaging, the illumination light field is prone to scattering when passing through the biological tissue. Since the speckle illumination light field is a random spot, the shape change is less affected by scattering, and it is less likely to be distorted than the stripe structured light, reducing the possibility of artifacts during reconstruction.
[0025] 4. Compared with the traditional far-field optical microscope, the present invention combines the illumination light field with a speckle structure with a super-fluorescent high-order nonlinear probe, which greatly compresses the point spread function size in the lateral direction, breaks through the diffraction limit, and improves the imaging resolution. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 This is a simulation comparison diagram of ordinary wide-field imaging and imaging combined with nonlinear effects in Example 1.
[0027] Figure 2 This is an experimental comparison diagram of ordinary wide-field imaging and imaging combined with nonlinear effects in Example 1.
[0028] Figure 3 Schematic diagram of the structure of the near-infrared speckle structured light super-resolution imaging device based on high-order nonlinearity in Example 2. DETAILED DESCRIPTION
[0029] The present invention will be further described below. It should be noted that the following embodiments are based on the present technical solution and provide detailed implementation methods and specific operation processes, but the protection scope of the present invention is not limited to these embodiments.
[0030] The present invention is a near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity, the method comprising the following steps:
[0031] The S1 laser generates a stable, single-peak laser beam, which is filtered out by a filter to remove other wavelengths of laser light, and then adjusted by a half-wave plate and a polarization beam splitter prism. Finally, it is reflected by a reflector into the speckle modulation system, and amplitude modulated by a digital micromirror device to generate a time-varying, irregularly distributed random speckle illumination light field. The random speckle illumination light field is emitted from the objective end of the multiphoton wide-field imaging module and irradiated onto the sample.
[0032] The upconversion fluorescence emission intensity of the S2 sample generated by the random speckle illumination field has a high-order nonlinear response relationship with the excitation light intensity. This multi-photon nonlinear fluorescence effect greatly compresses the initial fluorescence point spread function, thereby improving the imaging resolution and breaking through the diffraction limit;
[0033] S3 places the fluorescent probe (probe-specifically labeled sample) on the surface of the slide, scans it in the X and Y directions using a changing random speckle illumination light field, and then uses a high-sensitivity camera to collect the corresponding fluorescent signal of each frame, collects the image sequence and records it by the data processing end;
[0034] S4 processes the acquired image sequences using a blind SIM algorithm to ultimately obtain a high / super-resolution fluorescence image.
[0035] Furthermore, the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that a filter, a half-wave plate, a polarization beam splitter prism and a reflector are arranged between the laser light source and the digital micromirror device. The half-wave plate and the polarization beam splitter prism are used to receive the laser beam generated by the excitation light generation module and adjust the output power of the laser beam, and the reflector is used to reflect the laser beam into the digital micromirror device.
[0036] Furthermore, the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that, when modulating the random speckle illumination light field, a speckle binary image sequence of N digital signals of "0" and "1" needs to be loaded into the digital micromirror device first, and the laser beam needs to be irradiated at the center of the digital micromirror device at an incident angle of 24°.
[0037] Furthermore, the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that the speckle binary image sequence is randomly generated and irregularly distributed, and the digital signal of each pixel after the superposition and summation of the speckle binary image sequence should be greater than "0".
[0038] Furthermore, the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that when modulating the random speckle illumination light field, not only the digital micromirror device can be used for modulation, but also scattering media, spatial light modulators and other methods can be used for modulation.
[0039] Furthermore, the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that the random speckle illumination light field is projected onto the sample surface in the form of parallel light to generate a speckle fluorescence signal, and the multi-photon wide-field imaging module performs N surface scans in the X and Y directions, and the high-sensitivity camera is used to collect the corresponding fluorescence signal, and the high-sensitivity camera sends the signal to the computer after receiving each detection signal.
[0040] Furthermore, the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that a plurality of collected image sequences are processed using a blind SIM algorithm to ultimately obtain a high / super-resolution fluorescence image.
[0041] Furthermore, the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that the fluorescent probe comprises rare earth doped up-conversion nanoparticles, whose nonlinear order n≥2, and can be matched to its activated ion Tm by continuous / femtosecond near-infrared light. 3+ The excited state absorption energy of Nd 3+ or Yb 3+ As a sensitizer, co-doped upconversion nanoparticles can be excited by lasers with wavelengths of 980nm, 795nm, and 730nm respectively to produce a four-photon fluorescence radiation process, which greatly compresses the fluorescence point spread function, breaks through the diffraction limit, and achieves 110-140nm super-resolution imaging.
[0042] Furthermore, the near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity is characterized in that the fluorescent probe can also use an avalanche fluorescent nanoprobe to generate photon avalanche up-conversion fluorescence, generating a high-order nonlinear effect n≥10, so as to obtain a higher-order nonlinear effect, so that the fluorescence point spread function is greatly compressed, breaking through the diffraction limit, and achieving 70-110nm ultra-high resolution imaging.
[0043] Example 1
[0044] The laser generates a stable, single-peak laser beam, which is filtered out by a filter to remove other wavelengths of laser light, and then adjusted by a half-wave plate and a polarization beam splitter prism. Finally, it is reflected by a reflector into the speckle modulation system, and amplitude modulated by a digital micromirror device to generate a random speckle illumination light field that varies with time and is irregularly distributed. The random speckle illumination light field is emitted from the objective end of the multiphoton wide-field imaging module and irradiated onto the sample.
[0045] A fluorescent probe (a sample specifically labeled with a probe) is placed on the surface of a glass slide and scanned in the X and Y directions using a changing random speckle illumination light field. A highly sensitive camera is then used to collect the fluorescence signal corresponding to each frame, and an image sequence is acquired and recorded. The acquired image sequences are processed using a blind SIM algorithm to ultimately obtain a high / super-resolution fluorescence image. Figure 1 The simulation results are obtained under near-infrared excitation. Figure 1 (a) is the imaging result of simulated wide field. Figure 1 (b) is the simulation of the imaging result when the order N = 4 when introducing the fluorescence high-order nonlinear effect. The distances between the center lines of the parallel lines from top to bottom are: 280nm, 240nm, 200nm, 160nm, 120nm, 80nm. It can be seen that the imaging resolution is improved after the introduction of high-order nonlinearity. Figure 2 The experimental results are obtained under near-infrared excitation. Figure 2 (a) is the experimental imaging result under wide field. Figure 2 (b) Experimental imaging results with order N=2 to introduce higher-order nonlinear effects in fluorescence. It can be seen that higher-order nonlinearity improves the imaging resolution, and the experimental results match the simulation results.
[0046] Example 2
[0047] The schematic diagram of the device of the present invention is shown in Figure 3 , including excitation light generation module, speckle modulation module, multiphoton wide-field imaging module, sample module and photoelectric detection module:
[0048] 1. Excitation light generation module, including near-infrared laser 1, filter 2, half-wave plate 3 and polarization beam splitter 4. The near-infrared laser generates Gaussian laser output, the filter filters out stray light in other wavelengths of the laser, and the half-wave plate is mounted on a rotatable mount and used with a linear polarizer to adjust the power of the laser beam;
[0049] 2. A speckle modulation module, comprising a reflector 5 and a digital micromirror device 6. The power tunable laser generated by the excitation light generation module is irradiated at the center of the digital micromirror device at an incident angle of 24° via the reflector, and the amplitude is modulated in the digital micromirror working array area to generate a random speckle illumination pattern with irregular distribution that changes over time;
[0050] 3. A multi-photon wide-field imaging module, comprising a collimating beam expansion system 7, a tube lens 8, a high-reflection and low-transmittance dichroic mirror 9, and an objective lens 10. The random speckle illumination pattern is expanded by the collimating beam expansion system 7 to expand the excitation spot size, the high-reflection and low-pass dichroic mirror 9 reflects the modulated excitation beam and couples it into the objective lens 10, and the objective lens 10 projects the modulated image onto the sample surface, wherein the tube lens 8 and the objective lens 10 work together to reduce the speckle and project it onto the imaging plane;
[0051] 4. Sample module 11, a sample marked with a rare earth doped upconversion fluorescent probe, quantum dots or organic dyes is spread on the surface of a glass slide, and a focused speckle modulated light spot is incident from one side of the cover glass to excite the sample;
[0052] 5. Photoelectric detection module, including a tube lens 12 and a high-sensitivity imaging camera 13. The focusing lens and the high-sensitivity imaging camera are arranged along the forward direction of the fluorescence collected by the objective lens, and the high-sensitivity imaging camera is connected to an external computer. After the camera receives the detection signal, it transmits the signal to the computer, and realizes the random speckle illumination super-resolution image in combination with the algorithm.
[0053] The present invention and its embodiments are described above, and such description is not restrictive. The drawings show only one embodiment of the present invention, and the actual structure is not limited thereto. In short, if ordinary technicians in the field are inspired by it, without departing from the purpose of the invention, they can design a structure and embodiment similar to the technical solution without creativity, which should belong to the protection scope of the present invention.
Claims
1. A near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity, characterized by: The following steps are involved: The S1 laser generates a stable, single-peak laser beam, which is filtered out by a filter to remove other wavelengths of laser light, and then adjusted by a half-wave plate and a polarization beam splitter prism. Finally, it is reflected by a reflector into the speckle modulation system, and amplitude modulated by a digital micromirror device to generate a time-varying, irregularly distributed random speckle illumination light field. The random speckle illumination light field is emitted from the objective end of the multiphoton wide-field imaging module and irradiated onto the sample. The S2 sample is excited by the random speckle illumination light field to produce up-conversion fluorescence; S3 places the fluorescent probe on the surface of the slide, scans it in the X and Y directions using a changing random speckle illumination light field, and then uses a high-sensitivity camera to collect the corresponding fluorescent signal of each frame, collects the image sequence and records it by the data processing end; S4 processes the acquired image sequences using a blind SIM algorithm to ultimately obtain a high / super-resolution fluorescence image.
2. The method of near-infrared speckle structured light super-resolution imaging based on high-order nonlinearity according to claim 1, characterized in that: Modulating the random speckle illumination light field includes the following steps: First, a sequence of N speckle binary images with digital signals of "0" and "1" is loaded into the digital micromirror device; The laser beam is irradiated at the center of the DMD at an incident angle of 24°; When the digital micromirror device modulates the illumination light field, the playback frequency of the binary image sequence is consistent with the shooting frequency of the high-sensitivity imaging camera.
3. The near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity according to claim 2, characterized in that: The speckle binary image sequence is randomly generated and has no regular distribution, and the digital signal of each pixel after the superposition and summation of the speckle binary image sequence is greater than "0".
4. The method of near-infrared speckle structured light super-resolution imaging based on high-order nonlinearity according to claim 2, characterized in that: The modulation of the random speckle illumination light field also includes a scattering medium and a spatial light modulator.
5. The method of near-infrared speckle structured light super-resolution imaging based on high-order nonlinearity according to claim 1, characterized in that: The random speckle illumination light field is projected onto the sample surface in the form of parallel light to generate a speckle fluorescence signal, and the multiphoton wide-field imaging module performs N-times surface scanning in the X and Y directions, and the high-sensitivity camera collects the corresponding fluorescence signal. After receiving each detected signal, the high-sensitivity camera sends the signal to the computer.
6. The near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity according to claim 1, characterized in that: The fluorescent probe in S3 comprises rare earth doped upconversion nanoparticles, whose nonlinear order n≥2, and whose activation ion Tm is matched by continuous / femtosecond near-infrared light. 3+ The excited state absorption energy of Nd 3+ or Yb 3+ As a sensitizer, co-doped upconversion nanoparticles can be excited by lasers with wavelengths of 980nm, 795nm, and 730nm, respectively, to produce a four-photon fluorescence radiation process, which greatly compresses the fluorescence point spread function and achieves 110-140nm super-resolution imaging.
7. The near-infrared speckle structured light super-resolution imaging method based on high-order nonlinearity according to claim 1, characterized in that: The fluorescent probe includes using an avalanche fluorescent nanoprobe to generate photon avalanche up-conversion fluorescence, generating a high-order nonlinear effect n≥10, thereby obtaining a higher-order nonlinear effect, greatly compressing the fluorescent point spread function, and achieving 70-110nm ultra-high resolution imaging.
8. A near-infrared speckle structured light super-resolution imaging device based on high-order nonlinearity, characterized in that: It includes an excitation light generation module, a speckle modulation module, a multi-photon wide-field imaging module, a sample module and a photoelectric detection module; The excitation light generation module is used to generate a laser beam with adjustable power, and the speckle modulation module includes a reflector and a digital micromirror device arranged in sequence, and the digital micromirror device generates a random speckle illumination pattern with irregular distribution; The multi-photon wide-field imaging module receives the irregularly distributed random speckle illumination pattern and modulates it to project it to the sample module, and the photoelectric detection module transmits the signal to the computer to realize the random speckle illumination super-resolution image.
9. The near-infrared speckle structured light super-resolution imaging device based on high-order nonlinearity according to claim 8, characterized in that: The excitation light generation module includes a near-infrared laser, a filter, a half-wave plate, and a polarization beam splitter prism arranged in sequence; The near-infrared laser produces a Gaussian laser output, and the half-wave plate is mounted on a rotatable mount and is used in conjunction with a linear polarizer to adjust the power of the laser beam.
10. The near-infrared speckle structured light super-resolution imaging device based on high-order nonlinearity according to claim 8, characterized in that: The multiphoton wide-field imaging module comprises a collimating beam expansion system, a tube lens, a high-reflection and low-transmittance dichroic mirror and an objective lens, which are arranged in sequence, and the sample module is arranged close to the objective lens; The photoelectric detection module comprises a lens barrel and a high-sensitivity imaging camera which are arranged in sequence. The lens barrel and the high-sensitivity imaging camera are arranged along the forward direction of the fluorescence collected by the objective lens. The high-sensitivity imaging camera is connected to an external computer.
Citation Information
Patent Citations
Low-light-intensity single-beam large-view-field laser spot scanning super-resolution microscopic imaging device and method
CN113567410A
Dynamic target super-resolution reconstruction method based on speckle illumination
CN116596763A
Wide-spectrum microscopic Raman ghost imaging device and method based on structured light illumination
CN117007187A
Multi-photon structured light illumination super-resolution imaging method based on continuous light near-infrared excitation
CN117269129A
Cited By
Full-automatic intelligent multifunctional high-order nonlinear fluorescence dynamics testing method and device
CN119555651A
A fully automatic intelligent and multifunctional high-order nonlinear fluorescence kinetics testing method and device
CN119555651B
High-resolution semiconductor surface and interior flaw detection method and device based on multiphoton nonlinear fluorescence effect
CN120102535A
