A three-dimensional fluorescence signal encoding super-resolution microscopy imaging method

The fluorescent signal is encoded and decoded through laser pulse modulation and frequency domain phasor analysis technology, combined with time-dependent single photon counter, the problem of low three-dimensional resolution of traditional microscopes is solved, and the low-power, easy-to-implement three-dimensional super-resolution imaging is achieved. Improved image quality and simplified sample preparation for live cell research.

CN117783071BActive Publication Date: 2024-11-29SHENZHEN UNIV
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202311822492.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-12-27
Publication Date
2024-11-29
Estimated Expiration
2043-12-27

AI Technical Summary

Technical Problem

The resolution of traditional optical microscopes in the three-dimensional direction is limited by the optical diffraction limit, resulting in the research on three-dimensional dynamic processes of living cells and tissues facing the problems of complex imaging systems, high cost, poor image quality and complex sample preparation.

Method used

The fluorescent signal is encoded using laser pulse modulation and wavefront modulation technology, combined with frequency domain phasor analysis and time-dependent single-photon counter module, realizes three-dimensional super-resolution imaging, and repeats the sample in the nanosecond scale through Gaussian and cage pulse lasers. Excitation, three-dimensional super-resolution imaging is performed using traditional three-dimensional laser scanning confocal microscopy system.

Benefits of technology

Low-power, easy-to-implement three-dimensional super-resolution imaging is realized in traditional microscopy systems, providing three-dimensional dynamic process observations of organelles and biological molecules, improving image quality and simplifying sample preparation process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117783071B_ABST
    Figure CN117783071B_ABST
Patent Text Reader

Abstract

The invention discloses a three-dimensional fluorescence signal encoding super-resolution microscopic imaging method, which is applied in the field of optical microscope imaging technology. The invention encodes the fluorescence signal through laser pulse modulation and wavefront modulation technology, and then demodulates the encoded signal through frequency domain phasor analysis, and realizes three-dimensional super-resolution imaging in combination with three-dimensional scanning. The method is based on a traditional three-dimensional laser scanning confocal microscope system, and only needs to add a time-resolved detection module and two additional optical paths, so as to provide technical support for the three-dimensional super-resolution imaging research of cells and living bodies. The method combines optical methods and data processing technologies, encodes the repeated excitation of samples within a nanosecond time through Gaussian and cage pulse lasers, collects the spatiotemporal information of fluorescent molecules through a time-correlated single photon counter module, and then uses a photon extraction method based on frequency domain phasor analysis to decode the fluorescence signal, thereby realizing three-dimensional super-resolution imaging in a traditional confocal microscope system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of optical microscope imaging, and in particular relates to a method for realizing three-dimensional super-resolution imaging of an optical microscope by using optical methods and data processing technology to encode and decode fluorescence information in three-dimensional directions to break through the optical diffraction limit. Background Art

[0002] Optical microscopes are commonly used tools in research in life sciences and other related fields. They can be used to observe the dynamic interactions between organelles and reveal the mechanisms behind physiological and pathological phenomena. Therefore, they play an important role in the study of living cells and tissues. Biological cells are three-dimensional structures that exist in space. However, due to the existence of the optical diffraction limit, the resolution of traditional optical microscopes is limited. In the visible light band, the lateral resolution is 200-300nm and the axial resolution is 500-800nm. Since the spatial scale of many organelle structures and the dynamic processes of interactions between organelles is smaller than the diffraction limit, breaking through the optical diffraction limit in the three-dimensional direction is an important research need.

[0003] In the past three decades, researchers have proposed many super-resolution microscopy techniques based on fluorescence switching effects and single-molecule localization, which have increased the lateral resolution and axial resolution by at least 10 times and 6 times, respectively. At present, far-field super-resolution microscopy mainly includes three technologies. The first technology is represented by stimulated emission depletion microscopy; the second technology is mainly single-molecule localization microscopy, and its representative technologies are photoactivated localization microscopy and random optical reconstruction microscopy; the third technology is structured light illumination microscopy technology. Comparing the three technologies, STED has better resolution than SIM and faster imaging speed than SMLM. However, due to various reasons, the development of three-dimensional super-resolution imaging technology is still very slow. The realization of traditional three-dimensional super-resolution imaging usually requires the addition of a large number of optoelectronic devices, which makes the optical imaging system extremely complex and unstable, which brings challenges to the application of three-dimensional imaging of living cells.

[0004] In summary, the current three-dimensional super-resolution imaging technology still faces a series of problems such as complex imaging system, high cost, poor image quality, complex sample preparation process, and the need for special fluorescent probes. Therefore, the development of a low-power, easy-to-implement three-dimensional super-resolution microscopy imaging technology can perform three-dimensional super-resolution imaging of organelles and related biological molecules, observe the three-dimensional dynamic process of living samples, and then reveal the structure and function of living biological samples. Summary of the invention

[0005] The purpose of the present invention is to propose a three-dimensional fluorescence signal encoding super-resolution microscopy imaging method, which has the advantage of encoding the fluorescence signal through laser pulse modulation and wavefront modulation technology, and then demodulating the encoded signal using frequency domain phasor analysis, and realizing three-dimensional super-resolution imaging in combination with three-dimensional scanning. The method is based on a traditional three-dimensional laser scanning confocal microscope system, and only needs to add a time-resolved detection module and two additional optical paths to provide technical support for cell and living three-dimensional super-resolution imaging research. It combines optical methods and data processing technology, encodes repeated excitation of samples within nanosecond time through Gaussian and cage pulse lasers, uses a time-correlated single photon counter module to collect the spatiotemporal information of fluorescent molecules, and then uses a photon extraction method based on frequency domain phasor analysis to decode the fluorescence signal, thereby realizing three-dimensional super-resolution imaging in a traditional confocal microscope system.

[0006] The above technical objectives of the present invention are achieved through the following technical solutions: A three-dimensional fluorescence signal encoding super-resolution microscopic imaging method, including a laser scanning confocal imaging system based on time-resolved detection, and the laser scanning confocal imaging system based on time-resolved detection includes:

[0007] Laser, which generates pulsed excitation light using a picosecond laser;

[0008] Half-wave plate, used to adjust the polarization direction of the laser;

[0009] Polarizer, used for laser beam splitting, can be used with half-wave plate to control the energy ratio of the outgoing laser;

[0010] A reflector, used to change the transmission direction of the laser;

[0011] Beam splitters are used to split or combine laser beams;

[0012] Vortex glass slide, used to modulate the laser wavefront and convert Gaussian light into transverse hollow light;

[0013] 0 / π phase plate, used to modulate the laser wavefront and convert Gaussian light into axial hollow light;

[0014] The corner reflector is used to adjust the pulse interval between the Gaussian laser and the two hollow laser beams, that is, to move the position of the corner reflector to simultaneously extend or shorten the optical path of the two hollow excitation light spots, thereby controlling the time for the two hollow laser beams to reach the sample;

[0015] A dichroic mirror, used to transmit Gaussian and two hollow excitation lights and reflect the fluorescence signal;

[0016] Scanning galvanometer, used to synchronously scan the three beams of excitation light to achieve area array confocal imaging of the sample;

[0017] The scanning lens is placed behind the scanning galvanometer and is used to collect the laser beam for area array scanning;

[0018] The tube lens, together with the objective lens, forms a microscope system;

[0019] The objective lens is used to focus the laser onto the sample and collect the fluorescence signal reflected by the sample;

[0020] The stage is used to place and fix the sample and to control the three-dimensional movement of the sample;

[0021] A lens, used to focus the light beam;

[0022] Filters are used to remove stray light other than fluorescence and improve the image signal-to-noise ratio;

[0023] Detectors, using photomultiplier tubes or avalanche photodiodes, are used to collect signals and amplify the fluorescence signal;

[0024] A high-speed photodiode detector is used to detect the laser reflected by the first polarizer as a reference signal for time-resolved fluorescence detection;

[0025] Time-correlated single-photon counter, used for fluorescence time-resolved detection, recording the three-dimensional spatiotemporal information of the encoded fluorescence signal;

[0026] Computer, used to control the software to acquire images, store data and process image data, etc.

[0027] The present invention is further configured as follows: after the laser is emitted, it is divided into two beams through a first polarizer, wherein the reflected light is detected by a high-speed photodiode detector and used as a reference signal for fluorescence time-resolved detection; the other beam is transmitted and then split by a second polarizer; the transmitted light and the reflected light of the second polarizer are both Gaussian lasers; the reflected light beam is adjusted by an angle reflector for optical path adjustment, and then is split into two beams through a beam splitter; wherein the transmitted light is modulated by a 0-2π vortex glass slide to generate transverse hollow light, and the reflected light is modulated by a 0 / π phase plate to generate axial hollow light; since the transverse hollow light and the axial hollow light have the same optical path when reaching the sample, the laser pulses of the two beams of light irradiate the sample at the same time; the two beams of hollow light form a hollow cage-type light spot in three-dimensional space; the Gaussian light spot and the cage-type light spot overlap at a third beam splitter; the sample is excited and emits a fluorescence signal; the fluorescence signal is collected by an objective lens and then returns to the original path; after being reflected by a dichroic mirror, it passes through a lens and a filter in sequence to reach the detector; the fluorescence signal collected by the detector is transmitted to a time-correlated single-photon counter, and the data is stored in a computer.

[0028] The present invention is further configured to adjust the pulse interval between the Gaussian light spot and the cage light spot by moving the position of the corner reflector forward and backward.

[0029] The present invention is further configured to: adjust the optical path of the laser transmitted in the optical path, use a laser pulse sequence with a certain arrangement characteristic to encode the spontaneous radiation transition process of the fluorescent photons, use a fluorescence time-resolved detection technology based on a time-correlated single-photon module to record the nanosecond-scale time information and nanometer-scale spatial information in the photon emission process, and finally combine the frequency domain phasor analysis technology to decode the spatiotemporal information of the fluorescent signal.

[0030] The present invention is further configured such that: under the same imaging system and objective lens, when all the excitation light spots fill the entrance pupil of the objective lens, the spot sizes of the two hollow light beams are both larger than the Gaussian light spot in space;

[0031] Under the same incident energy, the focal plane intensity of the axial hollow light spot is smaller than that of the transverse hollow light spot. In space, the transverse hollow light and the axial hollow light form a cage-type light spot with zero central intensity. After calibration and debugging of the optical system, the three excitation light spots are completely overlapped in three-dimensional space.

[0032] The present invention is further configured as follows: the focal planes of the lateral hollow light and the axial hollow light coincide and have the same optical path, so their pulse sequences overlap with each other and arrive at the sample at the same time, and the pulse interval between the Gaussian light and the cage light can be controlled by a corner reflector, and the specific value is related to the fluorescence lifetime of the fluorescent dye and can be adjusted according to the fluorescence lifetime of the corresponding dye.

[0033] The present invention is further configured such that the Gaussian spot and the cage spot precisely overlap in space, the central intensity of the Gaussian spot is the largest, while the central intensity of the cage spot is zero, and fluorescence lifetime imaging is performed on the sample labeled with the fluorescent dye, and the spatiotemporal information of the fluorescent photons is collected and analyzed.

[0034] The present invention is further configured as follows: the distribution of the encoded fluorescence information in time, according to the distribution of the number of photons, the spatial coordinates can be divided into six regions:

[0035] Region A, such as coordinate (33), at this time the sample is only excited by the Gaussian spot and is not affected by the cage spot, so a single exponential fluorescence decay curve is generated;

[0036] Region B, such as coordinates (23, 32, 34, 43), the sample is excited by three laser beams, but the Gaussian spot intensity in the corresponding area is greater than the cage spot intensity, so a double-peak fluorescence decay curve is generated, and the number of photons in the first peak is greater than that in the second peak;

[0037] Region C, such as coordinates (22, 24, 42, 44), at this time the sample is excited by three laser beams, and the Gaussian spot intensity in the corresponding area is the same as the cage spot intensity, so the peak photon number of the double-peak fluorescence decay curve is the same;

[0038] Region D, such as coordinates (13, 31, 35, 53), at this time the sample is excited by three laser beams, but the Gaussian spot intensity in the corresponding area is smaller than the cage spot intensity, so a double-peak fluorescence decay curve is generated, and the number of photons in the first peak is smaller than that in the second peak;

[0039] Region E, such as coordinates (12, 21, 14, 41, 25, 52, 45, 54), at this time the sample is only excited by the cage light spot and is not affected by the Gaussian light spot, so a single exponential fluorescence decay curve with a certain time delay is generated;

[0040] In area F, such as coordinates (11, 15, 51, 55), there is no sample and therefore no fluorescence signal.

[0041] The present invention is further configured as follows: the phasor space includes a semicircular trajectory with coordinates (0.5, 0) as the center and a radius of 0.5, wherein the coordinates (0, 0) represent that the fluorescence lifetime is infinite, and the coordinates (1, 0) represent that the fluorescence lifetime is zero. After frequency domain conversion, each pixel in the spatial domain image corresponds to a phasor point in the phasor space, that is, the spatial coordinates (x, y) are converted to phasor coordinates (g, s), and the collection of all phasor points forms a phasor diagram. The fluorescence lifetime value of a single-component sample must fall on this semicircular curve, and different positions (coordinates) on the semicircle represent different fluorescence lifetimes. Therefore, when only a single lifetime component exists in the sample, the phasor center coordinates must be located on the semicircular curve. If the fluorescence emission contains Two or more components, the phasor center coordinates will no longer be located on the semicircular curve. Relative to the reference pulse signal, the cage laser pulse has a larger time delay than the Gaussian laser pulse. Therefore, in the phasor space, the phasor point of the fluorescence signal in the area with a greater influence of the cage laser has a larger phase delay relative to the photon phasor point in the central area of ​​the Gaussian laser, that is, a larger φ value. The change in the φ value is the result of the encoding of the fluorescence signal by this method. Pixels with similar phase delay (φ) and amplitude modulation (m) are clustered in the phasor diagram, where g = m×cos(φ), s = m×sin(φ). In the phasor diagram, the pixels in the area excited only by Gaussian light have a smaller φ value and are therefore closer to the coordinate (1, 0);

[0042] The pixels in the area excited only by the caged light have a larger φ value. Since the distribution of the phasor points in the phasor diagram is affected by the spatial position and relative intensity of the excitation light spot, when the sample is scanned and imaged in three dimensions, each layer of scanning data corresponds to a phasor diagram, thereby forming a three-dimensional phasor diagram. Since the high-frequency super-resolution signal is located at the center of the laser spot and is greatly affected by the Gaussian spot, the coordinates of the photon in the phasor space are close to the red dot.

[0043] The low-frequency non-super-resolution signal is located at the edge of the spot and is affected by both the Gaussian spot and the cage spot, so the coordinates of the photon in the phasor space move toward the cyan dot.

[0044] The present invention is further configured as follows: when all signals (including high-frequency and low-frequency signals) in the phasor diagram are extracted, the formed three-dimensional image is still limited by the optical diffraction limit, that is, a non-super-resolution three-dimensional image;

[0045] In the phasor diagram of each layer, only the signal photons near the red dots are extracted, and the fluorescence information of images at different depths in the axial direction is decoded and reconstructed to obtain a three-dimensional super-resolution image.

[0046] In summary, the present invention has the following beneficial effects:

[0047] The fluorescence signal is encoded by laser pulse modulation and wavefront modulation technology, and then the encoded signal is demodulated by frequency domain phasor analysis, combined with three-dimensional scanning to achieve three-dimensional super-resolution imaging. This method is based on the traditional three-dimensional laser scanning confocal microscope system. It only needs to add a time-resolved detection module and two additional optical paths to provide technical support for cell and living three-dimensional super-resolution imaging research. It combines optical methods and data processing technology, encodes the repeated excitation of samples within nanoseconds through Gaussian and cage pulse lasers, and uses a time-correlated single photon counter module to collect the spatiotemporal information of fluorescent molecules. Then, the photon extraction method based on frequency domain phasor analysis is used to decode the fluorescence signal, thereby achieving three-dimensional super-resolution imaging in a traditional confocal microscope system. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 It is a schematic diagram of a super-resolution optical microscopic imaging system for implementing three-dimensional fluorescence information encoding and decoding of the present invention;

[0049] Figure 2 It is a schematic diagram of the principle of realizing three-dimensional fluorescence information encoding and decoding super-resolution optical microscopy imaging of the present invention. DETAILED DESCRIPTION

[0050] The present invention is further described in detail below in conjunction with the accompanying drawings.

[0051] refer to Figure 1-2 A three-dimensional fluorescence signal encoding super-resolution microscopic imaging method includes a laser scanning confocal imaging system based on time-resolved detection, and the laser scanning confocal imaging system based on time-resolved detection includes:

[0052] Laser, which generates pulsed excitation light using a picosecond laser;

[0053] Half-wave plate, used to adjust the polarization direction of the laser;

[0054] Polarizer, used for laser beam splitting, can be used with half-wave plate to control the energy ratio of the outgoing laser;

[0055] A reflector, used to change the transmission direction of the laser;

[0056] Beam splitters are used to split or combine laser beams;

[0057] Vortex glass slide, used to modulate the laser wavefront and convert Gaussian light into transverse hollow light;

[0058] 0 / π phase plate, used to modulate the laser wavefront and convert Gaussian light into axial hollow light;

[0059] The corner reflector is used to adjust the pulse interval between the Gaussian laser and the two hollow laser beams, that is, to move the position of the corner reflector to simultaneously extend or shorten the optical path of the two hollow excitation light spots, thereby controlling the time for the Gaussian laser and the two hollow laser beams to reach the sample;

[0060] A dichroic mirror, used to transmit Gaussian and two hollow excitation lights and reflect the fluorescence signal;

[0061] Scanning galvanometer, used to synchronously scan the three beams of excitation light to achieve area array confocal imaging of the sample;

[0062] The scanning lens is placed behind the scanning galvanometer and is used to collect the laser beam for area array scanning;

[0063] The tube lens, together with the objective lens, forms a microscope system;

[0064] The objective lens is used to focus the laser onto the sample and collect the fluorescence signal reflected by the sample;

[0065] The stage is used to place and fix the sample and to control the three-dimensional movement of the sample;

[0066] A lens, used to focus the light beam;

[0067] Filters are used to remove stray light other than fluorescence and improve the image signal-to-noise ratio;

[0068] Detectors, using photomultiplier tubes or avalanche photodiodes, are used to collect signals and amplify the fluorescence signal;

[0069] A high-speed photodiode detector is used to detect the laser reflected by the first polarizer as a reference signal for time-resolved fluorescence detection;

[0070] Time-correlated single-photon counter, used for fluorescence time-resolved detection, recording the three-dimensional spatiotemporal information of the encoded fluorescence signal;

[0071] Computer, used to control the software to acquire images, store data and process image data, etc.

[0072] like Figure 1 As shown, after the laser is emitted, it passes through the first polarizer and is divided into two beams. The reflected light is detected by a high-speed photodiode detector and used as a reference signal for fluorescence time-resolved detection. The other beam is transmitted and then split by the second polarizer. Both the transmitted light and the reflected light of the second polarizer are Gaussian lasers. The reflected light beam is adjusted by an angle reflector and then split into two by a beam splitter. The transmitted light is modulated by a 0-2π vortex glass slide to produce a transverse hollow light, and the reflected light is modulated by a 0 / π phase plate to produce an axial hollow light. When the transverse hollow light, Gaussian light, and axial hollow light reach the sample, The optical path of the two beams of laser light is the same, so the laser pulses of the two beams of light irradiate the sample at the same time, and the two hollow light beams form a hollow cage-like spot in three-dimensional space. The Gaussian spot and the cage-like spot overlap at the third beam splitter. After the sample is excited, a fluorescence signal is emitted, which is collected by the objective lens and returned by the original path. After being reflected by the dichroic mirror, it passes through the lens and the filter in turn to reach the detector. The signal collected by the detector is transmitted to the time-correlated single-photon counter, and the data is saved to the computer. The pulse interval between the Gaussian spot and the cage-like spot is adjusted by moving the position of the corner reflector back and forth.

[0073] like Figure 2 As shown, by adjusting the optical path of the laser in the optical path, a laser pulse sequence with certain arrangement characteristics is used to encode the spontaneous radiation transition process of the fluorescent photons, and the fluorescence time-resolved detection technology based on the time-correlated single-photon module is used to record the nanosecond-scale time information and nanometer-scale spatial information in the photon emission process. Finally, the frequency-domain phasor analysis technology is combined to decode the spatiotemporal information of the fluorescent signal.

[0074] Figure 2 (a) is a theoretical simulation of a cage-type light spot composed of Gaussian light, transverse hollow light, axial hollow light and two hollow light beams in the transverse and axial directions, as well as the overlapped image of the three light beams. Under the same imaging system and objective lens, when all the excitation light spots fill the entrance pupil of the objective lens, the spot sizes of the two hollow light beams are larger than the Gaussian light spot in space; under the same incident energy, the focal plane intensity of the axial hollow light spot is smaller than that of the transverse hollow light spot. In space, the transverse hollow light and the axial hollow light form a cage-type light spot with a central intensity of zero. After calibration and debugging of the optical system, the three excitation light beams completely overlap in three-dimensional space;

[0075] Figure 2(b) is a schematic diagram of the laser pulse sequence of Gaussian beam, transverse hollow light and axial hollow light, and the fluorescence decay curve generated under the excitation of the above laser pulse sequence. Since the focal planes of the transverse hollow light and the axial hollow light coincide and the optical path is the same, their pulse sequences overlap with each other and arrive at the sample at the same time. The pulse interval between the Gaussian light and the cage light can be controlled by a corner reflector. The specific value is related to the fluorescence lifetime of the fluorescent dye and can be adjusted according to the fluorescence lifetime of the corresponding dye;

[0076] Figure 2 (c) is the distribution of the encoded fluorescence information in three-dimensional space. The Gaussian spot and the cage spot overlap precisely in space. The intensity at the center of the Gaussian spot is the largest, while the intensity at the center of the cage spot is zero. Fluorescence lifetime imaging is performed on the sample labeled with the fluorescent dye to collect and analyze the spatiotemporal information of the fluorescence photons.

[0077] Figure 2 (d) is the temporal distribution of the encoded fluorescence information. The spatial coordinates can be divided into six regions according to the distribution of photon numbers:

[0078] Region A, such as coordinate (33), at this time the sample is only excited by the Gaussian spot and is not affected by the cage spot, so a single exponential fluorescence decay curve is generated;

[0079] Region B, such as coordinates (23, 32, 34, 43), the sample is excited by three laser beams, but the Gaussian spot intensity in the corresponding area is greater than the cage spot intensity, so a double-peak fluorescence decay curve is generated, and the number of photons in the first peak is greater than that in the second peak;

[0080] Region C, such as coordinates (22, 24, 42, 44), at this time the sample is excited by three laser beams, and the Gaussian spot intensity in the corresponding area is the same as the cage spot intensity, so the peak photon number of the double-peak fluorescence decay curve is the same;

[0081] Region D, such as coordinates (13, 31, 35, 53), at this time the sample is excited by three laser beams, but the Gaussian spot intensity in the corresponding area is smaller than the cage spot intensity, so a double-peak fluorescence decay curve is generated, and the number of photons in the first peak is smaller than that in the second peak;

[0082] Region E, such as coordinates (12, 21, 14, 41, 25, 52, 45, 54), at this time the sample is only excited by the cage light spot and is not affected by the Gaussian light spot, so a single exponential fluorescence decay curve with a certain time delay is generated;

[0083] Region F, such as coordinates (11, 15, 51, 55), where there is no sample and therefore no fluorescence signal;

[0084] Figure 2(e) is the phasor diagram generated by frequency domain transformation of the encoded fluorescence information into the phasor space. The phasor space contains a semicircular trajectory with coordinates (0.5, 0) as the center and a radius of 0.5, where coordinates (0, 0) represent that the fluorescence lifetime is infinite, and coordinates (1, 0) represent that the fluorescence lifetime is zero. After frequency domain transformation, each pixel in the spatial domain image corresponds to a phasor point in the phasor space, that is, the spatial coordinates (x, y) are converted to phasor coordinates (g, s). The collection of all phasor points forms a phasor diagram. The fluorescence lifetime value of a single-component sample must fall on this semicircular curve, and different positions (coordinates) on the semicircle represent different fluorescence lifetimes. Therefore, when there is only a single lifetime component in the sample, the phasor center coordinates must be on the semicircular curve (as shown in Figure e). The red and cyan dots of the image are shown in Figure 3. If the fluorescence emission contains two or more components, the phasor center coordinates will no longer be on the semicircular curve. Relative to the reference pulse signal, the cage laser pulse has a larger time delay than the Gaussian laser pulse. Therefore, in the phasor space, the phasor points of the fluorescence signal in the area with a greater influence of the cage laser have a larger phase delay, that is, a larger φ value, relative to the photon phasor points in the central area of ​​the Gaussian laser. The change in φ value is the result of the encoding of the fluorescence signal by this method. Pixels with similar phase delay (φ) and amplitude modulation (m) are clustered in the phasor diagram, where g = m×cos(φ), s = m×sin(φ). In the phasor diagram, pixels in the area excited only by Gaussian light have a smaller φ value and are therefore closer to the coordinate (1, 0).

[0085] The pixels in the area excited only by the caged light have a larger φ value. Since the distribution of the phasor points in the phasor diagram is affected by the spatial position and relative intensity of the excitation light spot, when the sample is scanned and imaged in three dimensions, each layer of scanning data corresponds to a phasor diagram, thereby forming a three-dimensional phasor diagram. Since the high-frequency super-resolution signal is located at the center of the laser spot and is greatly affected by the Gaussian spot, the coordinates of the photon in the phasor space are close to the red dot.

[0086] The low-frequency non-super-resolution signal is located at the edge of the light spot and is affected by both the Gaussian light spot and the cage light spot, so the coordinates of the photon in the phasor space move toward the cyan dot;

[0087] Figure 2 (f) is a schematic diagram of the fluorescence information decoding method based on frequency domain phasor analysis for photon extraction. Specifically, when all signals (including high-frequency and low-frequency signals) in the phasor diagram are extracted, the formed three-dimensional image is still limited by the optical diffraction limit, that is, a non-super-resolution three-dimensional image; in the phasor diagram of each layer, only the signal photons near the red dots (yellow area) are extracted, and the fluorescence information of images at different depths in the axial direction is decoded and reconstructed to obtain a three-dimensional super-resolution image, as shown in FIG. Figure 2As shown in (g), in short, our method combines optical methods and data processing technology. Gaussian and cage pulse lasers are used to encode repeated excitation of the sample in nanosecond time, and a time-correlated single-photon counter module is used to collect the spatiotemporal information of fluorescent molecules. The fluorescence signal is then decoded using a photon extraction method based on frequency domain phasor analysis, thereby achieving three-dimensional super-resolution imaging in a traditional confocal microscope system.

[0088] This specific embodiment is merely an explanation of the present invention and is not a limitation of the present invention. After reading this specification, those skilled in the art may make non-creative modifications to the present embodiment as needed. However, as long as they are within the scope of the claims of the present invention, they are protected by the patent law.

Claims

1. A three-dimensional fluorescence signal encoding super-resolution microscopic imaging method, comprising a laser scanning confocal imaging system based on time-resolved detection, characterized in that: The laser scanning confocal imaging system based on time-resolved detection includes: Laser, which generates pulsed excitation light using a picosecond laser; Half-wave plate, used to adjust the polarization direction of the laser; Polarizer, used for laser beam splitting, can control the energy ratio of the outgoing laser when used in conjunction with a half-wave plate; A reflector, used to change the transmission direction of the laser; Beam splitters are used to split or combine laser beams; Vortex glass slide, used to modulate the laser wavefront and convert Gaussian light into transverse hollow light; 0 / π phase plate, used to modulate the laser wavefront and convert Gaussian light into axial hollow light; The corner reflector is used to adjust the pulse interval between the Gaussian laser and the two hollow laser beams, that is, to move the position of the corner reflector to simultaneously extend or shorten the optical path of the two hollow excitation light spots, thereby controlling the time for the two hollow laser beams to reach the sample; A dichroic mirror, used to transmit Gaussian and two hollow excitation lights and reflect the fluorescence signal; Scanning galvanometer, used to synchronously scan the three beams of excitation light to achieve area array confocal imaging of the sample; The scanning lens is placed behind the scanning galvanometer and is used to collect the laser beam for area array scanning; The tube lens, together with the objective lens, forms a microscope system; The objective lens is used to focus the laser onto the sample and collect the fluorescence signal reflected by the sample; The stage is used to place and fix the sample and to control the three-dimensional movement of the sample; A lens, used to focus the light beam; Filters are used to remove stray light other than fluorescence and improve the image signal-to-noise ratio; Detectors, using photomultiplier tubes or avalanche photodiodes, are used to collect signals and amplify the fluorescence signal; A high-speed photodiode detector is used to detect the laser reflected by the first polarizer as a reference signal for time-resolved fluorescence detection; Time-correlated single-photon counter, used for fluorescence time-resolved detection, recording the three-dimensional spatiotemporal information of the encoded fluorescence signal; Computer, capable of controlling the software to acquire images, store data and process image data; After the laser is emitted, it is divided into two beams through the first polarizer, of which the reflected light is detected by a high-speed photodiode detector and used as a reference signal for fluorescence time-resolved detection. The other beam is transmitted and split by the second polarizer. The transmitted light and reflected light of the second polarizer are both Gaussian lasers. The reflected light beam is adjusted by the corner reflector to adjust the optical path, and then split into two by a beam splitter. Among them, the transmitted light is modulated by a 0-2π vortex glass to produce a transverse hollow light, and the reflected light is modulated by a 0 / π phase plate to produce an axial hollow light. Since the transverse hollow light and the axial hollow light have the same optical path when they reach the sample, the laser pulses of the two beams irradiate the sample at the same time, and the two hollow light beams form a hollow cage-type light spot in three-dimensional space. The Gaussian light spot and the cage-type light spot overlap at another beam splitter. After the sample is excited, it emits a fluorescence signal, which is collected by the objective lens and returned to the original path. After being reflected by the dichroic mirror, it passes through the lens and the filter in sequence to reach the detector. The fluorescence signal collected by the detector is transmitted to the time-correlated single-photon counter, and the data is saved to the computer. The pulse interval between the Gaussian spot and the cage spot can be adjusted by moving the position of the corner reflector back and forth; Adjust the optical path of the laser in the optical path, use a laser pulse sequence with certain arrangement characteristics to encode the spontaneous radiation transition process of fluorescent photons, use fluorescence time-resolved detection technology based on time-correlated single-photon modules to record nanosecond-scale time information and nanometer-scale spatial information in the photon emission process, and finally combine frequency-domain phasor analysis technology to decode the spatiotemporal information of the fluorescence signal; Under the same imaging system and objective lens, when all the excitation light spots fill the objective lens entrance pupil, the spot sizes of the two hollow light beams are both larger than the Gaussian spot in space; Under the same incident energy, the focal plane intensity of the axial hollow light spot is smaller than that of the transverse hollow light spot. In space, the transverse hollow light and the axial hollow light form a cage-type light spot with zero central intensity. After calibration and debugging of the optical system, the three excitation light spots are completely overlapped in three-dimensional space. The focal planes of the transverse hollow light and the axial hollow light coincide and have the same optical path, so the focal plane pulse sequences of the transverse hollow light and the axial hollow light overlap and arrive at the sample at the same time. The pulse interval between the Gaussian light and the cage light can be controlled by the corner reflector. The specific value is related to the fluorescence lifetime of the fluorescent dye and can be adjusted according to the fluorescence lifetime of the corresponding dye. The Gaussian spot and the cage spot overlap precisely in space. The intensity at the center of the Gaussian spot is the largest, while the intensity at the center of the cage spot is zero. Fluorescence lifetime imaging is performed on samples labeled with fluorescent dyes to collect and analyze the spatiotemporal information of fluorescent photons. The temporal distribution of the encoded fluorescence information can be divided into six regions based on the distribution of photon numbers: Region A: At this time, the sample is only excited by the Gaussian spot and is not affected by the cage spot, so a single exponential fluorescence decay curve is generated; Region B: At this time, the sample is excited by three laser beams, but the Gaussian spot intensity in the corresponding area is greater than the cage spot intensity, thus generating a double-peak fluorescence decay curve, and the number of photons in the first peak is greater than that in the second peak; Region C, at this time, the sample is excited by three laser beams, and the Gaussian spot intensity in the corresponding area is the same as the cage spot intensity, so the peak photon number of the double-peak fluorescence decay curve is the same; Region D, at this time, the sample is excited by three laser beams, but the Gaussian spot intensity in the corresponding area is smaller than the cage spot intensity, so a double-peak fluorescence decay curve is generated, and the number of photons in the first peak is smaller than that in the second peak; In region E, the sample is only excited by the cage light spot and is not affected by the Gaussian light spot, thus generating a single exponential fluorescence decay curve with a certain time delay; Region F, where there is no sample and therefore no fluorescence signal; The phasor space contains a semicircular trajectory with the coordinate (0.5, 0) as the center and a radius of 0.5, where the coordinate (0, 0) represents that the fluorescence lifetime is infinite, and the coordinate (1, 0) represents that the fluorescence lifetime is zero. After frequency domain conversion, each pixel in the spatial domain image corresponds to a phasor point in the phasor space, that is, the spatial coordinate (x, y) is converted to the phasor coordinate (g, s). The collection of all phasor points forms a phasor diagram. The fluorescence lifetime value of a single-component sample must fall on this semicircular curve, and different position coordinates on the semicircle represent different fluorescence lifetimes. Therefore, when there is only a single lifetime component in the sample, the phasor center coordinate must be on the semicircular curve. If the fluorescence emission contains two or more Multiple components, the phasor center coordinates will no longer be located on the semicircular curve. Relative to the reference pulse signal, the cage laser pulse has a larger time delay than the Gaussian laser pulse. Therefore, in the phasor space, the phasor point of the fluorescence signal in the area with a greater influence of the cage laser has a larger phase delay relative to the photon phasor point in the central area of ​​the Gaussian laser, that is, a larger φ value. The change in the φ value is the result of encoding the fluorescence signal. Pixels with similar phase delay φ and amplitude modulation m are clustered in the phasor diagram, where g = m×cos(φ), s = m×sin(φ). In the phasor diagram, the pixels in the area excited only by Gaussian light have a smaller φ value and are therefore closer to the coordinate (1, 0); The pixels in the area excited only by the caged light have a larger φ value. Since the distribution of the phasor points in the phasor diagram is affected by the spatial position and relative intensity of the excitation light spot, when the sample is scanned and imaged in three dimensions, each layer of scanning data corresponds to a phasor diagram, thereby forming a three-dimensional phasor diagram. Since the high-frequency super-resolution signal is located at the center of the laser spot and is greatly affected by the Gaussian spot, the coordinates of the photon in the phasor space are close to the red dots. The red dots represent short-lived fluorescence information, which corresponds to the high-frequency signal generated by the excitation of the Gaussian laser spot. The low-frequency non-super-resolution signal is located at the edge of the spot and is affected by both the Gaussian spot and the cage spot. Therefore, the coordinates of the photon in the phasor space move toward the cyan dot. The cyan dot represents the long-life fluorescence information, which corresponds to the low-frequency signal generated by the ring laser spot excitation. When all signals in the phasor diagram are extracted, including high-frequency and low-frequency signals, the formed three-dimensional image is still limited by the optical diffraction limit, that is, a non-super-resolution three-dimensional image; In the phasor diagram of each layer, only the signal photons near the red dots are extracted, and the fluorescence information of images at different depths in the axial direction is decoded and reconstructed to obtain a three-dimensional super-resolution image.

Citation Information

Patent Citations

  • Fluorescence emission ratio three-dimensional super-resolution imaging method

    CN115656130A