A hyperspectral fluorescence lifetime imaging system and method based on streak camera

Through the hyperspectral fluorescence life imaging system based on striped cameras, the multi-coded pattern illumination sampling mode is used to solve the problems of slow data acquisition speed and low spectral resolution in spectral fluorescence life imaging technology, and efficient four-dimensional data acquisition is achieved, which improves the Spectral resolution of the number of channels and data acquisition speed provide high-precision and rapid diagnostic tools for the field of life sciences.

CN114705661BActive Publication Date: 2025-01-07XIAN INST OF OPTICS & PRECISION MECHANICS CHINESE ACAD OF SCI
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210146738.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-02-17
Publication Date
2025-01-07
Estimated Expiration
2042-02-17

AI Technical Summary

Technical Problem

The existing spectral fluorescence lifetime imaging technology has the problems of slow data acquisition speed, low spectral resolution, data acquisition time in the order of minutes or even hours, and the number of spectral resolution channels is limited.

Method used

Using a hyperspectral fluorescence life imaging system based on striped cameras, including an illumination light encoding unit, beam splitter, microscope, signal processing unit and synchronization control module, high-time resolution imaging is achieved through pulse light sources, pulse light encoding module and striped camera, using The multi-coded pattern lighting sampling mode eliminates the point scanning imaging process and improves data acquisition speed and spectral resolution.

Benefits of technology

The data acquisition time is shortened from minutes to hours to seconds to minutes, which improves the number of spectral resolution channels from orders 10 to 100 to orders 100 to orders 100 to 1000, and provides high-precision, fast and high-performance quantitative diagnostic tools.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114705661B_ABST
    Figure CN114705661B_ABST
Patent Text Reader

Abstract

The present invention provides a high-spectral fluorescence lifetime imaging system and method based on a streak camera, which solves the problems of slow acquisition speed, low spectral resolution, or data acquisition time in the order of minutes or even hours, and limited number of spectral resolution channels in the existing spectral fluorescence lifetime imaging technology. The system includes a pulse light source module, a pulse light coupling module, a pulse light encoding module, a coding pattern coupling module, a beam splitter, a microscope and a signal processing unit and a synchronization control module arranged on two output light paths of the beam splitter; the pulse light generated by the pulse light source module is imaged on the sample surface through the pulse light coupling module, the pulse light encoding module, the coding pattern coupling module, the beam splitter, and the microscope, and the fluorescence signal generated by the sample after excitation enters the signal processing unit through the microscope and the beam splitter; the signal processing unit includes a signal focusing module, a spectral light splitting module, a streak camera and a data processing module arranged in sequence on the output light path of the beam splitter.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of hyperspectral fluorescence lifetime imaging, and in particular to a hyperspectral fluorescence lifetime imaging system and an imaging method based on a streak camera. Background Art

[0002] Fluorescence imaging technology is widely used in the fields of life sciences, physical chemistry, and biomedical clinical diagnosis. It is an indispensable means for studying the characteristics, morphology, and dynamics of biological tissues, cells, and even single molecules. Fluorescence has multidimensional parameters such as intensity, spectrum, lifetime, and polarization, and carries the fingerprint information and physiological environment information of the target. How to obtain multidimensional fluorescence data more comprehensively is the key to improving the system's quantitative and refined diagnostic capabilities. Hyperspectral fluorescence lifetime imaging technology has the ability to obtain multidimensional fluorescence information (two-dimensional / three-dimensional space, spectrum, lifetime), and is a research hotspot in the fields of life sciences. Simultaneously analyzing the emission spectrum and lifetime information of the fluorescence signal is very important for quantitative analysis of the target and label-free, non-invasive diagnosis.

[0003] Traditional spectral fluorescence lifetime imaging technology is achieved by replacing filters combined with time-correlated single photon counting scanning fluorescence lifetime imaging, which faces problems such as slow data acquisition speed and low spectral resolution. How to improve the imaging speed and spectral resolution of hyperspectral fluorescence lifetime imaging technology is a research difficulty. In recent years, based on single-pixel imaging technology, Vincent Studer et al. used a one-dimensional single-photon avalanche diode (SPAD) array for the first time to achieve fluorescence lifetime imaging of 128 spectral channels (V.Studera et al., "Compressive fluorescence microscopy for biological and hyperspectral imaging," Proc. Natl. Acad. Sci., vol. 109, no. 26, pp. E1679–E1687, Jun. 2012.), which greatly improves the imaging speed compared to traditional methods. However, it still uses time-correlated single photon counting to obtain fluorescence time dimension decay information, and the data acquisition time is still in the order of minutes or even hours. In addition, the limited number of pixels in the SPAD array limits the number of spectral resolution channels. Therefore, there is an urgent need to develop a hyperspectral fluorescence lifetime imaging technology with a data acquisition time in the order of seconds to minutes and a spectral resolution channel number in the order of 100 to 1000. Summary of the invention

[0004] In order to solve the technical problems of slow acquisition speed, low spectral resolution, or data acquisition time in minutes or even hours and limited number of spectral resolution channels in the existing spectral fluorescence lifetime imaging technology, the present invention provides a hyperspectral fluorescence lifetime imaging system and method based on a streak camera.

[0005] To achieve the above purpose, the technical solution provided by the present invention is:

[0006] A hyperspectral fluorescence lifetime imaging system based on a streak camera, which is special in that it includes an illumination light encoding unit, a beam splitter, a microscope, a signal processing unit and a synchronization control module;

[0007] The illumination light encoding unit includes a pulse light source module and a pulse light coupling module, a pulse light encoding module, and a coding pattern coupling module which are sequentially arranged along the output light path of the pulse light source module;

[0008] The pulse light source module is used to generate pulse light to excite exogenously labeled fluorescent molecules or endogenous fluorescent molecules in the sample, the wavelength of the pulse light is within the excitation spectrum range of the fluorescent molecules, and the single pulse width is in the order of femtoseconds to picoseconds;

[0009] The pulse light coupling module is used to smooth, expand and collimate the pulse light generated by the pulse light source module, and couple the illumination to the pulse light encoding module;

[0010] The pulse light encoding module is used to encode the pulse light processed by the pulse light coupling module;

[0011] The coding pattern coupling module is used to couple the coded pulse light to generate illumination light;

[0012] The beam splitter is located on the outgoing light path of the coding pattern coupling module;

[0013] The microscope and the signal processing unit are respectively located in two outgoing light paths of the beam splitter; the microscope is used to image the illumination light emitted by the beam splitter on the sample surface, and to collect the fluorescence signal generated by the sample after being excited by the illumination light, and the beam splitter is used to emit the fluorescence signal collected by the microscope to the signal processing unit;

[0014] The signal processing unit comprises a signal focusing module, a spectrum splitting module, a streak camera and a data processing module which are sequentially arranged on the output light path of the beam splitter;

[0015] The signal focusing module is used to focus the fluorescence signal at the entrance of the spectrum splitting module to form a point fluorescence signal;

[0016] The spectral spectrometry module is used to expand the point fluorescence signal into a one-dimensional fluorescence spectrum signal;

[0017] The streak camera is used to perform high time resolution imaging of the one-dimensional fluorescence spectrum signal and output N streak camera images;

[0018] The data processing module is used to process N streak camera images output by the streak camera and output a hyperspectral fluorescence lifetime image;

[0019] The synchronous control module synchronously controls the generation of pulse light of the pulse light source module, the updating of the pattern of the pulse light encoding module and the exposure of the streak camera.

[0020] Furthermore, the coding pattern of the pulse light coding module is a Gaussian random coding pattern, a Hadamard coding pattern, or a Fourier coding pattern.

[0021] Furthermore, the laser encoding module is a digital micromirror array;

[0022] The beam splitter is a dichroic mirror beam splitter.

[0023] Further, the microscope is located on the reflected light path of the beam splitter, and the signal processing unit is located on the transmitted light path of the beam splitter;

[0024] The signal processing unit also includes a reflecting mirror located between the beam splitter and the signal focusing module.

[0025] At the same time, the present invention also provides a hyperspectral fluorescence lifetime imaging method based on a streak camera, which is special in that it includes the following steps:

[0026] 1) The pulse light generated by the pulse light source module is smoothed, expanded and collimated by the pulse light coupling module, and then illuminates the pulse light encoding module;

[0027] 2) The pulse light encoding module encodes the pulse light processed by the pulse light coupling module, and then the coding pattern coupling module couples the encoded pulse light to generate illumination light, and cooperates with the microscope to couple the encoded illumination light pattern to the sample surface for imaging;

[0028] Wherein, a beam splitter is provided between the coding pattern coupling module and the microscope;

[0029] 3) After the sample is excited by the illumination light, a fluorescence signal is generated. The fluorescence signal is collected by a microscope, focused by a beam splitter and a signal focusing module, and then focused at the entrance of the spectral spectrometry module to form a point fluorescence signal;

[0030] 4) The spectral spectrometry module expands the point fluorescence signal into a one-dimensional fluorescence spectrum signal;

[0031] 5) The streak camera performs high time resolution imaging of the one-dimensional fluorescence spectrum signal and outputs N streak camera images;

[0032] 6) The synchronous control module controls the pulse light generation of the pulse light source module, the updating of the pattern of the pulse light encoding module and the exposure of the streak camera, so that the streak camera outputs N streak images, and each streak image corresponds to a different encoded image;

[0033] 7) The data processing module processes N streak camera images output by the streak camera and outputs a hyperspectral fluorescence lifetime image.

[0034] Furthermore, in step 1), the single pulse width of the pulse light is in the range of femtoseconds to picoseconds.

[0035] Further, step 7) is specifically as follows:

[0036] The data processing module first uses a single-pixel reconstruction algorithm to process the N sampling data corresponding to each pixel of the streak camera image and reconstructs the four-dimensional data (x, y, λ, t) M x ×M y ×M s ×M t , and then use the fluorescence lifetime algorithm to process the time dimension information to reconstruct the hyperspectral fluorescence lifetime image set M x ×M y ×M s , that is, to obtain M s Size: M x ×M y Lifetime images, each of which corresponds to a different spectral resolution channel;

[0037] Among them, M x ×M y is the coding pattern size, M x and M y are the number of pixels of the coding pattern projected on the sample in the horizontal and vertical directions of the space. The size of a single pixel is determined by the pixel size of the digital micromirror array in the pulse light coding module. s ×M t is the streak camera image size, M s and M t are the number of pixels on the spectral and time axes in the fringe image, respectively.

[0038] Further, in step 2), the coding pattern of the pulse light coding module is a Gaussian random coding pattern or a Hadamard coding pattern or a Fourier coding pattern;

[0039] In step 7), the single pixel reconstruction algorithm is a compressed sensing algorithm, an inverse Hadamard algorithm, or an inverse Fourier algorithm.

[0040] Furthermore, in step 7), the fluorescence lifetime algorithm is an exponential fitting algorithm or a fast fluorescence lifetime algorithm.

[0041] Compared with the prior art, the advantages of the present invention are:

[0042] 1. The imaging system and method of the present invention adopts a streak camera combined with a single-pixel imaging mode, has a four-dimensional data acquisition capability (x, y, λ, t), and can realize high-spectral fluorescence lifetime imaging. Compared with the prior art, the present invention uses a single-pixel imaging mode of multi-coded pattern illumination sampling, which eliminates the point scanning imaging process, reduces the complexity of the system, and improves the data acquisition speed; in addition, the streak camera in the present invention performs ultrafast imaging by mapping the time dimension information into the space dimension information. Compared with the time dimension information acquisition method of the existing time-correlated single photon counting technology, it has a faster time dimension information sampling capability of time-varying fluorescence signals, which can further improve the data acquisition speed and shorten the data acquisition time from minutes to hours to seconds to minutes.

[0043] 2. The imaging system and method of the present invention adopts a streak camera with high temporal and spatial resolution as a signal acquisition device. Compared with the existing high-spectral fluorescence lifetime imaging system using a single-photon avalanche diode, it has the advantages of high fluorescence signal sampling time resolution and a large number of spectral resolution channels. It can improve the fluorescence signal sampling time resolution from hundreds of picoseconds to picoseconds or even sub-picoseconds, and increase the number of spectral resolution channels from 10 to 100 to 1000, providing high-precision, fast, and high-performance quantitative diagnostic tools for fields such as life sciences. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 1 is a schematic diagram of the principle structure of an embodiment of a hyperspectral fluorescence lifetime imaging system based on a streak camera of the present invention;

[0045] Figure 2 is a schematic diagram of the working timing of an embodiment of the present invention;

[0046] Figure 3 is a data processing flow chart in step 7) of an embodiment of a hyperspectral fluorescence lifetime imaging method based on a streak camera of the present invention;

[0047] The reference numerals are as follows:

[0048] 01-illumination light encoding unit, 02-signal processing unit;

[0049] 1- pulse light source module, 2- pulse light coupling module, 3- pulse light encoding module, 4- encoding pattern coupling module, 5- beam splitter, 6- microscope, 7- sample, 8- reflector, 9- signal focusing module, 10- spectrum splitting module, 11- streak camera, 12- data processing module, 13- synchronization control module. DETAILED DESCRIPTION

[0050] The present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0051] like Figure 1 As shown, an embodiment of a hyperspectral fluorescence lifetime imaging system based on a streak camera of the present invention includes an illumination light encoding unit 01 , a beam splitter 5 , a microscope 6 , a signal processing unit 02 and a synchronization control module 13 .

[0052] The illumination light encoding unit 01 comprises a pulse light source module 1 and a pulse light coupling module 2, a pulse light encoding module 3 and a coding pattern coupling module 4 which are arranged in sequence along the outgoing light path of the pulse light source module 1;

[0053] The pulse light source module 1 is used to generate pulse light to excite the exogenous labeled fluorescent molecules or endogenous fluorescent molecules in the sample 7. The pulse light wavelength is within the excitation spectrum range of the fluorescent molecules to be measured, the single pulse width is in the order of femtoseconds to picoseconds, and the pulse repetition frequency is f laser ;

[0054] The pulse light coupling module 2 is used to smooth, expand and collimate the pulse light generated by the pulse light source module 1, and couple the illumination pulse light encoding module 3;

[0055] The pulse light encoding module 3 is a digital micromirror array (DMD), which is used to encode the pulse light processed by the pulse light coupling module 2; the encoding pattern of the pulse light encoding module 3 can be a Gaussian random encoding pattern or a Hadamard encoding pattern (Hadamard encoding pattern) or a Fourier encoding pattern, etc., and the encoding pattern size is M x ×M y , the encoding image update frequency is f pattern ;

[0056] The coding pattern coupling module 4 is used to couple the coded pulse light to generate illumination light.

[0057] The beam splitter 5 and the microscope 6 are sequentially arranged on the outgoing light path of the coding pattern coupling module 4. In this embodiment, the beam splitter 5 adopts a dichroic mirror beam splitter. The beam splitter 5 is used to reflect the illumination light coupled by the coding pattern coupling module 4, and then the microscope 6 is used to image the illumination light reflected by the beam splitter 5 on the surface of the sample 7. Therefore, the coding pattern coupling module 4 cooperates with the microscope 6 to couple the coding pattern to the surface of the sample 7.

[0058] The microscope 6 is also used to collect the fluorescence signal generated by the sample 7 after being excited by the illumination light, and the beam splitter 5 is also used to transmit the fluorescence signal collected by the microscope 6. The beam splitter 5 of this embodiment is used to reflect the illumination light and transmit the fluorescence signal light. In other embodiments, the mode in which the beam splitter 5 transmits the illumination light and reflects the fluorescence signal light can also be adopted.

[0059] The signal processing unit 02 includes a signal focusing module 9, a spectrum splitting module 10, a streak camera 11 and a data processing module 12 which are sequentially arranged on the transmission light path of the beam splitter 5;

[0060] The signal focusing module 9 is used to focus the fluorescence signal at the entrance of the spectrum splitting module 10 to form a point fluorescence signal;

[0061] The spectral spectrometry module 10 is used to expand the point fluorescence signal into a one-dimensional fluorescence spectrum signal, and different positions correspond to different fluorescence spectra;

[0062] The streak camera 11 is used to perform high time resolution imaging of the one-dimensional fluorescence spectrum signal and output N streak camera 11 images, each streak image size is M s ×M t , the image output frequency of streak camera 11 is f sc ;

[0063] The synchronous control module 13 is used to synchronously control the pulse light generation of the pulse light source module 1, the updating of the pattern of the pulse light encoding module 3 and the exposure of the streak camera 11, so that f laser =f pattern =f sc ;

[0064] The data processing module 12 is used to process N streak camera 11 images output by the streak camera 11 and output a hyperspectral fluorescence lifetime image.

[0065] In order to reduce the volume of the imaging system, in this embodiment, a reflector 8 is arranged between the beam splitter 5 and the signal focusing module 9 to achieve the deflection of the light path and reduce the volume of the entire imaging system.

[0066] The imaging process of the hyperspectral fluorescence lifetime imaging system based on the streak camera in this embodiment is as follows:

[0067] 1) The pulse light generated by the pulse light source module 1 is smoothed, expanded and collimated by the pulse light coupling module 2, and then illuminates the pulse light encoding module 3. The single pulse width of the pulse light is in the order of femtoseconds to picoseconds;

[0068] 2) The pulse light encoding module 3 encodes the pulse light processed by the pulse light coupling module 2, and then the coding pattern coupling module 4 couples the encoded pulse light to generate illumination light, and cooperates with the microscope 6 to couple the encoded illumination light pattern to the surface of the sample 7. The coding pattern size is M x ×M y , the encoding image update frequency is f pattern ;

[0069] Wherein, a beam splitter 5 is provided between the coding pattern coupling module 4 and the microscope 6 for reflecting the illumination light;

[0070] 3) After being excited by the illumination light, the sample 7 generates a fluorescence signal, which is collected by the microscope 6, transmitted by the beam splitter 5, and focused by the signal focusing module 9, and then focused at the entrance of the spectrum splitting module 10 to form a point fluorescence signal;

[0071] 4) The spectral splitting module 10 expands the point fluorescence signal into a one-dimensional fluorescence spectrum signal;

[0072] 5) The streak camera 11 performs high time resolution imaging on the one-dimensional fluorescence spectrum signal and outputs the streak camera 11 image. The streak image size is M s ×M t ;

[0073] 6) The synchronous control module 13 synchronously controls the pulse light generation of the pulse light source module 1, the updating of the pattern of the pulse light encoding module 3 and the exposure (exposure gate) of the streak camera 11, so that the streak camera 11 outputs N streak images, and each streak image corresponds to a different coded image, see Figure 2 As shown;

[0074] 7) The data processing module 12 processes the N streak camera 11 images output by the streak camera 11 and outputs a hyperspectral fluorescence lifetime image; specifically, Figure 3 As shown, the data processing module 12 first uses a single pixel reconstruction algorithm to process the N sampling data corresponding to each pixel of the streak camera 11 image, and reconstructs four-dimensional data (two-dimensional space + one-dimensional spectrum + one-dimensional time) M x ×M y ×M s ×M t , and then use the fluorescence lifetime algorithm to process the time dimension information to reconstruct the hyperspectral fluorescence lifetime image set M x ×M y ×M s , that is, to obtain M s Size: M x ×M y Lifetime images, each of which corresponds to a different spectral resolution channel; M x ×M y is the coding pattern size, M x and M y are the number of pixels of the coding pattern projected on the sample 7 in the horizontal and vertical directions of the space, and the size of a single pixel is determined by the pixel size of the digital micromirror array in the pulse light coding module 3; M s ×M t is the image size of streak camera 11, M s and M t are the number of pixels on the spectral and time axes in the fringe image, respectively.

[0075] The single pixel reconstruction algorithm varies according to the type of coding pattern. For example, if the coding pattern of the pulse light coding module 3 is a Gaussian random coding pattern, the single pixel reconstruction algorithm uses a compressed sensing algorithm; if the coding pattern of the pulse light coding module 3 is a Hadamard coding pattern, the single pixel reconstruction algorithm uses an inverse Hadamard algorithm; if the coding pattern of the pulse light coding module 3 is a Fourier coding pattern, the single pixel reconstruction algorithm uses an inverse Fourier algorithm. And the fluorescence lifetime algorithm is an exponential fitting algorithm or a fast fluorescence lifetime algorithm.

[0076] The above is only a description of the preferred implementation mode of the present invention, and the technical solution of the present invention is not limited thereto. Any modification made by those skilled in the art on the basis of the main technical concept of the present invention belongs to the technical scope to be protected by the present invention.

Claims

1. A hyperspectral fluorescence lifetime imaging system based on a streak camera, characterized in that: It comprises an illumination light encoding unit (01), a beam splitter (5), a microscope (6), a signal processing unit (02) and a synchronization control module (13); The illumination light encoding unit (01) comprises a pulse light source module (1), and a pulse light coupling module (2), a pulse light encoding module (3), and a coding pattern coupling module (4) which are sequentially arranged along an output light path of the pulse light source module (1); The pulse light source module (1) is used to generate pulse light to excite exogenously labeled fluorescent molecules or endogenous fluorescent molecules in the sample (7); the wavelength of the pulse light is within the excitation spectrum range of the fluorescent molecules, and the width of a single pulse is in the order of femtoseconds to picoseconds; The pulse light coupling module (2) is used to smooth, expand and collimate the pulse light generated by the pulse light source module (1), and couple the illumination to the pulse light encoding module (3); The pulse light encoding module (3) is used to encode the pulse light processed by the pulse light coupling module (2); The coding pattern coupling module (4) is used to couple the coded pulse light to generate illumination light; The beam splitter (5) is located on the outgoing light path of the coding pattern coupling module (4); The microscope (6) and the signal processing unit (02) are respectively located on two output light paths of the beam splitter (5); the microscope (6) is used to image the illumination light output by the beam splitter (5) onto the surface of the sample (7), and to collect the fluorescence signal generated by the sample (7) after being excited by the illumination light, and the beam splitter (5) is used to output the fluorescence signal collected by the microscope (6) to the signal processing unit (02); The signal processing unit (02) comprises a signal focusing module (9), a spectrum splitting module (10), a streak camera (11) and a data processing module (12) which are sequentially arranged on the output light path of the beam splitter (5); The signal focusing module (9) is used to focus the fluorescent signal at the entrance of the spectrum splitting module (10) to form a point fluorescent signal; The spectral spectrometry module (10) is used to expand the point fluorescence signal into a one-dimensional fluorescence spectrum signal; The streak camera (11) is used to perform high time-resolution imaging on a one-dimensional fluorescence spectrum signal and output N streak camera (11) images; The data processing module (12) is used to process N streak camera (11) images output by the streak camera (11) and output a hyperspectral fluorescence lifetime image; specifically: the data processing module (12) uses a single-pixel reconstruction algorithm to process N sampling data corresponding to each pixel of the streak camera (11) image to reconstruct four-dimensional data (x, y, λ, t), and then uses a fluorescence lifetime algorithm to process time dimension information to reconstruct a hyperspectral fluorescence lifetime image set, that is, to obtain a hyperspectral fluorescence lifetime image; The synchronous control module (13) synchronously controls the generation of pulse light by the pulse light source module (1), the updating of the pattern of the pulse light encoding module (3), and the exposure of the streak camera (11).

2. The hyperspectral fluorescence lifetime imaging system based on a streak camera according to claim 1, characterized in that: The coding pattern of the pulse light coding module (3) is a Gaussian random coding pattern, a Hadamard coding pattern or a Fourier coding pattern.

3. The hyperspectral fluorescence lifetime imaging system based on a streak camera according to claim 1, characterized in that: The pulse light encoding module (3) is a digital micromirror array; The beam splitter (5) is a dichroic mirror beam splitter.

4. The hyperspectral fluorescence lifetime imaging system based on a streak camera according to any one of claims 1 to 3, characterized in that: The microscope (6) is located on the reflected light path of the beam splitter (5), and the signal processing unit (02) is located on the transmitted light path of the beam splitter (5); The signal processing unit (02) further comprises a reflector (8) located between the beam splitter (5) and the signal focusing module (9).

5. A hyperspectral fluorescence lifetime imaging method based on a streak camera, characterized in that: The following steps are involved: 1) The pulse light generated by the pulse light source module (1) is smoothed, expanded and collimated by the pulse light coupling module (2) and then illuminates the pulse light encoding module (3); 2) The pulse light encoding module (3) encodes the pulse light processed by the pulse light coupling module (2), and then the encoding pattern coupling module (4) couples the encoded pulse light to generate illumination light, and cooperates with the microscope (6) to couple the encoded illumination light pattern to the surface of the sample (7) for imaging; Wherein, a beam splitter (5) is provided between the coding pattern coupling module (4) and the microscope (6); 3) The sample (7) generates a fluorescence signal after being excited by the illumination light, and the fluorescence signal is collected by the microscope (6), focused by the beam splitter (5) and the signal focusing module (9), and then focused at the entrance of the spectrum splitting module (10), forming a point fluorescence signal; 4) The spectral spectrometry module (10) expands the point fluorescence signal into a one-dimensional fluorescence spectrum signal; 5) The streak camera (11) performs high time resolution imaging on the one-dimensional fluorescence spectrum signal and outputs N streak camera (11) images; 6) The synchronization control module (13) controls the generation of pulse light of the pulse light source module (1), the updating of the pattern of the pulse light encoding module (3) and the exposure of the streak camera (11), so that the streak camera (11) outputs N streak images, and each streak image corresponds to a different encoded image; 7) The data processing module (12) uses a single pixel reconstruction algorithm to process N streak camera (11) images output by the streak camera (11), reconstructs four-dimensional data (x, y, λ, t), and then uses a fluorescence lifetime algorithm to process time dimension information, reconstructs a hyperspectral fluorescence lifetime image set, and outputs a hyperspectral fluorescence lifetime image.

6. The hyperspectral fluorescence lifetime imaging method based on a streak camera according to claim 5, characterized in that: In step 1), the single pulse width of the pulse light is in the order of femtoseconds to picoseconds.

7. The method for hyperspectral fluorescence lifetime imaging based on a streak camera according to claim 6, characterized in that: Step 7) is specifically as follows: The data processing module (12) first uses a single pixel reconstruction algorithm to process N sampling data corresponding to each pixel of the streak camera (11) image, and reconstructs four-dimensional data (x, y, λ, t) M x ×M y ×M s ×M t , and then use the fluorescence lifetime algorithm to process the time dimension information to reconstruct the hyperspectral fluorescence lifetime image set M x ×M y ×M s , that is, to obtain M s Size: M x ×M y Lifetime images, each of which corresponds to a different spectral resolution channel; Among them, M x ×M y is the coding pattern size, M x and M y are the number of pixels of the coding pattern projected on the sample (7) in the horizontal and vertical directions of the space, respectively. The size of a single pixel is determined by the pixel size of the digital micromirror array in the pulse light coding module (3); M s ×M t is the image size of the streak camera (11), M s and M t are the number of pixels on the spectral and time axes in the fringe image, respectively.

8. The hyperspectral fluorescence lifetime imaging method based on a streak camera according to claim 7, characterized in that: In step 2), the coding pattern of the pulse light coding module (3) is a Gaussian random coding pattern, a Hadamard coding pattern, or a Fourier coding pattern; In step 7), the single pixel reconstruction algorithm is a compressed sensing algorithm, an inverse Hadamard algorithm, or an inverse Fourier algorithm.

9. The method for hyperspectral fluorescence lifetime imaging based on a streak camera according to claim 8, characterized in that: In step 7), the fluorescence lifetime algorithm is an exponential fitting algorithm or a fast fluorescence lifetime algorithm.

Citation Information

Patent Citations

  • Systems and Methods for 4-D Hyperspectral Imaging

    US20170343477A1