Compressed Imaging Dual-Channel Encoded Near-Infrared II High-Speed ​​Fluorescence Microscopy Device

By using a compressed imaging dual-channel coded near-infrared II fluorescence microscopy device, combined with compressed sensing and aperture coding technology, the problems of imaging speed and signal-to-noise ratio in near-infrared II fluorescence microscopy imaging systems have been solved, achieving ultra-high-speed, high-quality microscopic imaging.

CN117270183BActive Publication Date: 2026-11-17EAST CHINA NORMAL UNIV
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311213476.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-09-20
Publication Date
2026-11-17
Estimated Expiration
2043-09-20

AI Technical Summary

Technical Problem

Existing near-infrared II fluorescence microscopy systems have limited imaging speed, making it difficult to achieve ultra-high-speed imaging, and their signal-to-noise ratio is insufficient.

Method used

A high-speed fluorescence microscope with compressed imaging dual-channel coded near-infrared two-zone is used, which combines compressed sensing and aperture coding techniques. Through temporal compressed sampling and deep learning-based image reconstruction algorithms, ultra-high-speed microscopic image reconstruction of dynamic scenes is achieved.

Benefits of technology

It breaks through the imaging speed limit of infrared cameras, achieving a more than tenfold increase in microscopic imaging speed, improving the signal-to-noise ratio and image quality, and supporting efficient three-dimensional spatiotemporal information reconstruction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117270183B_ABST
    Figure CN117270183B_ABST
Patent Text Reader

Abstract

This invention discloses a compressed imaging dual-channel coded high-speed near-infrared II fluorescence microscopy device, comprising a light source and beam expander system, a wide-field fluorescence microscopy system, a complementary dual-channel aperture-coded temporal compression imaging system, a synchronization control system, and a data processing and reconstruction system. This invention introduces compressed sensing principles and aperture coding technology into the field of near-infrared II fluorescence microscopy. Utilizing the sparsity characteristics of dynamic imaging targets, it compresses and acquires dynamic image data in each image acquisition through temporal compression sampling, and uses an image reconstruction algorithm based on compressed sensing principles to reconstruct the dynamic process of near-infrared II fluorescence. This invention overcomes the hardware speed limitations of infrared cameras and has significant application value for live-body imaging observation in the field of near-infrared II fluorescence microscopy.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of near-infrared II fluorescence microscopy, specifically to a compressed imaging type dual-channel coded near-infrared II high-speed fluorescence microscopy device. Background Technology

[0002] Fluorescence imaging, as a non-ionizing radiation optical imaging technique, uses fluorescent labeling reagents or antibodies to visualize objects that are otherwise inaccessible. It boasts numerous advantages, including non-radiotoxicity, high sensitivity, and the ability to use multiple colors for labeling. It enables direct observation of the morphology or structure of cells or proteins, as well as life activities, and has become one of the most important imaging techniques in modern life science research. When fluorescence propagates in biological media, absorption attenuation and dissipation perturbations are key limiting factors affecting fluorescence energy and the signal-to-background ratio, and are therefore a major focus for researchers. On the one hand, the degree of absorption attenuation determines the intensity of the fluorescence signal captured by the imaging system; on the other hand, the strength of the dissipation perturbation determines the clarity of the scene image. Furthermore, the spontaneous fluorescence signals of biomolecules themselves are inevitably collected by the imaging system, affecting the final imaging results. Therefore, in the field of biofluorescence imaging, finding an imaging band with weak photon absorption and minimal light scattering is crucial for achieving high-quality fluorescence imaging.

[0003] From the perspective of the spectral range of fluorescence emission, traditional fluorescence imaging techniques mainly focus on the visible light and near-infrared I bands. In early studies primarily aimed at in vitro diagnostics or cell imaging, traditional visible light fluorescent probes were sufficient, and detectors based on CCD and CMOS technologies possessed ultra-high quantum efficiency and dynamic range in this band, providing crucial assurance for imaging. As scientific research has deepened, researchers have increasingly strong demands for imaging biological mechanisms, such as those related to the in-situ microenvironment of living organisms. However, due to the varying degrees of scattering and absorption of excitation and emission light by different tissues within organisms, visible light fluorescence imaging faces bottlenecks in terms of penetration depth and imaging resolution. Compared to the former, NIR-I fluorescence imaging features low photon scattering, low tissue absorption, and weak autofluorescence, offering significant advantages in penetration depth and imaging quality. Therefore, it has rapidly become a research hotspot in the field of biomedical imaging and has already achieved clinical applications. Recent research has shown that when fluorescence wavelengths extend into the near-infrared II region (NIR-II, 900-1880 nm), photon scattering and absorption levels further decrease, while tissue autofluorescence also diminishes. This allows NIR-II fluorescence imaging to achieve a penetration depth of several centimeters and spatial resolution on the micrometer scale, while also obtaining higher signal-to-background ratio and fidelity. Therefore, this band is considered a near-perfect biomedical imaging window. Thanks to the research achievements of researchers from various fields in areas such as fluorescent probe design and synthesis, imaging function innovation and improvement, and therapeutic and diagnostic applications, NIR-II fluorescence imaging has demonstrated a very broad application prospect in basic biomedical research and clinical translation.

[0004] Novel fluorescent probes with high quantum yield and biocompatibility can greatly promote the application of near-infrared II fluorescence imaging in in vivo imaging research. Furthermore, the importance of detection methods with high spatiotemporal resolution in terms of imaging speed is equally self-evident. Currently, the imaging speed of near-infrared II microscopy systems in the market and research fields is limited by camera bandwidth, remaining at a level of tens of frames per second, which is far from meeting the imaging requirements of ultra-high-speed processes. Therefore, the development of near-infrared II fluorescence microscopy imaging systems with ultra-high-speed imaging capabilities has broad application prospects and development potential.

[0005] CACTI (Current Domain Compression Imaging) technology, based on compressed sensing, achieves sparse signal sampling through optical coding. By loading different random codes onto information from different times and then integrating the images through a single camera exposure, signal compression is achieved. Combined with a deep learning-based computational reconstruction algorithm, leveraging compressed sensing and prior image knowledge, it enables ultra-high-speed microscopic image reconstruction of dynamic scenes, overcoming camera imaging speed limitations while avoiding the difficulties in achieving multi-frame real-time imaging caused by massive data transmission and storage. Introducing CACTI technology into NIR-II fluorescence microscopy, and achieving ultra-high-speed wide-field imaging while breaking the Nyquist sampling theorem, can overcome the limitations of existing infrared camera acquisition rates and transmission bandwidth. Summary of the Invention

[0006] The purpose of this invention is to address the shortcomings of existing technologies by providing a compressed imaging dual-channel coded near-infrared II high-speed fluorescence microscopy device. By introducing the principles of compressed sensing and aperture coding technology into the field of near-infrared II fluorescence microscopy, and utilizing the sparsity characteristics of dynamic imaging targets, dynamic image data is compressed and acquired in each image acquisition through temporal compressed sampling. Furthermore, an image reconstruction algorithm based on the compressed sensing principle is used to reconstruct the dynamic process of near-infrared II fluorescence, thus overcoming the hardware speed limitations of infrared cameras.

[0007] The specific technical solution for achieving the objective of this invention is as follows:

[0008] A compressed imaging dual-channel coded near-infrared two-zone high-speed fluorescence microscope, comprising:

[0009] A light source and beam expanding system consisting of a continuous laser and a beam expander;

[0010] The light source and the continuous laser and beam expander of the beam expansion system are connected in sequence via optical paths;

[0011] A wide-field fluorescence microscopy system consisting of a sample stage, objective lens, dichroic mirror and first lens;

[0012] The dichroic mirror of the wide-field fluorescence microscopy system divides the optical path into two paths; one path reflected by the dichroic mirror is connected to the objective lens and the sample stage in sequence; the other path transmitted by the dichroic mirror is connected to the optical path of the first lens.

[0013] A complementary dual-channel aperture-coded temporal compression imaging system consisting of a second lens, a first reflecting mirror, a stereo objective lens, a digital micromirror device, a third lens, a fourth lens, a second reflecting mirror, a third reflecting mirror, a right-angle prism reflecting mirror, and an InGaAs infrared camera.

[0014] The complementary dual-channel aperture-coded temporal compression imaging system consists of a second lens, a first reflector, a bulk objective lens, and a digital micromirror device connected in sequence via optical paths. The digital micromirror device reflects the optical path into two paths: one path is connected in sequence to the bulk objective lens, a third lens, and a second reflector; the other path is connected in sequence to the bulk objective lens, a fourth lens, and a third reflector. The second and third reflectors are respectively connected to the optical paths of a right-angle prism reflector. The right-angle prism reflector is connected to the optical path of an InGaAs infrared camera.

[0015] A synchronous control system consisting of a multi-functional digital delay pulse generator DG645;

[0016] A data processing and reconstruction system composed of computers;

[0017] The beam expander of the light source and beam expander system is connected to the dichroic mirror of the wide-field fluorescence microscope system.

[0018] The first lens of the wide-field fluorescence microscopy system is optically connected to the second lens of the complementary dual-channel aperture-coded time-domain compression imaging system.

[0019] The multifunctional digital delay pulse generator DG645 of the synchronous control system is connected to the digital micromirror device of the complementary dual-channel aperture coded time-domain compression imaging system and the data cable of the InGaAs infrared camera.

[0020] The computer of the data processing and reconstruction system is connected to the digital micromirror device of the complementary dual-channel aperture coded time-domain compression imaging system, the InGaAs infrared camera, and the DG645 multifunctional digital delayed pulse generator of the synchronization control system via data cables.

[0021] The light source and beam expansion system generate excitation light and expand it; the wide-field fluorescence microscopy system guides the excitation light to the fluorescent sample to be tested, and the excitation light excites the fluorescent sample to produce a dynamic fluorescence scene.

[0022] The complementary dual-channel aperture-coded temporal compression imaging system generates two beams of complementary fluorescent dynamic information by encoding the fluorescence dynamic scene through dual-channel complementary encoding, and realizes temporal compression imaging of two different regions on the InGaAs infrared camera chip.

[0023] The synchronous control system inputs a trigger signal to perform timing control on the digital micromirror device and the InGaAs infrared camera, thereby synchronizing the encoding switching and image acquisition to achieve time-domain compressed imaging.

[0024] The data processing and reconstruction system uses a plug-and-play algorithm based on the Alternating Direction Method of Multipliers (ADMM) as an optimization iterative framework to reconstruct the temporal compressed image of the two channels, and finally obtain the restored three-dimensional spatiotemporal dynamic scene.

[0025] The beneficial effects of this invention are:

[0026] This invention employs a compressed imaging image acquisition strategy, which improves imaging speed by reconstructing multiple microscopic images from a single frame, rather than simply increasing image acquisition speed, thus solving the problem of low signal-to-noise ratio in high-speed imaging acquisition.

[0027] The coded compression imaging part of this invention adopts a complementary coded dual-channel design, which compresses the time-domain image signal acquired by the microscopic excitation imaging system. The large-aperture stereo lens combines the two coded complementary fluorescence beams reflected by the digital micromirror device into an InGaAs infrared camera for image acquisition, thereby improving the information sampling rate of a single acquisition, improving the signal-to-noise ratio, and enhancing the quality of the final acquired microscopic image.

[0028] This invention uses a multifunctional digital delay pulse generator DG645 in a synchronous control system to perform timing control on the input trigger signals of the digital micromirror device and the InGaAs infrared camera, thereby achieving synchronization between encoding switching and image acquisition, and thus achieving the purpose of time-domain compressed imaging.

[0029] This invention is the first to introduce time-domain compression ultra-high-speed imaging technology, which combines the principle of compressed sensing with optical coding technology, into the field of near-infrared II fluorescence microscopy. Under the premise of breaking through the Nyquist sampling theorem, it realizes ultra-high-speed wide-field imaging, increasing the microscopic imaging speed in this band to more than ten times that of conventional infrared cameras, and increasing the number of imaging frames per exposure to more than ten frames.

[0030] This invention develops a high-performance spatiotemporal three-dimensional information reconstruction algorithm for ultra-high-speed microscopy. By developing a spatial two-dimensional image to spatiotemporal three-dimensional information reconstruction algorithm that integrates traditional optimization iterative algorithm framework with deep learning noise reduction and other functions, the accuracy and efficiency of compressed imaging information restoration are improved, providing an important guarantee for realizing real-time observation of ultra-high-speed dynamics. Attached Figure Description

[0031] Figure 1 This is a structural diagram of the present invention;

[0032] Figure 2 This is a flowchart of the forward imaging data flow of the present invention;

[0033] Figure 3Structural diagrams collected for DMD dual-channel encoding and bulk objectives;

[0034] Figure 4 A schematic diagram of the random complementary coding generated for DMD;

[0035] Figure 5 This is a flowchart of the image reconstruction algorithm of the present invention. Detailed Implementation

[0036] The present invention will now be described in detail with reference to the accompanying drawings.

[0037] See Figure 1 The present invention includes:

[0038] A light source and beam expanding system 100 consisting of a continuous laser 101 and a beam expander 102;

[0039] The light source is sequentially optically connected to the continuous laser 101 and the beam expander 102 of the beam expander system 100;

[0040] A wide-field fluorescence microscopy system 200 consisting of a sample stage 201, an objective lens 202, a dichroic mirror 203, and a first lens 204;

[0041] The dichroic mirror 203 of the wide-field fluorescence microscopy system 200 divides the optical path into two paths; one path reflected by the dichroic mirror 203 is connected to the objective lens 202 and the sample stage 201 in sequence; the other path transmitted by the dichroic mirror 203 is connected to the optical path of the first lens 204.

[0042] See Figure 1 , Figure 3 A complementary dual-channel aperture-coded temporal compression imaging system 300, consisting of a second lens 301, a first reflector 302, a stereo objective lens 303, a digital micromirror device 304, a third lens 305, a fourth lens 306, a second reflector 307, a third reflector 308, a right-angle prism reflector 309, and an InGaAs infrared camera 310;

[0043] The complementary dual-channel aperture-coded temporal compression imaging system 300 consists of a second lens 301, a first reflector 302, a bulk objective lens 303, and a digital micromirror device 304 connected in sequence via optical paths. The digital micromirror device 304 reflects the optical path into two paths: one path is connected in sequence to the bulk objective lens 303, a third lens 305, and a second reflector 307; the other path is connected in sequence to the bulk objective lens 303, a fourth lens 306, and a third reflector 308. The second reflector 307 and the third reflector 308 are respectively connected in optical paths to a right-angle prism reflector 309. The right-angle prism reflector 309 is connected in optical path to an InGaAs infrared camera 310.

[0044] See Figure 1 A synchronous control system 400 consisting of a multi-functional digital delay pulse generator DG645.

[0045] See Figure 1 A data processing and reconstruction system consisting of computers 500.

[0046] See Figure 1 The beam expander 102 of the light source and beam expander system 100 is connected to the dichroic mirror 203 of the wide-field fluorescence microscope system 200.

[0047] The first lens 204 of the wide-field fluorescence microscopy system 200 is optically connected to the second lens 301 of the complementary dual-channel aperture-coded time-domain compression imaging system 300.

[0048] The multifunctional digital delayed pulse generator DG645 of the synchronous control system 400 is connected to the digital micromirror device 304 and the InGaAs infrared camera 310 of the complementary dual-channel aperture coded time-domain compression imaging system 300 via data cables.

[0049] The computer of the data processing and reconstruction system 500 is connected to the digital micromirror device 304 of the complementary dual-channel aperture coded time-domain compression imaging system 300, the InGaAs infrared camera 310, and the multifunctional digital delayed pulse generator DG645 of the synchronization control system 400 via data cables.

[0050] The light source and beam expander system 100 generate excitation light and expand it; the wide-field fluorescence microscopy system 200 guides the excitation light to the fluorescent sample to be tested, and the excitation light excites the fluorescent sample to produce a dynamic fluorescence scene.

[0051] The complementary dual-channel aperture-coded temporal compression imaging system 300 generates two beams of complementary fluorescent dynamic information by encoding the fluorescence dynamic scene through dual-channel complementary encoding, and realizes temporal compression imaging of two different regions on the InGaAs infrared camera 310 chip.

[0052] The synchronous control system 400 inputs a trigger signal to perform timing control on the digital micromirror device 304 and the InGaAs infrared camera 310, thereby achieving synchronization between encoding switching and image acquisition to achieve time-domain compressed imaging.

[0053] The data processing and reconstruction system 500 uses a plug-and-play algorithm based on the Alternating Direction Method of Multipliers (ADMM) as an optimization iterative framework to reconstruct the temporal compressed image of the two channels, and finally obtains the restored three-dimensional spatiotemporal dynamic scene.

[0054] This invention includes data acquisition and image reconstruction:

[0055] The data acquisition process involves capturing the dynamic fluorescence scene using aperture-encoded temporal compression. The dynamic fluorescence sequence d(x,y,t) to be tested first passes through the wide-field fluorescence microscopy system 200, where it is limited by the optical diffraction limit. This is equivalent to convolving the point spread function of the optical microscope with the dynamic fluorescence sequence d(x,y,t). The diffraction-limited image sequence s(x,y,t,n) can be expressed as:

[0056] s(x,y,t,n)=∫∫h(τ x -x,τ y -y)d(x,y,t)dτ x dτ y

[0057] Where h(x,y) is the point spread function of optical microscopy. The diffraction-limited image sequence is then randomly encoded sequentially by different spatial modes c(x,y,t,n), and then superimposed into a single image m(x,y) by the exposure integration of the InGaAs infrared camera 310 of the complementary dual-channel aperture-coded temporal compression imaging system 300.

[0058] m(x,y)=∫∫c(x,y,t,n)s(x,y,t,n)dtdn

[0059] In dual-channel encoding mode, the image acquisition of this invention can be simplified as follows:

[0060]

[0061] Wherein, m1 and m2 are two channel images obtained by exposure integration of the InGaAs infrared camera 310 of the complementary dual-channel aperture-coded temporal compression imaging system 300, d is the dynamic scene sequence to be tested, C1 and C2 are two complementary spatial coding pattern sequences, H is the optical microscopy point spread function convolution operation, I is the spatiotemporal integration operation, and A represents the integrated operation of image acquisition in this invention.

[0062] The image reconstruction process involves restoring the spatiotemporal three-dimensional information of the compressed image by fusing a deep learning denoiser within an optimization iterative algorithm framework. Reconstructing the compressed sampled image is an underdetermined problem. This invention transforms it into an optimization problem by adding regularization constraints and solves the following optimization problem using a plug-and-play algorithm based on the Alternating Direction Method of Multipliers (ADMM) as the optimization iterative framework:

[0063]

[0064] Where ν is the intermediate auxiliary variable introduced by the ADMM algorithm, λ is the regularization factor, and g represents the regularization term. It can be decomposed by solving the following series of subproblems:

[0065]

[0066]

[0067] u (k+1) =u (k) +(ρx (k+1) -ν (k+1) )

[0068] Where u is an intermediate auxiliary variable introduced by the ADMM algorithm, the superscript k represents the iteration number, and ρ is the iteration step size parameter introduced by the ADMM algorithm. By using a plug-and-play optimization algorithm framework based on the alternating direction multiplier method, combined with the DRUNET deep learning denoiser and the fully variational TV denoiser optimized and trained according to the scene data of the corresponding category, sparse constraints are applied to both the temporal and spatial domains simultaneously to complete image reconstruction.

[0069] This invention works as follows:

[0070] See Figure 1 The continuous laser 101 of the light source and beam expander system 100 generates laser light. The laser beam is expanded by the beam expander 102 and then reflected by the long-pass dichroic mirror 203 of the wide-field fluorescence microscopy system 200. The reflected laser light is focused onto the sample stage 201 by the objective lens 202. The fluorescent sample on the sample stage 201 generates near-infrared II band fluorescence and forms a fluorescence dynamic scene. The fluorescence dynamic scene is transmitted through the objective lens 202, through the dichroic mirror 203, and then through the first lens 204 into the complementary dual-channel aperture coded time-domain compression imaging system 300.

[0071] See Figure 1 , Figure 4 In the complementary dual-channel aperture coded temporal compression imaging system 300, the fluorescent dynamic scene is relayed by the second lens 301, reflected by the first mirror 302, and then focused onto the digital micromirror device 304 by the stereo objective lens 303. The chip of the digital micromirror device 304 contains several tiny mirrors. Each mirror can generate two deflection directions of ±12°, controlling the opening and closing of the pixels, which correspond to the loaded codes. When the fluorescent dynamic scene is irradiated onto the digital micromirror device 304, the several mirrors reflect the fluorescent dynamic scene in two directions of ±12° according to the loaded codes. Thus, after being modulated by the digital micromirror device 304, the fluorescent dynamic scene generates two beams of coded complementary fluorescent dynamic information.

[0072] See Figure 1 , Figure 3 The two fluorescent dynamic information beams are split into two paths. One path of fluorescence passes through the stereo objective lens 303 and the third lens 305, and is then reflected by the second mirror 307 onto the right-angle prism mirror 309. The other path of fluorescence passes through the stereo objective lens 303 and the fourth lens 306, and is then reflected by the third mirror 308 onto the right-angle prism mirror 309. The right-angle prism mirror 309 simultaneously reflects the two fluorescent dynamic information beams into the InGaAs infrared camera 310, and finally forms two images of different regions on the chip of the InGaAs infrared camera 310.

[0073] See Figure 1 , Figure 2 During the data acquisition process, the multi-functional digital delay pulse generator DG645 of the synchronous control system 400 performs timing control on the input trigger signals of the digital micromirror device 304 and the InGaAs infrared camera 310. Let the exposure time of a single exposure of the InGaAs infrared camera 310 be Δt and the compression ratio be N. Then, within the time period Δt, the digital micromirror device 304 switches N encodings. The fluorescence scene images of N encodings are integrated and compressed into one image within the InGaAs infrared camera 310, thus achieving the purpose of time-domain compressed imaging.

[0074] See Figure 1 , Figure 5 The computer in the data processing and reconstruction system 500 processes the data acquired by the InGaAs infrared camera 310. The specific process is as follows: first, iterative parameters and initialization conditions are set; then, intermediate results x are calculated according to the forward image acquisition method based on the present invention. (k) The residual between the experimentally acquired compressed image y and the image x is then back-projected onto x. (k) The updated result x is obtained (k+1) Then update the result x (k+1) Hybrid noise reduction processing is performed to obtain ν (k+1) Then, u is calculated, accumulated, and iteration conditions are determined to finally obtain the reconstructed 3D dynamic scene. Furthermore, this invention reduces the data compression ratio and improves computational accuracy through dual-channel coupling, thus obtaining more accurate reconstruction results.

[0075] See Figure 1The laser 101 used in this invention emits a continuous 808nm laser as the excitation light to match the fluorescence emitted by the sample. The fluorescent sample on the sample stage 201 emits fluorescence in the near-infrared II band, generating a dynamic scene of the fluorescence to be measured. The first lens 204, the second lens 301, the third lens 305, and the fourth lens 306 are all coated with an anti-reflection film of 1100-1650nm. The InGaAs infrared camera 310 has a response band of 400nm-1700nm. All imaging devices in this invention are suitable for the near-infrared II band.

[0076] See Figure 1 The InGaAs infrared camera 310 used in this invention has an InGaAs sensor chip, an effective pixel array of 1280×1024, a detectable spectral wavelength range of 400nm-1700nm, and uses a global shutter with a maximum imaging frame rate of 72fps.

[0077] See Figure 1 The stereomicroscope 303 used in this invention is a large-aperture microscope objective. Its application in the dual-channel imaging optical path design facilitates the simultaneous collection of dynamic information from two beams of fluorescence.

[0078] See Figure 1 The multi-functional digital delay pulse generator DG645 used in the synchronous control system 400 of this invention can perform multi-channel synchronous control, can trigger the digital micromirror device 304 to switch codes according to preset rules, can trigger the InGaAs infrared camera 310 to perform exposure, and can control the trigger timing and delay.

[0079] See Figure 1 The dichroic mirror 203 used in this invention is a long-pass dichroic mirror, which can separate the light beam according to the wavelength, transmit the light beam with a wavelength higher than the cutoff wavelength, and reflect the light beam with a wavelength lower than the cutoff wavelength. Its cutoff wavelength is selected according to the emission fluorescence wavelength of the actual sample.

[0080] See Figure 1 In the wide-field fluorescence microscopy system 200, the objective lens 202 and the first lens 204 form an optical 4f imaging system, which is used to transmit the fluorescence dynamic scene to the complementary dual-channel aperture-coded temporal compression imaging system 300. In the complementary dual-channel aperture-coded temporal compression imaging system 300, the second lens 301, the first mirror 302 and the bulk objective lens 303 form an optical 4f imaging system, which is used to transmit the fluorescence dynamic scene to the digital micromirror device 304. The bulk objective lens 303, together with the third lens 305 and the fourth lens 306, respectively form two dual-channel optical 4f imaging systems, which are used to transmit two beams of complementaryly coded fluorescence dynamic information to the InGaAs infrared camera 310.

Claims

1. A compressed imaging type dual-channel coded near-infrared two-zone high-speed fluorescence microscope, characterized in that it include: A light source and beam expanding system (100) consisting of a continuous laser (101) and a beam expander (102); The light source and the continuous laser (101) and beam expander (102) of the beam expander system (100) are connected in sequence by optical path; A wide-field fluorescence microscopy system (200) consisting of a sample stage (201), an objective lens (202), a dichroic mirror (203) and a first lens (204). The dichroic mirror (203) of the wide-field fluorescence microscopy system (200) divides the light path into two paths; one path reflected by the dichroic mirror (203) is connected to the objective lens (202) and the sample stage (201) in sequence; the other path transmitted by the dichroic mirror (203) is connected to the light path of the first lens (204). A complementary dual-channel aperture-coded temporal compression imaging system (300) consisting of a second lens (301), a first reflector (302), a stereo objective lens (303), a digital micromirror device (304), a third lens (305), a fourth lens (306), a second reflector (307), a third reflector (308), a right-angle prism reflector (309), and an InGaAs infrared camera (310). The complementary dual-channel aperture-coded temporal compression imaging system (300) consists of a second lens (301), a first reflector (302), a bulk objective lens (303), and a digital micromirror device (304) connected in sequence via optical paths. The digital micromirror device (304) reflects the optical path into two paths: one path is connected in sequence to the bulk objective lens (303), a third lens (305), and a second reflector (307); the other path is connected in sequence to the bulk objective lens (303), a fourth lens (306), and a third reflector (308). The second reflector (307) and the third reflector (308) are connected in optical paths to a right-angle prism reflector (309), and the right-angle prism reflector (309) is connected in optical path to an InGaAs infrared camera (310). A synchronous control system (400) consisting of a multi-functional digital delay pulse generator DG645. A data processing and reconstruction system composed of computers (500). The light source and the beam expander (102) of the beam expander system (100) are connected to the dichroic mirror (203) of the wide field fluorescence microscope system (200) in the optical path; The first lens (204) of the wide-field fluorescence microscopy system (200) is optically connected to the second lens (301) of the complementary dual-channel aperture-coded time-domain compression imaging system (300); The multifunctional digital delayed pulse generator DG645 of the synchronous control system (400) is connected to the digital micromirror device (304) of the complementary dual-channel aperture coded time-domain compression imaging system (300) and the InGaAs infrared camera (310) via data lines. The computer of the data processing and reconstruction system (500) is connected to the digital micromirror device (304) of the complementary dual-channel aperture-coded temporal compression imaging system (300), the InGaAs infrared camera (310), and the DG645 multifunctional digital delayed pulse generator of the synchronization control system (400) via data lines; wherein: The data processing and reconstruction system (500) uses the Plug-and-Play algorithm based on the Alternating Direction Multiplier Method (ADMM) as an optimization iterative framework to reconstruct the temporal compressed image of the two channels, and finally obtains the restored three-dimensional spatiotemporal dynamic scene.

2. The compression imaging type dual-channel encoding near-infrared two-region high-speed fluorescence microscope device according to claim 1, characterized by, The light source and beam expansion system (100) generate excitation light and expand it; the wide-field fluorescence microscopy system (200) guides the excitation light to the fluorescent sample to be tested, and the excitation light excites the fluorescent sample to generate a dynamic fluorescence scene.

3. The compression imaging type dual-channel encoding near-infrared two-region high-speed fluorescence microscope device according to claim 1, characterized by, The complementary dual-channel aperture-coded temporal compression imaging system (300) generates two beams of complementary fluorescent dynamic information by encoding the fluorescence dynamic scene through dual-channel complementary encoding, and realizes temporal compression imaging of two different regions on the InGaAs infrared camera (310) chip.

4. The compression imaging type dual-channel encoding near-infrared two-region high-speed fluorescence microscope device according to claim 1, characterized by The synchronous control system (400) inputs a trigger signal to perform timing control on the digital micromirror device (304) and the InGaAs infrared camera (310), thereby achieving synchronization between encoding switching and image acquisition, so as to achieve the purpose of time-domain compressed imaging.

Citation Information

Patent Citations

  • Four-dimensional high-speed fluorescence microscopic imaging device based on compressed sensing

    CN114895449A

  • Multi-channel compressive sensing-based object recognition

    WO2018164969A1