Super-resolution microscope illumination device and method with continuously adjustable angle

By using a super-resolution microscope illumination device with continuously adjustable angle, combined with a digital micromirror array and a spatial light modulator, seamless switching of multi-mode imaging is achieved, solving the problems of single function and high phototoxicity in existing technologies, and improving the resolution and stability of live cell imaging.

CN121050071APending Publication Date: 2025-12-02GUANGDONG GBA INST OF COLLABORATIVE INNOVATION +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202511210257.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-08-27
Publication Date
2025-12-02

AI Technical Summary

Technical Problem

Existing super-resolution microscopy techniques are limited in function, have high phototoxicity, and poor adaptability in live cell imaging, and cannot meet complex and flexible imaging needs.

Method used

A super-resolution microscope illumination device with continuously adjustable angle is used, combined with LED-DMD excitation optical path, SLM-Laser excitation/optical manipulation optical path and fluorescence microscopy imaging optical path. Multi-mode imaging, including SIM, TIRF, FRAP, optogenetics and holographic optical tweezers, is realized through digital micromirror array and spatial light modulator. Real-time optical manipulation and intensity modulation are realized by using control system.

Benefits of technology

It achieves seamless switching between multiple imaging modes, reduces phototoxicity, is suitable for long-term live cell observation, improves imaging resolution and stability, expands the functional boundaries of microscopic imaging, and supports multi-level high-precision observation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121050071A_ABST
    Figure CN121050071A_ABST
Patent Text Reader

Abstract

The invention discloses an angle continuously adjustable super-resolution microscope illumination device and method. The device comprises a light beam coupling assembly; an LED-DMD excitation light path and a digital micromirror array perform intensity modulation on Kohler illumination light according to a loaded intensity distribution reference pattern, a first light beam is reflected, and the first light beam is projected to a sample plane through a light beam coupling assembly and a conjugate light path in sequence; an SLM-Laser excitation / light control light path, a spatial light modulator performs phase modulation on parallel light according to a loaded phase distribution reference pattern to generate a second light beam, and the second light beam is coupled with the first light beam through a light beam coupling assembly and then is projected to a sample plane; the excitation mode switching module is used for switching a conjugate surface to realize TIRF illumination or spot scanning excitation; the control system realizes seamless switching between a preset light control imaging mode and a real-time light control imaging mode. The problems that a traditional super-resolution microscope is single in function, high in phototoxicity, poor in adaptability and the like are solved, and a more powerful imaging platform can be provided for biomedical research.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of super-resolution microscopy, and in particular to a continuously adjustable angle illumination device and method for super-resolution microscopy. Background Technology

[0002] Structured light super-resolution microscopy (SIM) is a computational super-resolution imaging method based on structured light modulation information, characterized by low phototoxicity and high imaging speed. SIM typically uses multi-beam interference or lattice diffraction to achieve structured light illumination of fringes or grids; the illumination angle determines the spatial frequency and illumination depth of the structured light fringes.

[0003] Current mainstream SIM technology utilizes SLM to generate two- or three-beam interference beams, enabling basic imaging functions such as 2DSIM, 3DSIM, and TIRFSIM through object-plane interference, achieving a 2x improvement in optical resolution. Simultaneously, SIM is a wide-field (WF) imaging method, achieving imaging speeds far exceeding those of point scanning (e.g., confocal microscopy). However, the interference light field constructed by SIM imaging based on multi-beam interference cannot effectively separate the focal and off-focal signals of the sample. Optical sectioning (removing off-focal signals by constructing the difference between focal and off-focal beams) imaging methods can effectively remove off-focal signals; examples include confocal microscopy, light sheet microscopy, and optical sectioning microscopy (e.g., patent number CN202411170660.4).

[0004] SIM super-resolution imaging is particularly suitable for super-resolution imaging of live cells due to its low phototoxicity and fast imaging speed. Besides fluorescence structural imaging, various other imaging methods have been developed in the field of traditional live-cell imaging:

[0005] 1. Total internal reflection fluorescent microscopy (TIRF) uses evanescent waves of total internal reflection light for shallow cell illumination, with an illumination depth of approximately 200 nm, effectively removing defocus signals. It can also be used for stochastic optical reconstruction microscopy (STORM). To achieve uniform TIRF imaging, a ring-shaped converging light is typically constructed at the back focal plane of the objective lens.

[0006] 2. Fluorescence recovery after photobleaching (FRAP) technique

[0007] Fluorescence recovery after photobleaching (FRAP) involves labeling cell membrane proteins or lipids with fluorescent substances, then irradiating the cell membrane with a laser beam to bleach a specific area. If the membrane protein is mobile, the fluorescence of the bleached area will recover after laser irradiation is stopped, and the diffusion rate of the membrane protein or lipid can be calculated based on the recovery rate. FRAP technology typically requires high-power illumination of specific cellular regions for rapid bleaching.

[0008] 3. Optogenetics

[0009] Optogenetics uses light to stimulate channel proteins in nerve cells, causing changes in the electrical potential across the cell membrane and thus selectively stimulating or inhibiting the cell. This typically requires illuminating specific regions of the nerve cell with light of a specific wavelength.

[0010] 4. Holographic Optical Tweezers (HOT)

[0011] Holographic optical tweezers utilize a liquid crystal spatial light modulator (SLM) to perform wavefront phase shaping on the light field, thereby generating an array of optical traps. By loading and converting holographic images in real time via a computer, the position of the optical traps can be controlled. By generating holographic patterns of preset shapes, multiple particles can be captured and manipulated simultaneously in three-dimensional space, allowing for independent dynamic manipulation of particles in any optical trap within the array.

[0012] The aforementioned imaging methods are widely used in the field of live-cell imaging, but they are not combined with live-cell super-resolution technology. Single modalities and functions cannot cope with more complex and flexible imaging scenarios. Summary of the Invention

[0013] The purpose of this invention is to provide an illumination device and method for a super-resolution microscope with continuously adjustable angle, so as to overcome or at least mitigate at least one of the above-mentioned defects of the prior art.

[0014] To achieve the above objectives, the present invention provides an illumination device for a super-resolution microscope with continuously adjustable angle, comprising:

[0015] A beam coupling assembly, consisting of a first optical glass and a second optical glass with an air gap between them, wherein the refractive index n1 of the first optical glass is set to the range of 1.3 to 1.4, and the refractive index n2 of the second optical glass is set to the range of 1.45 to 2.0, and satisfies n1 < 1 / sinθ1, n2 > 1 / sinθ1, θ1 is the incident angle and θ1 = 45° ± Δθ, is used for total internal reflection and transmission coupling of the received first beam and second beam;

[0016] The LED-DMD excitation light path includes an LED Kohler illumination component, a digital micromirror array, and a conjugate light path. The LED Kohler illumination component generates Kohler illumination light with a numerical aperture greater than a set value. The digital micromirror array modulates the intensity of the Kohler illumination light according to the applied intensity distribution reference pattern, and reflects out a first beam. The first beam is then projected onto the sample plane through the beam coupling component and the conjugate light path in sequence.

[0017] The SLM-Laser excitation / optical manipulation optical path includes a parallel light output component, a spatial light modulator, and an excitation mode switching module. The parallel light output component generates polarization-controllable parallel light. The spatial light modulator modulates the phase of the parallel light according to a loaded phase distribution reference pattern to generate a second beam. The second beam is coupled to the first beam through a beam coupling component and then projected onto the sample plane. The excitation mode switching module includes a dual-lens conjugate lens group and a single condenser lens, used to switch the conjugate surface to achieve TIRF illumination or point scan excitation.

[0018] The fluorescence microscopy imaging optical path is used to receive the fluorescence emitted by the sample plane after it is excited and to perform imaging.

[0019] The control system includes a host computer and a controller. The host computer generates a dynamic intensity distribution reference pattern and a phase distribution reference pattern based on real-time fluorescence image feedback, and loads them synchronously to the digital micromirror array and the spatial light modulator through the controller to achieve seamless switching between preset light-manipulated imaging mode and real-time light-manipulated imaging mode. The real-time light-manipulated imaging mode includes three-dimensional optical tweezers manipulation by generating a holographic phase pattern through the spatial light modulator, or super-resolution optical tomography by dynamically selecting area illumination through the digital micromirror array.

[0020] The present invention also provides a method for illuminating a super-resolution microscope with continuously adjustable angles using the above-described continuously adjustable angle super-resolution microscope illumination device, comprising:

[0021] Step 1. Generate Kohler illumination light with a numerical aperture greater than a preset value using LED Kohler illumination components, and load a predefined intensity distribution reference pattern onto the digital micromirror array to dynamically modulate the intensity of the Kohler illumination light to generate the first beam;

[0022] Step 2. Load a phase distribution reference pattern using a spatial light modulator to perform holographic phase modulation on a polarization-controllable parallel laser, generating a second beam;

[0023] Step 3. Use a beam coupling assembly to perform total internal reflection and transmission coupling on the first beam and the second beam to form a composite illumination light field that is projected onto the sample plane;

[0024] Step 4. Based on the real-time acquired fluorescence images, the host computer dynamically generates updated intensity distribution reference patterns and phase distribution reference patterns, and synchronously loads them into the digital micromirror array and spatial light modulator.

[0025] Step 5. Switch operations according to the imaging mode command:

[0026] a. In SIM imaging mode, the digital micromirror array is controlled to cyclically load fringe patterns of 0, π / 3, and 2π / 3 phases, and combined with the spectrum demodulation algorithm to achieve 2x resolution reconstruction;

[0027] b. In optical tweezers mode, control the spatial light modulator to generate a three-dimensional holographic optical trap array, and at the same time use a digital micromirror array to perform dark field masking on non-target areas;

[0028] c. In FRAP mode, a scanning phase sequence is generated based on the coordinates of the selected area, and high-precision laser bleaching and dynamic tracking compensation are achieved through a spatial light modulator.

[0029] The present invention has the following advantages due to the adoption of the above technical solutions:

[0030] 1. Multi-mode integration and flexible switching: By combining the intensity modulation of the Digital Micromirror Devices (DMD) and the phase modulation of the Spatial Light Modulator (SLM), this invention achieves seamless switching between multiple imaging modes, such as SIM super-resolution imaging, optical tomography, TIRF imaging, FRAP photobleaching recovery, optogenetic stimulation, and holographic optical tweezers manipulation, covering the complex and varied experimental needs in live cell imaging and significantly expanding the functional boundaries of microscopic imaging.

[0031] 2. Combining super-resolution and low phototoxicity: Using LED Kohler illumination instead of traditional laser light sources, combined with dynamic loading of stripe patterns by digital micromirror array, it achieves a 2x resolution improvement (SIM mode) while effectively reducing background fluorescence interference and phototoxicity. It is particularly suitable for long-term live cell super-resolution observation and reduces sample damage.

[0032] 3. Real-time dynamic feedback and adaptive control: The control system dynamically generates and loads intensity distribution reference patterns and phase distribution reference patterns based on real-time fluorescence image feedback, supporting functions such as cell position tracking and dynamic compensation of bleached areas. For example, in FRAP mode, the phase distribution is updated in real time through image recognition algorithms to adapt to cell migration and improve experimental accuracy.

[0033] 4. Synergistic Light Field Control and Efficient Optical Path Design: First, the beam coupling assembly: employing a first optical glass (fluoropolymer) and a second optical glass (quartz glass) with refractive index gradient matching, combined with an air gap design (50–200 μm), achieves efficient coupling between the reflected light from the digital micromirror array and the transmitted light from the spatial light modulator, reducing polarization-dependent losses and improving optical path stability. Second, conjugate optical path optimization: filtering out high-order diffraction stray light through an aperture stop, and controlling the numerical aperture of the illumination (continuously adjustable from 1.33 to 1.5) using a relay lens group, ensuring uniformity and high contrast of the light field on the sample plane.

[0034] 5. Multi-wavelength adaptation and high-throughput experiments: The SLM-Laser excitation / optical manipulation optical path integrates a tunable laser (wavelength switching of 405nm, 488nm, 561nm, etc.), supporting the excitation needs of multiple fluorescently labeled samples. At the same time, through digital micromirror array selected illumination and spatial light modulator holographic light field generation, parallel operation of multiple target areas (such as simultaneous optical tweezers manipulation and super-resolution imaging) can be achieved, significantly improving experimental efficiency.

[0035] 6. Application Scenarios Expansion: TIRF and Optical Sectioning Combined Imaging: A ring illumination light is generated by a spatial light modulator to achieve shallow high-contrast imaging (TIRF) of the sample. Combined with wide-field stripe alternating illumination of a digital micromirror array to remove defocus signals (optical sectioning), it supports multi-level high-precision observation from the cell membrane surface to internal organelles.

[0036] 7. Super-resolution FRAP technology: Based on SIM super-resolution imaging, local high-power bleaching is achieved through SLM laser spot scanning, combined with time-series fluorescence analysis to quantify the diffusion rate of membrane proteins, providing a new tool for the study of live cell dynamics.

[0037] This invention solves the problems of traditional super-resolution microscopes, such as single function, high phototoxicity, and poor adaptability, through dynamic light field control, multi-mode synergy, and hardware optimization design. It has achieved significant breakthroughs in resolution, stability, application range, and experimental efficiency, providing a more powerful imaging platform for biomedical research. Attached Figure Description

[0038] Figure 1 This is a system optical path diagram provided in an embodiment of the present invention. The diagram shows the mode in which the dual-lens conjugate lens group 5 is cut in.

[0039] Figure 2 This is a schematic diagram of multi-angle Kohler illumination on a DMD surface provided according to an embodiment of the present invention.

[0040] Figure 3 This is a system optical path diagram provided in an embodiment of the present invention. The diagram shows the mode in which the single focusing lens 6 is cut in.

[0041] Figure 4 This is a schematic diagram of the control system provided in an embodiment of the present invention. In the diagram, solid lines represent data transmission lines and dashed lines represent signal transmission lines.

[0042] Figure 5 This is a schematic diagram of the TIR prism beam combining optical path provided in an embodiment of the present invention;

[0043] Figure 6 This is a schematic diagram of the SIM fluorescence microscopy imaging optical path based on the DMDLED illumination optical path provided in an embodiment of the present invention;

[0044] Figure 7 This is a real-world photograph of the striped structured light field provided in an embodiment of the present invention;

[0045] Figure 8a a, b, and c are schematic diagrams of SIM loaded stripes, different spectral components in the original SIM image, and the extended spectrum obtained by SIM spectrum synthesis, respectively, provided in the embodiments of the present invention.

[0046] Figure 9 This is a schematic diagram of the distribution of LEDDMD lighting stripes along the XZ axis provided in an embodiment of the present invention.

[0047] Figure 10a b is a schematic diagram of the objective lens TIRF illumination provided in an embodiment of the present invention. Figure 10a Schematic diagram of illumination light at different angles of the objective lens; Figure 10b Schematic diagram of ring illumination light with different diameters on the back focal plane of the objective lens;

[0048] Figure 11 This is a schematic diagram of the real-time light manipulation imaging mode provided in an embodiment of the present invention. Detailed Implementation

[0049] In the accompanying drawings, the same or similar reference numerals are used to denote the same or similar elements or elements having the same or similar functions. The embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0050] In the description of this invention, the terms "center," "longitudinal," "lateral," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limiting the scope of protection of this invention.

[0051] like Figure 1 As shown, the continuously adjustable angle super-resolution microscope illumination device provided in this embodiment of the invention includes a beam coupling component, an LED-DMD excitation optical path, an SLM-Laser excitation / light manipulation optical path, a fluorescence microscopy imaging optical path, and a control system for controlling the above three optical paths.

[0052] The LED-DMD excitation optical path includes an LED Kohler lighting component, a digital micromirror array DMD11, and a conjugate optical path.

[0053] The LED Kohler lighting assembly includes an extended LED light source 8 and an LED condenser lens 9. The extended LED light source 8 is located at the rear focal plane of the LED condenser lens 9. The extended LED light source 8 emits divergent incoherent light, which is converged by the LED condenser lens 9 to obtain Kohler lighting light with an aperture larger than a set numerical aperture. The set numerical aperture can be, for example, 1.33 or other values.

[0054] like Figure 2 As shown, the Digital Micromirror Array (DMD11) exhibits light-dark gating characteristics and can be used as an intensity modulation device for a light field. The DMD11 is an array of micromirrors, each switching within ±12° when a digital signal of 1 or 0 is applied. For example, when a signal of 1 is applied, the micromirrors are at +12°, and the reflected light satisfies the total internal reflection condition of the beam coupling component 10, entering the LED-DMD excitation light path. In this case, the mirror with an input signal of 1 is in a gated state, and this area is a bright region. Conversely, the micromirrors with an input signal of 0 do not meet the total internal reflection condition, and the reflected light does not enter the LED-DMD excitation light path, remaining in an ungated state, and this area becomes a dark region. Of course, the angle of the micromirrors can also be ±14.5°, ±17°, or other values ​​currently available on the market.

[0055] Therefore, when the LED-DMD excitation optical path is working, the Kohler illumination light output by the LED Kohler illumination component forms uniform illumination in multiple directions on the surface of the DMD11. The DMD11 is used to modulate the light field intensity distribution of the Kohler illumination light according to the applied intensity distribution reference pattern P1. As mentioned above, the DMD11 is a micromirror array, and each micromirror can tilt ±12°. For an image grayscale value loaded with 1 or 0, when the angle is +12°, the reflected light enters the optical path, and the pixel is "bright"; when the angle is -12°, the reflected light does not enter the optical path, and the pixel is not "dark." This principle achieves light intensity modulation. Furthermore, during modulation, 8-bit grayscale adjustment can be achieved by rapidly switching between different duty cycles of the "bright" and "dark" states.

[0056] After intensity distribution modulation, the Kohler illumination light, which satisfies the total internal reflection condition of the beam coupling component 10, is subsequently projected onto the sample plane 20 through a conjugate optical path. When the digital micromirror array DMD11 is loaded with the intensity distribution reference pattern P1, it will form a structured illumination light with the same distribution as the pattern on the sample plane 20.

[0057] The conjugate optical path includes a first relay lens 12, an aperture stop 13, a second relay lens 14, and a first tube mirror 15.

[0058] The first relay lens 12 and the second relay lens 14 form a conjugate lens group for relaying the pattern of the digital micromirror array DMD11 or the conjugate surface 23 to the corresponding image plane of the microscope Tubelens 15, which is located on the confocal plane of 14 and 15.

[0059] The aperture stop 13 is positioned between the first relay lens 12 and the second relay lens 14. It serves two purposes: first, to filter stray light generated by the blazed grating effect of the digital micromirror array (DMD11); and second, to control the numerical aperture of the illumination light. Therefore, under the constraints of the aperture of the aperture stop 13 and the numerical aperture of the objective lens 19, the pattern on the sample plane 20 is smoother than the intensity distribution reference pattern P1.

[0060] The first tube lens 15 serves as the output end of the conjugate optical path and forms a microscopic fluorescence imaging optical path with the objective lens 19, which has a magnification of M. The front focal plane of the first tube lens 15 is confocal with the second relay lens 14. The front focal plane of the first tube lens 15 is also conjugate with the sample plane 20. Therefore, the image of the front focal plane of the first tube lens 15 can be projected onto the sample plane 20.

[0061] By loading different intensity distribution reference patterns P1 into the LED-DMD excitation light path, different structured light illuminations can be formed, suitable for various scenarios. For example: the intensity distribution reference pattern P1 is a stripe pattern with different directions and phases, which can realize SIM super-resolution imaging; the intensity distribution reference pattern P1 is an alternating illumination of wide field and stripe patterns, which can realize optical tomography; the intensity distribution reference pattern P1 is a discrete spot pattern, which can realize multi-point confocal spot to achieve multi-point confocal imaging in the sample plane 20; the intensity distribution reference pattern P1 is a pattern for selecting ROI, which, combined with SIM, can realize SIM imaging of arbitrary regions; and based on the excitation of local regions of the sample, optogenetic light stimulation and FRAP imaging can be realized.

[0062] The SLM-Laser excitation / light manipulation optical path includes a parallel light output component, a spatial light modulator SLM1, and an excitation mode switching module.

[0063] The parallel light output component includes a half-wave plate 2, a polarizing beam splitter 3, and a collimated wide-beam laser 4. The extended parallel wide beam emitted by the collimated wide-beam laser 4 illuminates the polarizing beam splitter 3. Due to the polarization selectivity of the polarizing beam splitter 3, the beam is reflected by the polarizing beam splitter 3 and passes through the half-wave plate 2, illuminating the spatial light modulator SLM1.

[0064] The spatial light modulator SLM1 is used to modulate the wavefront phase of parallel light according to the phase distribution corresponding to the loaded phase distribution reference pattern P2, thereby causing diffraction and forward propagation.

[0065] The excitation mode switching module is located in the SLM-Laser excitation / optical manipulation optical path where the diffracted light propagates forward. The module includes a dual-lens conjugate lens group 5 and a single condenser lens 6. By switching either the dual-lens conjugate lens group 5 or the single condenser lens 6 into the SLM-Laser excitation / optical manipulation optical path, switching between TIRF illumination light and electrically scanned excitation light is achieved at the conjugate surface 23. The following explains the subsequent optical path principles after the dual-lens conjugate lens group 5 or the single condenser lens 6 is switched into the SLM-Laser excitation / optical manipulation optical path.

[0066] When the double-lens conjugate lens group 5 is switched to the SLM-Laser excitation / optical manipulation optical path, the annular diffracted light forms a converging annular illumination light at the confocal position between the two lenses of the double-lens conjugate lens group 5. The annular illumination light passes through the conjugate optical path of the LED-DMD excitation optical path, is conjugate with the back focal plane 18 of the objective lens, and then passes through the microscope objective lens 19 to form parallel light of annular illumination on the sample plane 20. When the illumination angle is not greater than the total internal reflection angle, the objective lens illumination light is transmitted light, forming wide-field transmitted illumination. When the illumination angle is greater than the total internal reflection angle, a uniform TIRF illumination light will be formed on the sample plane 20. Since the annular illumination light is located on the Fourier spectrum plane of the SLM, the phase distribution of the phase distribution reference pattern P2 can be calculated by inverse Fourier transform through the light field distribution of the annular diffracted light.

[0067] like Figure 3 As shown, when the single focusing lens 6 is switched to the SLM-Laser excitation / optical manipulation optical path, the diffracted light is converged by the lens 6, forming a converged point illumination light on the conjugate surface 23. This point illumination light passes through the conjugate optical path of the LED-DMD excitation optical path and then through the microscope objective 19, forming a point illumination light on the sample plane 20. Specifically, if a gradient-changing phase is applied to the surface of the spatial light modulator SLM1, two-dimensional scanning of the diffracted light can be achieved within the plane containing the conjugate surface 23, thereby obtaining a point scanning excitation light and realizing two-dimensional point scanning on the conjugate surface 23. In other words, this embodiment can realize imaging methods such as FRAP, holographic optical tweezers, and optogenetics by controlling the scanning area on the sample plane 20.

[0068] The beam coupling assembly 10 is used to couple the received beam, and in this embodiment, it serves as a beam combiner for the LED-DMD excitation optical path and the SLM-Laser excitation / optical manipulation optical path. For example... Figure 5 As shown, the beam coupling assembly 10 is composed of a first optical glass ( Figure 5 Glass 1 and the second optical glass (in the middle) Figure 5 The first optical glass is composed of Glass2, with an air gap between them. The first optical glass is made of fluoropolymer glass, and its refractive index n1 is set to a range of 1.3–1.4. The second optical glass can be either soda glass or quartz glass, and its refractive index n2 is set to a range of 1.45–2.0. n1 and n2 can be arbitrarily selected within the pre-approval range, satisfying n1 < 1 / sinθ1 and n2 > 1 / sinθ1, where θ1 is the angle of incidence, θ1 = 45° ± Δθ, and Δθ can be, for example, 2°. θ1 = θ2 = θ6, θ3 = arcsin(sinθ4 / n2), θ2 = arcsin[n2 / n1·sin(θ6-θ3)]. For example, as... Figure 5As shown, θ1=θ2=θ6=45°, θ5=90°, and θ4 is determined by the model of the digital micromirror array DMD11, which is generally 24°. Therefore, n1<1 / sinθ1=1.414, and n2>1 / sinθ1=1.414.

[0069] like Figure 5 In the optical path shown, the wide-field illumination light or electrically scanned excitation light A2 output from the SLM-Laser excitation / optical manipulation optical path is incident on the middle surface of the beam coupling component 10. Because the total internal reflection condition is not met, total internal reflection does not occur, and transmission occurs instead. At the same time, the first beam A1 output from the LED-DMD excitation optical path undergoes total internal reflection on the inclined surface of the second optical glass. Thus, the second beam A2 and the first beam A1 are coupled into a composite beam A via the beam coupling component 10, and the composite beam A is projected onto the sample plane 20 via the conjugate optical path. In this embodiment, the beam coupling component 10 is used as a beam combining device, which can be used for beam combining of the same wavelength, does not have polarization requirements, and can also realize the coupling of the SLM-Laser excitation / optical manipulation optical path and the LED-DMD excitation optical path to achieve dual-path illumination light modulation.

[0070] like Figure 3 As shown, the fluorescence microscopy imaging optical path includes a microscope objective 19, a second tube mirror 16, a dichroic mirror 17, a reflecting mirror 21, and a camera 22. The dichroic mirror 17 is used to separate the excitation light and fluorescence; commonly used microscopes emit light from the side. The reflecting mirror 21 acts as a light deflector. When the fluorescently labeled sample plane 20 is illuminated by the aforementioned illumination light, it emits fluorescence. The fluorescence is received by the microscope objective 19, then passed through the second tube mirror 16, and imaged onto the detector chip of the camera 22.

[0071] In the control system, Figure 4 As shown, the control system includes a digital micromirror array DMD11 (such as LED-DMD excitation optical path) in the DMD11 excitation optical path. Figure 4 DMD), SLM-Laser excitation / optical manipulation optical path spatial light modulator SLM1 (such as DMD), Figure 4 The camera 22 (such as SLM) in the fluorescence microscopy imaging optical path Figure 4 The system comprises a Camera, a Computer, and a Controller. The Computer controls the Camera 22 to capture images, reconstruct and display images, and calculate and generate intensity distribution reference pattern P1 and phase distribution reference pattern P2. The Controller is responsible for high-speed synchronous control of the lower-level computer, as well as controlling the digital micromirror array DMD11 to load intensity distribution reference pattern P1 and the spatial light modulator SLM1 to load phase distribution reference pattern P2.

[0072] The multi-mode optical manipulation imaging method provided by the embodiments of the present invention will be introduced below.

[0073] The imaging control method of the imaging system to which this invention pertains includes a preset light-controlled imaging mode and a real-time light-controlled imaging mode. Wherein:

[0074] The preset light-manipulated imaging mode completes the imaging task through a preset imaging process, along with the intensity distribution reference pattern P1 loaded on the digital micromirror array DMD11 and the phase distribution reference pattern P2 loaded on the spatial light modulator SLM1.

[0075] like Figure 6 As shown, the preset optical manipulation imaging mode includes three sub-modes: SIM imaging mode, optical tomography imaging mode, and TIRF imaging mode. The imaging process for each sub-mode is explained in detail below.

[0076] (I) The SIM imaging mode is used to load multi-phase distributed stripe patterns through a digital micromirror array (DMD), combined with image reconstruction algorithms to achieve resolution improvement. Figure 1 , Figure 4 and Figure 6 The imaging process specifically includes:

[0077] The controller manipulates the digital micromirror array (DMD11) to sequentially load parallel fringe patterns with three phase distributions: 0, 2π / 3, and 4π / 3. Through nine structured light fringe illumination imaging acquisitions, each acquisition successfully forms a pattern on the sample plane. Figure 7 The structured light fringe illumination shown is used; therefore, after three structured light fringe illumination imaging acquisitions, the following results are obtained: Figure 8a The nine original striped lighting images shown are: Figure 8a Nine original fringe illumination images are displayed from top to bottom, showing three phase distributions: 0, 2π / 3, and 4π / 3. All nine original fringe illumination images are transmitted to a host computer, which uses the SIM super-resolution image reconstruction algorithm to separate the phase distributions from the original image spectrum. Figure 8b The nine spectral components shown (the center spectrum is repeated three times) are fused together to obtain the following... Figure 8c The extended spectrum shown allows for the restoration of high-frequency information as the spectrum expands, resulting in a super-resolution image with a 2x increase in resolution, which can then be used for image display or post-processing.

[0078] The super-resolution principle of SIM is based on the modulation and demodulation of image information. In ordinary optical microscopy, due to the limitations of the optical system, it is impossible to collect all the information of the sample, resulting in the loss of high-frequency information. However, SIM super-resolution imaging uses structured light stripe illumination, which allows high-frequency information to be modulated into the low-frequency region and acquired by the camera. By separating and restoring the high-frequency information through reconstruction algorithms, an extended spectrum can be obtained to achieve super-resolution reconstruction.

[0079] In this invention, using LED-DMD to excite the light path illumination has the following advantages:

[0080] 1. Compared with traditional SIM laser light sources, LED light sources can significantly reduce costs and avoid laser safety issues;

[0081] 2. For example Figure 9 As shown, because the LED lighting is Kohler lighting, compared to the traditional SIM lighting mode that uses laser interference lighting, the structured light stripes diverge rapidly along the Z-axis, which can effectively reduce the excitation intensity of background fluorescence, thereby reducing the interference of background fluorescence.

[0082] (II) The optical tomographic imaging mode is used to remove defocus signals by applying alternating wide-field and striped pattern illumination through the digital micromirror array DMD11, combined with... Figure 1 and Figure 6 The imaging process specifically includes:

[0083] The controller controls the digital micromirror array (DMD11) to load a stripe pattern and a wide-field (WF) pattern, thus completing the acquisition in two stages: one for structured light stripe illumination imaging and the other for wide-field illumination imaging. The structured light stripe illumination imaging process is identical to the SIM imaging mode based on the DMDLED excitation path described above, and will not be repeated here. The difference between wide-field illumination imaging and structured light stripe illumination imaging is that after loading a wide-field pattern with full amplitude all 1s (2-bit mode) or full 255s (8-bit mode) onto the DMD11, the DMD11 acts as a reflector, forming a uniformly distributed wide-field illumination light field that is projected onto the sample plane 20, providing uniform wide-field illumination to the sample.

[0084] By controlling a digital micromirror array (DMD11) to load a series of known periodic fringe patterns onto a sample, and then moving these patterns, multiple raw images of optically sectioned layers at different phases are acquired and transmitted to a host computer. The host computer uses the fringe patterns and wide-mode patterns in the raw optically sectioned layer images to perform differential reconstruction, obtaining a reconstructed image of the optically sectioned layer with defocused signals removed, which can then be displayed or post-processed. It should be noted that selectively imaging a specific layer of the sample can avoid interference from the sample background, thus making the image clearer. This technique enables the acquisition of clear images of different depths even for thick samples and reduces image blurring caused by sample thickness.

[0085] The advantages of optical tomography include:

[0086] 1. Using LED Kohler lighting, with a larger numerical aperture, can effectively reduce the loss of chromatic light power caused by the DMD blazed grating effect, and can be compatible with multiple wavelengths without the need for dispersion compensation;

[0087] 2. Both SIM imaging mode and optical section imaging mode can use the same DMDLED excitation optical path illumination for imaging acquisition. By jointly reconstructing the SIM reconstruction algorithm and the optical section reconstruction algorithm, optical section SIM super-resolution reconstruction can be achieved, which can effectively remove the defocus signal in SIM super-resolution imaging and solve the problem of defocus signal interference in traditional laser illumination SIM.

[0088] 3. Using DMD-LED excitation for optical path illumination allows for customized illumination selection. Users can select specific regions within cells for illumination imaging based on the image. In dense cell sample imaging scenarios, localized cell excitation can effectively eliminate signal interference from other systems. This is achieved by selecting a region, dividing it into illuminated bright areas and unilluminated dark areas, and loading these areas into a pattern on the DMD11 digital micromirror array in real time, enabling customized control of the intensity light field distribution. Furthermore, the illuminated bright areas can exhibit structured light stripe distributions for optical tomography and SIM imaging.

[0089] (III) The TIRF imaging mode is used to generate ring illumination light through the spatial light modulator SLM1 to achieve high contrast in the shallow layer of the sample. The imaging process specifically includes:

[0090] Step 1c: Select the dual-lens conjugate lens group 5 in the cutting mode, and load the phase distribution reference pattern P2 through the spatial light modulator SLM1.

[0091] Step 2c, as follows Figure 1As shown, a wide-beam laser source 4 emits laser light to illuminate a polarizing beam splitter 3. When the laser is set to vertical polarization, the polarizing beam splitter reflects the light through a half-wave plate 2 and onto a spatial light modulator (SLM1). The SLM1 is loaded with a phase distribution pattern obtained from the inverse Fourier transform of a ring-shaped diffracted light field. After the SLM1 modulates the phase of the incident light field, the light is reflected again through the half-wave plate 2 and onto the polarizing beam splitter 3. Because the polarization direction is deflected during phase modulation, the light propagates through the polarizing beam splitter 3. On the spectral plane in the middle of the double-lens group 5, due to the Fourier transform of the lenses, a ring-shaped illumination light is formed. After passing through the double-lens group 5, an inclined surface illumination light is formed on the conjugate surface 7. This surface illumination light passes through the beam coupling assembly 10 and is conjugated by the first relay lens 12 and the second relay lens 14 to the back focal plane of the first relay lens 14. After a second Fourier transform by the first tube lens 15, a ring-shaped illumination light is formed again at the rear focal plane 18 of the objective lens. This light then passes through the microscope objective lens 19, forming a tilted surface illumination on the surface of the objective lens 19, as shown below. Figure 11 As shown, when the illumination angle is greater than the total internal reflection condition, TIRF illumination light will be formed on the sample plane 20. Fluorescent markers in the 200nm range near the slide of the fluorescently labeled sample are excited and their fluorescence is collected by the microscope objective 19. The fluorescence is then collected again by the second tube mirror 16 through the dichroic mirror 17, reflected by the mirror 21, and imaged on the detector chip of the camera 22 to obtain a TIRF image. The image is then output to the host computer control interface for image display or image post-processing.

[0092] The ring-shaped illumination light generated by the spatial light modulator SLM1 is conjugated to the back focal plane of the microscope objective 19. An inclined illumination light exits from the microscope objective 19. When the angle of the illumination light is greater than the total internal reflection condition, the sample plane 20 is illuminated by TIRF. Since the evanescent wave penetration depth in TIRF imaging mode is typically less than 200 nm, interference from background fluorescence can be effectively avoided. Generally, the TIRF imaging mode can be extended to single-molecule imaging methods such as STORM and DNAPAINT.

[0093] like Figure 10a As shown, I1 and I2 are illumination lights of different diameters illuminating the back focal plane of the microscope objective 19. Figure 10b This presents the distributions of two annular illumination beams with different diameters, I1 and I2. Taking a 1.5 numerical aperture / 100x objective lens as an example, when the numerical aperture of the illumination is greater than 1.333, the emitted light from the microscope objective 19 satisfies the condition of total internal reflection. In this case, let the numerical aperture of the illumination I1 be 1.4 and the numerical aperture of the illumination I2 be 1.45. Then... Figure 10b The radius r of the numerical aperture for I1 illumination I1 =(NA×f TL ) / M obj=1.4× / 100=2.52mm, where NA is the numerical aperture of I1 illumination, which is 1.4, f TL It is the focal length of the objective lens matching the tube lens, for example, 180mm, M obj For the magnification of microscope objective 19, for example 100x, the radius r of the numerical aperture of illumination I1 can be calculated. I1 It is 2.52 mm. Similarly, the radius r of the numerical aperture of I2 illumination can be obtained. I2 The radius is 2.61 mm. Where NA = nsinθ, derived from the TIRF illumination evanescent wave illumination depth. Where λ is the illumination wavelength and n is the refractive index of the medium, the larger NA is, the larger the illumination angle θ is, and the smaller the evanescent depth Z0 is, typically less than 200 nm, thus effectively avoiding interference from background fluorescence. TIRF imaging can usually be extended to single-molecule imaging methods such as STORM and DNAPAINT.

[0094] In this invention, the TIRF imaging mode based on the "SLM-Laser excitation / optical manipulation optical path" has the following advantages:

[0095] 1. The SLM illumination optical path and the DMD illumination optical path share the same optical axis, which can achieve higher system stability. For example, the SLM illumination field of view and the DMD illumination field of view can be matched through calibration. Because they share the same optical axis, the calibration result can maintain high stability.

[0096] 2. The ring-shaped illumination TIRF generated using SLM exhibits higher illumination uniformity compared to unidirectional illumination TIRF. By applying different SLM phase distributions, the illumination angle of the time-varying TIRF can be adjusted.

[0097] 3. TIRF illumination can be combined with LEDDMD illumination to achieve dual-modal imaging of TIRF and optical tomography. Generally, TIRF has higher slice selection capability than optical tomography and can cover a wider slice range. For example, TIRF can be used for imaging membrane surface proteins, while optical tomography is used for imaging intracellular organelles.

[0098] Real-time light-manipulated imaging mode is used to update the DMD / SLM pattern to complete the imaging task through image, manual selection, automatic position calculation and other methods.

[0099] like Figure 11 The real-time light manipulation imaging mode shown is different from the preset reference pattern used in the preset light manipulation imaging mode. The real-time light manipulation mode is used to update the intensity distribution reference pattern P1 to the digital micromirror array DMD11 or the phase distribution reference pattern P2 to the spatial light modulator SLM1 based on the online image through user settings and image calculation.

[0100] The real-time light manipulation mode is also used to calculate the intensity distribution reference pattern P1 in real time and update it to the digital micromirror array DMD11, or the phase distribution reference pattern P2 and update it to the spatial light modulator SLM1, based on the online image and through methods such as user manual operation, image distribution, and event trigger judgment, in order to complete the imaging task.

[0101] One possible update method is as follows: the detection surface of camera 22 is a conjugate surface with digital micromirror array (DMD11) or spatial light modulator (SLM1), and the two images have the same distribution and a phase difference magnification factor of M. In the host computer, image Im1 is acquired by the camera. The user delineates a selected area on Im1, or automatically delineates a cell region as a selected area through an edge detection algorithm. The selected area image is used to generate image Im2, which is loaded into digital micromirror array (DMD11) or spatial light modulator (SLM1). The host computer downloads Im2 to digital micromirror array (DMD11) or spatial light modulator (SLM1) through a communication protocol. The controller triggers digital micromirror array (DMD11) or spatial light modulator (SLM1) to load image Im2.

[0102] The real-time optical manipulation imaging mode includes three sub-modes: FRAP imaging, optogenetic imaging, and optical tweezers imaging. FRAP imaging generates a scanning phase pattern using a spatial light modulator (SLM1) to monitor photobleaching and fluorescence recovery in a selected region. Optogenetic imaging modulates a light field using the SLM1 to stimulate specific cellular regions. Optical tweezers imaging generates a holographic phase pattern using the SLM1 to achieve three-dimensional capture and manipulation of microparticles.

[0103] This invention enables three lighting modes: laser point scanning illumination, laser area-based illumination, and LED area-based illumination. The principle is as follows:

[0104] 1. Laser point scanning illumination: The phase distribution of the illumination light is changed by loading a gradient periodically through a spatial light modulator, which modulates the wavefront of the illumination light. The SLM acts as a blazed grating. By loading phase grating stripes with different periods and directions, different blazed angles can be achieved, thus modulating the beam angle.

[0105] By combining a single focusing lens 6, two-dimensional point scanning illumination can be achieved on the conjugate surface 23.

[0106] 2. Laser regional illumination: When the dual-lens conjugate lens group 5 is used for insertion, the SLM surface is conjugate with the conjugate surface 23 and the sample plane 20. At this time, the spatial light modulator SLM1 can be loaded with a full 0-phase phase to act as a reflector, achieving bright area illumination. In non-illuminated areas, a high-frequency phase pattern is loaded, causing the illumination light to deviate from the principal optical axis and not enter the optical path or be blocked by the aperture stop in the optical path, thus achieving dark area illumination. Therefore, the spatial light modulator SLM1 can also achieve regional bright and dark illumination.

[0107] 3. LED regional surface lighting: As a light intensity modulation device, DMD itself can realize the gated lighting of a custom area on the DMD two-dimensional micro-mirror array to achieve regional surface lighting.

[0108] 3.2.1 FRAP Imaging Workflow

[0109] Taking FRAP imaging as an example, the principle of FRAP imaging is as follows: FRAP labels cell membrane proteins or lipids with fluorescent substances, and then irradiates the cell membrane with a laser beam, causing fluorescence bleaching in a certain area. If the membrane protein is fluid, the fluorescence of the bleached area can be restored after the laser irradiation is stopped. The diffusion rate of the membrane protein or lipid can be calculated based on its recovery rate. FRAP technology usually requires high-power illumination of specific cellular regions for rapid bleaching.

[0110] Therefore, in this system, laser point scanning illumination can be used to achieve local high-power illumination. Compared with LEDs, lasers can achieve higher light power density. By excitation through a convergence point, faster photobleaching illumination can be achieved in local areas.

[0111] The control system achieves FRAP imaging mode through the following steps:

[0112] S1, turn on the light source of the LED-DMD excitation optical path, and insert a single focusing lens 6 into the SLM-Laser excitation / light manipulation optical path to enter the point excitation mode;

[0113] S2, in the preset light manipulation imaging mode, the cell fluorescence imaging is captured in any sub-mode, and the selected area that needs to be photobleached or photostimulated is selected on the image.

[0114] S3, calculate and generate the phase distribution reference pattern sequence corresponding to the selected area based on the location of the selected area, and update it to the spatial light modulator SLM1;

[0115] S5, the second beam A2 is controlled by the spatial light modulator SLM1 to scan the position of the selected area, the selected area is light-bleached, and then the light source of the LED-DMD excitation light path is turned off;

[0116] S6, use any sub-mode in the preset light manipulation imaging mode to take pictures of cells according to the time sequence, and obtain images of cell fluorescence changing over time;

[0117] S7. By analyzing the fluorescence intensity over time in the selected region through image analysis, the FRAP fluorescence bleaching recovery curve is obtained.

[0118] S8, the user can manually set or determine the cell position based on the image recognition algorithm, and automatically update the phase or intensity distribution pattern to update the selected area when the cell position changes dynamically, and then return to step S3.

[0119] In FRAP imaging mode, the DMD-LED illumination optical path and the SLM-Laser excitation / optical manipulation optical path jointly complete the imaging process. Specifically, the LED-DMD excitation optical path performs the imaging process, while the SLM-Laser excitation / optical manipulation optical path performs the fluorescence bleaching manipulation. This invention achieves super-resolution FRAP functionality based on the combined functions of SIM imaging and laser bleaching.

[0120] FRAP SIM fluorescence microscopy imaging optical path principle:

[0121] like Figure 1 As shown, the extended LED light source 8 serves as the excitation source, emitting divergent incoherent light, which is focused by the condenser lens 9 and then converged through the beam coupling assembly 10 onto the surface of the digital micromirror array DMD11 to form Kohler illumination. At this time, the digital micromirror array DMD11 is loaded with... Figure 7 The striped pattern shown in the left figure is formed by the digital micromirror array (DMD11) modulating the intensity of the Kohler illumination field, creating a wide-field illumination field with a striped distribution. The reflected light from the DMD11 undergoes total internal reflection via the beam coupling assembly 10 and is collected by the first relay lens 12. The first relay lens 12 and the second relay lens 14 form a conjugate lens group, which shapes the striped light field modulated by the DMD11 onto the back focal plane of the second relay lens 14, as shown in the figure. Figure 7 The structured light fringe field shown has an aperture stop 13 between the first relay lens 12 and the second relay lens 14 to filter out higher-order diffraction light generated by the digital micromirror array (DMD) 11. The first tube mirror 15 and the microscope objective 19 conjugate the fringe light field to the sample plane 20, forming structured light illumination of the sample. When the fluorescently labeled sample is excited, its fluorescence is collected by the objective 19, passes through the dichroic mirror 17, is converged by the tube mirror 16, and reflected by the mirror 21 before being imaged on the surface of the detector chip in the camera 22. Figure 4 The control flow shown will control the camera 22, digital micromirror array DMD11, and LED light source 8 to complete SIM imaging acquisition.

[0122] FRAP photobleaching optical path principle:

[0123] like Figure 1 As shown, a wide-beam laser source 4 emits laser light to illuminate a polarizing beam splitter 3. When the laser is set to vertical polarization, the polarizing beam splitter reflects the light through a half-wave plate 2 and onto a spatial light modulator (SLM1). The SLM1 is loaded with a light tilt phase distribution calculated based on FRAP optical bleaching at the image plane position. After phase modulation of the incident light field, the light is reflected again through the half-wave plate 2 and onto the polarizing beam splitter 3. Because the polarization direction is deflected during phase modulation by the SLM1, the light will propagate through the polarizing beam splitter 3. After the single lens 6 converges the parallel light reflected from the SLM, a converging point illumination is formed on the conjugate surface 7, and the illumination position is conjugate to the bleaching position set on the sample plane 20. This illumination light passes through the beam coupling assembly 10 and is conjugate to the back focal plane of the second relay lens 14 by the first relay lens 12 and the second relay lens 14. Through the conjugation of the first tube lens 15 and the microscope objective 19, a converging point excitation illumination is formed on the sample plane 20. Because the excitation point is conjugate with the conjugate surface 10, when the spatial light modulator SLM1 is loaded with different tilted phase patterns, it will perform point scanning according to the bleaching area set by the user. When the laser source 4 is set to high power, it will rapidly bleach the corresponding area of ​​the sample plane 20. After bleaching, SIM imaging of the sample can be performed to observe the fluorescence recovery phenomenon of the bleached area over time. By statistically analyzing the fluorescence change values, the FRAP fluorescence bleaching recovery curve is obtained.

[0124] In this invention, the spatial light modulator SLM1 can also be loaded with a phase distribution conjugate with the sample plane 20 to form surface illumination bleaching. By loading a phase distribution in multiple regions, multi-point FRAP bleaching function can be achieved. In this invention, the DMD illumination optical path can also be loaded with a pattern distribution conjugate with the sample plane 20 to realize the DMD optical path for fluorescence bleaching.

[0125] In this invention, the advantages of the real-time light-manipulated imaging mode are as follows:

[0126] 1. It can be combined with SIM, optical layer cutting, TIRF, WF and other modes to realize optical control navigation. For example, combined with SIM super resolution, it can realize higher precision navigation and realize super resolution FRAP function.

[0127] 2. Surface and point excitation can be switched freely, combining the high efficiency of surface illumination with the high power density of point scanning;

[0128] 3. The method of updating the reference pattern in real time can realize intelligent light-controlled imaging. For example, in the live cell imaging scenario, long-term live cell imaging will cause cell migration. By taking pictures and calculating the position of the correction pattern, the automatic imaging method can intelligently track the cell position and realize real-time dynamic light control.

[0129] In the above embodiments, the angle-adjustable super-resolution microscope illumination method implemented using the angle-adjustable super-resolution microscope illumination device described in the above embodiments includes:

[0130] Step 1. Generate Kohler illumination light with a numerical aperture greater than a preset value using LED Kohler illumination components, and load a predefined intensity distribution reference pattern P1 onto the digital micromirror array to dynamically modulate the intensity of the Kohler illumination light to generate the first beam A1;

[0131] Step 2. Load the phase distribution reference pattern P2 through a spatial light modulator to perform holographic phase modulation on the polarization-controllable parallel laser and generate a second beam A2;

[0132] Step 3. Use a beam coupling assembly to perform total internal reflection and transmission coupling on the first beam A1 and the second beam A2 to form a composite illumination light field that is projected onto the sample plane;

[0133] Step 4. Based on the real-time acquired fluorescence images, the host computer dynamically generates updated intensity distribution reference pattern P1 and phase distribution reference pattern P2, and synchronously loads them into the digital micromirror array and spatial light modulator.

[0134] Step 5. Switch operations according to the imaging mode command:

[0135] a. In SIM imaging mode, the digital micromirror array is controlled to cyclically load fringe patterns of 0, π / 3, and 2π / 3 phases, and combined with the spectrum demodulation algorithm to achieve 2x resolution reconstruction;

[0136] b. In optical tweezers mode, control the spatial light modulator to generate a three-dimensional holographic optical trap array, and at the same time use a digital micromirror array to perform dark field masking on non-target areas;

[0137] c. In FRAP mode, a scanning phase sequence is generated based on the coordinates of the selected area, and high-precision laser bleaching and dynamic tracking compensation are achieved through a spatial light modulator.

[0138] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them. Those skilled in the art should understand that modifications can be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An illumination device for a super-resolution microscope with continuously adjustable angle, characterized in that, include: A beam coupling assembly, consisting of a first optical glass and a second optical glass with an air gap between them, wherein the refractive index n1 of the first optical glass is set to the range of 1.3 to 1.4, and the refractive index n2 of the second optical glass is set to the range of 1.45 to 2.0, and satisfies n1 < 1 / sinθ1, n2 > 1 / sinθ1, θ1 is the incident angle and θ1 = 45° ± Δθ, is used for total internal reflection and transmission coupling of the received first beam and second beam; The LED-DMD excitation light path includes an LED Kohler illumination component, a digital micromirror array, and a conjugate light path. The LED Kohler illumination component generates Kohler illumination light with a numerical aperture greater than a set value. The digital micromirror array modulates the intensity of the Kohler illumination light according to the applied intensity distribution reference pattern (P1) and reflects out a first beam (A1). The first beam (A1) is then projected onto the sample plane through the beam coupling component and the conjugate light path in sequence. The SLM-Laser excitation / optical manipulation optical path includes a parallel light output component, a spatial light modulator, and an excitation mode switching module. The parallel light output component generates polarization-controllable parallel light. The spatial light modulator modulates the phase of the parallel light according to the loaded phase distribution reference pattern (P2) to generate a second beam (A2). The second beam (A2) is coupled to the first beam (A1) through a beam coupling component and then projected onto the sample plane. The excitation mode switching module includes a dual-lens conjugate lens group and a single condenser lens, used to switch the conjugate surface to achieve TIRF illumination or point scan excitation. The fluorescence microscopy imaging optical path is used to receive the fluorescence emitted by the sample plane after it is excited and to perform imaging. The control system includes a host computer and a controller. The host computer generates a dynamic intensity distribution reference pattern (P1) and a phase distribution reference pattern (P2) based on real-time fluorescence image feedback, and loads them synchronously to the digital micromirror array and the spatial light modulator through the controller to achieve seamless switching between preset light-manipulated imaging mode and real-time light-manipulated imaging mode. The real-time light-manipulated imaging mode includes three-dimensional optical tweezers manipulation by generating a holographic phase pattern through the spatial light modulator, or super-resolution optical tomography by dynamically selecting area illumination through the digital micromirror array.

2. The continuously adjustable angle super-resolution microscope illumination device as described in claim 1, characterized in that, The conjugate optical path includes a first relay lens, an aperture stop, and a second relay lens. The aperture stop is located between the two relay lenses and is used to filter out high-order diffraction stray light generated by the digital micromirror array. The illumination numerical aperture is continuously adjustable within a preset range by adjusting the aperture size.

3. The continuously adjustable angle super-resolution microscope illumination device as described in claim 1, characterized in that, Preset light-controlled imaging modes include: SIM imaging mode: A 2x resolution improvement is achieved by loading multi-phase stripe patterns through a digital micromirror array and combining them with an image spectrum demodulation algorithm; Optical tomographic imaging mode: Wide field and stripe patterns are alternately loaded by a digital micromirror array, and defocus signals are removed by combining differential reconstruction algorithm; TIRF imaging mode: A ring phase pattern is generated by a spatial light modulator, and a total reflection angle illumination is formed at the back focal plane of the objective lens by a double-lens conjugate lens group to achieve shallow evanescent wave excitation of the sample.

4. The continuously adjustable angle super-resolution microscope illumination device as described in claim 1, characterized in that, The real-time light manipulation imaging mode is used to calculate the intensity distribution reference pattern (P1) online based on the online image and load it into the digital micromirror array, or to calculate the phase distribution reference pattern (P2) and load it into the spatial light modulator. It is also used to calculate the intensity distribution reference pattern (P1) in real time based on the image distribution and selected area and load it into the digital micromirror array, or to calculate the phase distribution reference pattern (P2) and load it into the spatial light modulator for imaging. Real-time light-manipulated imaging modes include: FRAP imaging mode: A scanning phase pattern is generated by a spatial light modulator to photobleach a selected area, and the recovery curve is analyzed based on time-series fluorescence images; Optogenetic imaging mode: Dynamic light stimulation of specific cell regions is achieved by modulating the light field through a spatial light modulator, and the stimulation parameters are matched with changes in cell potential in real time; Optical tweezers imaging mode: A three-dimensional optical trap array is generated by loading a holographic phase pattern through a spatial light modulator, enabling independent capture and dynamic manipulation of particles.

5. The continuously adjustable angle super-resolution microscope illumination device as described in claim 4, characterized in that, The steps to implement FRAP imaging mode include: S1. Insert the single focusing lens and start the LED-DMD excitation light path to acquire fluorescence images and select the areas that need photobleaching or photostimulation; S2. Generate a phase distribution sequence based on the selected region coordinates, use it as a phase distribution reference pattern (P2), load it into the spatial light modulator, and start laser point scanning bleaching; S3. Turn off the light source in the LED-DMD excitation light path and acquire time-series fluorescence images using a preset mode; S4. Combine image recognition algorithms to dynamically track cell positions and update the phase distribution sequence in real time to adapt to the selected region, then return to step S2.

6. The continuously adjustable angle super-resolution microscope illumination device as described in claim 1, characterized in that, The first optical glass of the beam coupling assembly is fluoropolymer glass, and the second optical glass is quartz glass, with an air gap thickness of 50-200 μm, which is used to reduce polarization-dependent loss of the coupled optical path.

7. The continuously adjustable angle super-resolution microscope illumination device as described in claim 1, characterized in that, The control system achieves multi-mode cooperative imaging in the following ways: Method 1: In SIM imaging mode, the digital micromirror array is simultaneously controlled to load the stripe pattern and the spatial light modulator generates a compensated phase to suppress defocus background noise. Method 2: In optical tweezers mode, by combining digital micromirror array selective illumination and spatial light modulator holographic manipulation, particle capture and super-resolution imaging can be performed simultaneously.

8. The continuously adjustable angle super-resolution microscope illumination device as described in claim 1, characterized in that, In the excitation mode switching module, when the dual-lens conjugate lens group is switched to the SLM-Laser excitation / optical manipulation optical path, the second beam (A2) can realize TIRF illumination light on the conjugate surface; when the single condenser lens is switched to the SLM-Laser excitation / optical manipulation optical path, the second beam (A2) can realize point scanning excitation light on the conjugate surface.

9. The continuously adjustable angle super-resolution microscope illumination device as described in claim 1, characterized in that, In the SLM-Laser excitation / light manipulation optical path, the parallel light output component includes a tunable laser and a polarizing beam splitter. The laser wavelength can be switched in real time to at least two of 405nm, 488nm, 561nm, and 640nm to adapt to the excitation requirements of multi-fluorescent labeled samples.

10. A method for illuminating a super-resolution microscope with continuously adjustable angles, implemented using any one of the above-described 1-9 illumination devices, characterized in that... include: Step 1. Generate Kohler illumination light with a numerical aperture greater than a preset value using LED Kohler illumination components, and load a predefined intensity distribution reference pattern (P1) onto the digital micromirror array to dynamically modulate the intensity of the Kohler illumination light to generate the first beam (A1); Step 2. Load a phase distribution reference pattern (P2) using a spatial light modulator to perform holographic phase modulation on the polarization-controllable parallel laser to generate a second beam (A2); Step 3. Use a beam coupling assembly to perform total internal reflection and transmission coupling on the first beam (A1) and the second beam (A2) to form a composite illumination light field that is projected onto the sample plane; Step 4. Based on the real-time acquired fluorescence images, the host computer dynamically generates updated intensity distribution reference patterns (P1) and phase distribution reference patterns (P2), and synchronously loads them into the digital micromirror array and spatial light modulator. Step 5. Switch operations according to the imaging mode command: a. In SIM imaging mode, the digital micromirror array is controlled to cyclically load fringe patterns of 0, π / 3, and 2π / 3 phases, and combined with the spectrum demodulation algorithm to achieve 2x resolution reconstruction; b. In optical tweezers mode, control the spatial light modulator to generate a three-dimensional holographic optical trap array, and at the same time use a digital micromirror array to perform dark field masking on non-target areas; c. In FRAP mode, a scanning phase sequence is generated based on the coordinates of the selected area, and high-precision laser bleaching and dynamic tracking compensation are achieved through a spatial light modulator.

Citation Information

Patent Citations

  • Three-dimensional optical section microscopic imaging system and imaging method based on DMD and LED

    CN118688172A