High-resolution multicolor fluorescence imaging system and fluorescence imaging system

Through the angle and phase modulation of multi-color LED light source and grating, combined with light filtering and capture objective lens, high-resolution multi-color fluorescence imaging is achieved, solving the problem of poor imaging resolution and multi-color imaging effects in the prior art. More comprehensive high-resolution images.

CN118937284APending Publication Date: 2024-11-12UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310536515.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-12
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The existing multi-color fluorescence imaging devices have many challenges in achieving high-resolution imaging, especially in grating angle and phase modulation, which makes it difficult to effectively improve imaging resolution and multi-color imaging effects.

Method used

Using multi-color LED light source and modulation objective lens, by adjusting the angle and phase of the grating, combining the filter unit and the capture objective lens, multi-angle and multi-phase acquisition of fluorescent images is achieved, and image synthesis is used to generate high-resolution Multicolor fluorescent images.

Benefits of technology

It realizes the acquisition of fluorescence images of different grating angles, phases and wavelengths, improves imaging resolution and multi-color imaging effects, provides a more comprehensive high-resolution image, and solves the imaging resolution and multi-color imaging in the prior art. The problem of poor results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118937284A_ABST
    Figure CN118937284A_ABST
Patent Text Reader

Abstract

A high-resolution multicolor fluorescence imaging system comprises a multicolor LED light source used for emitting excitation light waves with different wavelengths in a time-sharing manner; the grating is used for modulating the excitation light wave into cosine structured light; the modulation objective lens is arranged on a light path of the cosine structured light and is used for projecting the cosine structured light; the objective table 240 is used for bearing a sample, the sample is used for receiving the cosine structured light projected by the modulation objective lens and forming a projection pattern on the surface, and the sample is excited to generate fluorescence; the moving unit is used for adjusting the grating to change the angle and the phase of the grating, so that the projection pattern received by the sample is changed; the light filtering unit is used for filtering the fluorescent light; the capturing objective lens is used for receiving the filtered fluorescent light and emitting the fluorescent light; and the imaging unit is used for sensing the fluorescence emitted by the capturing objective lens to obtain a fluorescence image. The high-resolution multicolor fluorescence imaging system can automatically acquire multicolor fluorescence images under different grating phases and angles, and is very convenient.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of computational microscopic imaging, and in particular to a high-resolution multi-color fluorescence imaging system and a fluorescence imaging system. Background Art

[0002] Multicolor fluorescence imaging is often used to better perform pathological analysis and better understand biological processes, and is an important research method in the biomedical field. Structured illumination microscopy (SIM) is one of the fastest-growing fluorescence microscopy technologies. As an extension of wide-field fluorescence microscopy, it can provide resolution beyond the diffraction limit, and also has the advantages of fast imaging speed and multicolor imaging. It has broad application prospects in biomedicine and other fields. By applying a high spatial frequency cosine structured light illumination field to the sample, the high-frequency information beyond the diffraction limit is mixed with the low-frequency information, and multiple images with different illumination modes are obtained, so that the high-frequency information can be frequency-shifted to the original position, thereby reconstructing a high-resolution image.

[0003] How to achieve multi-color fluorescence imaging is one of the hot topics of research for technicians. Currently, there are still many problems in multi-color fluorescence imaging devices that need to be improved. Summary of the invention

[0004] In view of the above problems, the present invention provides a high-resolution multi-color fluorescence imaging system and a fluorescence imaging system, which are described in detail below.

[0005] According to the first aspect, an embodiment provides a high-resolution multi-color fluorescence imaging system, comprising:

[0006] A multi-color LED light source is used to emit excitation light waves of different wavelengths in different time periods; the multi-color LED light source is preset with multiple wavelengths;

[0007] A grating, used for modulating the excitation light wave into a cosine structured light; the grating is preset with multiple angles and multiple phases;

[0008] A modulation objective lens, disposed on the optical path of the cosine structured light, and used for projecting the cosine structured light;

[0009] A stage for carrying a sample; the sample on the stage is used to receive the cosine structured light projected by the modulating objective lens and form a projection pattern on the surface, and the sample is stimulated to generate fluorescence;

[0010] A moving unit, used for adjusting the grating to change the angle and phase of the grating, so that the projection pattern received by the sample changes;

[0011] A filter unit, used for filtering the fluorescence;

[0012] A capture objective lens, used to receive and emit the fluorescence after filtering; the numerical aperture of the modulation objective lens is greater than the numerical aperture of the capture objective lens;

[0013] An imaging unit, used to sense the fluorescence emitted by the capture objective lens to obtain a fluorescence image, wherein:

[0014] For multiple angles, the moving unit adjusts the grating from one angle to the last angle, and when the moving unit adjusts the grating to any angle: the moving unit adjusts the grating from one phase to the last phase, and when the moving unit adjusts the grating to any phase: the LED light source starts to emit excitation light waves of different wavelengths in time-sharing from one wavelength until the last wavelength, wherein after the imaging unit completes shooting, the LED light source is notified to switch from the current wavelength to the next wavelength until the last wavelength is switched, and then the moving unit is notified to switch the grating from the current phase to the next phase until the last phase is switched, and then the moving unit is notified to switch the grating from the current angle to the next angle until the last angle is switched, so that the imaging unit obtains multiple fluorescence images, each fluorescence image corresponds to an excitation light wave of different wavelength, a grating of different angle and phase; the imaging unit synthesizes a multi-color high-resolution image according to the multiple fluorescence images.

[0015] In a possible implementation, the angles include 0°, 60°, and 120°; and the phases include 0, 2π / 3, and 4π / 3.

[0016] In a possible implementation, the high-resolution multi-color fluorescence imaging system further includes a lens, which is disposed on an optical path of the excitation light wave and is used to emit the excitation light wave as parallel light to the grating.

[0017] In a possible implementation, the filter unit includes a plurality of filters corresponding to fluorescence of different wavelengths, and the excitation light waves of different wavelengths excite the sample to emit fluorescence of different wavelengths.

[0018] According to the second aspect, an embodiment provides a fluorescence imaging system, comprising:

[0019] LED light source, used to emit excitation light waves;

[0020] A grating, used for modulating the excitation light wave into a cosine structured light;

[0021] A modulation objective lens, disposed on the optical path of the cosine structured light, and used for projecting the cosine structured light;

[0022] A stage for carrying a sample; the sample on the stage is used to receive the cosine structured light projected by the modulating objective lens and form a projection pattern on the surface, and the sample is stimulated to generate fluorescence;

[0023] A filter unit, used for filtering the fluorescence;

[0024] A capture objective lens, used to receive and emit the fluorescence after filtering; the numerical aperture of the modulation objective lens is greater than the numerical aperture of the capture objective lens;

[0025] An imaging unit is used to sense the fluorescence emitted by the capture objective lens to obtain a fluorescence image.

[0026] In a possible implementation, the LED light source is a multi-color LED light source, which is preset with multiple wavelengths, and the multi-color LED light source is used to emit excitation light waves of different wavelengths in time division;

[0027] After the imaging unit captures an image, it notifies the LED light source to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit obtains multiple fluorescent images; the imaging unit synthesizes a multi-color high-resolution image based on the multiple fluorescent images.

[0028] In a possible implementation, the filter unit includes a plurality of filters corresponding to fluorescence of different wavelengths, and the excitation light waves of different wavelengths excite the sample to emit fluorescence of different wavelengths.

[0029] In a possible implementation, the fluorescence imaging system further includes a moving unit, and the moving unit is used to adjust the grating to change the angle and phase of the grating, so that the projection pattern received by the sample changes;

[0030] The imaging unit is also used to notify the moving unit to adjust the grating to change the angle and phase of the grating so that the projection pattern received by the sample changes, thereby obtaining a plurality of the fluorescence images; the imaging unit synthesizes a high-resolution image based on the plurality of the fluorescence images.

[0031] In a possible implementation, the angles include 0°, 60°, and 120°; and the phases include 0, 2π / 3, and 4π / 3.

[0032] In a possible implementation, the fluorescence imaging system further includes a lens, which is disposed on an optical path of the excitation light wave and is used to emit the excitation light wave to the grating as parallel light.

[0033] According to the high-resolution multi-color fluorescence imaging system implemented as above, its multi-color LED light source is used to emit excitation light waves of different wavelengths in time-sharing, and its grating is preset with multiple angles and multiple phases, and, for multiple angles, the moving unit adjusts the grating from one angle to the last angle, and when the moving unit adjusts the grating to any one of the angles: the moving unit adjusts the grating from one phase to the last phase, and when the moving unit adjusts the grating to any one of the phases: the LED light source emits excitation light waves of different wavelengths in time-sharing from one wavelength until the last wavelength, wherein when the imaging unit senses the fluorescence for shooting, it notifies the LED light source to switch from the current wavelength to the next wavelength , until it switches to the last wavelength, and then notifies the mobile unit to switch the grating from the current phase to the next phase, until it switches to the last phase, and then notifies the mobile unit to switch the grating from the current angle to the next angle, until it switches to the last angle, so that the imaging unit obtains multiple fluorescence images, each fluorescence image corresponds to an excitation light wave of a different wavelength, a grating of a different angle and phase; so that the imaging unit can finally obtain multiple fluorescence images, these fluorescence images correspond to different grating angles, phases and different wavelengths of excitation light waves, therefore, the high-resolution multi-color fluorescence imaging system can automatically obtain multi-color fluorescence images corresponding to different grating angles, phases and different wavelengths of excitation light waves, which provides a good foundation for the final synthesized multi-color high-resolution image;

[0034] The high-resolution multi-color fluorescence imaging system and the fluorescence imaging system implemented as above have an LED light source for emitting an excitation light wave, a grating for modulating the excitation light wave into a cosine structured light, a modulation objective lens, a stage for carrying a sample, a capture objective lens and an imaging unit, and the numerical aperture of the modulation objective lens is larger than the numerical aperture of the capture objective lens. Compared with the optical path structure design in the prior art that uses the same objective lens for both projecting cosine structured light and receiving fluorescence, the present invention uses two different objective lenses, namely a modulation objective lens and a capture objective lens, which are respectively used to project cosine structured light and receive fluorescence emitted by the sample, and the numerical aperture of the modulation objective lens is larger than the numerical aperture of the capture objective lens. This design enables the optical path structure to improve the imaging resolution. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 is a schematic structural diagram of a fluorescence imaging system according to an embodiment;

[0036] Figure 2 is a schematic structural diagram of a fluorescence imaging system according to an embodiment;

[0037] Figure 3A schematic diagram of a fluorescence image under a high-resolution multi-color fluorescence imaging system according to an embodiment;

[0038] Figure 4 is a schematic structural diagram of a fluorescence imaging system according to an embodiment;

[0039] Figure 5 A schematic diagram of the structure of a structured light illumination microscope according to an embodiment;

[0040] Figure 6 It is a schematic diagram showing that after irradiating the sample with cosine structured light, the two light spots seen in the observation field can be separated further for easier observation and resolution under an embodiment. DETAILED DESCRIPTION

[0041] The present invention is further described in detail below by specific embodiments in conjunction with the accompanying drawings. Wherein similar elements in different embodiments adopt associated similar element numbers. In the following embodiments, many detailed descriptions are for making the present application better understood. However, those skilled in the art can easily recognize that some features can be omitted in different situations, or can be replaced by other elements, materials, methods. In some cases, some operations related to the present application are not shown or described in the specification, this is to avoid the core part of the present application being overwhelmed by too much description, and for those skilled in the art, it is not necessary to describe these related operations in detail, and they can fully understand the related operations according to the description in the specification and the general technical knowledge in the art.

[0042] In addition, the features, operations or characteristics described in the specification can be combined in any appropriate manner to form various implementations. At the same time, the steps or actions in the method description can also be interchanged or adjusted in a manner that is obvious to those skilled in the art. Therefore, the various sequences in the specification and the drawings are only for the purpose of clearly describing a certain embodiment and are not meant to be a required sequence, unless otherwise specified that a certain sequence must be followed.

[0043] The serial numbers of the components in this document, such as "first", "second", etc., are only used to distinguish the objects described and do not have any order or technical meaning. The "connection" and "coupling" mentioned in this application, unless otherwise specified, include direct and indirect connections (couplings).

[0044] The fluorescence imaging system provided by some embodiments of the present invention can be applied to any device that needs to form a fluorescence image of an observed sample, such as a fluorescence microscope. Figure 1As shown, the fluorescence imaging system of some embodiments includes an LED light source 210, a grating 220, a modulating objective lens 230, a stage 240, a filter unit 250, a capture objective lens 260 and an imaging unit 270. The LED light source 210 is used to emit an excitation light wave; the grating 220 is used to modulate the excitation light wave into a cosine structured light; the modulating objective lens 230 is arranged on the optical path of the cosine structured light and is used to project the cosine structured light; the stage 240 is used to carry a sample, and the sample on the stage 240 is used to receive the cosine structured light projected by the modulating objective lens 230 and form a projection pattern on the surface, and the sample is stimulated to generate fluorescence; the filter unit 250 is used to filter the fluorescence; the capture objective lens 260 is used to receive the filtered fluorescence and emit it; the imaging unit 270 is used to sense the fluorescence emitted by the capture objective lens 260 to obtain a fluorescence image (i.e., to take an image). A more detailed description is given below.

[0045] In some embodiments of the present invention, an LED light source 210 is used instead of a laser light source, so as to reduce the influence of speckle noise caused by the laser.

[0046] In some embodiments, the LED light source 210 is a multi-color LED light source 210, which is preset with multiple wavelengths, and the excitation light waves of different wavelengths are used to excite the sample to emit fluorescence of different wavelengths. In some embodiments, the multi-color LED light source 210 is used to emit excitation light waves of different wavelengths in time division. In some embodiments, after the imaging unit 270 captures the image (that is, after the capture is completed), the LED light source 210 is notified to switch the wavelength of the emission light wave.

[0047] In some embodiments, the LED light source 210 selects a programmable multi-color LED light board, and the imaging unit 270 includes an image sensor, such as a CMOS camera or a CCD camera. The programmable multi-color LED light source is connected to the CMOS camera, and the programmable multi-color LED light source is programmed so that it can switch the wavelength of the light source once each time it receives a signal instruction from the CMOS camera, or emit light waves of corresponding wavelengths each time according to specific signal instructions from the CMOS camera.

[0048] Alternatively, in some embodiments, the programmable multi-color LED light source is configured to emit excitation light waves of different wavelengths in a time-sharing manner, and when it receives a signal instruction from the CMOS camera, it switches the wavelength after a preset time interval until all preset wavelengths are traversed. In some embodiments, after the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 obtains multiple fluorescence images.

[0049] In some embodiments, the imaging unit 270 may further include an image processing module, such as using a computer to perform image processing, connecting a CMOS camera to the computer, and after the CMOS camera captures an image, transmitting the fluorescence image to the computer, and the computer synthesizes a multi-color high-resolution image based on the received multiple fluorescence images. While transmitting the fluorescence image to the computer, the CMOS camera may also send a signal instruction to the CMOS camera to enable the LED light source 210 to switch the wavelength of the excitation light wave.

[0050] The above are some descriptions of the multi-color LED light source 210 and some descriptions of how the imaging unit 270 notifies the multi-color LED light source 210 to switch wavelengths.

[0051] In some embodiments, the grating 220 is used to modulate the excitation light wave into a cosine structured light. In some embodiments, after the excitation light wave is modulated by the grating 220, the light intensity distribution of the generated stripes satisfies the cosine function, so the grating 220 can modulate the excitation light wave into a cosine structured light. In order to obtain more information, in some embodiments, the grating 220 can be preset with multiple angles and / or phases, and the excitation light wave passes through the grating 220 with different angles and / or phases and finally projects different cosine structured lights on the sample through the modulating objective lens 230.

[0052] In some embodiments, please refer to Figure 2 , the fluorescence imaging system further includes a moving unit 280, which is used to adjust the grating 220 to change the angle and / or phase of the grating 220, so that the projection pattern received by the sample changes. In some embodiments, the imaging unit 270 is also used to notify the moving unit 280 to adjust the grating 220 to change the angle and / or phase of the grating 220, so that the projection pattern received by the sample changes, thereby obtaining multiple fluorescence images; accordingly, the imaging unit 270 synthesizes a multi-color high-resolution image based on the multiple fluorescence images; in this case, the fluorescence imaging system can be called a high-resolution multi-color fluorescence imaging system.

[0053] In some embodiments, the moving unit 280 is used to adjust the phase of the grating 220, so that the fluorescence imaging system can synthesize a high-resolution image using the principle of the three-step phase shift method. In this case, the moving unit 280 translates the grating 220 by a preset length to change the phase of the grating 220. After obtaining the fluorescence images of the grating 220 at three phases, the three fluorescence images are synthesized into a high-resolution image according to the super-resolution reconstruction algorithm. The three-step phase shift method described here is only an example. In practical applications, a four-step phase shift method or a five-step phase shift method can also be used to synthesize a high-resolution image, and this application does not limit this.

[0054] In some embodiments, the moving unit 280 is used to adjust the angle of the grating 220 by means of rotation, etc. Since if only the fluorescence image obtained when the grating 220 is at the same angle is used to synthesize a high-resolution image, only the resolution in the corresponding direction can be improved to the maximum extent, in some embodiments, the moving unit 280 can be further used to rotate the angle of the grating 220 at a preset angle by means of rotation, etc., so as to obtain fluorescence images at multiple angles, such as Figure 3 As shown, the three observation images on the left are high-resolution images synthesized without rotating the grating under the three colors of excitation light waves, and the three observation images on the right are high-resolution images obtained by rotating the grating angle under the three colors of excitation light waves, that is, after adding the grating rotation, the high-resolution image synthesized by the present invention can improve the resolution in all directions.

[0055] It can be understood that in some embodiments, the moving unit 280 can only change the angle of the grating 220 to obtain multiple corresponding fluorescence images at multiple angles of the grating 220, and the imaging unit then synthesizes a multi-color high-resolution image based on the multiple fluorescence images.

[0056] It is understandable that in some embodiments, the moving unit 280 may only change the phase of the grating 220, thereby acquiring multiple corresponding fluorescence images at multiple phases of the grating 220, and the imaging unit then synthesizes a multi-color high-resolution image based on the multiple fluorescence images.

[0057] It can be understood that in some embodiments, the moving unit 280 can change the phase and angle of the grating 220, so as to obtain multiple corresponding fluorescence images at multiple angles and phases of the grating 220, and the imaging unit then synthesizes a multi-color high-resolution image based on the multiple fluorescence images.

[0058] In order to realize the automation of the system and facilitate the operation of users, in some embodiments, the imaging unit 270 can also notify the moving unit 280 to adjust the grating 220 to change the angle and / or phase of the grating 220. For example, after the imaging unit 270 takes an image, the moving unit 280 is notified to rotate the grating 220 at a preset angle. After notifying the moving unit 280 a preset number of times, the moving unit 280 is notified to translate the grating 220 by a preset distance to change the phase of the grating 220. After traversing all combinations of angles and phases, a corresponding number of fluorescence images are obtained, and each fluorescence image is synthesized into a high-resolution image. If the LED light source 210 is a multi-color LED light source, the excitation light wave of each color needs to traverse all combinations of angles and phases, and finally all the obtained fluorescence images are synthesized into a multi-color high-resolution image.

[0059] Therefore, in some embodiments, for the angles that the grating 220 needs to be adjusted, the moving unit 280 adjusts the grating 220 from one angle to the last angle, and when the moving unit 280 adjusts the grating 220 to any one of these angles: the moving unit 280 adjusts the grating 220 from one phase to the last phase (referring to the phases that the grating 220 needs to be adjusted), and when the moving unit 280 adjusts the grating 220 to any one of these phases: the LED light source 210 starts to emit excitation light waves of different wavelengths in time-sharing from one wavelength until the last wavelength, wherein when After the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, and then notifies the moving unit 280 to switch the grating from the current phase to the next phase until it switches to the last phase, and then notifies the moving unit 280 to switch the grating 220 from the current angle to the next angle until it switches to the last angle, so that the imaging unit 270 obtains multiple fluorescence images, each of which corresponds to an excitation light wave of a different wavelength and a grating of a different angle and phase; the imaging unit 270 synthesizes a multi-color high-resolution image based on the multiple fluorescence images.

[0060] In some embodiments, the angles of the grating 220 include 0°, 60°, and 120°.

[0061] In some embodiments, the phases of the grating 220 include 0, 2π / 3, and 4π / 3.

[0062] So an example could be:

[0063] (1) The imaging unit 270 notifies the moving unit 280 to first adjust the grating 220 to 0° angle and 0 phase: the LED light source 210 starts to emit excitation light waves of different wavelengths in time-sharing from one wavelength to the last wavelength, wherein after the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 can obtain multiple fluorescence images corresponding to different wavelengths when the grating 220 is 0° angle and 0 phase;

[0064] (2) The imaging unit 270 then notifies the moving unit 280 to keep the grating 220 at an angle of 0° and adjust the phase to 2π / 3: the LED light source 210 starts to emit excitation light waves of different wavelengths in a time-sharing manner from one wavelength to the last wavelength, wherein after the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 can obtain multiple fluorescence images corresponding to different wavelengths when the grating 220 is at an angle of 0° and a phase of 2π / 3;

[0065] (3) The imaging unit 270 then notifies the moving unit 280 to keep the grating 220 at an angle of 0° and adjust the phase to 4π / 3: the LED light source 210 starts to emit excitation light waves of different wavelengths in a time-sharing manner from one wavelength to the last wavelength, wherein after the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 can obtain multiple fluorescence images corresponding to different wavelengths when the grating 220 is at an angle of 0° and a phase of 4π / 3;

[0066] (4) The imaging unit 270 then notifies the moving unit 280 to adjust the angle of the grating 220 to 60° and the phase to 0: the LED light source 210 starts to emit excitation light waves of different wavelengths in a time-sharing manner from one wavelength to the last wavelength, wherein after the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 can obtain multiple fluorescence images corresponding to different wavelengths when the grating 220 is at an angle of 60° and a phase of 0;

[0067] (5) The imaging unit 270 then notifies the moving unit 280 to keep the grating 220 at an angle of 60° and adjust the phase to 2π / 3: the LED light source 210 starts to emit excitation light waves of different wavelengths in a time-sharing manner from one wavelength to the last wavelength, wherein after the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 can obtain multiple fluorescence images corresponding to different wavelengths when the grating 220 is at an angle of 60° and a phase of 2π / 3;

[0068] (6) The imaging unit 270 then notifies the moving unit 280 to keep the grating 220 at an angle of 60° and adjust the phase to 4π / 3: the LED light source 210 starts to emit excitation light waves of different wavelengths in a time-sharing manner from one wavelength to the last wavelength, wherein after the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 can obtain multiple fluorescence images corresponding to different wavelengths when the grating 220 is at an angle of 60° and a phase of 4π / 3;

[0069] (7) The imaging unit 270 then notifies the moving unit 280 to adjust the angle of the grating 220 to 120° and the phase to 0: the LED light source 210 starts to emit excitation light waves of different wavelengths in a time-sharing manner from one wavelength to the last wavelength, wherein after the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 can obtain multiple fluorescence images corresponding to different wavelengths when the grating 220 is at an angle of 120° and a phase of 0;

[0070] (8) The imaging unit 270 then notifies the moving unit 280 to keep the grating 220 at an angle of 120° and adjust the phase to 2π / 3: the LED light source 210 starts to emit excitation light waves of different wavelengths in a time-sharing manner from one wavelength to the last wavelength, wherein after the imaging unit 270 captures an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 can obtain multiple fluorescence images corresponding to different wavelengths when the grating 220 is at an angle of 120° and a phase of 2π / 3;

[0071] (9) The imaging unit 270 then notifies the moving unit 280 to keep the grating 220 at an angle of 120° and adjust the phase to 4π / 3: the LED light source 210 emits excitation light waves of different wavelengths in a time-sharing manner starting from one wavelength until the last wavelength, wherein after the imaging unit 270 takes an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit 270 can obtain multiple fluorescence images corresponding to different wavelengths when the grating 220 is at an angle of 120° and a phase of 4π / 3.

[0072] (10) The imaging unit 270 synthesizes a multi-color high-resolution image based on the fluorescent images acquired from (1) to (9).

[0073] In other embodiments, other angles and other phases may be used to adjust the grating 220 . The present application does not specifically limit the angle and phase of the grating 220 .

[0074] Therefore, the high-resolution fluorescence imaging system provided in some embodiments may include a multi-color LED light source 210, a grating 220, a modulation objective lens 230, a stage 240, a moving unit 280, a filtering unit 250, a capture objective lens 260 and an imaging unit 270. Among them, the multi-color LED light source 210 is used to emit excitation light waves of different wavelengths in time division. The multi-color LED light source 210 is preset with multiple wavelengths. The excitation light waves of different wavelengths can excite the sample to emit fluorescence of different wavelengths; the grating 220 is used to modulate the excitation light wave into cosine structured light. The grating 220 is preset with multiple angles and multiple phases. Adjusting the angle and phase of the grating 220 can change the angle and phase of the cosine structured light; the modulating objective lens 230 is arranged on the optical path of the cosine structured light, and is used to project the cosine structured light onto the focal plane of the modulating objective lens 230; the stage 240 is used to carry the sample, and the sample on the stage 240 is used to receive the cosine structured light projected by the modulating objective lens 230 and form a projection pattern on the sample surface. Changing the angle and phase of the grating 220 can change the angle and phase of the cosine structured light, thereby changing the cosine structured light. The moving unit 280 is used to adjust the grating 220 to change the angle and phase of the projection pattern of the grating 220 so that the projection pattern received by the sample changes; the filtering unit 250 is used to filter the fluorescence, and the filtering unit 250 can reduce the transmittance of light waves other than the fluorescence wavelength to reduce the influence of stray light on imaging and improve the signal-to-noise ratio of imaging; the capturing objective lens 260 is used to receive and emit the fluorescence after filtering; the imaging unit 270 is used to sense the fluorescence emitted by the capturing objective lens 260 to obtain a fluorescence image (i.e., to capture the image), and the imaging unit 270 captures the fluorescence excited by the sample under the irradiation of cosine structured light of different projection patterns modulated by excitation light waves of different wavelengths to obtain the corresponding fluorescence image, and then synthesizes a multi-color high-resolution image based on the multiple fluorescence images.

[0075] It can be seen that in some embodiments, the LED light source 210 can emit excitation light waves of different wavelengths starting from one wavelength until the last wavelength, and when the imaging unit 270 takes an image, it notifies the LED light source 210 to switch from the current wavelength to the next wavelength until it switches to the last wavelength, and the entire process is automated. In this way, the acquisition of multi-color fluorescence images can be achieved; further, in some embodiments, the imaging unit 270 can also notify the moving unit 280 to change the angle and / or phase of the grating 220, so that the high-resolution multi-color fluorescence imaging system can automatically acquire the fluorescence images corresponding to different wavelengths of laser light waves at different angles and / or phases of the grating 220, which lays a good foundation for the subsequent synthesis of multi-color high-resolution images.

[0076] In some embodiments, the filter unit 250 includes a plurality of filters corresponding to fluorescence of different wavelengths. Excitation light waves of different wavelengths excite the sample to emit fluorescence of different wavelengths. The filter unit 250 can reduce the transmittance of light waves other than the target fluorescence wavelength. In actual use, filters corresponding to the fluorescence wavelength can be placed in the light path according to actual needs to filter out light waves other than other wavelengths, reduce the impact of stray light on imaging, and use different filters for fluorescence of different wavelengths to avoid crosstalk between fluorescences, thereby improving the signal-to-noise ratio of imaging.

[0077] In some embodiments, please refer to Figure 4 The fluorescence imaging system also includes a lens 290, which is arranged on the optical path of the excitation light wave and is used to emit the excitation light wave as parallel light to the grating 220. The lens 290 can prevent the LED light source 210 from diverging and causing the excitation light wave to have a low intensity, thereby ultimately avoiding affecting the signal-to-noise ratio of the fluorescence image.

[0078] In some embodiments, the fluorescence imaging system uses two different objective lenses, such as a modulation objective lens 230 and a capture objective lens 260, which are respectively used to project cosine structured light and receive fluorescence emitted by the sample. In some embodiments, the numerical aperture of the modulation objective lens 230 is greater than the numerical aperture of the capture objective lens 260; in some embodiments, the applicant has found that: according to the Abbe diffraction formula, it can be known that the optical path structure constructed by the high-resolution fluorescence imaging system of the present application can improve the imaging resolution, and the fluorescence imaging system of the present application can obtain a high-resolution image.

[0079] Compared with the optical path structure design that uses the same objective lens for both projecting cosine structured light and receiving fluorescence, the high-resolution fluorescence imaging system of some embodiments of the present invention uses two different objective lenses, namely, the modulation objective lens 230 and the capture objective lens 260, which are respectively used to project cosine structured light and receive fluorescence emitted by the sample, and the numerical aperture of the modulation objective lens 230 is larger than the numerical aperture of the capture objective lens 260. In some embodiments, the applicant has found that: according to the Abbe diffraction formula, it can be known that the optical path structure constructed by the high-resolution fluorescence imaging system of the present application can improve the imaging resolution, and the high-resolution fluorescence imaging system of the present application can obtain a multi-color high-resolution image. The applicant will make an analysis below.

[0080] In some cases, the resolution of a lens can be calculated using the Abbe diffraction formula, which is as follows:

[0081]

[0082] Where D is the resolution of the lens, λ is the wavelength of light passing through the lens, and NA is the numerical aperture of the lens.

[0083] Please refer to Figure 5, is a schematic diagram of the structure of a fluorescence imaging system (or structured light illumination microscope) in some embodiments. The light source 110 is a light wave emitted by a laser transmitter. The spatial light modulator 120 modulates the light source 110 into structured light. After the structured light reaches the beam splitter 130, it is reflected to the objective lens 140. The objective lens 140 projects the structured light onto the sample 150. The sample 150 is stimulated to emit fluorescence. After the fluorescence enters the objective lens 140, it is emitted to the beam splitter 130 and then transmitted from the beam splitter 130 to the image sensor 160. The image sensor 160 captures the fluorescence image of the sample under the structured light illumination. It can be seen that the objective lens 140 is used for both projecting cosine structured light and receiving fluorescence. According to formula (1), the theoretical total limiting resolution of the structured light illumination microscope is:

[0084]

[0085] Among them, D1 is Figure 5 The structured light illumination microscope shown in the figure has a theoretical total resolution, D2 is the resolution after the structured light is introduced, D3 is the resolution of the wide-field fluorescence display microscope itself, NA1 is the numerical aperture of the objective lens 140, λ1 is the wavelength of the structured light, and λ2 is the wavelength of the fluorescence.

[0086] Please refer to Figure 1 , Figure 2 or Figure 4 In the fluorescence imaging system shown in any one of the items, the modulation objective lens 230 images the cosine structured light on the image focal plane. The applicant has studied that in some embodiments, the fringe interval can be expressed as:

[0087]

[0088] Wherein, e is the fringe spacing, d is the grating constant of the grating 220 , and M is the magnification of the modulation objective lens 230 .

[0089] In some embodiments, the applicant has found that when the grating constant is small or the magnification of the modulation objective lens 230 is large, the spatial frequency of the illumination light field of the cosine structured light will exceed the diffraction limit of the optical system, and the cosine structured light is irradiated on the sample to present higher spatial frequency information of the sample, such as Figure 6As shown, two light spots are more clearly distinguished within the observation field of view; the sample is placed on the image focal plane of the modulation objective lens 230, so that the sample receives the cosine structured light projected by the modulation objective lens 230 and forms a projection pattern on the surface. Since the cosine structured light is alternating between light and dark stripes, the sample is stimulated to produce fluorescence under the irradiation of each bright stripe, and the fluorescence emitted by the sample is received by the capture objective lens 260, and the fluorescence is projected onto the imaging unit 270. The imaging unit 270 includes an image sensor, and the image sensor photographs the sample to obtain a fluorescence image of the sample. The fluorescence image contains high-frequency spatial information of the sample, that is, subtle contents that cannot be seen by an ordinary optical microscope; wherein, in order to improve the signal-to-noise ratio of the fluorescence image, a filter unit 250 can be placed before or after the capture objective lens 260. The filter unit 250 can reduce the transmittance of light waves other than the fluorescence wavelength, thereby reducing stray light from entering the imaging unit 270, thereby affecting the reconstruction quality of the fluorescence image.

[0090] According to formula (1), the theoretical total limiting resolution of the fluorescence imaging system of the present invention can be obtained as follows:

[0091]

[0092] Among them, D4 is the theoretical total limiting resolution of the fluorescence imaging system of the present invention, D5 is the resolution of the modulation objective lens 230, D6 is the resolution of the capture objective lens 260, NA2 is the numerical aperture of the modulation objective lens 230, NA1 is the numerical aperture of the capture objective lens 260, λ1 is the wavelength of the cosine structured light, since the grating does not change the wavelength of the excitation light wave, λ1 is also the wavelength of the excitation light wave, and λ2 is the wavelength of the fluorescence.

[0093] It can be seen that the fluorescence imaging system in some embodiments of the present invention uses two objective lenses (such as the modulation objective lens 230 and the capture objective lens 260) to project the cosine structured light and receive the fluorescence, and the numerical aperture NA2 of the modulation objective lens 230 is larger than the numerical aperture NA1 of the capture objective lens 260. By comparing formula (2) and formula (4), it can be seen that the value D4 of the theoretical total limiting resolution of the fluorescence imaging system in some embodiments of the present invention is less than Figure 4 The total limiting resolution value D1 of the structured light illumination microscope is shown. The smaller the resolution value, the stronger the resolving power. That is, the theoretical limiting resolution of the fluorescence imaging system in some embodiments of the present invention is improved.

[0094] In practical applications, in addition to making the fluorescence imaging system of the present invention into a complete device, those skilled in the art can also build the fluorescence imaging system of the present invention by modifying an existing inverted microscope. For example, since the inverted microscope itself has an objective lens under the stage 240, the objective lens can be used as the capture objective lens 260 of the present invention, and the LED light source 210, the grating 220 and the modulation objective lens 230 are placed above the stage 240 of the inverted microscope, and an objective lens with a numerical aperture greater than the capture objective lens 260 is selected as the modulation objective lens 230. That is, the fluorescence imaging system of the present invention is realized by modifying an existing inverted microscope, and the present application does not impose any restrictions on this.

[0095] This document is described with reference to various exemplary embodiments. However, those skilled in the art will recognize that changes and modifications may be made to the exemplary embodiments without departing from the scope of this document. For example, various operating steps and components for performing the operating steps may be implemented in different ways (e.g., one or more steps may be deleted, modified, or incorporated into other steps) depending on the specific application or considering any number of cost functions associated with the operation of the system.

[0096] Although the principles of this invention have been shown in various embodiments, many modifications of structures, arrangements, proportions, elements, materials and components particularly suitable for specific environments and operational requirements can be used without departing from the principles and scope of this invention. The above modifications and other changes or amendments will be included in the scope of this invention.

[0097] The foregoing specific description has been described with reference to various embodiments. However, those skilled in the art will recognize that various modifications and changes can be made without departing from the scope of the present disclosure. Therefore, the consideration of the present disclosure will be in an illustrative rather than a restrictive sense, and all these modifications will be included in its scope. Similarly, the advantages, other advantages and solutions to the problems of various embodiments have been described above. However, the benefits, advantages, solutions to the problems and any elements that can produce these, or solutions that make them more clear should not be interpreted as critical, necessary or necessary. The term "include" and any other variants used in this article are all non-exclusive inclusions, so that the process, method, article or device that includes a list of elements includes not only these elements, but also includes other elements that are not explicitly listed or do not belong to the process, method, system, article or device. In addition, the term "coupled" and any other variants used in this article refer to physical connections, electrical connections, magnetic connections, optical connections, communication connections, functional connections and any other connections.

[0098] Those skilled in the art will appreciate that many changes may be made to the details of the above-described embodiments without departing from the basic principles of the invention. Therefore, the scope of the present invention should be determined solely by the claims.

Claims

1. A high-resolution multicolor fluorescence imaging system, characterized in that: include: A multi-color LED light source is used to emit excitation light waves of different wavelengths in different time periods; the multi-color LED light source is preset with multiple wavelengths; A grating, used for modulating the excitation light wave into a cosine structured light; the grating is preset with multiple angles and multiple phases; A modulation objective lens, disposed on the optical path of the cosine structured light, and used for projecting the cosine structured light; A stage for carrying a sample; the sample on the stage is used to receive the cosine structured light projected by the modulating objective lens and form a projection pattern on the surface, and the sample is stimulated to generate fluorescence; A moving unit, used for adjusting the grating to change the angle and phase of the grating, so that the projection pattern received by the sample changes; A filter unit, used for filtering the fluorescence; A capture objective lens, used to receive and emit the fluorescence after filtering; The numerical aperture of the modulation objective lens is greater than the numerical aperture of the capture objective lens; An imaging unit, used to sense the fluorescence emitted by the capture objective lens to obtain a fluorescence image, wherein: For multiple angles, the moving unit adjusts the grating from one angle to the last angle, and when the moving unit adjusts the grating to any angle: the moving unit adjusts the grating from one phase to the last phase, and when the moving unit adjusts the grating to any phase: the LED light source starts to emit excitation light waves of different wavelengths in time-sharing from one wavelength until the last wavelength, wherein after the imaging unit completes shooting, the LED light source is notified to switch from the current wavelength to the next wavelength until the last wavelength is switched, and then the moving unit is notified to switch the grating from the current phase to the next phase until the last phase is switched, and then the moving unit is notified to switch the grating from the current angle to the next angle until the last angle is switched, so that the imaging unit obtains multiple fluorescence images, each fluorescence image corresponds to an excitation light wave of different wavelength, a grating of different angle and phase; the imaging unit synthesizes a multi-color high-resolution image according to the multiple fluorescence images.

2. The high-resolution multi-color fluorescence imaging system according to claim 1, characterized in that: The plurality of said angles include 0°, 60° and 120°; and, The plurality of phases include 0, 2π / 3 and 4π / 3.

3. The high-resolution multi-color fluorescence imaging system according to claim 1, characterized in that: It also includes a lens, which is arranged on the optical path of the excitation light wave and is used to emit the excitation light wave to the grating as parallel light.

4. The high-resolution multi-color fluorescence imaging system according to claim 1, characterized in that: The filter unit includes a plurality of filters corresponding to fluorescence of different wavelengths, and the excitation light waves of different wavelengths excite the sample to emit fluorescence of different wavelengths.

5. A fluorescence imaging system, characterized in that: include: LED light source, used to emit excitation light waves; A grating, used for modulating the excitation light wave into a cosine structured light; A modulation objective lens, disposed on the optical path of the cosine structured light, and used for projecting the cosine structured light; A stage for carrying a sample; the sample on the stage is used to receive the cosine structured light projected by the modulating objective lens and form a projection pattern on the surface, and the sample is stimulated to generate fluorescence; A filter unit, used for filtering the fluorescence; A capture objective lens, used to receive and emit the fluorescence after filtering; The numerical aperture of the modulation objective lens is greater than the numerical aperture of the capture objective lens; An imaging unit is used to sense the fluorescence emitted by the capture objective lens to obtain a fluorescence image.

6. The fluorescence imaging system according to claim 5, characterized in that: The LED light source is a multi-color LED light source, which is preset with multiple wavelengths, and the multi-color LED light source is used to emit excitation light waves of different wavelengths in time division; After the imaging unit captures an image, it notifies the LED light source to switch from the current wavelength to the next wavelength until it switches to the last wavelength, so that the imaging unit obtains multiple fluorescent images; the imaging unit synthesizes a multi-color high-resolution image based on the multiple fluorescent images.

7. The fluorescence imaging system according to claim 6, characterized in that: The filter unit includes a plurality of filters corresponding to fluorescence of different wavelengths, and the excitation light waves of different wavelengths excite the sample to emit fluorescence of different wavelengths.

8. The fluorescence imaging system according to claim 5, characterized in that: Also included is a moving unit, the moving unit is used to adjust the grating to change the angle and phase of the grating, so that the projection pattern received by the sample changes; The imaging unit is further used to notify the moving unit to adjust the grating to change the angle and phase of the grating, so that the projection pattern received by the sample changes, thereby obtaining a plurality of the fluorescence images; The imaging unit synthesizes a high-resolution image according to the multiple fluorescence images.

9. The fluorescence imaging system according to claim 8, characterized in that: The angles include 0°, 60° and 120°; and, The phases include 0, 2π / 3, and 4π / 3.

10. The fluorescence imaging system according to claim 5, characterized in that: It also includes a lens, which is arranged on the optical path of the excitation light wave and is used to emit the excitation light wave to the grating as parallel light.