Hydrodynamic focusing imaging system based on frequency-domain labeling illumination
By using frequency domain labeled illumination and hydrodynamic focusing imaging system, the limitations of imaging flow cytometers in high-throughput and high-resolution imaging have been overcome, achieving high-throughput, high-resolution fluorescence spectroscopy and label-free imaging, thus improving detection efficiency and image quality.
Patent Information
- Application Number
- PCT/CN2025/093783
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-05-09
- Publication Date
- 2026-11-12
AI Technical Summary
Existing imaging flow cytometers have limitations in terms of high-throughput and high-resolution imaging, and cannot simultaneously achieve high-throughput detection and complete acquisition of cell fluorescence spectral information.
A hydrodynamic focusing imaging system based on frequency domain labeled illumination is adopted. Multiple light spots with preset position distribution are generated by the frequency domain labeled illumination module, and the scintillation frequency of each light spot is modulated by the illumination frequency modulation submodule. Combined with the fluid focusing module, the single-cell axial flow of the sample cell suspension is controlled to achieve frequency domain encoded imaging.
It improves detection throughput, reduces signal aliasing, and achieves high-throughput, high-resolution fluorescence spectroscopy imaging and label-free imaging, with high system flexibility and applicability.
Smart Images

Figure CN2025093783_12112026_PF_FP_ABST
Abstract
Description
A hydrodynamic focusing imaging system based on frequency domain labeled illumination Technical Field
[0001] This disclosure relates to the field of flow cytometry technology, and more particularly to a hydrodynamic focusing imaging system based on frequency domain marker illumination. Background Technology
[0002] Flow cytometry and fluorescence microscopy are two important instruments in biological research and clinical applications. Flow cytometry can analyze cells at extremely high throughput but lacks morphological information; while fluorescence microscopy can obtain morphological information, but its detection throughput is relatively low. Imaging flow cytometry is an instrument that combines the advantages of both, capable of acquiring cell images at extremely high speeds. However, imaging flow cytometry requires microscopic fluorescence imaging of cells flowing at m / s, and its throughput and number of channels are often low, and it cannot obtain complete cellular fluorescence spectral information. Summary of the Invention
[0003] In view of this, this disclosure proposes a technical solution for a hydrodynamic focusing imaging system based on frequency domain marker illumination.
[0004] According to one aspect of this disclosure, a hydrodynamic focusing imaging system based on frequency-domain labeled illumination is provided. The imaging system includes: at least one frequency-domain labeled illumination module, a fluid focusing module, a light-receiving module, a beam-splitting module, at least one photoelectric detection module, and an acquisition and processing module, wherein the optical paths corresponding to different frequency-domain labeled illumination modules are independent. The frequency-domain labeled illumination module is used to generate a frequency-domain labeled illumination light field based on a preset modulation frequency, wherein the frequency-domain labeled illumination light field includes multiple light spots distributed at preset positions, and each light spot corresponds to a different scintillation frequency. The fluid focusing module is used to control a sample cell suspension to flow through a detection area in the form of a single-cell axial flow, wherein the detection area is the area irradiated by the frequency-domain labeled illumination light field. The light-receiving module is used to detect the sample cell suspension in the area irradiated by the frequency-domain labeled illumination light field. The system comprises: a target light signal generated under the action of a frequency-domain labeled illumination field; a spectroscopic module for separating the target light signal into a fluorescence spectral signal and a label-free signal, wherein the fluorescence spectral signal contains independently distributed fluorescence components in different wavelength ranges, and the label-free signal includes a light signal without fluorescence components; a photoelectric detection module for detecting the fluorescence spectral signal and the label-free signal, and respectively determining a first electrical signal corresponding to the fluorescence spectral signal and a second electrical signal corresponding to the label-free signal; and an acquisition and processing module for determining a fluorescence-labeled spectral image corresponding to the sample cell suspension based on the first electrical signal, and determining a label-free image corresponding to the sample cell suspension based on the second electrical signal, wherein different structures in the cells are distinguished by fluorescence labels in the fluorescence-labeled spectral image.
[0005] In one possible implementation, the frequency domain marking illumination module includes: a laser source for generating continuous laser or pulsed laser of a preset wavelength; an optical fiber bundle for separating the continuous laser or pulsed laser into multiple independent laser beams, wherein the positional relationship between each optical fiber in the optical fiber bundle satisfies the preset positional distribution; a focusing lens for focusing the multiple independent laser beams to obtain an initial light field; and an illumination frequency modulation submodule for frequency modulating each spot in the initial light field based on the modulation frequency to obtain the frequency domain marking illumination light field.
[0006] In one possible implementation, the frequency domain marking illumination module includes: a laser source array for generating multiple independent laser beams that satisfy a preset wavelength; a focusing lens for focusing the multiple independent laser beams to obtain an initial light field, wherein the positional relationship between each spot in the initial light field satisfies the preset positional distribution; and an illumination frequency modulation submodule for performing frequency modulation on each spot in the initial light field based on the modulation frequency to obtain the frequency domain marking illumination light field.
[0007] In one possible implementation, the frequency domain marking illumination module includes: a laser source for generating continuous laser or pulsed laser of a preset wavelength; a laser modulation device for modulating the continuous laser or pulsed laser into multiple independent laser beams, wherein the positional relationship between the multiple independent laser beams satisfies the preset positional distribution; a focusing lens for focusing the multiple independent laser beams to obtain an initial light field; and an illumination frequency modulation submodule for frequency modulating each spot in the initial light field based on the modulation frequency to obtain the frequency domain marking illumination light field.
[0008] In one possible implementation, the illumination frequency modulation submodule includes any one of an optical chopper, an electro-liquid crystal control array, or a modulated laser array.
[0009] In one possible implementation, the spectrophotometer module includes: a fluorescence separation submodule and a multi-channel spectrophotometer module; the fluorescence separation submodule is used to separate the fluorescence components of the target light signal based on a preset wavelength range to obtain the fluorescence spectral signal; the multi-channel spectrophotometer module is used to perform multi-channel separation of the target light signal by utilizing the optical interaction type of the frequency domain labeled illumination field of the sample cell suspension to obtain the label-free signal.
[0010] In one possible implementation, the fluorescence separation submodule is any one of a prism dispersion photonics module, a grating dispersion photonics module, a diffractive optical device dispersion photonics module, and a multi-dichroic mirror and filter photonics module.
[0011] In one possible implementation, the label-free signal includes at least one of: a laser intensity signal, a forward-scattered light signal, a side-scattered light signal, a back-scattered light signal, and a phase difference signal; the multi-channel photonics module includes at least one channel unit selected from a bright-field channel unit, a forward-scattered channel unit, a side-scattered channel unit, a back-scattered channel unit, and a phase difference imaging channel unit; the bright-field channel unit is used to obtain the laser intensity signal by perturbing the intensity of the frequency-domain labeled illumination field with the sample cell suspension; the forward-scattered channel unit is used to... The system utilizes the forward scattering of the frequency-domain labeled illumination field by the sample cell suspension to determine the forward scattered light signal; the side scattering channel unit utilizes the side scattering of the frequency-domain labeled illumination field by the sample cell suspension to determine the side scattered light signal; the backscattering channel unit utilizes the backscattering of the frequency-domain labeled illumination field by the sample cell suspension to determine the backscattered light signal; and the phase difference imaging channel unit utilizes the refraction of the frequency-domain labeled illumination field by the sample cell suspension to determine the phase difference signal.
[0012] In one possible implementation, the photoelectric detection module includes: a fluorescence spectrometer for detecting the fluorescence spectral signal and converting the fluorescence spectral signal into the first electrical signal, wherein the fluorescence spectrometer includes a preset number of detection channels, the preset number being greater than or equal to the number of different fluorescent components in the fluorescence spectral signal; and a labelless signal detector for detecting the labelless signal and converting the labelless signal into the second electrical signal.
[0013] In one possible implementation, the acquisition and processing module includes: an acquisition card for acquiring the first electrical signal and converting the first electrical signal into a corresponding first digital signal; and a computer submodule for analyzing, reconstructing, and spectrally unmixing the first digital signal to determine the fluorescent label spectral image.
[0014] In one possible implementation, the acquisition card is used to acquire the second electrical signal and convert the second electrical signal into a corresponding second digital signal; the computer submodule is used to analyze and reconstruct the second digital signal to determine the unmarked image.
[0015] The hydrodynamic focusing imaging system based on frequency-domain labeled illumination of this embodiment utilizes fluid dynamics principles. A fluid focusing module directs a sample cell suspension through a frequency-domain labeled illumination light field generated by a frequency-domain labeled illumination module at a preset modulation frequency, in a single-cell axial flow manner. The frequency-domain labeled illumination light field comprises multiple light spots distributed at preset positions, each with a different flicker frequency. This allows for dynamic modulation of the spatial distribution of the illumination light field and the flicker frequency modulation of each light spot, encoding a two-dimensional image of the cell into the frequency domain. This approach leverages the high flow rate of the sample cell suspension to increase detection throughput and utilizes the smaller size of the frequency-domain illumination light field parallel to the cell movement direction to reduce the probability of signal aliasing between two cell samples, further improving cell imaging throughput. A light-receiving module collects the target light signal generated by the sample cell suspension under the influence of the frequency-domain labeled illumination light field and transmits the target light signal to a light-splitting module. The target light signal can be separated into fluorescence spectral signals and label-free signals with independently distributed fluorescence components in different wavelength ranges through a beam splitting module. A photoelectric detection module can detect the fluorescence spectral signals and label-free signals, and determine the first electrical signal corresponding to the fluorescence spectral signal and the second electrical signal corresponding to the label-free signal, respectively. The acquisition and processing module can determine the fluorescence-labeled spectral image corresponding to the sample cell suspension based on the first electrical signal, thus distinguishing different structures in the cells through fluorescence labeling. Based on the second electrical signal, it can determine the label-free image corresponding to the sample cell suspension, thereby achieving high-throughput, high-resolution fluorescence spectral imaging and label-free imaging. Furthermore, the hydrodynamic focusing imaging system of this embodiment can not only achieve frequency-domain coded flow cytometry based on frequency-domain labeled illumination, but also achieve time-domain coded flow cytometry by adjusting the specific structure of the frequency-domain labeled illumination module according to actual imaging needs and cost requirements. It has high system flexibility and applicability and can be widely applied to various usage scenarios.
[0016] Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description
[0017] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this disclosure together with the specification and serve to explain the principles of this disclosure.
[0018] Figure 1 shows a block diagram of a hydrodynamic focusing imaging system based on frequency domain marker illumination according to an embodiment of the present disclosure;
[0019] Figure 2 shows a schematic diagram of the structure of a conventional flow cytometer flow chamber according to an embodiment of the present disclosure;
[0020] Figure 3 shows a schematic diagram of the structure of a microfluidic chip according to an embodiment of the present disclosure;
[0021] Figure 4 shows a schematic diagram of a frequency domain marker illumination module according to an embodiment of the present disclosure;
[0022] Figure 5 shows a schematic diagram of a frequency domain marker illumination module according to an embodiment of the present disclosure;
[0023] Figure 6 shows a schematic diagram of the structure of an illumination frequency modulation submodule according to an embodiment of the present disclosure;
[0024] Figure 7 shows a schematic diagram of a frequency domain labeled illumination field according to an embodiment of the present disclosure;
[0025] Figure 8 shows a waveform diagram of an intensity modulation function according to an embodiment of the present disclosure;
[0026] Figure 9 shows a schematic diagram of the structure of a multi-prism dispersion photonic module according to an embodiment of the present disclosure;
[0027] Figure 10 shows a schematic diagram of the structure of a grating dispersion photonic module according to an embodiment of the present disclosure;
[0028] Figure 11 shows a schematic diagram of the structure of a diffractive optical device dispersion photonic module according to an embodiment of the present disclosure;
[0029] Figure 12 shows a schematic diagram of a multi-dichroic mirror and filter beam splitter module according to an embodiment of the present disclosure;
[0030] Figure 13 shows a schematic diagram of a bright field channel unit according to an embodiment of the present disclosure;
[0031] Figure 14 shows a schematic diagram of a light scattering channel unit according to an embodiment of the present disclosure;
[0032] Figure 15 shows a schematic diagram of a phase difference imaging channel unit according to an embodiment of the present disclosure;
[0033] Figure 16 shows a schematic diagram illustrating the principle of a first digital signal analysis and reconstruction according to an embodiment of the present disclosure;
[0034] Figure 17 illustrates a schematic diagram of the principle of spectral demixing of a fluorescently labeled spectral image according to an embodiment of the present disclosure;
[0035] Figure 18 shows a schematic diagram illustrating the principle of a first digital signal analysis and reconstruction according to an embodiment of the present disclosure;
[0036] Figure 19 shows a schematic diagram of a hydrodynamic focusing imaging system based on frequency domain marker illumination according to an embodiment of the present disclosure;
[0037] Figure 20 shows a schematic diagram of a hydrodynamic focusing imaging system based on frequency domain marker illumination according to an embodiment of the present disclosure;
[0038] Figure 21 shows a schematic diagram of a hydrodynamic focusing imaging system based on frequency domain marker illumination according to an embodiment of the present disclosure. Detailed Implementation
[0039] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.
[0040] As used herein, the terms “comprising,” “including,” “having,” or variations thereof are open-ended and include one or more of the stated features, integrals, elements, steps, components, or functions, but do not exclude the presence or addition of one or more other features, integrals, elements, steps, components, functions, or groups thereof.
[0041] When an element is referred to as “connected,” “coupled,” “responding,” or a variation thereof relative to another element, it may be directly connected, coupled, or responding to another element, or there may be an intermediate element present.
[0042] Although the terms first, second, third, etc., may be used herein to describe various elements / operations, these elements / operations should not be limited by these terms. These terms are only used to distinguish one element / operation from another. Therefore, without departing from the teachings of the inventive concept, a first element / operation in some embodiments may be referred to as a second element / operation in other embodiments.
[0043] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.
[0044] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.
[0045] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.
[0046] Flow cytometry and fluorescence microscopy are two important instruments in biological research and clinical applications. Flow cytometry can analyze cells with high throughput, but it lacks the ability to obtain morphological information of cells; while fluorescence microscopy can obtain morphological information of cells, but its throughput is relatively low.
[0047] Imaging flow cytometry combines high throughput and spatial resolution, enabling the acquisition of cell images at extremely high speeds. However, because imaging flow cytometry requires microscopic fluorescence imaging of cells flowing at m / s, its throughput and number of detection channels are typically low, and it cannot obtain complete cellular fluorescence spectral information. Related technologies have attempted to improve the throughput of fluorescence imaging through single-pixel imaging methods, such as using structured light illumination, but these methods cannot extend the imaging capability to the spectral domain.
[0048] To address the aforementioned issues, the two-dimensional image of the cell can be encoded into a time-domain signal through dynamic modulation of the spatial distribution of the illumination field. This involves unfolding the cell's two-dimensional image along the time axis using the spatial distribution of the static light spot and the cell's motion, thereby increasing detection throughput. However, because this imaging method requires encoding the cell's two-dimensional image onto the time axis, it demands a relatively large illumination field. Furthermore, when the interval between adjacent cells is small, two cells may simultaneously be located within the illumination field, leading to signal aliasing, reduced throughput, and compromised image quality.
[0049] In view of this, embodiments of this disclosure provide a hydrodynamic focusing imaging system based on frequency-domain labeled illumination. This system can encode a two-dimensional image of a cell into the frequency domain by dynamically modulating the spatial distribution of the illumination light field and modulating the scintillation frequency of each spot in the illumination light field. This can improve the detection throughput limit of the imaging system while avoiding signal aliasing. Furthermore, by combining the spectral separation of fluorescence and label-free signals, simultaneous fluorescence and label-free imaging of cells can be achieved. The following detailed explanation of the hydrodynamic focusing imaging system based on frequency-domain labeled illumination provided in this disclosure.
[0050] Figure 1 shows a block diagram of a hydrodynamic focusing imaging system based on frequency domain marker illumination according to an embodiment of the present disclosure. As shown in Figure 1, the system 100 includes: at least one frequency domain marker illumination module 101, a fluid focusing module 102, a light receiving module 103, a beam splitting module 104, at least one photoelectric detection module 105, and an acquisition and processing module 106, wherein the optical paths corresponding to different frequency domain marker illumination modules 101 are independent.
[0051] The frequency domain marker illumination module 101 is used to generate a frequency domain marker illumination light field based on a preset modulation frequency. The frequency domain marker illumination light field includes multiple light spots that satisfy a preset position distribution, and each light spot corresponds to a different flicker frequency.
[0052] The fluid focusing module 102 is used to control the sample cell suspension to flow through the detection area in the form of single-cell axial flow, wherein the detection area is the area irradiated by the frequency domain labeled illumination field;
[0053] The light receiving module 103 is used to detect the target light signal generated by the sample cell suspension under the action of the frequency domain labeled illumination light field;
[0054] The spectrometer module 104 is used to separate the target light signal into a fluorescence spectral signal and a label-free signal. The fluorescence spectral signal contains independently distributed fluorescent components in different wavelength ranges, and the label-free signal includes light signals without fluorescent components.
[0055] The photoelectric detection module 105 is used to detect fluorescence spectral signals and label-free signals, and to determine the first electrical signal corresponding to the fluorescence spectral signal and the second electrical signal corresponding to the label-free signal, respectively.
[0056] The acquisition and processing module 106 is used to determine the fluorescently labeled spectral image corresponding to the sample cell suspension based on the first electrical signal, and to determine the label-free image corresponding to the sample cell suspension based on the second electrical signal, wherein the fluorescently labeled spectral image distinguishes different structures in the cells by fluorescent labels.
[0057] The cell suspension mentioned here can refer to a cell suspension prepared by fluorescent staining; any cell in the cell suspension has a corresponding fluorescent marker on its surface or inside, and the fluorescent marker can be excited to emit a corresponding fluorescent signal under light. Specific methods of fluorescent staining can refer to embodiments in relevant existing technologies, such as staining with fluorescent reagents such as fluorescent proteins and fluorescent antibodies, etc., and this disclosure does not specifically limit them.
[0058] The frequency domain marker illumination module 101 can be used to generate a frequency domain marker illumination light field including multiple light spots that satisfy a preset position distribution, and modulate the flicker frequency corresponding to each light spot based on a preset modulation frequency, so that the flicker frequency corresponding to each light spot is different.
[0059] The specific form of the multiple light spots distributed at preset positions can be flexibly set according to actual usage requirements. For example, it can be set as a row of multiple light spots closely arranged on the cell flow plane perpendicular to the cell movement direction. This disclosure does not specifically limit this. The modulation frequency specifically includes the target flicker frequency corresponding to each light spot. The specific value of the target flicker frequency corresponding to any light spot can be flexibly set according to actual usage requirements. This disclosure does not specifically limit this. The specific method for modulating the flicker frequency corresponding to each light spot can refer to the implementation methods in related technologies. For example, the intensity modulation function corresponding to each light spot can be set separately to achieve frequency modulation. This disclosure does not specifically limit this.
[0060] Compared to structured light fields that are only dynamically modulated by spatial distribution, frequency-domain labeled illumination light fields have a smaller size parallel to the direction of cell motion, reducing the possibility of signal aliasing between two cell samples, thereby further improving the throughput of cell imaging.
[0061] In one example, with the same cell flow velocity of 5 m / s in the sample cell suspension and an imaging field of 30 μm × 30 μm, the spot size of the structured light field using only spatially distributed dynamic modulation is approximately 30 μm * (30 * 30) μm. Considering the possibility of signal aliasing, its limiting flux can be determined to be 5 (m / s) / (900 μm) ≈ 5555 eps. However, for the frequency domain labeled illumination field, assuming its illumination spot distribution is a single-row one-dimensional linear array perpendicular to the cell movement direction, and the length of this one-dimensional linear array is 30 μm, its imaging limiting flux can be determined to be 5 (m / s) / (30 μm) ≈ 166,667 eps, which is much higher than the imaging flux of the time domain imaging method using only spatially distributed dynamic modulation of the structured light field.
[0062] Furthermore, the system 100 may include multiple frequency-domain marker illumination modules 101 with independent optical paths to achieve multi-path imaging. This allows the system 100 to fuse images obtained from different optical paths without interfering with each other, thereby improving the resolution and image quality of the resulting fluorescent marker spectral image and the unmarked image. The structure of each frequency-domain marker illumination module 101 may be the same or different, and can be flexibly set according to actual usage requirements. This disclosure does not impose specific limitations on this.
[0063] The frequency domain marker illumination module 101 and the frequency domain marker illumination light field will be described in detail later in conjunction with the possible implementation methods of this disclosure, and will not be repeated here.
[0064] The fluid focusing module 102 can, based on fluid dynamics, control the sample cell suspension to flow in a single-cell axial flow along a fixed straight line through the detection area formed by the frequency domain labeled illumination field. Since the cell flow velocity in the fluid focusing module 102 can reach the order of m / s, the system 100 can achieve a detection throughput of over 10,000 cells / s. The specific form of the fluid focusing module 102 can be found in related technical embodiments, and this disclosure does not impose specific limitations on it.
[0065] In one example, the fluid focusing module 102 can be either a focusing module based on a conventional flow cytometer flow chamber or a focusing module based on microfluidics technology.
[0066] Figure 2 shows a schematic diagram of the structure of a conventional flow cytometer flow chamber according to an embodiment of the present disclosure. As shown in Figure 2, the conventional flow cytometer flow chamber 200 consists of a conical flow cell 201 and a direct current channel 203. The side wall of the conical flow cell 201 has two symmetrically positioned inlet ports 202. When the sample cell suspension is injected into the conical flow cell 201, two streams of sheath fluid are injected into the conical flow cell 201 through the two symmetrical inlet ports 202. The sheath fluid can encapsulate the sample cell suspension flow, and after being constrained by the conical flow cell 201, it forms a single-cell axial flow and enters the direct current channel 203, passing through the detection area 204 irradiated by a frequency-domain labeled illumination field.
[0067] Figure 3 shows a schematic diagram of a microfluidic chip according to an embodiment of the present disclosure. As shown in Figure 3, the microfluidic chip 300 includes a central channel 301 and two symmetrically positioned microchannels 302 on both sides. Two sheath fluids are injected into the chip 300 through the symmetrical microchannels 302, while a sample cell suspension is injected into the chip 300 through the central channel 301. Under the fluid compression of the two sheath fluids, the sample cell suspension can be converted into a constant single-cell axial flow and passed through the detection area 303 illuminated by a frequency-domain labeled illumination field. Focusing the sample cell suspension using the microfluidic chip has the advantage of being fully enclosed and pollution-free.
[0068] The sheath fluid can be obtained by referring to the implementation methods in related technologies, such as using a balanced electrolyte solution with no fluorescent background, etc., and this disclosure does not make specific limitations in this regard.
[0069] In addition to the above methods, the fluid focusing module 102 can also be implemented in other ways based on the principles of fluid dynamics, such as single-sheath flow, etc. This disclosure does not impose any specific restrictions on this.
[0070] In practical use, the probability of multiple cells overlapping and passing through the fluid focusing module 102 can be reduced by lowering the concentration of the sample cell suspension. If cells overlap in the fluid focusing module 102, they can be analyzed and processed during imaging to distinguish the overlapping cells.
[0071] When the sample cell suspension, after being focused by hydrodynamics, passes through the detection area, the fluorescent labels on the surface and inside each cell in the sample cell suspension are excited under the action of the frequency domain labeled illumination field, which can emit corresponding fluorescent signals, as well as label-free signals such as scattered light signals that can be directly used for imaging without fluorescent labeling; the fluorescent signals and label-free signals can be collectively referred to as target light signals, which usually need to undergo further light collection and dispersion processing in order to be used for imaging.
[0072] The light-receiving module 103 can detect the target light signal generated by the sample cell suspension under the action of the frequency domain labeled illumination field, and transmit the target light signal to the beam-splitting module 104. The specific structure of the light-receiving module can be flexibly set according to actual usage requirements, depending on the specific number of frequency domain labeled illumination modules 101 and the specific structure of the beam-splitting module 104. For example, it may include at least one light-receiving objective and at least one focusing objective. This disclosure does not specifically limit this.
[0073] The spectrometer module 104 can separate the target light signal into a fluorescence spectral signal and a label-free signal, which are then input into the photodetector module 105 respectively. On the other hand, fluorescence signals typically include multiple different fluorescent components; therefore, the spectrometer module 104 can further separate the fluorescence signal into fluorescence spectral signals with independently distributed different fluorescent components based on the wavelength differences of the fluorescent components. Furthermore, the label-free signal can also be further subdivided into different signal types by the spectrometer module 104 according to actual imaging requirements.
[0074] The beam splitter module 104 will be described in detail later in conjunction with the possible implementation methods disclosed herein, and will not be repeated here.
[0075] The photoelectric detection module 105 includes multiple independent detection channels, which can detect the fluorescence spectral signal obtained by the spectrometer module 104 and convert the fluorescence spectral signal into a first electrical signal. For example, a voltage signal proportional to the light intensity of the fluorescence spectral signal can be output as the first electrical signal. Because the photoelectric detection module 105 has a high number of spectral detection channels, the system 100 can detect a wide variety and quantity of fluorescent dyes.
[0076] In one example, the sample cell suspension used by system 100 is prepared by staining cells with 32 to 200 different fluorescent staining agents. In order to detect all fluorescent components in the fluorescence spectral signal, the photoelectric detection module 105 can be configured to have 32 to 200 spectral detection channels.
[0077] Correspondingly, the photoelectric detection module 105 can also detect unmarked signals and convert them into corresponding second electrical signals. The specific structure of the photoelectric detection module 105 can be flexibly set according to actual usage requirements, depending on the specific number of frequency domain marker illumination modules 101 and the specific structure of the beam splitting module 104. This disclosure does not impose specific limitations on this.
[0078] The photoelectric detection module 105 will be described in detail later in conjunction with the possible implementation methods of this disclosure, and will not be repeated here.
[0079] The acquisition and processing module 106 can receive and store the first electrical signal and the second electrical signal from the photoelectric detection module 105, and analyze and process the first electrical signal and the second electrical signal respectively, thereby determining the fluorescently labeled spectral image and the label-free image corresponding to the sample cell suspension. The specific structure of the acquisition and processing module 106 can be flexibly set according to actual usage requirements, and this disclosure does not impose specific limitations on it.
[0080] The acquisition and processing module 106 will be described in detail later in conjunction with the possible implementation methods of this disclosure, and will not be repeated here.
[0081] The hydrodynamic focusing imaging system based on frequency-domain labeled illumination of this embodiment utilizes fluid dynamics principles. A fluid focusing module directs a sample cell suspension through a frequency-domain labeled illumination light field generated by a frequency-domain labeled illumination module at a preset modulation frequency, in a single-cell axial flow manner. The frequency-domain labeled illumination light field comprises multiple light spots distributed at preset positions, each with a different flicker frequency. This allows for dynamic modulation of the spatial distribution of the illumination light field and the flicker frequency modulation of each light spot, encoding a two-dimensional image of the cell into the frequency domain. This approach leverages the high flow rate of the sample cell suspension to increase detection throughput and utilizes the smaller size of the frequency-domain illumination light field parallel to the cell movement direction to reduce the probability of signal aliasing between two cell samples, further improving cell imaging throughput. A light-receiving module collects the target light signal generated by the sample cell suspension under the influence of the frequency-domain labeled illumination light field and transmits the target light signal to a light-splitting module. The target light signal can be separated into fluorescence spectral signals and label-free signals with independently distributed fluorescence components in different wavelength ranges through a beam splitting module. A photoelectric detection module can detect the fluorescence spectral signals and label-free signals, and determine the first electrical signal corresponding to the fluorescence spectral signal and the second electrical signal corresponding to the label-free signal, respectively. The acquisition and processing module can determine the fluorescence-labeled spectral image corresponding to the sample cell suspension based on the first electrical signal, thus distinguishing different structures in the cells through fluorescence labeling. Based on the second electrical signal, it can determine the label-free image corresponding to the sample cell suspension, thereby achieving high-throughput, high-resolution fluorescence spectral imaging and label-free imaging. Furthermore, the hydrodynamic focusing imaging system of this embodiment can not only achieve frequency-domain coded flow cytometry based on frequency-domain labeled illumination, but also achieve time-domain coded flow cytometry by adjusting the specific structure of the frequency-domain labeled illumination module according to actual imaging needs and cost requirements. It has high system flexibility and applicability and can be widely applied to various usage scenarios.
[0082] In one possible implementation, the frequency domain marking illumination module 101 includes: a laser source for generating continuous laser or pulsed laser of a preset wavelength; an optical fiber bundle for separating the continuous laser or pulsed laser into multiple independent laser beams, wherein the positional relationship between each optical fiber in the optical fiber bundle satisfies a preset positional distribution; a focusing lens for focusing the multiple independent laser beams to obtain an initial light field; and an illumination frequency modulation submodule for performing frequency modulation on each spot in the initial light field based on the modulation frequency to obtain a frequency domain marking illumination light field.
[0083] Figure 4 shows a schematic diagram of a frequency domain marker illumination module according to an embodiment of the present disclosure. As shown in Figure 4, the frequency domain marker illumination module 101 includes: a laser source 401, an optical fiber bundle 402, a focusing lens 403, and an illumination frequency modulation submodule not shown in the figure.
[0084] The laser source 401 can be used to generate at least one preset wavelength of continuous laser or pulsed laser, and the power of the continuous laser or pulsed laser is within a preset range. The specific wavelength and power of the continuous laser or pulsed laser can be flexibly set according to actual usage requirements, and this disclosure does not impose specific limitations on them.
[0085] In one example, the wavelength of the continuous laser or pulsed laser can be 355nm, 375nm, 405nm, 488nm, 530nm, 561nm and 640nm, etc., and the laser power of the continuous laser or pulsed laser can be in the milliwatt range.
[0086] The specific form of the laser source 401 can be referred to in the implementation methods in related technologies, such as commercial laser sources, and this disclosure does not make specific limitations in this regard.
[0087] The fiber bundle 402 is composed of multiple independent optical fibers, including an output end for receiving continuous laser or pulsed laser from the laser source 401, and an output end where the positional relationship of each fiber head satisfies a preset positional distribution. It can be used to separate continuous laser or pulsed laser into multiple independent laser beams. The specific materials used for the optical fibers in the fiber bundle 402 can be found in embodiments in related technologies, and this disclosure does not impose specific limitations on them.
[0088] The focusing lens 403 can focus multiple independent laser beams and project them onto the corresponding focal plane to obtain an initial light field. The initial light field includes multiple light spots that meet a preset position distribution. Without modulating the flicker frequency of each light spot through the illumination frequency modulation submodule, the two-dimensional image of the cell can be unfolded on the time axis by the spatial distribution of the multiple static light spots themselves and the movement of each cell in the sample cell suspension, thereby realizing the encoding of the two-dimensional image of the cell in the time domain signal.
[0089] The frequency modulation submodule can perform frequency modulation on each spot in the initial light field based on the modulation frequency to obtain a frequency-domain marked illumination light field.
[0090] In addition to the aforementioned optical devices, other optical devices, such as beam combiners and apertures, can be added to the frequency domain marker illumination module 101 according to actual usage requirements. This disclosure does not impose specific limitations on this.
[0091] In one possible implementation, the frequency domain marking illumination module 101 includes: a laser source array for generating multiple independent laser beams that satisfy a preset wavelength; a focusing lens for focusing the multiple independent laser beams to obtain an initial light field, wherein the positional relationship between each spot in the initial light field satisfies a preset positional distribution; and an illumination frequency modulation submodule for performing frequency modulation on each spot in the initial light field based on the modulation frequency to obtain a frequency domain marking illumination light field.
[0092] Figure 5 shows a schematic diagram of a frequency domain marker illumination module according to an embodiment of the present disclosure. As shown in Figure 5, the frequency domain marker illumination module 101 includes: a laser source array 501, a focusing lens 502, and an illumination frequency modulation submodule not shown in the figure.
[0093] The laser source array 501 includes multiple laser sources for generating multiple independent laser beams that meet preset wavelengths. The specific wavelength and power of each independent laser beam can be flexibly set according to actual usage requirements, and this disclosure does not impose specific limitations on this.
[0094] In one example, the wavelength of any individual laser beam can be 355nm, 375nm, 405nm, 488nm, 530nm, 561nm, and 640nm, etc., and the laser power of each individual laser beam can be in the milliwatt range.
[0095] The focusing lens 502 can focus multiple independent laser beams and project them onto the corresponding focal plane to obtain an initial light field. The initial light field includes multiple light spots that meet a preset position distribution. Without modulating the flicker frequency of each light spot through the illumination frequency modulation submodule, the two-dimensional image of the cell can be unfolded on the time axis by the spatial distribution of the multiple static light spots themselves and the movement of each cell in the sample cell suspension, thereby realizing the encoding of the two-dimensional image of the cell in the time domain signal.
[0096] The frequency modulation submodule can perform frequency modulation on each spot in the initial light field based on the modulation frequency to obtain a frequency-domain marked illumination light field.
[0097] In addition to the aforementioned optical devices, other optical devices, such as beam combiners and apertures, can be added to the frequency domain marker illumination module 101 according to actual usage requirements. This disclosure does not impose specific limitations on this.
[0098] In one possible implementation, the frequency domain marking illumination module 101 includes: a laser source for generating continuous laser or pulsed laser of a preset wavelength; a laser modulation device for modulating the continuous laser or pulsed laser into multiple independent laser beams, wherein the positional relationship between the multiple independent laser beams satisfies a preset positional distribution; a focusing lens for focusing the multiple independent laser beams to obtain an initial light field; and an illumination frequency modulation submodule for performing frequency modulation on each spot in the initial light field based on the modulation frequency to obtain a frequency domain marking illumination light field.
[0099] Specifically, the frequency domain marker illumination module 101 may further include a laser source, a diffractive optical element, and a focusing lens. The laser source can be used to generate at least one preset wavelength of continuous laser or pulsed laser, and the power of the continuous laser or pulsed laser is within a preset range.
[0100] Laser modulation devices can be used to modulate continuous or pulsed laser light into multiple independent laser beams, ensuring that the positional relationship between these beams satisfies a preset positional distribution. The specific form of the laser modulation device can be flexibly configured according to actual application requirements; for example, it can be a diffractive optical element (DOE) or a spatial light modulator (SLM), etc., and this disclosure does not impose any specific limitations on it.
[0101] In one example, the laser modulation device is a DOE. The surface of the DOE is fabricated using micromachining techniques to create relief structures or nanoscale microstructures; when a continuous or pulsed laser from a laser source irradiates the DOE surface, it is modulated into multiple lasers whose positional relationships satisfy a preset positional distribution.
[0102] A focusing lens can focus multiple independent laser beams and project them onto the corresponding focal plane to obtain the initial light field.
[0103] The frequency modulation submodule can perform frequency modulation on each spot in the initial light field based on the modulation frequency to obtain a frequency-domain marked illumination light field.
[0104] In addition to the aforementioned optical devices, other optical devices, such as beam combiners and apertures, can be added to the frequency domain marker illumination module 101 according to actual usage requirements. This disclosure does not impose specific limitations on this.
[0105] In addition to the above-described embodiments, the composition of optical components in the optical devices of the frequency domain marker illumination module 101 can be adaptively adjusted according to actual usage requirements. This disclosure does not impose specific limitations in this regard.
[0106] In one possible implementation, the illumination frequency modulation submodule includes any one of an optical chopper, an electro-liquid crystal control array, or a modulated laser array.
[0107] Figure 6 shows a schematic diagram of an illumination frequency modulation submodule according to an embodiment of the present disclosure. As shown in Figure 6(a), the illumination frequency modulation submodule is an optical chopper, also known as a spatial light filter. It is circular in shape and its surface is engraved with light-transmitting structures (such as light-transmitting holes) and light-blocking structures that satisfy a preset distribution pattern. The specific content of the preset distribution pattern depends on the specific requirements of the modulation frequency and can be flexibly set according to actual usage requirements. For example, it may include the size of the light-transmitting structures, the spacing between adjacent light-transmitting structures, etc., which are not specifically limited in this disclosure.
[0108] An optical chopper can be set at the focal point of the initial light field (i.e., the focal point of any light spot in the initial light field) and rotate according to a preset angular velocity, so that the light-transmitting structure and the light-blocking structure on its surface satisfying a preset distribution law sweep across each light spot in the initial light field in sequence, so that each light spot flashes at the corresponding modulation frequency, thereby achieving frequency modulation of each light spot.
[0109] Taking Figure 6 as an example, as shown in Figure 6(b), the illumination frequency modulation submodule is an electro-liquid crystal control array, which can also be called a liquid crystal light-transmitting material array. The electro-liquid crystal control array includes multiple liquid crystal modulation units, and any liquid crystal modulation unit can adjust its own light transmittance according to the voltage applied externally. The specific number of liquid crystal modulation units depends on the number of light spots included in the initial light field, and can be flexibly set according to actual usage requirements. This disclosure does not impose specific limitations on this.
[0110] The electro-liquid crystal control array can be set at the focal point of the initial light field, and can apply a modulation electric field with a different modulation frequency to each liquid crystal modulation unit, so that each liquid crystal modulation unit can switch between the light-transmitting state and the light-blocking state with the corresponding modulation frequency, thereby making each light spot flash with the corresponding modulation frequency, and realizing frequency modulation of each light spot.
[0111] Taking Figure 6 above as an example, as shown in Figure 6(c), the illumination frequency modulation submodule is a modulation laser array, including multiple modulation lasers. The specific form of the modulation laser can be found in related technical implementations; for example, it can be a laser diode (LD), etc., and this disclosure does not specifically limit it in this regard.
[0112] The modulated laser array can be set at the focal point of the initial light field, and each modulated laser in the modulated laser array can be intensity modulated separately, such as TTL (Transistor-Transistor Logic) intensity modulation, so that each light spot in the initial light field can flicker at the corresponding modulation frequency.
[0113] Furthermore, the system 100 provided in this embodiment can also remove the illumination frequency modulation submodule in the frequency domain labeled illumination module 101, keeping other modules unchanged, thereby using the initial light field to time-domain encode the two-dimensional image of the cell to determine the fluorescently labeled spectral image and the unlabeled image corresponding to the sample cell suspension; the detection throughput of this time-domain encoded imaging method is lower than that of the frequency domain encoded imaging method using frequency domain labeled illumination, and when the interval between two adjacent cells is small, two cells are prone to be located in the illumination light field at the same time, resulting in signal aliasing and further reducing the detection throughput and affecting the imaging quality.
[0114] For any of the aforementioned frequency domain marker illumination modules 101, by adjusting its optical elements—for example, by adjusting the positional relationship between each optical fiber in the fiber bundle, or the positional relationship between each laser source in the laser source array, or the relief structure / nanoscale microstructure mode of the diffractive optical elements—the positional relationship between each light spot in the initial light field can satisfy a preset positional distribution. The specific form of the preset positional relationship depends on the specific usage of the system 100 and can be flexibly set according to actual usage requirements; this disclosure does not impose specific limitations on it.
[0115] In one possible implementation, when frequency domain labeled illumination is required, the preset position distribution can be set as at least one row of a one-dimensional linear array perpendicular to the direction of cell movement in the sample cell suspension and located on the cell flow plane.
[0116] Figure 7 shows a schematic diagram of a frequency-domain labeled illumination field according to an embodiment of the present disclosure. As shown in Figure 7(a), the direction of cell movement in the sample cell suspension is the y-direction, and the direction perpendicular to the cell movement is the x-direction. The frequency-domain labeled illumination field is a single-row one-dimensional linear array distributed along the x-direction, including n light spots, and the light spots n have corresponding scintillation frequencies f. n And the distance between any two light spots is δ x .
[0117] According to the sampling theorem, when using this frequency-domain labeled illumination field for streaming imaging, the imaging resolution in the x-direction is max(δ). x ( / 2, r), where r is the radius of each light spot. The distance between any two light spots is δ. xThe specific values of the radius r of each light spot can be flexibly set according to actual usage requirements, and this disclosure does not impose specific limitations on them.
[0118] Wherein, the flicker frequency f corresponds to the light spot n. n It can be modulated using any of the aforementioned forms of illumination frequency modulation submodules according to its corresponding light intensity modulation function. The specific form of the light intensity modulation function can be flexibly set according to actual usage requirements. For example, it can be set to a square wave, a sine wave, or any other orthogonal function system waveform. This disclosure does not impose any specific limitations on it.
[0119] Figure 8 shows a waveform diagram of a light intensity modulation function according to an embodiment of the present disclosure. As shown in Figure 8(a), the frequency domain labeled illumination light field consists of n light spots in a single-row one-dimensional linear array distributed along the x-direction, and the light intensity corresponding to each light spot can be represented as a square wave with different frequencies and periods. As shown in Figure 8(b), the frequency domain labeled illumination light field consists of n light spots in a single-row one-dimensional linear array distributed along the x-direction, and the light intensity corresponding to each light spot can be represented as a sine wave with different frequencies and periods.
[0120] To improve imaging resolution and quality, the number of rows in the one-dimensional linear array of the frequency-domain labeled illumination field can be increased. Taking Figure 7 as an example, as shown in Figure 7(b), the frequency-domain labeled illumination field consists of 2n spots in two rows of one-dimensional linear arrays distributed along the x-direction, with each row containing n spots. For any row of the one-dimensional linear array, the distance between any two spots is δ. x Furthermore, the horizontal distance along the x-direction between the first light spot in the upper one-dimensional linear array and the first light spot in the lower one-dimensional linear array is δ. x / 2, so that the light spots of the two rows of one-dimensional linear arrays are arranged alternately. Specifically, as shown in the enlarged view of Figure 7(b), the horizontal distance along the x-direction between two adjacent light spots in the lower one-dimensional linear array is δ. x The horizontal distance along the x-direction between the light spot in the upper one-dimensional linear array and the light spot in front of the lower one-dimensional linear array is δ. x / 2. The vertical distance between two rows of one-dimensional linear arrays can be flexibly set according to actual usage requirements, and this disclosure does not impose specific limitations on it.
[0121] Taking Figure 7 as an example, as shown in Figure 7(c), the frequency domain labeled illumination field consists of 3n light spots distributed along the x-direction in a three-row one-dimensional linear array, with each row of the one-dimensional linear array including n light spots. For any row of the one-dimensional linear array, the distance between any two light spots is δ. x Furthermore, the horizontal distance along the x-direction between the first light spot in the middle one-dimensional linear array and the first light spot in the bottom one-dimensional linear array is δ.x / 3, the first light spot in the topmost one-dimensional linear array is δ at a horizontal distance along the x-direction relative to the first light spot in the middle one-dimensional linear array. x / 3, so that the light spots of the three rows of one-dimensional linear arrays are arranged in an alternating pattern. Specifically, as shown in the enlarged view of Figure 7(b), the horizontal distance along the x-direction between two adjacent light spots in the bottom one-dimensional linear array is δ. x The horizontal distance along the x-direction between the light spot in the middle of the one-dimensional linear array and the light spot in front of the one-dimensional linear array below is δ. x / 3; The horizontal distance along the x-direction between the light spot in the uppermost one-dimensional linear array and the light spot in the middle one-dimensional linear array is also δ. x / 3. The vertical distance between the three rows of one-dimensional linear arrays can be flexibly set according to actual usage requirements, and this disclosure does not impose specific limitations on it.
[0122] In one possible implementation, where frequency-domain labeled illumination is not required, temporal coding can be directly performed using the initial light field to achieve flow-focusing imaging. In this case, the preset position distribution can include any of the following: a regular two-dimensional dot matrix, a regular one-dimensional dot matrix, or a random two-dimensional dot matrix, arranged at equal intervals along the cell movement direction and randomly arranged perpendicular to the cell movement direction. It is important to note that in this case, the horizontal distance between adjacent dots along the cell movement direction should be greater than the size of the cells in the sample cell suspension to ensure that the same cell is illuminated by only one dot at a time.
[0123] As cells in a sample cell suspension sequentially pass through each spot in the frequency-domain labeled illumination field, fluorescent labels on the cell surface or inside the cell are excited by each spot in a predetermined order, perpendicular to the direction of cell movement, generating corresponding fluorescent spectral signals and label-free signals. By detecting the fluorescent spectral signals and label-free signals, the distribution of fluorescent labels and the characteristics of the label-free signals can be encoded into the frequency domain. By splitting and recombining the fluorescent spectral signals and label-free signals in the frequency domain, a fluorescent spectral image of the cell and at least one label-free image can be reconstructed.
[0124] Correspondingly, in the absence of frequency domain labeled illumination, the initial light field can be directly utilized. As the cells in the sample cell suspension pass through each spot in the initial light field in sequence, the distribution of fluorescent labels and the characteristics of unlabeled signals are encoded into the time domain. In the time domain, the fluorescent spectral signal and the unlabeled signal can also be split and recombined to reconstruct the fluorescent spectral image of the cell and at least one unlabeled image.
[0125] The specific method of image reconstruction can be flexibly set according to actual usage requirements. For example, methods such as inverse Fourier transform can be used. This disclosure does not impose specific limitations on this.
[0126] In one possible implementation, the spectrophotometer 104 includes: a fluorescence separation submodule and a multi-channel spectrophotometer; the fluorescence separation submodule is used to separate the fluorescent components of the target light signal based on a preset wavelength range to obtain a fluorescence spectral signal; the multi-channel spectrophotometer is used to perform multi-channel separation of the target light signal by utilizing the optical action type of the frequency domain labeled illumination light field on the sample cell suspension to obtain a label-free signal.
[0127] Taking Figure 1 above as an example, as shown in Figure 1, the spectrophotometer module 104 includes a fluorescence spectral spectrophotometer module 1041 and a multi-channel spectrophotometer module 1042.
[0128] The spectrometer module 104 can separate the target light signal received from the light receiving module 103 into a fluorescent signal and a label-free signal. The separated fluorescent signal is then incident on the fluorescence spectral spectrometer module 1041. The fluorescence spectral spectrometer module 1041 can further perform fluorescence spectral spectrometry on the fluorescent signal based on a preset wavelength range, separating the fluorescent components of different wavelength bands in the fluorescent signal into spatially independent fluorescence spectral signals. The fluorescence spectral spectrometer module 1041 will be described in detail below in conjunction with possible implementations of this disclosure, and will not be repeated here.
[0129] The separated label-free signal is then incident on the multi-channel photonics module 1042. The multi-channel photonics module 1042 can utilize the optical interaction type of the sample cell suspension on the frequency-domain labeled illumination field to perform multi-channel separation of the target light signal, obtaining the label-free signal. The optical interaction type here can include light intensity interference, scattering, and phase delay effects, etc., and can be flexibly set with reference to implementation methods in related technologies; this disclosure does not specifically limit it in this regard.
[0130] In addition to the above structure, the beam splitter module 104 can also be adapted to add other optical devices, such as dichroic mirrors, optical fibers and reflectors, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0131] In one possible implementation, the fluorescence spectral dispersive module 1041 is any one of a prism dispersion dispersive module, a grating dispersion dispersive module, a diffractive optical device dispersion dispersive module, and a multi-dichroic mirror and filter dispersive module.
[0132] Figure 9 shows a schematic diagram of a multi-prism dispersion photonic module according to an embodiment of the present disclosure. As shown in Figure 9, the multi-prism dispersion photonic module 900 includes a multi-prism group 901 and a condenser lens 902. The multi-prism group 901 includes a predetermined number of prisms. After collimation, the fluorescence signal is incident on the multi-prism group 901. Since the fluorescence signal includes fluorescence components of different wavelengths, after the dispersion effect of the prisms, the fluorescence components of different wavelengths in the fluorescence signal exit from the multi-prism group 901 at different angles. After exiting through the condenser lens 902, spatially discrete fluorescence spectral signals are formed at the focal plane of the condenser lens 902.
[0133] The preset number of prisms in the prism group 901 can be set according to the detection resolution of the fluorescence spectrum by the photoelectric detection module 105 and the spatial dimensions of the system 100; this disclosure does not impose specific limitations on this. The parameters of the condenser lens 902, such as its size and focal length, can be set according to actual usage requirements; this disclosure does not impose specific limitations on this.
[0134] In addition to the above structure, the multi-prism dispersion photonic module can also be adapted to add other optical devices, such as lenses, optical fibers and mirrors, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0135] Figure 10 shows a schematic diagram of a grating dispersion photonic module according to an embodiment of the present disclosure. As shown in Figure 10, the grating dispersion photonic module 1000 includes a reflective dispersion grating 1001 and a condenser lens 1002. After a fluorescence signal is incident on the reflective dispersion grating 1001, it is dispersed by the reflective dispersion grating 1001, and the fluorescence components of different wavelengths in the fluorescence signal are reflected from the reflective dispersion grating 1001 at different angles. After exiting through the condenser lens 1002, spatially discrete fluorescence spectral signals are formed at the focal plane of the condenser lens 1002.
[0136] The parameters of the reflective dispersion grating 1001, such as dispersion rate and size, can be set according to actual usage requirements, and this disclosure does not impose specific limitations on them. The parameters of the condenser lens 1002, such as size and focal length, can be set according to actual usage requirements, and this disclosure does not impose specific limitations on them.
[0137] In addition to the above structure, the grating dispersion photonic module can also be adapted to add other optical devices, such as lenses, optical fibers and mirrors, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0138] Figure 11 shows a schematic diagram of a diffractive optical device dispersion photonic module according to an embodiment of the present disclosure. As shown in Figure 11, the diffractive optical device dispersion photonic module 1100 includes a diffractive optical device 1101 and a condenser lens 1102. The surface of the diffractive optical device 1101 has a micro-machined relief structure, which can be fabricated to resemble a transmission grating. After a fluorescence signal is incident on the diffractive optical device 1101, fluorescence components of different wavelengths in the fluorescence signal will exit from the diffractive optical device 1101 at different angles, and then exit through the condenser lens 1102, forming spatially discrete fluorescence spectral signals at the focal plane of the condenser lens 1102.
[0139] The diffractive optical device 1101 can be a diffractive optical element (DOE) or other devices. The parameters of the diffractive optical device 1101, such as its size, can be set according to the usage requirements, and this disclosure does not impose specific limitations on it. The parameters of the condenser lens 1102, such as its size and focal length, can be set according to the actual usage requirements, and this disclosure does not impose specific limitations on it.
[0140] In addition to the above structure, the diffractive optical device dispersion photonic module can also be adapted to add other optical devices, such as lenses, optical fibers and mirrors, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0141] Figure 12 shows a schematic diagram of a multi-dichroic mirror and filter photomultiplier module according to an embodiment of the present disclosure. As shown in Figure 12, the multi-dichroic mirror and filter photomultiplier module 1200 includes a dichroic mirror group, a bandpass filter group, and a condenser lens group. The dichroic mirror group includes a predetermined number of dichroic mirrors, namely dichroic mirrors 12011 to 1201n. The types of dichroic mirrors can be the same or different, ensuring that each dichroic mirror has a different cutoff wavelength, thus enabling spatial separation of fluorescence components in different wavelength bands of the fluorescence signal. This disclosure does not specifically limit this. The bandpass filter group includes a predetermined number of bandpass filters, namely bandpass filters 12021 to 1202n. The condenser lens group includes a predetermined number of condenser lenses, namely condenser lenses 12031 to 1203n.
[0142] The preset number of dichroic mirrors in the dichroic mirror group, the preset number of bandpass filters in the bandpass filter group, and the preset number of condenser lenses in the condenser lens group are the same, and can be set according to the detection resolution of the fluorescence spectrum by the photoelectric detection module 105 and the spatial size of the system 100. This disclosure does not make specific limitations in this regard.
[0143] In one example, all the dichroic mirrors in the dichroic mirror group can be long-pass dichroic mirrors, and the cutoff wavelengths of dichroic mirrors 12011 to 1201n can be determined as λ1 to λ2, respectively. n The fluorescence signal includes n fluorescent components of different wavelengths, with wavelengths ranging from λ1 to λ2. n When a fluorescent signal is incident on dichroic mirror 12011, due to the cutoff wavelength of dichroic mirror 12011 being λ1, the fluorescent components with wavelengths less than λ1 are reflected, pass through bandpass filter 12021, and are focused out by condenser lens 12031. Fluorescent components with wavelengths not less than λ1 can pass through dichroic mirror 12011 and are incident on dichroic mirror 12012. Due to the cutoff wavelength of dichroic mirror 12011 being λ2, the fluorescent components with wavelengths less than λ2 are reflected, pass through bandpass filter 12022, and are focused out by condenser lens 12032. Fluorescent components with wavelengths not less than λ2 can pass through dichroic mirror 12012 and are incident on dichroic mirror 12013. Similarly, after the components of different wavelengths in the fluorescence signal are separated by a series of dichroic mirrors and bandpass filters with closely spaced cutoff wavelengths, they can be separated into spatially discrete fluorescence spectral signals.
[0144] In one example, all the dichroic mirrors in the dichroic mirror group can be short-pass dichroic mirrors, and the cutoff wavelengths of dichroic mirrors 12011 to 1201n can be determined as λ1 to λ2, respectively. n The fluorescence signal includes n fluorescent components of different wavelengths, with wavelengths ranging from λ1 to λ2. n When a fluorescent signal is incident on dichroic mirror 12011, due to the cutoff wavelength of dichroic mirror 12011 being λ1, the fluorescent components with wavelengths greater than λ1 are reflected, pass through bandpass filter 12021, and are focused out by condenser lens 12031. Fluorescent components with wavelengths not greater than λ1 can pass through dichroic mirror 12011 and are incident on dichroic mirror 12012. Due to the cutoff wavelength of dichroic mirror 12011 being λ1, the fluorescent components with wavelengths greater than λ2 are reflected, pass through bandpass filter 12022, and are focused out by condenser lens 12032. Fluorescent components with wavelengths not greater than λ2 can pass through dichroic mirror 12012 and are incident on dichroic mirror 12013. Similarly, after the components of different wavelengths in the fluorescence signal are separated by a series of dichroic mirrors and bandpass filters with closely spaced cutoff wavelengths, they can be separated into spatially discrete fluorescence spectral signals.
[0145] The parameters of each dichroic mirror in the dichroic mirror group, the parameters of each bandpass filter in the bandpass filter group, and the parameters of each condenser lens in the condenser lens group, such as cutoff wavelength, size, and focal length, can be set according to actual usage requirements, and this disclosure does not impose specific limitations on them.
[0146] In addition to the above structure, the multi-dichroic mirror and filter photonic module can also be adapted to add other optical devices, such as lenses, optical fibers and mirrors, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0147] In one possible implementation, the label-free signal includes at least one of the following: laser intensity signal, forward scattered light signal, side scattered light signal, back scattered light signal, and phase difference signal. The multi-channel photonics module 1042 includes at least one of the following channel units: a bright field channel unit, a forward scattered channel unit, a side scattered channel unit, a back scattered channel unit, and a phase difference imaging channel unit. The bright field channel unit is used to obtain the laser intensity signal by utilizing the intensity perturbation of the frequency domain labeled illumination field by the sample cell suspension. The forward scattered channel unit is used to determine the forward scattered light signal by utilizing the forward scattering of the frequency domain labeled illumination field by the sample cell suspension. The side scattered channel unit is used to determine the side scattered light signal by utilizing the side scattering of the frequency domain labeled illumination field by the sample cell suspension. The back scattered channel unit is used to determine the back scattered light signal by utilizing the backscattering of the frequency domain labeled illumination field by the sample cell suspension. The phase difference imaging channel unit is used to determine the phase difference signal by utilizing the refraction of the frequency domain labeled illumination field by the sample cell suspension.
[0148] Based on the optical interaction of the sample cell suspension with the frequency-domain labeled illumination field, the multi-channel photonics module 1042 can perform multi-channel separation of the target light signal to obtain different types of label-free signals. Specifically, when cells in the sample cell suspension pass through the detection area, they exert various effects on the laser of the frequency-domain labeled illumination field, thereby generating different types of label-free signals. These label-free signals can include laser intensity signals, scattered light signals, and phase difference signals. The scattered light signals, depending on the scattering angle, can include forward scattered light signals, side scattered light signals, and backscattered light signals. Each label-free signal is associated with different information about the cell; therefore, based on the label-free signals, corresponding label-free imaging can be performed to generate images expressing the corresponding cell information.
[0149] When cells in a sample cell suspension pass through the detection area and are illuminated by a frequency-domain labeled light field, the cells cause a disturbance to the total intensity of the laser light field, generating a corresponding laser intensity signal. The image formed based on this laser intensity signal is related to the cell contours, etc.
[0150] When cells in a sample cell suspension pass through the detection area and are illuminated by a frequency-domain labeled illumination field, the cells scatter the laser light, generating corresponding scattered light signals. These scattered light signals can be used for cell imaging. Depending on the scattering angle, the scattered light signals can include forward scattered light signals, side scattered light signals, and backscattered light signals. Images based on forward scattered light signals are related to cell size, while images based on side scattered light signals are related to cell granularity, and images based on backscattered light signals are related to cell size and morphology.
[0151] When cells in a sample cell suspension pass through the detection area and are illuminated by a frequency-domain labeled light field, the refractive index change caused by the cells introduces a phase delay to the laser light in the frequency-domain labeled light field. By introducing other phase delays, a corresponding phase difference signal can be generated.
[0152] Figure 13 shows a schematic diagram of a bright-field channel unit according to an embodiment of the present disclosure. As shown in Figure 13, a frequency-domain labeled illumination field is generated at the focal plane of the focusing lens 1301. When cells in the sample cell suspension flow through the frequency-domain labeled illumination field, the laser intensity of the frequency-domain labeled illumination field is attenuated, thereby generating a laser intensity signal that reflects the attenuation of the laser intensity of the frequency-domain labeled illumination field. After the laser intensity signal is received by the receiving objective lens 1302, it is emitted to a 4f system 1303 composed of a pair of lenses. The 4f system 1303 converts the laser intensity signal at the exit pupil of the receiving objective lens 1302 onto the focal plane of the 4f system 1303. An aperture 1304 is placed after the 4f system 1303 to attenuate the intensity of the laser intensity signal to achieve a suitable detection range. When cells flow through the frequency-domain labeled illumination field, the intensity of the laser intensity signal is represented as a series of negative pulses in the time domain. By splitting and recombining the laser intensity signal, the bright-field image of the cells can be reconstructed.
[0153] In addition to the optical devices mentioned above, the bright-field channel unit can also be adapted to add other optical devices, such as lenses, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0154] Figure 14 shows a schematic diagram of a scattered light channel unit according to an embodiment of the present disclosure. As shown in Figure 14, a frequency-domain labeled illumination light field is generated at the focal plane of the focusing lens 1401. When cells in a sample cell suspension flow through the frequency-domain labeled illumination light field, scattered light is generated at various angles. Scattered light propagating in the same direction as the propagation direction of the frequency-domain labeled illumination light field is a forward scattered light signal. Scattered light propagating along a direction having a preset angle with the propagation direction of the frequency-domain labeled illumination light field is a side scattered light signal, wherein the preset angle is greater than 0° and less than 180°. Scattered light propagating away from the propagation direction of the frequency-domain labeled illumination light field, i.e., backward scattered light, is a backscattered light signal.
[0155] As shown in Figure 14(a), the receiving objective 1402a of the forward scattering channel unit can receive forward scattered light signals. A light-shielding device 1403 is placed behind the receiving objective 1402a. The light-shielding device 1403 is used to shield the direct laser light to prevent damage to the detection device of the photoelectric detection module 105. The input aperture of the receiving objective 1402a is larger than the output aperture of the focusing lens 1401, ensuring that the receiving objective 1402a can receive scattered light with a wider angular range than the frequency domain marker illumination field of the focusing lens 1401. The size of the light-shielding device 1403 is smaller than the output aperture of the receiving objective 1402a. The forward scattered light signal can pass through the remaining aperture range of the receiving objective 1402a, be focused by the condenser lens 1404a, and then be incident on the photoelectric detection module 1052b for forward scattered light imaging.
[0156] In addition to the optical devices mentioned above, the forward scattering channel unit can also be adapted to add other optical devices, such as lenses, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0157] As shown in Figure 14(b), the receiving objective 1402b of the side-scattering channel unit is placed at a preset angle to the propagation direction of the frequency domain marker illumination light field, and can receive the side-scattered light signal. Since the side-scattered light signal avoids the direct laser, no light-shielding device is needed behind the receiving objective 1402b. The side-scattered light signal is focused by the condenser lens 1404b and then incident on the photoelectric detection module 1052c for side-scattered light imaging. The preset angle at which the receiving objective 1402b is placed can be set according to actual usage requirements, such as 90°, 60°, and 30°, as long as the side-scattered light signal can be collected; this disclosure does not impose specific limitations on this.
[0158] In addition to the optical devices mentioned above, the side scattering channel unit can also be adapted to add other optical devices, such as lenses, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0159] As shown in Figure 14(c), the backscattered light signal is collected by the focusing lens 1401, propagates in the opposite direction to the propagation direction of the frequency domain marker illumination light field, is reflected by the beam splitter 1406 of the backscattering channel unit, and is then focused by the condenser lens 1404c before being incident on the photoelectric detection module 1052d for backscattering imaging.
[0160] In addition to the optical devices mentioned above, the backscattering channel unit can also be adapted to add other optical devices, such as beam splitters and lenses, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0161] Figure 15 shows a schematic diagram of a phase difference imaging channel unit according to an embodiment of the present disclosure. As shown in Figure 15, an annular phase transmission plate 1501 for generating phase difference ring illumination is placed in front of the focusing lens 1502. The presence of the annular phase transmission plate 1501 causes a 180° phase delay in the laser beam of the frequency domain labeled illumination field. When cells in the sample cell suspension flow through the frequency domain labeled illumination field, the refractive index change caused by the cells leads to a new phase delay in the laser beam of the frequency domain labeled illumination field, which interferes with the frequency domain labeled illumination field to generate a phase difference signal. After passing through the phase ring 1504 and the condenser lens 1505, the phase difference signal is incident on the photoelectric detection module 1052e for phase difference imaging.
[0162] In addition to the optical devices mentioned above, the phase contrast imaging channel unit can also be adapted to add other optical devices, such as lenses, according to actual usage requirements. This disclosure does not make specific limitations in this regard.
[0163] In one possible implementation, the photoelectric detection module 105 includes: a fluorescence spectral detector for detecting fluorescence spectral signals and converting the fluorescence spectral signals into a first electrical signal, wherein the fluorescence spectral detector includes a preset number of detection channels, the preset number being greater than or equal to the number of different fluorescent components in the fluorescence spectral signal; and a labelless signal detector for detecting labelless signals and converting the labelless signals into a second electrical signal.
[0164] Taking Figure 1 above as an example, as shown in Figure 1, the photoelectric detection module 105 includes a fluorescence spectrometer 1051 and a labelless signal detector 1052.
[0165] The fluorescence spectrometer 1051 can be used to detect fluorescence spectral signals and convert them into a first electrical signal. The fluorescence spectrometer 1051 includes a predetermined number of detection channels, each corresponding to a fluorescence spectral signal of a predetermined wavelength.
[0166] The fluorescence spectral detector 1051 can be composed of an array of photomultiplier tubes (PMTs) or an array of avalanche photodiodes (APDs). The number of photomultiplier tubes in the PMT or the number of avalanche photodiodes in the APD can be flexibly set according to actual usage requirements, depending on the amount of fluorescence components in different wavelength bands of the fluorescence signal; this disclosure does not impose specific limitations on this.
[0167] Taking Figure 9 as an example, as shown in Figure 9, the fluorescence spectral detector 1051a is a detector composed of an array of photomultiplier tubes or an array of avalanche phototubes, including n detection channels, each corresponding to a fluorescence component with wavelengths from λ1 to λn. Each detection channel can convert the fluorescence spectral signal of the corresponding preset wavelength into a first electrical signal.
[0168] The fluorescence spectral detector 1051 can also be composed of a preset number of discrete photomultiplier tubes or avalanche phototubes. The number of discrete photomultiplier tubes or avalanche phototubes can be flexibly set according to actual usage requirements, depending on the amount of fluorescence components in different wavelength bands in the fluorescence signal, and this disclosure does not make a specific limitation on this.
[0169] Taking Figure 12 as an example, as shown in Figure 12, the fluorescence spectral detector 1051b is a detector composed of discrete photomultiplier tubes or avalanche phototubes, including n discrete photomultiplier tubes or avalanche phototubes. Each discrete photomultiplier tube or avalanche phototube can be a detection channel, corresponding to fluorescence components with wavelengths from λ1 to λn. Each discrete photomultiplier tube or avalanche phototube can convert the fluorescence spectral signal of the corresponding preset wavelength into a first electrical signal.
[0170] System 100 achieves an extremely high number of spectral detection channels, such as 32-200 fluorescence spectral signal detection channels, by combining spectral dispersion and multi-channel fluorescence spectral detectors. In other words, System 100 can detect a wide variety and quantity of fluorescent dyes, enabling highly sophisticated flow cytometry applications.
[0171] The labelless signal detector 1052 can be used to detect labelless signals and convert them into a second electrical signal. The labelless signal detector 1052 may also include multiple detection channels, the number of which depends on the number of channel units in the labelless imaging module; this disclosure does not specifically limit this number. The labelless signal detector can refer to photodetectors in the prior art; this disclosure does not specifically limit this number.
[0172] Taking Figure 13 as an example, as shown in Figure 13, the laser intensity signal is incident on the markerless signal detector 1052a through the bright field channel unit, and the markerless signal detector 1052a converts the laser intensity signal into a second electrical signal.
[0173] Taking Figure 14 as an example, as shown in Figure 14(a), the forward-scattered light signal is incident on the labelless signal detector 1052b through the forward-scattering channel unit, and the labelless signal detector 1052b can convert the forward-scattered light signal into a second electrical signal. As shown in Figure 14(b), the side-scattered light signal is incident on the labelless signal detector 1052c through the side-scattering channel unit, and the labelless signal detector 1052c can convert the side-scattered light signal into a second electrical signal. As shown in Figure 14(c), the backscattered light signal is incident on the labelless signal detector 1052d through the forward-scattering channel unit, and the labelless signal detector 1052d can convert the backscattered light signal into a second electrical signal.
[0174] Taking Figure 15 as an example, as shown in Figure 15, the phase difference signal is incident on the markerless signal detector 1052e through the phase difference imaging channel unit. The markerless signal detector 1052e can convert the phase difference signal into a second electrical signal.
[0175] In one possible implementation, the acquisition and processing module 106 includes: an acquisition card for acquiring a first electrical signal and converting the first electrical signal into a corresponding first digital signal; and a computer submodule for analyzing, reconstructing, and spectrally demixing the first digital signal to determine the fluorescent label spectral image.
[0176] Taking Figure 1 as an example, as shown in Figure 1, the acquisition and processing module 106 includes an acquisition card 1061 and a computer submodule 1062. The acquisition card 1061 has the same number of acquisition channels as the detection channels of the photoelectric detection module 105.
[0177] The acquisition card 1061 can be used to acquire a first electrical signal from the fluorescence spectrometer 1051, convert the first electrical signal into a corresponding first digital signal, and store it in the computer submodule 1062. The specific form of the acquisition card 1061 can be found in embodiments in the prior art, and this disclosure does not impose specific limitations on it.
[0178] The computer submodule 1062 is used to analyze, reconstruct, and demix the spectrum of the first digital signal to determine the fluorescent label spectral image. The specific form of the computer submodule 1062 can be found in related technical embodiments, and this disclosure does not impose specific limitations on it. The specific method for analyzing, reconstructing, and demixing the spectrum of the first digital signal can be flexibly set according to actual usage requirements. For example, the first digital signal can be subjected to inverse Fourier transform, combined with principal component analysis, non-negative least squares method, etc., to achieve analysis, reconstruction, and spectral demixing; this disclosure does not impose specific limitations on it.
[0179] Figure 16 illustrates a schematic diagram of the principle of a first digital signal analysis and reconstruction according to an embodiment of the present disclosure. As shown in Figure 16, when the frequency-domain labeled illumination field consists of n spots in a single-row one-dimensional linear array perpendicular to the direction of cell movement in the sample cell suspension and located on the cell flow plane, for any cell in the sample cell suspension, when the cell passes through any spot i in the frequency-domain labeled illumination field, it will be excited by spot i and generate a corresponding fluorescence spectrum signal. This can be regarded as the fluorescence intensity information of the cell along the straight line swept by spot i, modulated at the scintillation frequency corresponding to spot i. Furthermore, the fluorescence spectrum signal obtained by the cell after passing through the frequency-domain labeled illumination field is equivalent to the sum of the signals obtained by the cell individually after passing through each spot. Since each spot in the frequency-domain labeled illumination field corresponds to a different scintillation frequency, the fluorescence spectrum signal obtained by the cell after passing through the frequency-domain labeled illumination field can be analyzed and reconstructed by performing an inverse Fourier transform on the fluorescence spectrum signal obtained by the cell after passing through the frequency-domain labeled illumination field. This reconstructs the components of the fluorescence spectrum signal obtained by the cell after passing through the frequency-domain labeled illumination field at each scintillation frequency, which is the intensity distribution when the cell passes through each spot alone. This information can be used to determine the measured fluorescence spectrum of any cell after passing through the frequency-domain labeled illumination field. The fluorescence labeled spectrum image of the cell can then be obtained by spectral demixing.
[0180] Figure 17 illustrates a schematic diagram of the principle of spectral demixing of a fluorescently labeled spectral image according to an embodiment of the present disclosure. As shown in Figures 17(a) and (b), n fluorescent staining agents are used when preparing the sample cell suspension, each of which is used to stain different structures of the cells. Under the illumination of a frequency-domain labeled illumination field, each fluorescent staining agent will generate a fluorescent spectral signal including multiple fluorescent components of different wavelengths.
[0181] In one example, the cells in the sample cell suspension can be animal cells. Fluorescent staining agent 1 is used to stain the cell membrane, fluorescent staining agent 2 is used to stain the cell nucleus, fluorescent staining agent 3 is used to stain the mitochondria, and so on. Fluorescent staining agent n-1 is used to stain the Golgi apparatus, and fluorescent staining agent n is used to stain the endoplasmic reticulum. The structures on the cell surface or inside the cell produce different fluorescent labels under the action of these fluorescent staining agents.
[0182] Furthermore, as shown in Figure 17(c), the first digital signal corresponding to the fluorescence spectral signal is determined by the acquisition card 1061, and the measured fluorescence spectrum of any cell after passing through the frequency domain labeled illumination field is determined based on the aforementioned process.
[0183] As shown in Figure 17(d), since the emission spectrum of each fluorescent dye is known, the computer submodule 1062 can reverse the calculation of the intensity value of each fluorescent dye on each pixel in the original spectral image based on the measured fluorescence spectrum, that is, perform fluorescence spectrum unmixing, and then determine the fluorescent labeling spectral image of the specific structure of the cell.
[0184] Figure 18 illustrates a schematic diagram of the principle of a first digital signal analysis and reconstruction according to an embodiment of the present disclosure. As shown in Figure 18, when the frequency domain labeled illumination field consists of 2n spots in two rows of one-dimensional linear arrays perpendicular to the direction of cell movement in the sample cell suspension and located on the cell flow plane, and each one-dimensional linear array includes n spots, for any cell in the sample cell suspension, when the cell passes through any spot i in the frequency domain labeled illumination field, it will be excited by spot i and generate a corresponding fluorescence spectrum signal. This can be regarded as the fluorescence intensity information of the cell on the straight line swept by spot i, and the modulation result at the scintillation frequency corresponding to spot i.
[0185] As shown in Figure 18(a), the fluorescence spectrum signal obtained when the cell passes through the first row of the frequency-domain labeled illumination field is equivalent to the sum of the signals obtained when the cell passes through each spot in the first row of the one-dimensional linear array individually. Since the scintillation frequency corresponding to each spot in the first row of the one-dimensional linear array is different, the fluorescence spectrum signal obtained by the cell passing through the first row of the one-dimensional linear array can be analyzed and reconstructed by performing an inverse Fourier transform on the fluorescence spectrum signal obtained by the cell passing through the first row of the one-dimensional linear array. This reconstructs the component of the fluorescence spectrum signal obtained by the cell passing through the first row of the one-dimensional linear array, which is the intensity distribution when the cell passes through each spot individually. Then, by spectral unmixing, the fluorescence spectrum image obtained by the cell passing through the first row of the one-dimensional linear array can be obtained. Similarly, as shown in Figure 18(b), the fluorescence spectrum signal obtained by the cell passing through the second row of the frequency-domain labeled illumination field can also be analyzed and reconstructed using the above principle. Then, by spectral unmixing, the fluorescence spectrum image obtained by the cell passing through the second row of the one-dimensional linear array can be obtained. Furthermore, as shown in Figure 18(c), the fluorescence spectrum image obtained by passing the cell through the first row of one-dimensional linear arrays can be fused with the fluorescence spectrum image obtained by passing the cell through the second row of one-dimensional linear arrays to obtain a fluorescence spectrum image of the cell passing through the entire frequency domain labeled illumination field, thereby improving the resolution and image quality of fluorescence spectral imaging.
[0186] In one possible implementation, a data acquisition card is used to acquire the second electrical signal and convert it into a corresponding second digital signal; a computer submodule is used to analyze and reconstruct the second digital signal to determine the unlabeled image.
[0187] The acquisition card 1061 can also be used to acquire a second electrical signal, convert the second electrical signal into a corresponding second digital signal, and store it in the computer submodule 1062. The computer submodule 1062 can split, reassemble, and further process the second digital signal to determine the label-free image. The label-free image may include at least one of a bright-field image, a forward-scattered light image, a side-scattered light image, a backscattered light image, and a phase-contrast image. Specific methods for analyzing and reconstructing the second digital signal can be found in related technologies or in the above-described processing method for the first digital signal; this disclosure does not specifically limit this method.
[0188] Figure 19 shows a schematic diagram of a hydrodynamic focusing imaging system based on frequency domain marker illumination according to an embodiment of the present disclosure. As shown in Figure 19, system 1900 is an imaging system based on a microfluidic chip, a forward detection optical path structure, a bright field channel unit, and 32 fluorescence spectral signal detection channels.
[0189] Continuous laser light is modulated into multiple spots in a single-row one-dimensional linear array by diffractive optical device 1901, and then passes through a 4f system composed of lenses 1902 and 1904. An optical chopper 1903 is positioned on the common focal plane of the 4f system and rotates at an angular velocity ω, modulating the frequency of each spot through its surface transmission structure to obtain a modulated light field. The modulated light field sequentially passes through lens 1904 and focusing lens 1905, forming a frequency-domain labeled illumination field at the focal plane of focusing lens 1905. A microfluidic chip 1906 is positioned at the focal plane of focusing lens 1905 and is irradiated by the frequency-domain labeled illumination field, forming a corresponding detection area. When cells in the sample cell suspension flow sequentially through the detection area in the form of single-cell axial flow, they are excited to generate target light signals under the action of the frequency-domain labeled illumination field, which are then collected by the collecting objective lens 1907.
[0190] The target light signal collected by the receiving objective lens 1907 is separated into a fluorescent signal and a label-free signal by a dichroic mirror 1908. The fluorescent signal is coupled into the optical fiber 1910 via lens 1909, exits from the output device 1911, and is collimated into the prism group 1912 of the prism dispersion photonics module. Under the action of the prism group 1912, the fluorescent components of different wavelengths in the fluorescent signal are output at different angles and incident on the condensing lens 1913 of the prism dispersion photonics module. To achieve system miniaturization, a mirror group 1914 can be placed after the condensing lens 1913 to fold the optical path. Finally, the fluorescent spectral signal formed after dispersion is incident on a fluorescence spectrometer 1915 composed of an array of photomultiplier tubes. The fluorescence spectrometer 1915 has 32 detection channels, enabling the detection of fluorescence spectral signals in various wavelengths. It converts the fluorescence spectral signals into corresponding first electrical signals, which are then provided to the acquisition and processing module for storage and processing to generate a fluorescently labeled spectral image.
[0191] The label-free signal is reflected by the dichroic mirror 1908 to the 4f system 1916 composed of two lenses below, converting the label-free signal to the aperture 1917, which attenuates the intensity of the label-free signal. The attenuated label-free signal enters the bright-field detector 1918, which performs imaging by detecting the perturbation and absorption of the total intensity of the frequency-domain labeled illumination field by the cells, i.e., imaging through the laser intensity signal. The bright-field detector 1918 converts the laser intensity signal into a corresponding second electrical signal, which is provided to the acquisition and processing module for storage and processing to generate a bright-field image.
[0192] Figure 20 shows a schematic diagram of a hydrodynamic focusing imaging system based on frequency domain labeled illumination according to an embodiment of the present disclosure. As shown in Figure 20, the system 2000 is an imaging system based on the flow cell and lateral fluorescence detection optical path structure of a traditional flow cytometer, having two optically independent frequency domain labeled illumination modules, two forward scattering channel units, and two sets of 32 fluorescence spectral signal detection channels.
[0193] In System 2000, the continuous lasers corresponding to the two frequency domain marker illumination modules are 2001 and 2002, respectively, with different wavelengths. The corresponding light rays are both along the y-axis, and the optical paths of the two frequency domain marker illumination modules have a preset height difference along the z-axis. This optical path design avoids mutual interference between the optical paths. The specific value of the preset height can be flexibly set according to actual usage requirements, but it should be greater than the size of the frequency domain marker illumination light field; this disclosure does not impose specific limitations on this.
[0194] Specifically, the continuous laser 2001 is modulated into multiple spots in a single-row one-dimensional linear array by the diffractive optical device 2003, and then passes through a 4f system composed of lenses 2004 and 2005 before being incident on the focusing lens 2007. At the common focal plane 2006 of the 4f system composed of lenses 2004 and 2005, any type of illumination frequency modulation submodule can be set to modulate the frequency of each spot, obtaining a modulated light field; alternatively, when frequency-domain labeled illumination is not required, an aperture can be set to filter out high diffraction orders of the laser spot generated by the diffractive optical device 2003. After passing through the focusing lens 2007, the modulated light field forms a frequency-domain labeled illumination light field at its focal plane. The flow chamber 2008 of the cytometer is located at the focal plane of the focusing lens 2007 and is irradiated by the frequency-domain labeled illumination light field, forming a corresponding detection area. When cells in the sample cell suspension flow sequentially through the detection area in the form of single-cell axial flow, they will be excited to generate target light signals under the action of the frequency domain labeled illumination light field, and collected by the light-collecting objective 2009 and light-collecting objective 2010.
[0195] A receiving objective 2009 is placed in the forward optical path of the target light signal to collect the label-free signal. The intensity of the collected fluorescence signal is negligible compared to the intensity of the label-free signal. The label-free signal collected by the receiving objective 2009 is incident on the condenser lens 2012 via a light-shielding strip 2011. The light-shielding strip 2011 blocks the direct laser light in the label-free signal, retaining only the forward-scattered light signal at a large angle. The forward-scattered light signal is incident on the forward-scattered light detector 2013 for forward-scattered light imaging. The forward-scattered light detector 2013 converts the forward-scattered light signal into a corresponding second electrical signal, which is provided to the acquisition and processing module for storage and processing to generate a forward-scattered light image. The forward-scattered light image can represent the size and outline of the cell.
[0196] The light-collecting objective 2010 is positioned at a preset angle to the forward optical path of the target light signal; that is, there is a preset angle between the light-collecting objective 2010 and the light-collecting objective 2009. The light-collecting objective 2010 can collect both fluorescence and label-free signals, with the label-free signal primarily being a side-scattered light signal. The collected fluorescence and side-scattered light signals are separated by a dichroic mirror 2014. The specific value of the preset angle between the light-collecting objective 2010 and the light-collecting objective 2009 can be set according to actual usage requirements, such as 90°, 60°, and 30°, etc., to ensure the collection of the side-scattered light signal; this disclosure does not impose specific limitations on this.
[0197] The separated side-scattered light signal is focused by the condenser lens 2015 and then incident on the side-scattered light detector 2016 for side-scattered light imaging. The side-scattered light detector 2016 converts the side-scattered light signal into a corresponding second electrical signal, which is provided to the acquisition and processing module for storage and processing to generate a side-scattered light image. The side-scattered light image can represent the particle size within the cell.
[0198] After being focused by the condenser lens 2017, the separated fluorescence signal is coupled into the optical fiber 2018, exits from the output device 2019, and collimates before entering the prism group 2020 of the prism dispersion photonics module. Under the action of the prism group 2020, fluorescence components of different wavelengths in the fluorescence signal are output at different angles and incident on the condenser lens 2021 of the prism dispersion photonics module. After the optical path is folded by the reflector group 2022, the fluorescence spectrum signal formed by dispersion is incident on the fluorescence spectrometer 2023, which is composed of an array of photomultiplier tubes. The fluorescence spectrometer 2023 has 32 detection channels, enabling the detection of fluorescence spectrum signals in various wavelengths. It converts the fluorescence spectrum signals into corresponding first electrical signals, which are then provided to the acquisition and processing module for storage and processing, generating a fluorescence-labeled spectral image.
[0199] Correspondingly, the optical path structure corresponding to the continuous laser 2002 is completely consistent with that corresponding to the continuous laser 2001. The process of using the continuous laser 2002 to achieve side scattering imaging and fluorescence spectroscopy imaging is also exactly the same as the process of using the continuous laser 2001 to achieve side scattering imaging and fluorescence spectroscopy imaging, which will not be described in detail here.
[0200] Figure 21 shows a schematic diagram of a hydrodynamic focusing imaging system based on frequency domain labeled illumination according to an embodiment of the present disclosure. As shown in Figure 21, the system 2100 is an imaging system based on a conventional flow cytometer flow cell, a pre-fluorescence detection optical path structure, two independent frequency domain labeled illumination modules, and two sets of 32 fluorescence spectral signal detection channels.
[0201] In system 2100, the two frequency-domain marker illumination modules correspond to continuous lasers 2101 and 2102, respectively, with different wavelengths. The light propagation direction of continuous laser 2101 is along the negative x-axis, while the light propagation direction of continuous laser 2102 is along the y-axis. That is, the optical paths of the two frequency-domain marker illumination modules are perpendicular to each other, and there is a preset height difference between their optical paths along the z-axis. This optical path design, compared to the parallel optical path arrangement in system 2000, not only avoids mutual interference between optical paths but also facilitates the identification and matching of two sets of target light signals generated by any cell in the sample cell suspension under the action of two different frequency-domain marker illumination light fields. The specific value of the preset height can be flexibly set according to actual usage requirements, but it should be greater than the size of the frequency-domain marker illumination light field; this disclosure does not impose specific limitations on this.
[0202] Specifically, the continuous laser 2101 is modulated into multiple spots in a single-row one-dimensional linear array by the diffractive optical device 2103, and then passes through a 4f system composed of lenses 2104 and 2105 before being incident on the focusing lens 2107. At the common focal plane 2106 of the 4f system composed of lenses 2104 and 2105, any type of illumination frequency modulation submodule can be set to modulate the frequency of each spot, obtaining a modulated light field; alternatively, when frequency-domain labeled illumination is not required, an aperture can be set to filter out high diffraction orders of the laser spot generated by the diffractive optical device 2103. After passing through the focusing lens 2107, the modulated light field forms a frequency-domain labeled illumination light field at its focal plane. The flow chamber 2108 of the cytometer is located at the focal plane of the focusing lens 2107 and is irradiated by the frequency-domain labeled illumination light field, forming a corresponding detection area. When cells in the sample cell suspension flow sequentially through the detection area in the form of single-cell axial flow, they will be excited to generate target light signals under the action of the frequency domain labeled illumination light field, and then collected by the light-collecting objective 2109.
[0203] The target light signal collected by the receiving objective lens 2109 is filtered by the band-stop filter 2110 to remove the laser component (i.e., the unlabeled signal), resulting in a fluorescence signal. The fluorescence signal is coupled into the optical fiber 2112 via the condenser lens 2111, and then emitted to the fluorescence detection device 2113 for fluorescence spectral dispersion and detection. The fluorescence detection device 2113 can be composed of any of the aforementioned fluorescence separation submodules and fluorescence spectral detectors.
[0204] Correspondingly, the optical path structure corresponding to the continuous laser 2102 is completely the same as that corresponding to the continuous laser 2101. The process of realizing fluorescence spectral imaging using the continuous laser 2102 is also exactly the same as the process of realizing fluorescence spectral imaging using the continuous laser 2101, and will not be described in detail here.
[0205] The hydrodynamic focusing imaging system based on frequency-domain labeled illumination of this embodiment utilizes fluid dynamics principles. A fluid focusing module directs a sample cell suspension through a frequency-domain labeled illumination light field generated by a frequency-domain labeled illumination module at a preset modulation frequency, in a single-cell axial flow manner. The frequency-domain labeled illumination light field comprises multiple light spots distributed at preset positions, each with a different flicker frequency. This allows for dynamic modulation of the spatial distribution of the illumination light field and the flicker frequency modulation of each light spot, encoding a two-dimensional image of the cell into the frequency domain. This approach leverages the high flow rate of the sample cell suspension to increase detection throughput and utilizes the smaller size of the frequency-domain illumination light field parallel to the cell movement direction to reduce the probability of signal aliasing between two cell samples, further improving cell imaging throughput. A light-receiving module collects the target light signal generated by the sample cell suspension under the influence of the frequency-domain labeled illumination light field and transmits the target light signal to a light-splitting module. The target light signal can be separated into fluorescence spectral signals and label-free signals with independently distributed fluorescence components in different wavelength ranges through a beam splitting module. A photoelectric detection module can detect the fluorescence spectral signals and label-free signals, and determine the first electrical signal corresponding to the fluorescence spectral signal and the second electrical signal corresponding to the label-free signal, respectively. The acquisition and processing module can determine the fluorescence-labeled spectral image corresponding to the sample cell suspension based on the first electrical signal, thus distinguishing different structures in the cells through fluorescence labeling. Based on the second electrical signal, it can determine the label-free image corresponding to the sample cell suspension, thereby achieving high-throughput, high-resolution fluorescence spectral imaging and label-free imaging. Furthermore, the hydrodynamic focusing imaging system of this embodiment can not only achieve frequency-domain coded flow cytometry based on frequency-domain labeled illumination, but also achieve time-domain coded flow cytometry by adjusting the specific structure of the frequency-domain labeled illumination module according to actual imaging needs and cost requirements. It has high system flexibility and applicability and can be widely applied to various usage scenarios.
[0206] It should be noted that although Figures 19, 20, and 21 have been used as examples to illustrate the hydrodynamic focusing imaging system based on frequency domain labeled illumination provided in this disclosure, those skilled in the art will understand that this disclosure is not limited thereto. In fact, users can flexibly set the specific structure of the hydrodynamic focusing imaging system based on frequency domain labeled illumination according to their personal preferences and / or actual application scenarios, and adaptively add, remove, and replace the optical components, as long as cell flow cytometry imaging can be achieved based on the above principles, and the corresponding fluorescently labeled spectral images and label-free images can be determined.
[0207] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.
Claims
1. A hydrodynamic focusing imaging system based on frequency domain marked illumination, characterized in that, The imaging system includes: at least one frequency domain marker illumination module, a fluid focusing module, a light receiving module, a beam splitting module, at least one photoelectric detection module, and an acquisition and processing module, wherein the optical paths corresponding to different frequency domain marker illumination modules are independent; The frequency domain marker illumination module is used to generate a frequency domain marker illumination light field based on a preset modulation frequency. The frequency domain marker illumination light field includes multiple light spots that satisfy a preset position distribution, and each light spot corresponds to a different flicker frequency. The fluid focusing module is used to control the sample cell suspension to flow through the detection area in the form of single-cell axial flow, wherein the detection area is the area irradiated by the frequency domain labeled illumination field; The light receiving module is used to detect the target light signal generated by the sample cell suspension under the action of the frequency domain labeled illumination light field; The spectral separation module is used to separate the target light signal into a fluorescence spectral signal and a label-free signal, wherein the fluorescence spectral signal contains independently distributed fluorescence components in different wavelength ranges, and the label-free signal includes a light signal without fluorescence components. The photoelectric detection module is used to detect the fluorescence spectral signal and the label-free signal, and to determine the first electrical signal corresponding to the fluorescence spectral signal and the second electrical signal corresponding to the label-free signal, respectively. The acquisition and processing module is used to determine the fluorescently labeled spectral image corresponding to the sample cell suspension based on the first electrical signal, and to determine the unlabeled image corresponding to the sample cell suspension based on the second electrical signal, wherein the fluorescently labeled spectral image distinguishes different structures in the cells by fluorescent labels.
2. The imaging system according to claim 1, characterized in that, The frequency domain marker illumination module includes: A laser source used to generate continuous or pulsed laser light of a preset wavelength; An optical fiber bundle is used to separate the continuous laser or the pulsed laser into multiple independent laser beams, wherein the positional relationship between each optical fiber in the optical fiber bundle satisfies the preset positional distribution; A focusing lens is used to focus the multiple independent laser beams to obtain an initial optical field; The illumination frequency modulation submodule is used to perform frequency modulation on each spot in the initial light field based on the modulation frequency to obtain the frequency domain marked illumination light field.
3. The imaging system according to claim 1, characterized in that, The frequency domain marker illumination module includes: A laser source array is used to generate multiple independent laser beams that meet a preset wavelength; A focusing lens is used to focus the multiple independent laser beams to obtain an initial light field, wherein the positional relationship between each spot in the initial light field satisfies the preset positional distribution; The illumination frequency modulation submodule is used to perform frequency modulation on each spot in the initial light field based on the modulation frequency to obtain the frequency domain marked illumination light field.
4. The imaging system according to claim 1, characterized in that, The frequency domain marker illumination module includes: A laser source used to generate continuous or pulsed laser light of a preset wavelength; A laser modulation device is used to modulate the continuous laser or the pulsed laser into multiple independent laser beams, wherein the positional relationship between the multiple independent laser beams satisfies the preset positional distribution; A focusing lens is used to focus the multiple independent laser beams to obtain an initial optical field; The illumination frequency modulation submodule is used to perform frequency modulation on each spot in the initial light field based on the modulation frequency to obtain the frequency domain marked illumination light field.
5. The imaging system according to any one of claims 2 to 4, characterized in that, The illumination frequency modulation submodule includes any one of an optical chopper, an electro-liquid crystal control array, or a modulated laser array.
6. The imaging system according to any one of claims 1 to 4, characterized in that, The spectral separation module includes: a fluorescence separation submodule and a multi-channel spectral separation module; The fluorescence separation submodule is used to separate the fluorescent components of the target light signal based on a preset wavelength range to obtain the fluorescence spectral signal; The multi-channel photonic module is used to perform multi-channel separation of the target light signal by utilizing the optical interaction type of the sample cell suspension on the frequency domain labeled illumination light field, thereby obtaining the label-free signal.
7. The imaging system according to claim 6, characterized in that, The fluorescence separation submodule is any one of the following: a prism dispersion photonic module, a grating dispersion photonic module, a diffractive optical device dispersion photonic module, and a multi-dichroic mirror and filter photonic module.
8. The imaging system according to claim 6, characterized in that, The unmarked signal includes at least one of the following: laser intensity signal, forward scattered light signal, side scattered light signal, back scattered light signal, and phase difference signal. The multi-channel photonic module includes at least one of the following: bright field channel unit, forward scattered channel unit, side scattered channel unit, back scattered channel unit, and phase difference imaging channel unit. The bright-field channel unit is used to obtain the laser intensity signal by perturbing the intensity of the frequency-domain labeled illumination field with the sample cell suspension. The forward scattering channel unit is used to determine the forward scattered light signal by using the sample cell suspension to forward scatter the frequency domain labeled illumination light field; The side scattering channel unit is used to determine the side scattering light signal by utilizing the side scattering of the frequency domain labeled illumination light field by the sample cell suspension; The backscattering channel unit is used to determine the backscattered light signal by utilizing the backscattering of the frequency domain labeled illumination light field by the sample cell suspension; The phase difference imaging channel unit is used to determine the phase difference signal by utilizing the refraction of the frequency domain labeled illumination light field by the sample cell suspension.
9. The system according to any one of claims 1 to 4, characterized in that, The photoelectric detection module includes: A fluorescence spectrometer is used to detect the fluorescence spectral signal and convert the fluorescence spectral signal into the first electrical signal, wherein the fluorescence spectrometer includes a preset number of detection channels, the preset number being greater than or equal to the number of different fluorescent components in the fluorescence spectral signal; A markerless signal detector is used to detect the markerless signal and convert the markerless signal into the second electrical signal.
10. The system according to any one of claims 1 to 4, characterized in that, The acquisition and processing module includes: A data acquisition card is used to acquire the first electrical signal and convert the first electrical signal into a corresponding first digital signal. The computer submodule is used to analyze, reconstruct, and spectrally unmix the first digital signal to determine the fluorescent label spectral image.
11. The system according to claim 10, characterized in that, The acquisition card is used to acquire the second electrical signal and convert the second electrical signal into a corresponding second digital signal; The computer submodule is used to analyze and reconstruct the second digital signal to determine the unmarked image.
