Multi-band scanning and band to improve reduced light source
Through the multi-band TDI imaging system and fiber beam light source assembly, combined with beam forming technology, the light damage caused by high power density in fast scanning is solved, and the light damage problem of TDI imaging system is achieved with lower power density and more efficient imaging, suitable for fast scanning and high throughput applications.
Patent Information
- Application Number
- CN202380029990.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-07-01
- Filing Date
- 2023-06-27
- Publication Date
- 2024-11-26
AI Technical Summary
TDI imaging systems require high excitation light intensity during rapid scanning to avoid motion blur, but high power density may cause light damage, and the existing high-frequency TDI sensor specifications require narrow requirements, making it difficult to meet the use cases where external vibration is high.
Using a multi-band TDI imaging system, by stacking multiple spaced image sensors along the scanning direction, combining a fiber beam light source assembly and a beam forming optics, a beam matching sample and sensor shape is formed to reduce peak power and expand exposure time. Reduce the risk of photodamage and optimize laser power utilization.
It achieves the use of lower power density while meeting increased scanning speed and throughput, reduces photodamage, avoids unnecessary photobleaching and waste, and reduces the hardware specification requirements of the imaging system.
Smart Images

Figure CN119032309A_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to U.S. Provisional Application No. 63 / 357,943, filed on July 1, 2022, entitled “MULTIBAND SCANNING AND FIBERBUNDLE TO ENABLE REDUCED LIGHT SOURCE INTENSITY AND IMPROVED IMAGING QUALITY,” which is incorporated herein by reference in its entirety. Background Art
[0003] In contrast to a camera or sensor with a two-dimensional pixel array that captures a static image of an entire object, line scanning can refer to imaging a sample line by line using lines of pixels to build a continuous image. A specific type of line scanning is time delay integration (TDI) line scanning, which can be particularly useful in imaging applications such as sequencing. TDI imaging systems permit imaging of moving samples without introducing motion blur. In a TDI imaging system, photoelectrons formed on the imaging sensor can be moved along the pixel columns in synchronization with the sample motion to remove motion blur.
[0004] TDI imaging of some samples may require a threshold signal-to-noise ratio (SNR). For example, imaging of fluorescently labeled DNA clusters requires a sufficient SNR that is related to the number of fluorescent photons and background photons released from the cluster of interest, as well as other factors, and is a function of the illumination dose. The fluorescence from the cluster can be linearly dependent on the power of the radiation used to excite the dye module. The illumination dose can be measured as the intensity of the excitation light (W / cm 2 ) multiplied by the exposure time (s). Therefore, the shorter the exposure time of the illumination dose, the higher the excitation intensity that may be required to provide the illumination dose that meets the threshold SNR.
[0005] Figure 1 Depicted is an example design of a TDI sensor used in some imaging systems. In this example, the circle indicates the FOV of the sample supported by the imaging system, the center dark grey line represents the illumination profile used to illuminate the sample, and the light grey rectangle represents the image of the TDI sensor imaging the sample. Figure 1The TDI sensor has a high aspect ratio, being narrow along the direction of travel but wide along the static axis. Due to the "shortness" of the sensor along the direction of travel and the fast scanning speeds required for some applications (e.g., >10 mm / s), the exposure time of the imaged sample may be very short. Therefore, the required intensity of the excitation light may be very high to achieve sufficient illumination dose for imaging applications (such as imaging of fluorescently labeled DNA clusters). In this example, the term "high" may be relative to the power density of an area scan and step-and-shoot imager using a conventional camera to image a static wide field of view (FOV) (e.g., approximately 1x1 mm). In addition, the term "high" may refer to an intensity of the excitation light that is close to the saturation intensity of the dye used during fluorescence imaging. The term "high" may also refer to an intensity of the excitation light that results in a perceptible population having an electronic triplet state.
[0006] If the high power density used in a TDI imaging system is above a threshold, the high power density may cause photodamage (i.e., photon-induced damage) to the imaged biological specimen. For example, in sequencing applications, photodamage to DNA, fully functional nucleotides (ffNs), fluorescent dyes, or proteins may occur if the excitation radiation is above a threshold. Photodamage processes such as photobleaching can be understood to be dose-dependent—that is, at some higher power density dose, the corresponding photodamage may occur above a threshold. However, damage may also be related to the peak power density (e.g., W / cm 2 ) rather than dose related. For example, for equivalent doses above the threshold, a greater degree of photodamage can be seen for samples with shorter exposure times and higher laser power densities than for samples with longer exposure times and lower peak power densities. This may be related to nonlinear effects, as fluorescence can cause confinement of the dye or occupation of an electronic triplet state that mediates the photodamage, and higher power densities can excite this or other states to higher energy states. Summary of the invention
[0007] Some embodiments described herein relate to a multi-band TDI imaging system, comprising: a plurality of spaced-apart image sensors stacked along a scanning direction of the TDI imaging system. In some embodiments, the imaging system is configured to match the shape of the projected light beam to the multi-band sensor design. To this end, the imaging system may include a light source assembly having a fiber bundle including a plurality of fiber cores that emit a plurality of light beams.
[0008] In one embodiment, an imaging system includes: a camera including a plurality of image sensors spaced apart, each of the image sensors being used to capture an image of a corresponding sample position among a plurality of sample positions of a sample; and a fiber bundle including a plurality of fiber cores, each of the fiber cores emitting a light beam that is projected onto a corresponding sample position among the sample positions.
[0009] In some specific implementations, the imaging system also includes: one or more beam shaping optical devices, which are positioned in the optical path between the output end of the fiber bundle and the sample, and the one or more beam shaping optical devices are used to shape the light beams into a shape corresponding to the shape of the sample position and the shape of the image sensor.
[0010] In some implementations, each of the image sensors is rectangular; and the one or more beam shaping optics include a collimator for shaping the light beam into an illumination line.
[0011] In some specific implementations, the collimator includes: a first non-cylindrical lens, which is used to shape the light beam on a first axis, and the first non-cylindrical lens has a first focal length; and a second non-cylindrical lens, which is used to shape the light beam on a second axis orthogonal to the first axis, and the second non-cylindrical lens has a second focal length different from the first focal length.
[0012] In some implementations, each of the cores is square.
[0013] In some implementations, the camera is a TDI camera.
[0014] In some implementations, the one or more beam shaping optics further include an objective lens for focusing the beam, the objective lens being positioned in an optical path between the collimator and the sample.
[0015] In some specific implementations, the imaging system is a structured illumination imaging system; and the imaging system further includes a light structuring optical component for structuring each of the light beams so that each of the light beams projected onto the sample position includes a plurality of fringes.
[0016] In some implementations, the light structuring optical assembly includes: a diffraction grating; and a grating projection lens positioned in an optical path between the diffraction grating and the sample.
[0017] In some implementations, the sample is patterned asymmetrically and the diffraction grating includes multiple sections.
[0018] In some specific implementations, the imaging system further includes: a processor for reconstructing, based on the images captured by the image sensor, an image having a higher resolution than each of the images captured by the sensor.
[0019] In some implementations, the image captured by the image sensor includes multiple phase images.
[0020] In some implementations, the number of the fiber cores is the same as the number of the image sensors.
[0021] In some implementations, the plurality of cores include: a first plurality of cores for emitting light beams having a first wavelength; and a second plurality of cores for emitting light beams having a second wavelength.
[0022] In some specific implementations, the optical fiber bundle includes: a first branch including the first plurality of fiber cores, the first branch coupled to a first light source emitting light of the first wavelength; and a second branch including the second plurality of fiber cores, the second branch coupled to a second light source emitting light of the second wavelength.
[0023] In one embodiment, an imaging system includes: a TDI camera, which includes a plurality of image sensors spaced apart along a scanning direction of the imaging system, each of the image sensors being used to capture an image of a corresponding sample position among a plurality of sample positions of a sample; a light source assembly, which is used to emit a plurality of light beams; and one or more beam shaping optical devices, which are used to shape the plurality of light beams into a plurality of lines having a shape corresponding to a shape of the sample position and a shape of the image sensor, each of the lines being projected onto a corresponding sample position among the sample positions.
[0024] In some implementations, the light source assembly includes a fiber bundle including a plurality of fiber cores, each of the fiber cores being configured to emit a corresponding one of the light beams.
[0025] In some implementations, each of the cores is square; and the one or more beam shaping optics include a collimator for shaping the plurality of beams into the plurality of lines.
[0026] In some specific implementations, the collimator includes: a first non-cylindrical lens, which is used to shape the light beam on a first axis, and the first non-cylindrical lens has a first focal length; and a second non-cylindrical lens, which is used to shape the light beam on a second axis orthogonal to the first axis, and the second non-cylindrical lens has a second focal length different from the first focal length.
[0027] In one embodiment, an imaging system includes: a camera comprising a plurality of spaced-apart TDI image sensors, each of the image sensors being used to capture an image of a corresponding sample position among a plurality of sample positions of a sample; and the sample, wherein the sample includes a plurality of nucleic acids to be analyzed, and the plurality of TDI image sensors achieves a lower power density for imaging than would be required in the case of a single sensor.
[0028] In some implementations, the imaging system further comprises: an asymmetrically patterned flow cell comprising the sample.
[0029] In some implementations, the imaging system further includes: a processor configured to form a composite image of the images captured by the plurality of TDI image sensors. In some implementations, the processor is configured to align the images before forming the composite image.
[0030] It should be understood that all combinations of the foregoing concepts and the additional concepts discussed in more detail below (assuming such concepts are not mutually inconsistent) are contemplated as being part of the inventive subject matter disclosed herein. In particular, all combinations of the claimed subject matter appearing at the end of this disclosure are contemplated as being part of the inventive subject matter disclosed herein.
[0031] Other features and aspects of the disclosed technology will become apparent from the following detailed description in conjunction with the accompanying drawings, which illustrate features according to specific implementations of the disclosed technology by way of example. The Summary of the Invention is not intended to limit the scope of any invention described herein, which is defined by the claims and equivalents. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] The present disclosure according to one or more various implementations is described in detail with reference to the following drawings. These drawings are provided for illustration purposes only and merely depict typical or exemplary implementations.
[0033] Figure 1 Depicts an example design of a TDI sensor used in some imaging systems.
[0034] Figure 2 Examples and Figure 1 An example of a higher TDI sensor compared to a .
[0035] Figure 3 An example of a multi-band TDI sensor according to some implementations of the present disclosure is illustrated, which includes a plurality of spaced apart sensors spaced along a scanning direction.
[0036] Figure 4 Imaging systems according to some implementations of the present disclosure are depicted.
[0037] Figure 5 Depicts a sensor plane and an object plane of an imaging system utilizing a multi-band camera according to some implementations of the present disclosure.
[0038] Figure 6 Depicting an example of an object plane being illuminated when the illumination does not match the conjugate sensor area.
[0039] Figure 7 Depicts an object plane being illuminated when the illumination matches a conjugate sensor area according to some implementations of the present disclosure.
[0040] Figure 8 is an optical diagram depicting an example optical configuration of a multi-band imaging system according to some implementations of the present disclosure.
[0041] Fig. 9 is an optical diagram depicting an example optical configuration of a structured illumination imaging system according to some implementations of the present disclosure.
[0042] Fig.10 is an optical diagram depicting an example optical configuration of a structured illumination imaging system for dual image sensor assembly imaging according to some implementations of the present disclosure.
[0043] Fig.11 Depicted is a 3-core fiber bundle that may be used in an imaging system according to some implementations of the present disclosure.
[0044] Fig.12 Depicted is a 6-core fiber bundle that may be used in an imaging system according to some implementations of the present disclosure.
[0045] Fig.13 Depicted is a 6-core fiber bundle that may be used in an imaging system according to some implementations of the present disclosure.
[0046] Fig.14A An example of a hexagonal flow cell pattern is illustrated.
[0047] Fig. 14B An example of a square array flow cell pattern is illustrated, which is imaged using illumination resulting in reduced dimensionality structured.
[0048] Fig. 14C Examples of asymmetric array flow cell patterns imaged using illumination resulting in reduced dimensionality structured are illustrated.
[0049] Fig.15 is a flow chart illustrating example operations that may be implemented for reduced dimensionality structured illumination imaging for use with line scan imaging, in accordance with some implementations of the present disclosure.
[0050] The drawings are not exhaustive and do not limit the disclosure to the precise forms disclosed. DETAILED DESCRIPTION
[0051] As used herein to refer to diffracted light emitted by a diffraction grating, the term "order" or "order number" is intended to mean the number of integer wavelengths that represents the difference in path lengths of light from adjacent slits of the diffraction grating for constructive interference. The term "zero order" or "zero order maximum" is intended to refer to the central bright fringe emitted by a diffraction grating in the absence of diffraction. The term "first order" is intended to refer to the two bright fringes emitted on either side of the zero order fringe, where the path length difference is ±1 wavelength.
[0052] As used herein to refer to a sample, the term "spot" or "feature" is intended to mean a point or area in a pattern that can be distinguished from other points or areas based on relative position. A single feature can include one or more molecules of a specific type. For example, a feature can contain a single target nucleic acid molecule with a specific sequence, or a feature can contain several nucleic acid molecules with the same sequence (and / or its complement).
[0053] As used herein, the term "tile" generally refers to one or more images of the same area of a sample, wherein each of the one or more images may represent a corresponding color wavelength range. A tile may form an imaging data subset of an imaging data set of an imaging cycle.
[0054] As used herein, the term "xy coordinates" is intended to mean information that specifies a position, size, shape, and / or orientation in an xy plane. The information may be, for example, numerical coordinates in a Cartesian system. The coordinates may be provided relative to one or both of the x-axis and the y-axis, or may be provided relative to another position in the xy plane. For example, the coordinates of a feature of an object may specify the position of the feature relative to a reference or other feature of the object.
[0055] As used herein, the term "xy plane" is intended to mean a 2-dimensional region defined by linear axes x and y. When used with reference to a detector and an object observed by the detector, the region may be further specified as being orthogonal to the direction of observation between the detector and the object being detected. When used herein to refer to a line scanner, the term "y direction" refers to the direction of the scan.
[0056] As used herein, the term "z-coordinate" is intended to mean information specifying the position of a point, line, or area along an axis orthogonal to the xy plane. In a particular implementation, the z-axis is orthogonal to the area of the object observed by the detector. For example, the focus direction of an optical imaging system can be specified along the z-axis.
[0057] As used herein, the term "scan" is intended to mean a 2-dimensional cross-section of the detection object in the xy plane, which cross-section is rectangular or oblong. For example, in the case of fluorescence imaging, a region of the object having a rectangular or oblong shape can be specifically excited (to the exclusion of other regions) and / or the emission from this region can be specifically acquired (to the exclusion of other regions) at a given time point in the scan.
[0058] As discussed above, TDI sensors may require a greater intensity of excitation light because of the relatively short exposure time (eg, Figure 1 ). The shortened exposure time may be the result of an increased scan speed or throughput rate. To meet the increased scan speed and corresponding reduction in exposure time, the power density may be increased to adequately excite the fluorophores associated with the sample of interest. However, if the power density is increased above a threshold, such as above a photo-saturation threshold of a fluorescent dye associated with the sample of interest or a biological sample photo-damage threshold, photo-damage or photo-saturation may occur. To avoid this, a "higher" TDI sensor with more combined TDI levels / scan lines may allow integration over a longer period of time and reduce the amount of illumination intensity to which a portion of the sample or fluorescent dye is exposed. For example, Figure 2 Examples and Figure 1An example of a higher TDI sensor compared to a TDI sensor of . However, a higher TDI sensor may increase the hardware specifications of the imaging device, including the sample scanner, vibration control, optics and / or alignment. For example, when scanning an image of a cluster across the TDI sensor, the image may need to move so that the image remains substantially aligned with a single column of pixels. That is, the lateral variation of the imaged cluster may need to be controlled so that the emitted light from the cluster moves less than one pixel (i.e., <±1 pixel) in either direction within the entire scan direction length of the TDI sensor. Any further lateral movement of the sample / image may cause blurring due to the offset of the emitted light to the adjacent columns of pixels of the TDI sensor. This blurring can be minimized by using high-accuracy, complex scanning stages that are very straight and have very little wobble as they move in the scan direction. In addition, the auxiliary X-stages may need to maintain their position very well, and the entire system may need to have very little vibration or "pull" on the moving sample. Similarly, at the edges of the light field, optical distortions may cause the motion of the sample spot to "bend" in the image plane, again causing the emitted light from the cluster at the sample spot to blur across multiple pixels. The longer the scanning distance (e.g., the taller the TDI scanner), the more difficult or expensive the above optical, motion, and / or stability specifications may become, such as in situations where external vibrations are not adequately controlled (e.g., movement of equipment adjacent to or near the instrument or laboratory personnel approaching the instrument). Therefore, while high-band TDI imaging may alleviate the high peak power requirements of standard TDI imaging, such sensors may have very narrow specifications that may be difficult to meet, especially in use cases where vibrations external to the instrument may be less controlled.
[0059] To alleviate at least some of the aforementioned deficiencies of standard and high-band TDI imaging systems, implementations described herein involve a "multi-band" TDI imaging sensor comprising a plurality of spaced-apart image sensors stacked along a scan direction of the TDI imaging system. Figure 3 An example of a multi-band TDI sensor according to some specific implementations of the present disclosure is illustrated, which includes multiple spaced apart sensors. During operation, each of the sensors of the multi-band camera is configured to generate an image of its own sample. A composite image can be formed by combining the images from each of the individual sensors in the individual sensors.
[0060] By using a multi-band design that uses multiple sensors spaced apart along the scan direction of the imaging system to collect multiple sample images that form a composite image (e.g., a composite sequenced image), the collection of images can be extended across a larger number of pixels in the scan direction without using a single high TDI sensor. This arrangement can achieve a longer total exposure time when the combined total exposure time of the multiple TDI sensors is considered. In addition, compared to Figure 1 This arrangement can also reduce peak power and thus above-threshold photodamage by distributing the exposure over a larger area compared to a shorter sensor design. Thus, the total dose delivered to the sample can be matched to the total intensity for increased scan speed or throughput, while also using a lower power density due to distribution over multiple TDI sensors. In addition, by means of Figure 3 The multi-band design can avoid Figure 2 The higher TDI scanners are associated with increasingly narrow imaging system specification requirements.
[0061] Furthermore, if some degree of lateral drift does occur, the shortness of each sensor in the direction of travel can limit the potential for blurring along the direction of travel of the sensor due to the finite length of each sensor in the scan direction. If the lateral drift at each sensor is limited so that the detected emitted light does not drift across multiple pixels, the composite image can be aligned even in the presence of greater lateral drift between stages or within the entire multi-band TDI sensor assembly. For example, if emitted light is received by a first sensor at a first lateral position and is subsequently received by a second sensor at a second lateral position that is laterally offset, for example, by one pixel or more relative to the first lateral position, the system can correct for the drift offset between the first sensor and the second sensor so that when the composite image is reconstructed, the first position and the second position are substantially co-located. Thus, even if more sensors are used, such as six sensors, ten sensors, etc., any potential lateral drift can still be corrected during composite image reconstruction without requiring the emitted light to be projected along the same pixel position along the scan direction at each of the sensors.
[0062] Another embodiment disclosed herein relates to an imaging system configured to match the shape of a projected light beam to the multi-band camera design described above. According to such an embodiment, the imaging system may include a light source assembly having a fiber bundle including a plurality of fiber cores that emit a plurality of light beams. Each of the light beams is projected onto a sample at a location corresponding to an imaged field of view (FOV) of a corresponding image sensor in a plurality of spaced-apart image sensors. For example, a plurality of illumination lines generated using the fiber bundle may be projected onto the sample to match the shape of the TDI band.
[0063] By shaping the illumination to match the imaged FOV of the multi-band camera, photobleaching and photodamage (e.g., DNA damage) caused by unnecessary exposure of substrates and / or samples or fluorophores outside the FOV that are not imaged by the sensor can be minimized, while the laser power density in the region of interest can be maximized. In addition, the power utilization of the laser light source can be optimized to a minimum sufficient to illuminate the region of interest. This may be particularly advantageous in bioimaging applications such as sequencing by synthesis (SBS), where imaging and sequencing quality can be improved, such as by exposing the sample, substrate, and / or fluorophore to only the amount of light required for each scan cycle. These and other advantages that can be achieved by the specific implementations described herein are further described below.
[0064] Before describing in detail various specific implementations of the imaging systems and methods disclosed herein, it is useful to describe an example environment in which the techniques disclosed herein may be implemented. One such example environment is Figure 4 The environment of the illumination imaging system 400 using excitation light to illuminate the sample is illustrated in FIG. Figure 4 In the specific implementation shown in , the illumination imaging system 400 can be a structured illumination imaging system with spatially structured light. For example, the system 400 can be a structured illumination fluorescence microscopy system that uses spatially structured excitation light to image biological samples. Although a structured illumination imaging system is described in this example, it should be understood that the multi-band imaging techniques described herein can be implemented in other imaging systems such as a TDI imaging system without structured illumination.
[0065] exist Figure 4 In the example of , the light emitter assembly 450 is configured to output a light beam shaped by a beam shaping optical device 451 (e.g., a collimator). The shaped light is structured (patterned) by a light structuring optical component 455 and directed by a dichroic mirror 460 through an objective lens 442 to a sample in a sample container 410 positioned on a stage 470. In the case of a fluorescent sample, the sample fluoresces in response to the structured excitation light, and the resulting light is collected by the objective lens 442 and directed to an image sensor of the camera system 440 to detect the fluorescence. In some specific implementations, the tubular lens 456 and the objective lens 442 can together form an imaging system that projects the fringes of the diffraction grating 455 onto the sample in the sample container 410. In a system that does not implement structured illumination, the optical component 455 can be omitted.
[0066] In the imaging system 400, the light emitter assembly 450 can be a coherent light emitter, such as an emitter of light output by one or more lasers or laser diodes. In an alternative implementation, it can be an incoherent light emitter (e.g., emitting a light beam output by one or more excitation diodes). In an example of the system 400, the light emitter assembly 450 includes a fiber bundle 452, which includes a plurality of fiber cores for guiding a plurality of corresponding light beams to be output. The bundle can include a stack of multimode fiber cores separated by a cladding region. As discussed further below, the number of fiber cores can match the number of sensors of the camera system 440. The fiber bundle 452 can be utilized by coupling a laser light source at one end and imaging the other end onto a sample to provide the shaped laser illumination. In an implementation in which the imaging system 400 is a single wavelength range imaging system, the light source can emit light within a single wavelength range.
[0067] In implementations utilizing structured illumination in a multi-channel imaging system (e.g., a multi-channel fluorescence microscope utilizing light in multiple wavelength ranges), the fiber bundle 452 can be optically coupled to a plurality of different light sources (not shown), each emitting light in a different wavelength range. For example, light corresponding to different wavelength ranges in the visible color spectrum (such as blue, green, red, and / or other colors) can be emitted. Although the imaging system 400 is illustrated as having a single light emitter assembly 450, in some implementations, multiple light emitter assemblies 450 as described above can be included. For example, multiple light emitter assemblies 450 can be utilized in an imaging system having multiple multi-band TDI cameras. In such implementations, each light emitter assembly 450 can be matched with a corresponding multi-band TDI camera.
[0068] In an alternative implementation, the light emitter assembly 450 can use components other than the fiber bundle 452 to generate multiple light beams that are imaged on the sample plane. For example, a single fiber core can output a light beam that is shaped into multiple lines using a combination of various beam shaping optics such as a Powell lens. Alternatively, some other components and / or beam shaping optics that generate multiple light beams can be used. In an alternative implementation, the light emitter assembly 450 can output a single light beam that is projected in the area of the sample that is imaged by the multi-band camera as described herein.
[0069] In implementations utilizing structured illumination, the light structuring optical component 455 may include one or more optical diffraction gratings to generate a sinusoidal pattern (e.g., fringes) of diffracted light projected onto a sample in the sample container 410. The diffraction grating may be a one-dimensional or two-dimensional transmission, reflection, or phase grating. In the imaging system 400, the diffraction grating does not necessarily involve a rotating stage. In some implementations, the diffraction grating may be fixed (e.g., not rotating or moving linearly) during operation of the imaging system. For example, in a particular implementation, the diffraction grating may include two fixed one-dimensional transmission diffraction gratings (e.g., a horizontal diffraction grating and a vertical diffraction grating) that are substantially or precisely / perfectly oriented perpendicular to each other, or a plurality of gratings having a fixed phase relationship to each other.
[0070] During each imaging cycle, the imaging system 400 can utilize the light structuring optical component 455 to acquire multiple images of various phases that are laterally shifted along the phase plane (e.g., along the xy plane), where the process is repeated one or more times by rotating the pattern orientation around the optical axis (i.e., relative to the xy plane of the sample) or by offsetting the pattern using other phase shifting components. The captured images can then be spatially reconstructed to generate a higher resolution image (e.g., an image with a lateral spatial resolution of approximately twice that of a single image). In specific implementations that do not utilize structured illumination, the light structuring component 455 can be omitted.
[0071] In some implementations, the imaging system 400 can include a projection lens 456 that can articulate or include lens elements to articulate along the longitudinal axis of the projection lens 456 to adjust the structured beam shape and path. For example, components of the projection lens 456 can articulate to account for a range of sample thicknesses (e.g., different cover glass thicknesses) for samples in the container 410. In other implementations, the projection lens 456 can be fixed and / or omitted, and a movable lens element can be positioned within a tubular lens assembly in the emission optical path to account for focusing on the upper or lower inner surface of the sample container 410 and / or spherical aberration introduced by movement of the objective lens 442.
[0072] The imaging system 400 may include a fluid delivery module or device 490 that can direct the flow of reagents (e.g., fluorescently labeled nucleotides, buffers, enzymes, cleavage reagents, etc.) to (and through) the sample container 410 and the waste valve 420.
[0073] The sample container 410 may include one or more substrates on which the sample is provided. For example, in the case of a system for analyzing a large number of different nucleic acid sequences, the sample container 410 may include one or more substrates on which the nucleic acid to be sequenced is combined, attached or associated. The substrate may include any substrate to which the nucleic acid may be attached, such as, for example, a glass surface, a plastic surface, latex, dextran, a polystyrene surface, a polypropylene surface, a polyacrylamide gel, a gold surface and a silicon wafer. In some applications, the substrate is in a channel or is included in a channel formed at multiple positions in a matrix or array formed across the sample container 410 in a substrate or other region. The imaging system 400 may also include a temperature station actuator 430 and a heater / cooler 435 that may optionally adjust the temperature of the fluid conditions in the sample container 410. In some specific implementations, the heater / cooler 432 may be fixed to a sample stage 470 on which a flow cell 410 is placed and / or may be integrated into the sample stage 470 therein.
[0074] In a specific implementation, the sample container 410 can be implemented as a patterned flow pool, including a translucent cover and a substrate configured to contain a fluid or allow a fluid to flow therebetween, and the biological sample can be located at the inner surface of the translucent cover and / or the inner surface of the substrate. The flow pool can include a large number (e.g., thousands, millions, billions, or more) of holes or regions that are patterned on the substrate to define an array (e.g., a hexagonal array, a rectangular array, etc.). Each region can form a cluster (e.g., a monoclonal cluster, a substantially monoclonal cluster, or a polyclonal cluster) of a biological sample or more than one cluster, the biological sample being such as DNA, RNA, or another genomic material that can be sequenced, for example, using synthetic sequencing. A substantially monoclonal cluster can be a cluster in which a particular sample forms a distinguishable portion of a cluster, even if the cluster itself is polyclonal due to the presence of one or more other samples in the cluster. The flow pool can be divided into a plurality of physically separated lanes (e.g., eight lanes), each of which includes an array of clusters, such as a hexagonal array of clusters or a linear array of clusters. During each sequencing cycle, each surface (eg, upper and lower) of each lane can be imaged in separate swaths (eg, three), and any number of images or tiles can be collected for each swath.
[0075] Images can be obtained in one wavelength range or multiple wavelength ranges (e.g., two or four). In a specific implementation, images can be obtained in two different color wavelength ranges, which can be used to distinguish a specific nucleotide base type from another base type. More specifically, "base calling" can be implemented, which generally refers to the process of determining a base call (e.g., adenine (A), cytosine (C), guanine (G), or thymine (T)) for a given spot position of an image in an imaging cycle. During base calling, image data extracted from the image can be used to determine the presence of one of the four base types. For a given spot or position in each image in the image, a base identifier can be determined based on whether a combination of signal identifiers statistically corresponds to a predetermined set of intensity values or ranges defined as corresponding to the corresponding base call.
[0076] The sample container 410 may be mounted on a sample stage 470 to provide movement and alignment of the sample container 410 relative to the objective lens 442. The sample stage 470 may have one or more actuators to allow the sample stage 470 to move in one or more of any of the three dimensions. For example, according to a Cartesian coordinate system, actuators may be provided to allow the stage to move in the X, Y, and / or Z directions relative to the objective lens 442, tilt relative to the objective lens 442, and / or move relative to the objective lens 442 in other ways. Movement of the sample stage 470 may allow one or more sample positions on the sample container 410 to be positioned to be optically aligned with the objective lens 442. Movement of the sample stage 470 relative to the objective lens 442 may be achieved by moving the sample stage 470 itself, the objective lens 442, some other component of the imaging system, or any combination of the foregoing. For example, in some implementations, the sample stage 470 may be capable of actuating in the X and Y directions relative to the objective lens 442, while the focusing component 475 or the Z stage may move the objective lens 442 relative to the sample stage 470 along the Z direction. Additional implementations may also include moving the entire imaging system onto a fixed sample. Thus, in some versions, sample container 410 may be fixed during imaging while one or more components of imaging assembly 420 are moved to capture images at different areas of sample container 410.
[0077] In some implementations, a focusing component 475 can be included to control the positioning of the objective lens 442 relative to the sample container 410 in a focus direction (commonly referred to as the z-axis or z-direction). The focusing component 475 can include one or more actuators physically coupled to the objective lens 442, the optical table, the sample stage 470, or a combination thereof to move the sample container 410 on the sample stage 470 relative to the objective lens 442 to provide proper focus for the imaging operation. In some implementations, the focusing component 475 can utilize a focus tracking module (not shown) that is configured to detect displacement of the objective lens 442 relative to a portion of the sample container 410 and output data indicating a focus position to the focusing component 475 to move the objective lens 442 to position the corresponding portion of the sample container 410 in the focus of the objective lens 442.
[0078] In some implementations, the focusing component 475 or an actuator for the sample stage 470 can be physically coupled to the objective lens 442, the optical table, the sample stage 470, or a combination thereof, such as, for example, by mechanical, magnetic, fluidic, or other direct or indirect attachment or contact to the table or its components. The actuator of the focusing component (175) can be configured to move the objective lens 442 in the z-direction while maintaining the sample stage 470 in the same plane (e.g., maintaining a horizontal or horizontal attitude substantially or perfectly perpendicular to the optical axis). It will be understood that, according to some examples or implementations, due to, for example, manufacturing tolerances, operating limitations, etc., a perfect perpendicular, parallel, or other orientation may not be achieved. However, for the purposes of the technology disclosed herein, a substantially perpendicular, parallel, or other orientation is understood to mean an orientation sufficient to achieve the desired resolution or other related effects as described and / or contemplated herein. In some implementations, the sample stage 470 includes an X-direction actuator and a Y-direction actuator to form an XY stage. The sample stage 470 may also be configured to include one or more flip or tilt actuators to flip or tilt the sample stage 470 and / or a portion thereof (such as a flow cell cartridge). For example, this may be done so that the sample container 410 may be dynamically leveled to account for any slope on its surface.
[0079] When an excitation emission, such as excitation light, is projected onto the sample container 410, a corresponding element, such as a fluorophore, may emit a detectable response emission, such as emission light from the excited fluorophore. In other implementations, excitation radiation other than light and emission radiation other than light may be used. Light emitted from one or more fluorophores associated with the test sample at the sample location being imaged may be directed to a sensor of the camera system 440 through a dichroic mirror 460. As mentioned above, in some implementations, a tubular lens assembly may be positioned between the objective lens 442 and the dichroic mirror 460 or between the dichroic mirror 460 and the image sensor of the camera system 440. The movable lens element may be capable of translating along the longitudinal axis of the tubular lens assembly to account for focusing on the upper or lower inner surface of the sample container 410 and / or spherical aberration introduced by movement of the objective lens 442. In some implementations, a filter switching component 465 having one or more emission filters can be included, wherein the one or more emission filters can be used to pass specific emission wavelength ranges and block (or reflect) other emission wavelength ranges. For example, one or more emission filters can be used to direct emitted light of different wavelength ranges to different image sensors of the camera system 440 of the imaging system. In a specific implementation, the emission filter can be implemented as a dichroic mirror that directs emitted light of different wavelength ranges to different image sensors of the camera system 440.
[0080] The camera system 440 may include one or more image sensors used to monitor and track the imaging (e.g., sequencing) of the sample container 410. The camera system 440 may be implemented, for example, as a charge coupled device (CCD) image sensor camera, although other image sensor technologies (e.g., active pixel sensors) may be used. Output data (e.g., images) from the camera system 440 may be transmitted to a real-time analysis module (not shown) that may be implemented as a software application, which may reconstruct the images captured during each imaging cycle to form an image with a higher spatial resolution, as further described below.
[0081] As further described below, camera system 440 may be implemented as a multi-band TDI camera having multiple image sensors spaced apart along a scan direction of the imaging system. For example, camera system 400 may be a TDI CCD camera that implements a line scan technique using multiple spaced apart image sensors, where each sensor produces its own image of a sample, and a composite image is formed from a combination of the images.
[0082] Although not illustrated, a controller may be provided to control the operation of the structured illumination imaging system 400, including synchronizing the various optical components of the system 400. The controller may be implemented to control various aspects of the system operation, such as, for example, the configuration of the light structuring optical assembly 455 (e.g., selection and / or linear translation of a diffraction grating and / or phase shifter or other optical component), movement of the projection lens 456 or its lens elements, movement of the lens elements of the tubular lens, focusing components 475, sample stage 470 and / or optical stage movement, and imaging operations. In various implementations, the controller may be implemented using hardware, algorithms (e.g., machine executable instructions), or a combination of the foregoing (such as one or more printed circuit board assemblies and / or computing engines). For example, in some implementations, the controller may include one or more CPUs or processors with associated memory. As another example, the controller may include hardware or other circuitry to control operations, such as a computer processor and a non-transitory computer readable medium having machine readable instructions stored therein. For example, the circuit system may include one or more of the following: a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a complex programmable logic device (CPLD), a programmable logic array (PLA), a programmable array logic (PAL), or other similar processing devices or circuit systems. As another example, the controller may include a combination of the circuit and one or more processors.
[0083] Figure 5 Depicts a sensor plane 510 and an object plane 520 (located at a plane of interest in a sample container 410) of an imaging system utilizing a multi-band TDI camera according to some implementations of the present disclosure. As shown by the sensor plane 510, the camera in this example has six sensors, with a sensor height of y1, a sensor width of x1, a center-to-center distance between sensors of y2, and an edge-to-edge gap between sensors of y3. These parameters may be considered when matching the sensor plane 510 to the object plane 520.
[0084] In order to match the illumination depicted by the object plane 520 at the plane of interest in the sample container 410 with the conjugate sensor area as depicted by the sensor plane 510 of the corresponding image showing the sensor, the following parameters can be considered for the six spaced apart illumination areas in the object plane 520: illumination height y4, illumination width x2, and center-to-center distance y5 between illumination areas. In addition, the magnification (Mag) from the sensor plane 510 to the object plane 520 can be considered. In some implementations, y4=Mag*y1, y5=Mag*y2, and x2=Mag*x1. In a specific embodiment, y1 is about 1.38 mm, y2 is about 1.57 mm, y3 is about 0.19 mm, and x1 is about 22.12 mm; y4 is about 42.6 μm, y5 is about 48.5 μm, and x2 is about 684 μm; and Mag is about 1 / 32.36. In one specific embodiment, the sensor has 4096 x 256 pixels, and the pixel size is about 5.4 μm.
[0085] Figure 6 Depicted is the illumination 610 (ie, Figure 6 610 does not match the conjugate sensor area. An image 620 of the sensor area (i.e., the area of the sample imaged onto the sensor) is depicted by the rectangular dashed line. The illumination 610 does not take into account the gaps between sensors that are not imaged. The illumination 610 can be generated by imaging the core of one laser-coupled optical fiber onto the sample. As depicted, using only one optical fiber can be inefficient because unnecessary portions of the sample corresponding to the gaps between the sensors are illuminated. This unnecessary radiation can cause photobleaching and / or DNA degradation in the sample. In addition, the rectangular illumination 610 that illuminates the gap area can waste power of the light source (e.g., laser).
[0086] Figure 7 Depicted is the illumination 710 (ie, Figure 7The object plane 520 is illuminated when the projected illumination 710 matches the shape of the sensor area (shaded portion) with the conjugate sensor area. The image 620 of the sensor area is depicted by the rectangular dashed line. By matching the projected illumination 710 to the shape of the sensor area, photobleaching and power waste from the light source can be reduced or eliminated. The illumination 710 can be generated using a fiber bundle that includes a stack of cores separated by cladding regions. The cores can be multimode cores. As described herein with reference to specific embodiments, the cores can have a square cross-section. For example, in a specific embodiment, each of the cores is 320x320μm or 400x400mm. However, in other embodiments, the cores can have a rectangular or circular cross-section. The bundle can be utilized by coupling laser light (e.g., a laser diode) into one end and imaging the other end onto the sample to provide the shaped laser illumination 710.
[0087] Figure 8 is an optical diagram depicting an example optical configuration of a multi-band imaging system 800 according to some implementations of the present disclosure. For simplicity, some optical components of the imaging system 800 may be seen from Figure 8 The multi-band imaging system 800 images a plane 856 of a sample 855 onto a TDI camera (not shown). The illumination 870 is shaped as a rectangle matching the shape of the TDI sensor. The image 880 of the sensor is depicted by a rectangular dashed line.
[0088] During operation of the multi-band imaging system 800, each sensor produces an image of its own sample, and a composite image (e.g., image 880) is formed by the combination of the images. In some implementations, the composite image can be formed by summing the images. In some implementations, before summing the images, one or more transformation operations can be applied to at least some of the images to align them. For example, each sensor image can be slightly different based on the specifications of the optical and motion control systems in the imager / sequencer. As the sample moves the distance between the first sensor and the last sensor, the sample can move slightly in X, thereby producing an offset image, or the relationship of the sample to the pixels in the Y direction may change. In these implementations, the difference in the images between the sensors can be a simple offset in X or Y, or can be slightly more complex, requiring, for example, an affine transformation or distortion correction.
[0089] The illumination 870 can be generated as follows. The laser engine 810 couples laser light into one end of a fiber bundle 820 having multiple cores. For example, a laser diode of the laser engine 810 can generate light. As depicted by the cross section 825 of the fiber bundle 820, the number of cores (6) in the bundle 820 matches the number of sensors (6) in the TDI camera. The light beam from the output end 827 of the bundle 820 is imaged onto the plane 856 of the sample 855 to provide the shaped illumination 870. As shown in Figure 7 In the example of , the illuminated area of sample 855 matches the area imaged by the TDI sensor so that there is no or minimal unnecessary illumination. Thus, illumination efficiency can be maximized while minimizing photobleaching and photodamage from unnecessary illumination.
[0090] To shape the illumination 870, the beam of the fiber bundle output 827 passes through a collimator 830. The shaped beam can then pass through an objective lens 840. In this example, the collimator 830 is a cross-cylindrical collimator including two non-cylindrical lenses 831, 832. The two non-cylindrical lenses can have different focal lengths and are rotated 90 degrees relative to each other to achieve independent magnification in the x-axis and y-axis. The non-cylindrical lens 831 can provide a focal length f x The x-axis is collimated, and the non-cylindrical lens 82 can provide a focal length f y The y-axis alignment, where f y >f x In this example, by choosing a higher magnification (shorter focal length) for the x-axis, the six square cores are imaged as a series of rectangles rather than squares. By appropriately choosing the magnification on each axis and designing the cores and spacing, these rectangles can be made to substantially match the shape of the TDI sensor array. For example, if objective lens 840 has a focal length f o , then in this example, the magnification on the sample on the x-axis may be M x =f o / f x , and on the y-axis it can be M y =f o / f y In implementations where the cores are not necessarily square (eg, they are rectangular), the core aspect ratio may still be limited and the relative elongation of one of the axes as described above may still be achieved.
[0091] When considering manufacturing tolerances of the fiber bundle, using independent magnifications in the x-axis and y-axis as described in the previous example may be advantageous, since it may be difficult or infeasible to stack the cores too closely together in the y-direction. By applying a lower magnification in the y-axis, the spacing of the illumination bands can be matched to the TDI sensor bands without making the spacing of the cores so small that they are difficult (if not infeasible) to manufacture. The x magnification can then be freely adjusted to fill the width of the bands. The cores can be manufactured so that the ratio of band height to inter-band distance clearly matches the corresponding ratio in the dimensions of the multi-band TDI sensor.
[0092] In other implementations, other means can be used to shape the illumination 870. For example, in one implementation, the fiber core has a rectangular cross-section, which outputs a light beam having a rectangular cross-section. In some implementations, other beam shaping optics besides a cross-cylindrical collimator can be used to generate the laser line. In some implementations, multiple separate optical fibers (e.g., not part of a fiber bundle) can be used to generate multiple corresponding light beams.
[0093] Although system 800 is illustrated as a single image sensor system in this example, in other specific implementations, it can be implemented as a multi-image sensor system (e.g., by using two light sources emitting in two different wavelength ranges). Specific examples of multi-wavelength range imaging systems are further described below. Although six spaced apart sensors are depicted in the foregoing examples, any camera having multiple bands of sensors with gaps therebetween can be utilized, depending on the application.
[0094] As the aforementioned examples illustrate, it may be effective to use fiber bundles in multi-band TDI imaging systems. In multi-band TDI, laser excitation and imaging can be distributed in multiple lines / TDI bands so that the laser power density incident on the sample is reduced. This can, for example, improve imaging / sequencing quality by reducing the impact of power density on DNA damage and phasing. In addition, fiber bundle applications can provide a convenient, cost-effective route to generate the multi-line pattern required for multi-band TDI, which can be easily scaled to any reasonable number of TDI bands by changing the number of fiber cores in the bundle. The shape of the core and projection optics can also be varied to match the size of the TDI band. Using fiber stacks can eliminate the need to use complex, bulky and expensive beam shaping optics to generate multi-line patterns, thereby making multi-band TDI more feasible to achieve.
[0095] In some implementations, the multi-band sensors described herein can be utilized in structured illumination imaging applications. In such applications, it may be necessary to illuminate a grating or other light structured optical device with the correct pattern (e.g., a multi-line pattern). While this added complexity may make it challenging to generate the correct pattern, using a fiber bundle as described herein can provide a convenient and cost-effective solution for doing so.
[0096] Fig. 9 is an optical diagram depicting an example optical configuration of a structured illumination imaging system 900 according to some specific implementations of the present disclosure. For simplicity, some optical components of the imaging system 900 may be viewed from FIG. Fig. 9 The structured illumination imaging system 900 images the plane 956 of the sample 955 onto a TDI camera (not shown). The illumination 970 is structured into rectangles / strips of stripes that match the shape of the TDI sensor. The image 980 of the sensor is depicted by the rectangular dashed lines.
[0097] The laser engine 810 couples laser light into one end of a fiber bundle 920 having multiple cores. As depicted by a cross section 925 of the fiber bundle 920, the number of cores (3) in the bundle 920 matches the number of sensors (3) in the TDI camera. In order to shape the output end of the fiber bundle 920 into a line, it passes through a collimator 830 as described above. It should be noted that the specific parameters of the collimator 830 (e.g., the focal length of the lens) can be adapted depending on the design of the structured illumination imaging system 900.
[0098] In this example, a cross cylindrical collimator 830 and a fiber imaging lens 985 are used to image the three cores of the laser coupled fiber bundle 920 onto a light structured optical component 990 to obtain the correct multi-line pattern. The light structured optical component 990 can be a diffraction grating (e.g., a transmission grating) or other beam splitting element such as a beam splitter cube or plate. The output of the light structured optical component 990 passes through a projection lens 995 and an objective lens 840 and is imaged onto a plane 956 of a sample 955 to generate illumination 970 of three regions matching three TDI sensors including illumination stripes. Each region imaged in the region of the illumination stripes can correspond to one of the three phases used to reconstruct a high resolution, structured illumination image. The specific techniques for doing this are further described below.
[0099] although Fig. 9 An example use of the fiber bundle is depicted for a single wavelength range sensor assembly structured illumination imaging system using a TDI camera with spaced sensors, but the fiber bundle application can be extended to multiple wavelength range sensor assembly structured illumination imaging systems. For example, Fig.10is an optical diagram depicting an example optical configuration of a structured illumination imaging system 1000 for dual-channel imaging according to some implementations of the present disclosure. In this example, the two sensor components can correspond to colors in two wavelength ranges in the visible color spectrum (e.g., in the blue and green wavelength ranges), and the imaging system 1000 can be utilized in applications such as SBS.
[0100] The multi-wavelength range sensor assembly laser engine 1010 may include a first laser (e.g., a laser configured to output excitation light in a first wavelength range) and a second laser (e.g., a laser configured to output excitation light in a second wavelength range), which may be coupled into two respective input ends of a fiber bundle 1020. Each input end of the fiber bundle 1020 may include three fiber cores, which may then be combined to form a stack of six fiber cores as depicted by a cross section 1025 of the fiber bundle 1020. In this example, the number of cores in the bundle 1020 (six) matches the number of sensors in the TDI camera (six). In order to shape the output end of the fiber bundle 1020 into lines (e.g., three lines for the first wavelength range and three lines for the second wavelength range), the fiber bundle 1020 outputs the excitation light through a collimator 830 as described above. It should be noted that the specific parameters of the collimator 830 (e.g., the focal length of the lens) may be adapted depending on the design of the structured illumination imaging system 1000.
[0101] In this example, a cross cylindrical collimator 830 and a fiber imaging lens 1085 are used to image the six cores of the laser-coupled fiber bundle 1020 onto a light-structured optical component 1090 (e.g., a grating) to obtain a correct multi-line pattern. The output end of the light-structured optical component 1090 passes through a projection lens 1095 and an objective lens 840, and is imaged onto a plane 1056 of a sample 1055 to generate illumination including three regions 1071 corresponding to a first wavelength range of illumination stripes and three regions 1072 corresponding to a second wavelength range of illumination stripes. These six regions match six TDI sensors. Each group of three illumination stripes 1071, 1072 imaged can correspond to three phases for high-resolution structured illumination images for image reconstruction of the corresponding wavelength range.
[0102] Fig.11A three-core fiber bundle 10 that can be used in an imaging system according to some specific implementations of the present disclosure is depicted. For example, the bundle 10 can be utilized in the structured illumination imaging system 900 described above. In this example, the fiber bundle 10 includes a connector 11, a pillow pad 12, a bend protector 13, a protective tube 14, a stretch protector 15, a label 16, and an adapter 17 for the connector 11. As depicted by views A and B of the connector 11, the bundle contains a stack of three square multimode cores 21, 22, and 23. It should be understood that the location and number of components of the optical fiber bundle can vary depending on the specific implementation. In some cases, certain components (e.g., bend protector 13, stretch protector 15, label 16, adapter 17, etc.) can be omitted.
[0103] Fig.12 Depicts a six-core fiber bundle 30 that can be used in an imaging system according to some specific implementations of the present disclosure. For example, the bundle 30 can be utilized in the above-mentioned multi-sensor assembly structured illumination imaging system 1000. In this example, the fiber bundle 30 includes a connector 31, pillow pads 32 and 37, a bend protector 33, a protective tube 34, a stretch protector 35, a label 36, a splitter / combiner 38, and an adapter 39 for the connector 31. In this case, the bundle 30 has two branches that can be coupled to corresponding laser inputs. As shown by views B1 and B2 of the connector 31, one branch contains a stack of three square multimode cores 41, 42, and 43, and the other branch contains a stack of three square multimode cores 44, 45, and 46. The splitter / combiner 38 can combine the two branches to form a stack of six cores as shown by view A. It should be understood that the location and number of components of the fiber bundle can vary depending on the specific implementation. In some cases, certain components (eg, bend protector 33, stretch protector 35, label 36, adapter 39, etc.) may be omitted.
[0104] Fig.13 Depicts a six-core fiber bundle 50 that can be used in an imaging system according to some specific implementations of the present disclosure. For example, the bundle 50 can be utilized in the structured illumination imaging system 800 described above. In this example, the fiber bundle 50 includes a connector 51, a pillow 52, a bend protector 53, a protective tube 54, a stretch protector 55, and a label 56. As depicted by view A of the connector 51, the bundle contains a stack of six square multimode cores 61, 62, 63, 64, 65, and 66. It should be understood that the location and number of components of the fiber bundle can vary depending on the specific implementation. In some cases, certain components (e.g., bend protector 53, stretch protector 55, label 56, etc.) can be omitted.
[0105] As described above, in some embodiments, a multi-band TDI camera is used in a structured illumination imaging system. Structured illumination microscopy (SIM) describes an imaging technique by which spatially structured (i.e., patterned) light can be used to image a sample in order to increase the lateral resolution of the microscope by two or more times. During imaging of the sample, images of the sample can be acquired at various pattern phases (e.g., at 0°, 120°, and 240°), where the process is repeated by rotating the pattern orientation around the optical axis (e.g., rotating 60° and 120°). The captured images (e.g., nine images, one image for each orientation angle at each pattern phase) can be assembled into a single image with an extended spatial frequency bandwidth. The single image can be retransformed into real space to generate an image with a higher resolution than what a microscope would normally be able to resolve.
[0106] In some implementations of SIM systems, a linearly polarized light beam is directed through an optical diffraction grating that diffracts the light beam into two or more separate orders that can be projected as sinusoidal interference fringe patterns on the imaged sample. In these implementations, the orientation of the projected optical diffraction grating pattern is controlled by rotating the optical diffraction grating about the optical axis, while the phase of the pattern is adjusted by moving the optical diffraction grating laterally across the axis. In such systems, the optical diffraction grating is mounted on a translation stage, which in turn is mounted on a rotation stage.
[0107] Some specific implementations described herein relate to imaging the biological sample configured to have a square or asymmetric pattern.For example, by configuring the flow cell to have a square or asymmetric pattern (rather than, for example, a hexagonal pattern), fewer images are needed, because the resolution enhancement required for resolving substrates becomes anisotropic, therefore by using a more limited SIM angle set to build anisotropic optical transfer function (OTF) becomes sufficient to resolve substrates to a sufficient degree.That is, the flow cell with the nanopore of a square or asymmetric pattern allows one / multiple axes of the flow cell with a tighter pitch (that is, the distance between the nanopores next to each other) and relates to the increased resolution to be aligned with one / multiple axes of the flow cell with its resolution to be increased.In an example of a square patterned flow cell, only the increased resolution relative to two axes is needed.Therefore, only six images (images at each angle in two angles across three phases) are needed.In the case of an asymmetrically patterned flow cell, only three images of the sample are needed to realize the increased resolution to fully resolve the features required for sequencing (images at an angle across three phases).
[0108] In the case of a multi-angle SIM implementation, a fixed field of view is required to acquire each of the angle / phase image combinations. However, when images are taken only with respect to a single angle, as is the case in the implementation disclosed herein, where an asymmetrically patterned flow cell is used as the sample matrix, TDI line scans can be used to capture images of the sample covering three SIM pattern phases. That is, the SIM pattern can be moved relative to the asymmetrically patterned flow cell to generate the three phases required to resolve the sample in the flow cell with increasing resolution along only one axis.
[0109] In some implementations, TDI line scans can be used with the SIM technique to image a sample by capturing images along a flow cell (i.e., a scan band) using a TDI line scan camera or sensor. That is, a TDI line scan can be performed on a flow cell patterned with a SIM pattern in a first phase. The SIM pattern can be offset to a second phase, and the TDI line scan can be repeated. The SIM pattern can be offset to a third phase, and the TDI line scan can be repeated again. In this way, an image of the sample at each pattern phase is captured.
[0110] Alternatively, different portions of the flow cell can be patterned with different phases of the SIM pattern. For example, at a first portion of the flow cell, the SIM pattern can be in a first position, at a second portion of the flow cell, the SIM pattern can be offset to a second position, and at a third portion of the flow cell, the SIM pattern can be offset to a third position. Thus, an image of the sample across each of the three SIM pattern phases is captured in a single TDI line scan (e.g., by using three sensors in a camera) as the scan swath is captured by multiple sensors of the camera.
[0111] Some implementations of TDI line scanning can be implemented using a multi-band TDI camera as described above, where three phases of the projected fringe pattern can be specified in one scan. Such implementations can be implemented using a three-part diffraction grating, where each part of the diffraction grating corresponds to a specific phase. For example, a three-element diffraction grating can be formed on the same substrate with each element phase stepped. With this implementation, no movement of the grating or sample may be required, except for movement along the scan direction.
[0112] The use of a multi-part diffraction grating to generate multiple fringe phases can be suitable for some of the structured illumination imaging systems described above. For example, a three-part diffraction grating that generates three fringe phases can be used as part of the light structuring optical component 990, where each line of fiber stack illumination illuminates one of the three parts of the grating. Similarly, a six-part diffraction grating that generates three fringe phases for each color / wavelength can be used as part of the light structuring optical component 1090. In this case, each line of fiber stack illumination can illuminate one of the six parts of the grating.
[0113] In yet other specific implementations, rather than offsetting the SIM pattern relative to the sample / flow cell, the sample / flow cell is moved while the SIM pattern remains fixed. It should be understood that the sample is located / placed in the flow cell, resulting in the sample being patterned according to the nanopores that make up the flow cell. When a TDI line scan is implemented, as mentioned above, the sample / flow cell is already moving. Therefore, this movement of the sample / flow cell can be used to avoid having to offset the SIM pattern. That is, the movement of the sample / flow cell relative to the fixed SIM pattern (given an appropriate orientation) generates the necessary phase required to resolve the sample.
[0114] In some implementations, the grating and hole pattern can be configured with a slight angular deviation, where three thin illumination areas are projected onto the sample relatively far apart. Within each illumination line, the holes can be kept mostly in phase with the grating, but the distance between the illumination areas can be sufficient so that they are λ / 3 out of phase with the second illumination area for phase shifting. In such implementations, the spacing between illumination lines may make it easier to have a multi-band TDI camera with multiple image sensors (e.g., three) in close proximity to each other.
[0115] Fig.14A An example configuration of a patterned flow cell 1400 that can be imaged according to embodiments disclosed herein is illustrated. In this example, the flow cell 1400 is patterned with a hexagonal array (see 1404) of ordered spots or features 1402 that can be imaged simultaneously during an imaging run. For ease of illustration, the flow cell 1400 is illustrated as having tens to hundreds of spots 1402. However, as will be appreciated by those skilled in the art, the flow cell 1400 can have thousands, millions, or billions of spots 1402 that are imaged.
[0116] As implied above, in some examples, in order to resolve a sample using patterned flow cell 1400, at least nine images are required to achieve the necessary resolution. This is because the hexagonal array of nanoholes in patterned flow cell 1400 is a high-frequency pattern in which the pitch between nanoholes is tight and indistinguishable. Specifically, in this example, there are two factors that can determine how many images are needed to fully resolve the sample. The first factor is the number of copies of the desired optical passband. The second factor is the number of images used to demodulate the phase of each optical passband. Although only two images are theoretically required (to obtain the real and imaginary parts), three images are typically used to obtain better noise averaging.
[0117] It should be understood that when the image is converted from spatial frequency to Fourier space (the analysis of the raw data generated by the microscope at the rear focal plane of the objective is based on Fourier analysis), the Fourier transform contains 3 components or axes. That is, the diffraction of light at the rear focal plane of the objective can form a diffraction barrier that specifies a maximum resolution of about 200nm in the lateral (x, y) dimension and about 500nm in the axial (z) dimension, depending on the objective numerical aperture and the average wavelength of the illumination. Therefore, when a hexagonal array of nanoholes is used in the patterned flow cell 1400, SIM is used to capture images at three angles. As discussed above, in order to obtain the necessary resolution, images must be captured across three phases at each of the three angles, where three phases are required to ensure that all parts on the imaging area are observed (i.e., covering the entire wavelength of the SIM pattern), resulting in nine images. This results in an increase in resolution on all three axes 1408.
[0118] However, in one example, another type of patterned flow cell (e.g., as provided by Fig. 14B The illustrated flow cell 1410, in which the nanopores 1412 are patterned into a square array (see 1414), requires only two angles to achieve increased resolution, which is aligned along the axes of the square array. A square patterned flow cell such as flow cell 1410 can be resolved by aligning the SIM pattern or stripes with those directions where the resolution increase is desired, in this case, along the two axes (x and y) of the square array. It will be appreciated that along any diagonal path between adjacent nanopores 1412, there will be some resolution enhancement such that diagonally adjacent nanopores will be resolvable from one another. However, between nanopores 1412 along the x-axis and y-axis, the pitch (P) is 1.25 mm / s. x , P y ) is narrow enough that SIM needs to be used to improve the resolution, i.e., the spatial frequencies in the x- and y-axes are too high to be resolved.
[0119] By using a square patterned flow cell (such as flow cell 1410), the dimensional requirements of a conventional sequencing system using SIM can be reduced by one dimension, where the resolution is increased in only two axes 1418. That is, instead of capturing nine images each covering three angles on three phases, only six images each covering two angles on three phases need to be captured in order to adequately resolve the sample contained within the flow cell 1410. This is advantageous despite the reduced packing density of the flow cell 1410. For example, the reduction in packing density may be only 11% compared to a hexagonal array with the same pitch. However, implementing SIM according to various examples may result in an increase in packing density of a square patterned array with a pitch of 350nm, for example, by 356% compared to a non-SIM hexagonal array with a pitch of 700nm.
[0120] By using yet another type of patterned flow cell (in this example, an asymmetric patterned flow cell), the dimensionality requirement of a conventional sequencing system using SIM can be reduced by yet another dimension. Fig. 14C An example patterned flow cell 1420 is illustrated, whose nanopores are patterned asymmetrically. In this specific implementation, each nanopore 1422 is shaped or configured to form an elongated structure. As used herein, the term elongated structure refers to a shape where the dimension along a first axis is greater than the dimension along a second axis. In this example, the x-axis is narrower than the length or height of the nanopore 1422 along another axis (in this example, the y-axis). It should be understood that although Fig. 14C The specific implementation illustrated in uses an elliptical nanopore, but other types of elongated nanopores, such as rectangles, can be used. Nanopores of any shape that result in a certain pattern can be used, whereby samples along only one axis are associated with increased resolution using SIM. In some specific implementations, the stripe width w of the patterned feature is at least substantially equal to or slightly greater than the size of the diameter of a circular feature, the length of the side of a square feature, the length of the longer side or shorter side of a rectangular feature, the diameter of an elliptical feature along its major or minor axis, or the longest dimension of an irregular shape feature along one axis (e.g., x or y axis) of a feature. In some specific implementations, the nanopore can alternatively be shaped as a square or a circle, but with an asymmetric spacing therebetween. In various specific implementations, an asymmetric patterned flow cell can refer to an array in which the main frequency component is at different distances from the zero frequency component, an array in which the unit cell can be defined by various pitches, or an array in which the frequency components of the array can be resolved by an optical transfer function that is more asymmetric than the traditional 3-angle SIM OTF.
[0121] In this way, samples can be resolved along one direction or axis (i.e., the y-axis), while along another direction or axis (i.e., the x-axis), SIM is used to increase the resolution in order to resolve the samples. That is, along the x-axis, the pitch P of the asymmetrically patterned flow cell 1420 is x is narrow or tight, resulting in an increase in resolution, while along the y-axis, the pitch P of the asymmetrically patterned flow 1420 y Thus, the resolution is increased in only one direction / along one axis 1418, and only three images are captured in order to adequately resolve the sample contained within the nanopore of the flow cell 1420. Thus, only one copy of the optical passband is formed and required to increase the resolution.
[0122] Fig.15 1420 is a flow chart illustrating example operations that may be performed in a line scan imaging system to sequence samples using an asymmetrically patterned flow cell, such as flow cell 1420. Depending on whether the method is implemented using a single image sensor assembly or a multiple image sensor assembly line scan imaging system, one or more laser light sources may be turned on. At operation 1510, a light beam from a laser source is output through a fixed optical diffraction grating corresponding to the orientation of the optical diffraction grating pattern. The fixed optical diffraction grating may be a multi-part diffraction grating that generates a plurality of corresponding fringe phases (e.g., three phases for three lines in a single image sensor assembly system, or six phases for six lines in a dual image sensor assembly system). One or more laser light sources may be coupled into a fiber bundle (e.g., 920, 1020, etc.) as described above, and the light beam may pass through a collimator (e.g., collimator 830) before being output through the fixed optical diffraction grating.
[0123] At operation 1520, an optical diffraction grating pattern is projected onto the sample, and at operation 1530, the sample is line scanned. At operation 1540, the sample is moved according to the aforementioned line scanning technique, or the guided light may be moved as described above to achieve relative motion between the sample and the optical diffraction grating pattern.
[0124] Operations 1530 and 1540 may be repeated as many times as necessary to capture an image representing the entire sample. Since the sample moves relative to the fixed optical diffraction grating pattern, images of the sample and the optical diffraction grating pattern may be captured across the necessary phase shifts required to increase resolution. At operation 1550, a high-resolution image may be reconstructed. For a given image sensor assembly, a high-resolution image may be reconstructed using only three captured images (e.g., three images captured by three sensors of a TDI camera).
[0125] It should be noted that in order to prevent motion blur between the optical diffraction grating pattern and the sample during the line scan, the laser source can be operated in a pulsed manner. That is, the laser source can be pulsed so that at each excitation, a line scan image can be captured. In some implementations, the orientation of the optical diffraction grating pattern relative to the sample / flow cell can be offset by 90°. In other implementations, if the orientation of the optical diffraction grating pattern is such that the sample does not move through light and dark regions (as may be the case if the orientation of the optical diffraction grating pattern is offset by 90°), then pulsing of the laser source may not be required because the sample moves through the same fringe intensity relative to the movement of the optical diffraction grating pattern.
[0126] It should be noted that although the implementations described herein have been primarily described in the context of using a diffraction grating to form a fringe pattern projected onto an imaged sample, in implementations, the projected fringe pattern is not necessarily created by a diffraction grating. Any method of forming a sinusoidal fringe pattern may be suitable. The formation of the fringe pattern may be achieved via interference between two counter-propagating beams that are mutually coherent at points where the interference pattern is desired; coherent or incoherent imaging of a diffraction grating; beams separated and interfered by a beam splitter; counter-propagating beams in a light pipe or waveguide, etc.
[0127] In this document, the terms "machine-readable medium", "computer-readable medium" and similar terms are generally used to refer to volatile or non-volatile, non-transitory media that store data and / or instructions that cause a machine to operate in a specific manner. Common forms of machine-readable media include, for example, hard disks, solid-state drives, magnetic tapes or any other magnetic data storage media, optical disks or any other optical data storage media, any physical media with a pattern of holes, RAM, PROM, EPROM, FLASH-EPROM, NVRAM, any other memory chip or cartridge, and networked versions thereof.
[0128] These and other various forms of computer-readable media may involve carrying one or more sequences of one or more instructions to a processing device for execution. Such instructions embodied on the medium are generally referred to as "instructions" or "codes". Instructions may be grouped in the form of computer programs or other groupings. When executed, such instructions may enable a processing device to perform features or functions of the present application as discussed herein.
[0129] In this document, a "processing device" may be implemented as a single processor that performs processing operations or a combination of dedicated and / or general-purpose processors that perform processing operations. A processing device may include a CPU, GPU, APU, DSP, FPGA, ASIC, SOC, and / or other processing circuits.
[0130] The terms "substantially" and "approximately" used throughout this disclosure (including the claims) are used to describe and illustrate small fluctuations, such as small fluctuations due to changes in processing. For example, they can refer to less than or equal to ±5%, such as less than or equal to ±2%, such as less than or equal to ±1%, such as less than or equal to ±0.5%, such as less than or equal to ±0.2%, such as less than or equal to ±0.1%, such as less than or equal to ±0.05%.
[0131] To the extent applicable, the terms "first", "second", "third", etc. herein are used merely to show the corresponding objects described by these terms as separate entities, and are not intended to imply a time sequence, unless otherwise expressly stated herein.
[0132] Unless expressly stated otherwise, the terms and phrases used in this document and variations thereof should be interpreted as open-ended and not restrictive. As an example of the foregoing: the term "including" should be understood to mean "including but not limited to," etc.; the term "example" is used to provide an illustrative example of the items discussed, rather than an exhaustive or limiting list thereof; the term "one" or "an" should be understood to mean "at least one," "one or more," etc.; and adjectives such as "conventional," "traditional," "normal," "standard," "known," and terms of similar meaning should not be interpreted as limiting the items described to a given time period or to items available at a given time, but should be understood to include conventional, traditional, normal, or standard technologies available or known at any time now or in the future. Similarly, where this document refers to technologies that are obvious or known to a person of ordinary skill in the art, such technologies include those technologies that are obvious or known to a person of ordinary skill in the art at any time now or in the future.
[0133] In some cases, the appearance of broadening words and phrases such as "one or more," "at least," "but not limited to," or other similar phrases should not be understood to mean that a narrower case is intended or required where such broadening phrases may not be present.
[0134] In addition, the various embodiments set forth herein are described in terms of exemplary block diagrams, flow charts, and other illustrations. As will be apparent to one of ordinary skill in the art upon reading this document, the illustrated embodiments and their various alternatives may be implemented without limitation to the examples shown. For example, the block diagrams and their accompanying descriptions should not be construed as mandatory requirements for a particular architecture or configuration.
[0135] The terms "substantially" and "approximately" used throughout this disclosure (including the claims) are used to describe and illustrate small fluctuations, such as small fluctuations due to changes in processing. For example, they can refer to less than or equal to ±5%, such as less than or equal to ±2%, such as less than or equal to ±1%, such as less than or equal to ±0.5%, such as less than or equal to ±0.2%, such as less than or equal to ±0.1%, such as less than or equal to ±0.05%.
[0136] To the extent applicable, the terms "first", "second", "third", etc. herein are used merely to show the corresponding objects described by these terms as separate entities, and are not intended to imply a time sequence, unless otherwise expressly stated herein.
[0137] Although various embodiments of the present disclosure have been described above, it should be understood that they are presented only by way of example and not limitation. Similarly, each figure may depict an exemplary architecture or other configuration of the present disclosure, which is done to help understand the features and functions that may be included in the present disclosure. The present disclosure is not limited to the exemplary architecture or configuration shown, but various alternative architectures and configurations may be used to achieve the desired features. In fact, it is obvious to those skilled in the art how to implement alternative functional, logical or physical partitions and configurations to achieve the desired features of the present disclosure. In addition, many different component module names other than those described herein may be applied to various partitions. In addition, with respect to flow charts, operational descriptions, and method claims, unless the context otherwise provides, the order of the actions presented herein should not force the implementation of various embodiments to perform the functions in the same order.
[0138] Although the present disclosure is described above in terms of various exemplary embodiments and implementations, it should be understood that the various features, aspects, and functions described in one or more separate embodiments in separate implementations are not limited in their applicability to the specific embodiments in which they are described, but may be applied to one or more other embodiments in other embodiments of the present disclosure, either alone or in various combinations, regardless of whether such embodiments are described and whether such features are presented as part of the described embodiments. Therefore, the breadth and scope of the present disclosure should not be limited by any of the exemplary embodiments described above.
[0139] It should be understood that all combinations of the aforementioned concepts (assuming such concepts are not mutually contradictory) are contemplated as being part of the inventive subject matter disclosed herein. Specifically, all combinations of the claimed subject matter appearing in this disclosure are contemplated as being part of the inventive subject matter disclosed herein.
Claims
1. An imaging system, comprising: a camera comprising a plurality of spaced-apart image sensors, each of the image sensors being configured to capture an image of a corresponding sample location of a plurality of sample locations of the sample; and A fiber bundle includes a plurality of fiber cores, each of the fiber cores emitting a light beam, the light beam being projected onto a corresponding sample position among the sample positions.
2. The imaging system according to claim 1, further comprising: One or more beam shaping optics positioned in an optical path between an output end of the fiber bundle and the sample, the one or more beam shaping optics for shaping the beam into a shape corresponding to a shape of the sample location and a shape of the image sensor.
3. The imaging system of claim 2, wherein: Each of the image sensors is rectangular; and The one or more beam shaping optics include a collimator for shaping the light beam into an illumination line.
4. The imaging system of claim 3, wherein the collimator comprises: a first non-cylindrical lens, the first non-cylindrical lens being used to shape the light beam on a first axis, the first non-cylindrical lens having a first focal length; and A second non-cylindrical lens, the second non-cylindrical lens is used to shape the light beam on a second axis orthogonal to the first axis, and the second non-cylindrical lens has a second focal length different from the first focal length.
5. The imaging system of claim 4, wherein each of the cores is square.
6. The imaging system of claim 3, wherein the camera is a time delay integration (TDI) camera.
7. The imaging system of claim 3, wherein the one or more beam shaping optical devices further comprise an objective lens for focusing the light beam, the objective lens being positioned in an optical path between the collimator and the sample.
8. The imaging system of claim 2, wherein: The imaging system is a structured illumination imaging system; and The imaging system further includes a light structuring optical component for structuring each of the light beams so that each of the light beams projected onto the sample position includes a plurality of fringes.
9. The imaging system of claim 8, wherein the light structuring optical component comprises: Diffraction grating; and A grating projection lens is positioned in an optical path between the diffraction grating and the sample.
10. The imaging system of claim 9, wherein the sample is patterned asymmetrically and the diffraction grating comprises a plurality of sections.
11. The imaging system according to claim 8, further comprising: A processor is configured to reconstruct, based on the images captured by the image sensor, an image having a higher resolution than each of the images captured by the sensor.
12. The imaging system of claim 11, wherein the image captured by the image sensor comprises a plurality of phase images.
13. The imaging system of claim 1, wherein the number of the fiber cores is the same as the number of the image sensors.
14. The imaging system of claim 1, wherein the plurality of fiber cores comprises: a first plurality of fiber cores configured to emit a light beam having a first wavelength; and A second plurality of fiber cores are provided, the second plurality of fiber cores being configured to emit a light beam having a second wavelength.
15. The imaging system of claim 14, wherein the fiber optic bundle comprises: comprising a first branch of the first plurality of fiber cores, the first branch coupled to a first light source emitting light at the first wavelength; as well as A second branch of the second plurality of fiber cores is included, the second branch being coupled to a second light source emitting light at the second wavelength.
16. An imaging system, comprising: a time delay integration (TDI) camera comprising a plurality of image sensors spaced apart along a scan direction of the imaging system, each of the image sensors being configured to capture an image of a corresponding sample position of a plurality of sample positions of the sample; A light source assembly, the light source assembly is used to emit a plurality of light beams; and One or more beam shaping optics for shaping the plurality of beams into a plurality of lines having a shape corresponding to a shape of the sample locations and a shape of the image sensor, each of the lines being projected onto a respective one of the sample locations.
17. The imaging system of claim 16, wherein the light source assembly comprises a fiber bundle, the fiber bundle comprising a plurality of fiber cores, each of the fiber cores being configured to emit a respective one of the light beams.
18. The imaging system of claim 17, wherein: Each of the cores is square; and The one or more beam shaping optics include a collimator for shaping the plurality of beams into the plurality of lines.
19. The imaging system of claim 18, wherein the collimator comprises: a first non-cylindrical lens, the first non-cylindrical lens being used to shape the light beam on a first axis, the first non-cylindrical lens having a first focal length; and A second non-cylindrical lens, the second non-cylindrical lens is used to shape the light beam on a second axis orthogonal to the first axis, and the second non-cylindrical lens has a second focal length different from the first focal length.
20. An imaging system, comprising: a camera comprising a plurality of spaced-apart TDI image sensors, each of the image sensors being configured to capture an image of a corresponding sample location of a plurality of sample locations of a sample; and The sample, wherein the sample includes a plurality of nucleic acids to be analyzed, and the plurality of TDI image sensors enable a lower power density for imaging than would be required with a single sensor.
21. The imaging system of claim 20, further comprising: An asymmetrically patterned flow cell includes the sample.
22. The imaging system of claim 20, further comprising: A processor is provided for forming a composite image of the images captured by the plurality of TDI image sensors.
23. The imaging system of claim 22, wherein the processor is to align the images prior to forming the composite image.
