Systems for cell sorting based on frequency-encoded images and methods of use thereof
Patent Information
- Application Number
- JP2024187476
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2019-03-27
- Filing Date
- 2024-10-24
- Publication Date
- 2026-01-28
AI Technical Summary
The existing flow-type particle sorting system has problems of inefficiency and insufficient accuracy in particle detection and sorting. Especially in particle sorting based on particle light scattering and fluorescence characteristics, it is difficult to effectively distinguish and separate different types of particles.
By generating a cell image mask, using optical sensors to detect cells in the fluid flow, particle sorting is performed based on the generated image mask, including grayscale image processing and image mask generation, and particle characteristics such as size, mass and morphology are determined using the image mask to achieve accurate particle sorting.
It improves the accuracy and efficiency of particle sorting, and can efficiently sort according to the optical characteristics of particles, achieving accurate classification and separation of cells and other biological samples.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Background technology]
[0001] Sorting Flow-based particle sorting systems, such as flow cytometers, are used to sort particles in a fluid sample based on at least one measured characteristic of the particles. In a flow-based particle sorting system, particles, such as molecules, analyte-bound beads, or individual cells in fluid suspension, pass in a stream through a detection region where a sensor detects the particles of interest contained within the stream. Upon detecting the particles of interest, the sensor triggers a sorting mechanism that selectively isolates the particles of interest.
[0002] Particle sensing is typically performed by passing a fluid stream through a detection region where the particles are exposed to illumination from one or more lasers and the light scattering and fluorescence properties of the particles are measured. Particles or components thereof may be labeled with fluorescent dyes to facilitate detection, and multiple different particles or components may be detected simultaneously by labeling different particles or components with spectrally distinct fluorescent dyes. Detection is performed using one or more optical sensors to facilitate independent measurement of the fluorescence of each different fluorescent dye.
[0003] To sort particles in a sample, a droplet charging mechanism applies an electric charge to droplets of the fluid stream containing particles of the type to be sorted at a break-off point of the fluid stream. The droplets are passed through an electrostatic field and deflected into one or more collection vessels based on the polarity and magnitude of the charge on the droplet. Uncharged droplets are not deflected by the electrostatic field. Summary of the Invention
[0004] Aspects of the present disclosure include a method for sorting cells in a sample based on an image of the cells in a fluid stream. A method according to certain embodiments includes detecting light from a sample containing cells in a fluid stream, generating an image mask of the cells from the sample, and sorting the cells based on the generated image mask. Also described is a system having a processor with a memory operatively coupled to the processor and having instructions stored thereon, which, when executed by the processor, cause the processor to generate an image mask of cells in a sample in a fluid stream and sort the cells based on the generated image mask. Also provided is an integrated circuit device (e.g., a field programmable gate array, etc.) having programming for generating the image mask and determining one or more characteristics of the cells.
[0005] Cells in the sample in the fluid stream are sorted based on generated images (e.g., frequency encoded images, etc.) of cells in the fluid stream. Cells in the fluid stream are imaged by detecting light from the sample. In some embodiments, the method includes detecting one or more of light absorption, light scattering, light emission (e.g., fluorescence, etc.) from the sample in the fluid stream. In some cases, an image of one or more cells in the sample is generated from detected light absorption (e.g., bright field image data, etc.). In other cases, an image of one or more cells in the sample is generated from detected light scattering (e.g., forward scatter image data, side scatter image data, etc.). In still other cases, an image of one or more cells in the sample is generated from detected fluorescence (e.g., fluorescent marker image data, etc.). In still other cases, an image of one or more cells in the sample is generated from a combination of two or more of detected light absorption, detected light scattering, and detected fluorescence.
[0006] In embodiments, the method includes generating an image mask of cells in the fluid stream. In some cases, generating the image mask includes generating a grayscale image of cells in the fluid stream. In these cases, the method includes generating a grayscale image of cells in the fluid stream from the grayscale image. determining a pixel intensity threshold. To determine the pixel intensity threshold, one method includes minimizing the intra-class variance of the grayscale image and calculating a pixel intensity threshold based on the minimized intra-class variance. In some embodiments, generating the image mask includes comparing the intensity of each pixel from the grayscale image to the determined pixel intensity threshold and converting each pixel of the grayscale image to a binarized pixel value. In some cases, generating the image mask includes comparing each pixel intensity value of the grayscale image to the determined threshold across horizontal columns. In one example, the method includes detecting light absorption from the fluid stream (e.g., bright field image data, etc.) and assigning each pixel of the grayscale image a pixel value of 1 if the pixel intensity of the grayscale image is less than a threshold and a pixel value of 0 if the pixel intensity of the grayscale image is greater than the threshold. In another example, the method includes detecting light scattering from cells in the fluid stream and assigning each pixel of the grayscale image a pixel value of 1 if the pixel intensity is greater than a threshold and a pixel value of 0 if the pixel intensity is less than the threshold. In still other examples, the method includes detecting fluorescence from cells in the fluid stream and assigning each pixel of the grayscale image a pixel value of 1 if the pixel intensity is greater than a threshold and a pixel value of 0 if the pixel intensity is less than the threshold. In these examples, the method also includes determining a first pixel and a second pixel across a horizontal column of the grayscale image having an assigned pixel value of 1. In some cases, the first pixel is the first pixel in the horizontal column having a pixel value of 1. In these cases, the second pixel is the last pixel in the horizontal column having a pixel value of 1. In other cases, the first pixel is the first pixel in the horizontal column having a pixel value of 0 and the second pixel is the last pixel in the horizontal column having a pixel value of 0. In some embodiments, the image mask is generated from pixels having a binary pixel value of 1. In other embodiments, the image mask is generated from pixels having a binary pixel value of 0.
[0007] The method according to certain embodiments includes determining one or more properties of the cells in the fluid stream based on the generated image mask. For example, the method includes determining a size of the cells, a center of mass of the cells, or an eccentricity of the cells based on the image mask. In some embodiments, the method includes generating a second image mask of the cells and comparing the first image mask to the second image mask, for example, to determine whether the image of the cells includes a doublet.
[0008] In some embodiments, the method includes calculating image moments from the image mask. For example, the image moments may be calculated from the image mask according to:
[0009]
number
[0010] where m is the image moment calculated along the x-axis of the image mask and n is the image moment calculated along the y-axis of the image mask.
[0011] In some cases, the center of mass may be calculated from the image moments of the image mask. For example, the center of mass may be calculated from the image moments of the image mask according to:
[0012]
number
[0013] In other cases, the orientation of the cell may be calculated from the image moments of the image mask. For example, the orientation of the cell may be calculated from the image moments of the image mask according to:
[0014]
number
[0015] In yet other cases, the eccentricity of the cell may be calculated from the image moments of the image mask. For example, the eccentricity of the cell may be calculated from the image moments of the image mask according to:
[0016]
number
[0017] In certain embodiments, the method further includes multiplying each pixel value from the image with each pixel value from the image mask to generate a masked image of the cell. In some cases, the method includes calculating image moments from the masked image according to:
[0018]
number
[0019] where m is the image moment calculated along the x-axis of the masked image and n is the image moment calculated along the y-axis of the masked image.
[0020] In other cases, the center of mass may be calculated from the image moments of the masked image. For example, the center of mass may be calculated from the image moments of the masked image according to:
[0021]
number
[0022] In yet other cases, the orientation of the cell may be calculated from the image moments of the masked image. For example, the orientation of the cell may be calculated from the image moments of the masked image according to:
[0023]
number
[0024] In yet other cases, the eccentricity of the cell may be calculated from the image moments of the masked image. For example, the eccentricity of the cell may be calculated from the image moments of the masked image according to:
[0025]
number
[0026] In some embodiments, the method includes comparing two or more of the image, the image mask, and the masked image for each cell. In other embodiments, the method includes generating and comparing two or more different image masks of the cell, two or more different images of the cell, or two or more different masked images of the cell. In these embodiments, the method further includes calculating a colocalization coefficient (i.e., degree of colocalization) for one or more features of the cell in the image mask, image, or masked image. In embodiments, the features of the cell include: The colocalization coefficient may be a colocalization coefficient between two or more distinct cells of a cell, such as organelles (e.g., nuclei, mitochondria) or macromolecules (e.g., proteins, nucleic acids). In another embodiment, the colocalization coefficient is calculated for the cellular feature using two or more different images of the cell. In yet another embodiment, the colocalization coefficient is calculated for the cellular feature using two or more different masked images of the cell. In yet another embodiment, the colocalization coefficient is calculated for the cellular feature using two or more combinations of image masks, images, and masked images of the cell.
[0027] In certain embodiments, the colocalization coefficient for a cellular feature is calculated according to:
[0028]
number
[0029] where x is a pixel of the first image, first image mask, or first masked image; y is a pixel of the second image, second image mask, or second masked image; x is the average pixel value of the first image, first image mask, or first masked image; and y is the average pixel value of the second image, second image mask, or second masked image.
[0030] In another embodiment, the colocalization coefficient for a cellular feature is calculated according to:
[0031]
number
[0032] In other embodiments, the colocalization coefficient for a cellular feature is calculated according to:
[0033]
number
[0034] Aspects of the present disclosure also include a system for sorting cells in a sample in a fluid stream. The system according to certain embodiments includes a light source configured to illuminate a sample containing cells in the fluid stream, a light detection system having a light detector, a processor operatively coupled to a memory such that the memory includes instructions stored therein, and a cell sorting component configured to cause the processor to generate an image mask of cells in the fluid stream and to sort cells in the sample based on the generated image mask when the instructions are executed by the processor. In an embodiment, the light detection system includes one or more light detectors for detecting light absorption, light scattering, fluorescence, or a combination thereof.
[0035] In embodiments, the system includes a processor operatively coupled to a memory such that the memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate an image mask of cells in the fluid stream. In some embodiments, the memory includes instructions for generating a grayscale image of cells in the fluid stream. In these embodiments, the memory includes instructions that, when executed by the processor, cause the processor to determine a pixel intensity threshold from the grayscale image. In some cases, the memory includes instructions for comparing each pixel from the grayscale image to the determined threshold and converting each pixel to a binary pixel value. For example, the memory may include instructions for comparing each pixel intensity threshold of the grayscale image to the determined threshold across a horizontal column.
[0036] In one embodiment, the memory includes instructions that, when executed by the processor, cause the processor to detect light absorption from the fluid stream and assign each pixel of the grayscale image a pixel value of 1 if the pixel intensity is below a threshold and a pixel value of 0 if the pixel intensity is above the threshold. In other embodiments, the memory includes instructions that, when executed by the processor, cause the processor to detect light scattering from cells in the fluid stream and assign each pixel of the grayscale image a pixel value of 1 if the pixel intensity is above a threshold and a pixel value of 0 if the pixel intensity is below the threshold. In yet other embodiments, the memory includes instructions that, when executed by the processor, cause the processor to detect fluorescence from cells in the fluid stream and assign each pixel of the grayscale image a pixel value of 1 if the pixel intensity is above a threshold and a pixel value of 0 if the pixel intensity is below the threshold. In these embodiments, the memory includes instructions that, when executed by the processor, also cause the processor to determine a first pixel and a second pixel across a horizontal row of the grayscale image that have an assigned pixel value of 1. In some cases, the first pixel is the first pixel in the horizontal row that has a pixel value of 1. In these cases, the second pixel is the last pixel in the horizontal row with a pixel value of 1. In other cases, the first pixel is the first pixel in the horizontal row with a pixel value of 0 and the second pixel is the last pixel in the horizontal row with a pixel value of 0. In some embodiments, the image mask is It is generated from pixels with a binary pixel value of 1. In another embodiment, the image mask is generated from pixels with a binary pixel value of 0.
[0037] The subject systems also include a memory having instructions that, when executed by the processor, cause the processor to determine one or more properties of cells in the fluid stream based on the image mask. In these embodiments, the memory may include instructions for determining a size of the cells, a center of mass of the cells, or an eccentricity of the cells based on the image mask. In certain cases, the memory includes instructions for generating a second image mask of the cells and instructions for comparing the first image mask and the second image mask. In certain cases, the memory includes instructions for determining the presence of a doublet (i.e., a cell cluster) based on the first image mask and the second image mask.
[0038] In some embodiments, the system includes a processor with a memory operatively coupled to the processor, such that the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate image moments from the image mask. In one particular case, the image moments are calculated from the image mask according to:
[0039]
number
[0040] where m is the image moment calculated along the x-axis of the image mask and n is the image moment calculated along the y-axis of the image mask.
[0041] In some embodiments, the memory includes instructions for calculating a center of mass from the image moments of the image mask. For example, the memory may include instructions for calculating a center of mass of a cell from the image moments of the image mask according to:
[0042]
number
[0043] In other embodiments, the memory includes instructions for calculating the orientation of a cell from the image moments of the image mask. For example, the memory may include instructions for calculating the orientation of a cell from the image moments of the image mask according to:
[0044]
number
[0045] In yet other embodiments, the memory includes instructions for calculating the eccentricity of a cell from the image moments of the image mask. For example, the memory may include instructions for calculating the eccentricity of a cell from the image moments of the image mask according to:
[0046]
number
[0047] In certain embodiments, the system includes a processor with a memory operatively coupled to the processor such that the memory includes instructions stored thereon that, when executed by the processor, cause the processor to multiply each pixel value from the image with each pixel value from the image mask to generate a masked image of the cell. In some cases, the memory further includes instructions for calculating image moments from the masked image according to:
[0048]
number
[0049] where m is the image moment calculated along the x-axis of the masked image and n is the image moment calculated along the y-axis of the masked image.
[0050] In some embodiments, the memory includes instructions for calculating a center of mass from image moments of the masked image. For example, the memory may include instructions for calculating a center of mass of a cell from image moments of the masked image according to:
[0051]
number
[0052] In other embodiments, the memory includes instructions for calculating the orientation of a cell from the image moments of the masked image. For example, the memory may include instructions for calculating the orientation of a cell from the image moments of the masked image according to:
[0053]
number
[0054] In yet other embodiments, the memory includes instructions for calculating the eccentricity of a cell from the image moments of the masked image. For example, the memory may include instructions for calculating the eccentricity of a cell from the image moments of the masked image according to:
[0055]
number
[0056] The subject systems may be configured to generate two or more image masks, images, or masked images for each cell, hi some cases, the systems are configured to generate two or more different image masks of a cell, two or more different images of a cell, or two or more different masked images of a cell.
[0057] In some embodiments, the memory may further include instructions for calculating a colocalization coefficient (i.e., degree of colocalization) for one or more features of a cell in an image mask, image, or masked image. In one example, the memory includes instructions for calculating a colocalization coefficient for a feature of a cell using two or more different image masks of a cell. In another example, the memory includes instructions for calculating a colocalization coefficient for a feature of a cell using two or more different images of a cell. In yet another example, the memory includes instructions for calculating a colocalization coefficient for a feature of a cell using two or more different masked images of a cell. In yet another example, the memory includes instructions for calculating a colocalization coefficient for a feature of a cell using two or more combinations of image masks, images, or masked images of a cell.
[0058] In some cases, the memory includes instructions that, when executed by the processor, cause the processor to calculate a colocalization coefficient for a cellular feature according to:
[0059]
number
[0060] where x is a pixel of the first image, first image mask, or first masked image; y is a pixel of the second image, second image mask, or second masked image; x is the average pixel value of the first image, first image mask, or first masked image; and y is the average pixel value of the second image, second image mask, or second masked image.
[0061] In other cases, the memory includes instructions for calculating a colocalization coefficient for a cellular feature according to the following:
[0062]
number
[0063] In other cases, the memory calculates a colocalization coefficient for the cellular features according to Includes instructions for:
[0064]
number
[0065] Aspects of the present disclosure also include an integrated circuit device programmed to generate an image mask of cells in a fluid stream detected by an optical detection system including an optical detector, and to sort the cells based on the generated image mask. The integrated circuit device of interest may, in certain cases, include a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or a complex programmable logic device (CPLD).
[0066] An integrated circuit device according to certain embodiments is programmed to generate a grayscale image of cells in a fluid stream. In some embodiments, the integrated circuit device is programmed to determine a pixel intensity threshold from the grayscale image. In one particular case, the integrated circuit device is programmed to compare each pixel of the grayscale image to the determined threshold and convert each pixel to a binary pixel value. In some embodiments, the integrated circuit device is programmed to assign a pixel value of 1 to each pixel of the grayscale image if the pixel intensity is below the threshold and a pixel value of 0 to each pixel of the grayscale image if the pixel intensity is greater than the threshold. In other embodiments, the integrated circuit is programmed to assign a pixel value of 1 to each pixel of the grayscale image if the pixel intensity is greater than the threshold and a pixel value of 0 to each pixel of the grayscale image if the pixel intensity is greater than the threshold. In one particular case, the integrated circuit is programmed to determine a first pixel and a second pixel across a horizontal column of the grayscale image that have an assigned pixel value of 1.
[0067] In some cases, the integrated circuit device is programmed to determine a first pixel and a second pixel across a horizontal column of the grayscale image that have an assigned pixel value of 1. In some cases, the first pixel is the first pixel in the horizontal column that has a pixel value of 1. In these cases, the second pixel is the last pixel in the horizontal column that has a pixel value of 1. In other cases, the integrated circuit device is programmed to determine a first pixel and a second pixel across a horizontal column of the grayscale image that have an assigned pixel value of 0. In these cases, the first pixel is the first pixel in the horizontal column that has a pixel value of 0 and the second pixel is the last pixel in the horizontal column that has a pixel value of 0. In some embodiments, the image mask is generated by the integrated circuit device from pixels that have a binary pixel value of 1. In other embodiments, the image mask is generated by the integrated circuit device from pixels that have a binary pixel value of 0.
[0068] In some embodiments, the integrated circuit device is programmed to determine a size of the cell based on the image mask. In other embodiments, the integrated circuit device is programmed to determine a center of mass of the cell based on the image mask. In yet other embodiments, the integrated circuit device is programmed to determine an eccentricity of the cell based on the image mask.
[0069] The integrated circuit device may be programmed to generate a second image mask of the cell. In these embodiments, the integrated circuit device may be programmed to compare the first image mask and the second image mask of the cell. For example, comparing the first image mask and the second image mask may include determining that the image mask of the cell includes a doublet.
[0070] In some cases, the integrated circuit device is programmed to calculate the image moments from the image mask. For example, the integrated circuit device may be programmed to calculate the image mask according to:
[0071]
number
[0072] where m is the image moment calculated along the x-axis of the image mask and n is the image moment calculated along the y-axis of the image mask.
[0073] The image moments may be used to calculate the center of mass of the cell. In these embodiments, the integrated circuit device may be programmed to calculate the center of mass of the cell from the image moments of the image mask according to:
[0074]
number
[0075] The image moments may be used to calculate the orientation of the cell from the image moments. In these embodiments, the integrated circuit device may be programmed to calculate the orientation of the cell from the image moments according to:
[0076]
number
[0077] The image moments may be used to calculate the eccentricity of the cell from the image moments. In these embodiments, the integrated circuit device may be programmed to calculate the eccentricity of the cell from the image moments according to:
[0078]
number
[0079] In certain embodiments, the subject integrated circuit device is programmed to multiply each pixel value from the image with each pixel value from the image mask to generate a masked image of the cell. In some instances, the integrated circuit device is programmed to calculate image moments from the masked image according to:
[0080]
number
[0081] where m is the image moment calculated along the x-axis of the masked image and n is the image moment calculated along the y-axis of the masked image.
[0082] In some embodiments, the integrated circuit device is programmed to calculate the center of mass from the image moments of the masked image. For example, the integrated circuit device is programmed to calculate the center of mass of the cell from the image moments of the masked image according to:
[0083]
number
[0084] In another embodiment, the integrated circuit device is programmed to calculate the orientation of the cell from the image moments of the masked image. For example, the integrated circuit device is programmed to calculate the orientation of the cell from the image moments of the masked image according to:
[0085]
number
[0086] In yet another embodiment, the integrated circuit device is programmed to calculate the eccentricity of the cell from the image moments of the masked image. For example, the integrated circuit device is programmed to calculate the eccentricity of the cell from the image moments of the masked image according to:
[0087]
number
[0088] A subject integrated circuit device may be programmed to generate two or more image masks, images, or masked images for each cell, hi some cases, the integrated circuit device is programmed to generate two or more different image masks of a cell, two or more different images of a cell, or two or more different masked images of a cell.
[0089] In some embodiments, the integrated circuit device is programmed to calculate a colocalization coefficient for one or more features of a cell in an image mask, image, or masked image. In one example, the integrated circuit device is programmed to calculate a colocalization coefficient for a feature of a cell using two or more different image masks of a cell. In another example, the integrated circuit device is programmed to calculate a colocalization coefficient for a feature of a cell using two or more different images of a cell. In yet another example, the integrated circuit device is programmed to calculate a colocalization coefficient for a feature of a cell using two or more different masked images of a cell. In yet another example, the integrated circuit device is programmed to calculate a colocalization coefficient for a feature of a cell using two or more combinations of image masks, images, or masked images of a cell.
[0090] In some cases, the integrated circuit device is programmed to calculate a colocalization coefficient for a cellular feature according to the following:
[0091]
number
[0092] where x is a pixel of the first image, first image mask, or first masked image; y is a pixel of the second image, second image mask, or second masked image; x is the average pixel value of the first image, first image mask, or first masked image; and y is the average pixel value of the second image, second image mask, or second masked image.
[0093] In other instances, the integrated circuit device is programmed to calculate a colocalization coefficient for a cellular feature according to the following:
[0094]
number
[0095] In yet other instances, the integrated circuit device is programmed to calculate a colocalization coefficient for a cellular feature according to the following:
[0096]
number
[0097] The invention is best understood from the following detailed description when read in conjunction with the accompanying drawing figures. [Brief description of the drawings]
[0098] [Figure 1] 1 is a flowchart for imaging and characterizing cells in a fluid stream, according to certain embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0099] Aspects of the present disclosure include a method for sorting cells in a sample based on an image of the cells in a fluid stream. A method according to a particular embodiment includes detecting light from a sample containing cells in a fluid stream, generating an image mask of the cells from the sample, and sorting the cells based on the generated image mask. Also described is a system having a processor with a memory operatively coupled to the processor and having instructions stored thereon, the instructions, when executed by the processor, causing the processor to generate an image mask of cells contained in a sample in a fluid stream and to sort the cells based on the generated image mask. Also provided is an integrated circuit device (e.g., a field programmable gate array, etc.) having programming for generating the image mask and determining one or more characteristics of the cells.
[0100] Before the present invention is described in more detail, it is to be understood that the invention is not limited to the particular embodiments described, as such may, of course, vary, and the scope of the present invention will be limited only by the appended claims, and the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting.
[0101] Where a range of values is provided, unless the context clearly dictates otherwise, it is understood that each intervening value, to the tenth of the unit of the lower limit, between the upper and lower limit of that range and any other stated or intervening value in that stated range is encompassed within the invention. The upper and lower limits of these smaller ranges may be independently included in the smaller ranges, subject to any specifically excluded limits in the stated range, and are also encompassed within the invention. Where the stated range includes one or both of the limits, ranges excluding either or both of those included limits are also included in the invention.
[0102] In this specification, certain ranges are presented with the term "about" before numerical values. In this specification, the term "about" is used to provide literal support for the exact number it precedes, as well as a number that is close to or approximately the number it precedes. In determining whether a number is close to or approximately a specifically recited number, the close or approximate unrecited number may be a number that provides a substantial equivalent to the specifically recited number in the context in which it is presented.
[0103] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Although any methods and materials similar or equivalent to those described herein can be used in the practice or testing of the present invention, representative exemplary methods and materials are described herein.
[0104] All publications and patents cited herein are incorporated by reference as if each individual publication or patent was specifically and individually indicated to be incorporated by reference, and are incorporated by reference herein to disclose and describe the methods and / or materials in connection with which the publications cited are disclosed. The citation of any publication is for its disclosure prior to the filing date and should not be construed as an admission that the invention is not entitled to antedate such publication by virtue of prior invention. Further, the publication dates provided may be different from the actual publication dates which may need to be independently confirmed.
[0105] It should be noted that as used in this specification and the appended claims, the singular forms "a," "an," and "the" include plural references unless the context clearly dictates otherwise. It is further noted that the claims may be drafted to exclude any optional element. As such, this statement is intended to serve as a predecessor to the use of exclusive terminology, such as "solely," "only," and the like, in connection with the recitation of claim elements or the use of a "negative" limitation.
[0106] As will be apparent to those skilled in the art upon reading this disclosure, each of the individual embodiments described and illustrated herein has distinct components and features which may be readily separated from or combined with the features of any of the other several embodiments without departing from the scope or spirit of the invention. Any recited method can be carried out in the order of events recited or in any other order which is logically possible.
[0107] Although the apparatus and methods have been described or will be described for grammatical fluidity with functional descriptions, it is expressly understood that the claims, unless expressly formulated under 35 U.S.C. § 112, should not be construed as necessarily limited by "means" or "step" limitation constructions, but should be accorded the full scope of the meaning and equivalents of the definitions provided by the claims under the judicial theory of equivalents, and that if the claims are expressly formulated under 35 U.S.C. § 112, then the full legal equivalents under 35 U.S.C. § 112 should be accorded.
[0108] As summarized above, the present disclosure provides systems and methods for sorting particulate components of a sample, such as cells in a biological sample. To further describe embodiments of the present disclosure, a method for generating an image mask of cells in a fluid stream and sorting the cells based on the generated image mask is first described in great detail. A system for characterizing and sorting particles in a sample in real time is then described. An integrated circuit device, such as a field programmable gate array, with programming for generating an image mask of cells, characterizing the cells, and sorting the cells is also provided.
[0109] Method for separating particles of a sample Aspects of the present disclosure also include methods for sorting particles of a sample, such as cells in a biological sample. In performing a method according to certain embodiments, the sample is illuminated with a light source and light from the sample is detected to generate an image mask of cells in the sample, and the cells are sorted based on the generated image mask. In some cases, the sample is a biological sample. The term "biological sample" is used in its conventional sense to refer to a whole organism, a plant, a fungus, or a subset of animal tissues, cells, or component parts that may be found in blood, mucus, lymphatic fluid, synovial fluid, cerebrospinal fluid, saliva, bronchoalveolar lavage, amniotic fluid, amniotic spinal blood, urine, vaginal fluid, and semen, in certain cases. Thus, a "biological sample" refers to both a native organism or a subset of its tissues, as well as homogenates, lysates, or extracts prepared from an organism or a subset of its tissues, including, but not limited to, for example, plasma, serum, spinal fluid, lymphatic fluid, skin sections, respiratory, gastrointestinal, cardiovascular, and urinary tracts, tears, saliva, milk, blood cells, tumors, and organs. A biological sample may be any type of biological tissue, including both healthy and diseased tissue (e.g., cancerous, malignant, necrotic, etc.). In certain embodiments, the biological sample is a liquid sample such as blood or a derivative thereof, e.g., plasma, tears, urine, semen, and in some cases, the sample is a blood sample, including whole blood, such as blood obtained from a venipuncture or finger prick (the blood may or may not be combined with any reagents prior to assay, such as preservatives, anticoagulants, etc.).
[0110] In certain embodiments, the source of the sample is a "mammal" or "mammalian animal," terms used broadly to describe organisms within Mammalia, including carnivores (e.g., dogs and cats), rodents (e.g., mice, guinea pigs, and rats), and primates (e.g., humans, chimpanzees, and monkeys). In some cases, the subject is a human. The methods are applicable to human subjects of both genders and at any stage of development (i.e., neonates, infants, The present invention may be applied to samples obtained from animals (children, adolescents, adults) and in certain embodiments, the human subject is a juvenile, adolescent, or adult. It is understood that the present invention may be applied to samples from human subjects, but is not limited thereto, and may also be practiced on samples from other animal subjects (i.e., "non-human subjects"), such as birds, mice, rats, dogs, cats, livestock, and horses.
[0111] In practicing the subject methods, a sample (e.g., in a fluid stream of a flow cytometer) is illuminated with light from a light source. In some embodiments, the light source is a broadband light source that emits light having a wide range of wavelengths, e.g., 100 nm or more, e.g., 150 nm or more, e.g., 200 nm or more, e.g., 250 nm or more, e.g., 300 nm or more, e.g., 350 nm or more, e.g., 400 nm, and 500 nm or more, e.g., 50 nm or more. For example, one suitable broadband light source emits light having a wavelength between 200 nm and 1500 nm. Another example of a suitable broadband light source includes a light source that emits light having a wavelength between 400 nm and 1000 nm. Where the method includes illuminating with a broadband light source, the subject broadband light source protocol may include other broadband light sources such as, but not limited to, halogen lamps, deuterium arc lamps, xenon arc lamps, stabilized fiber-coupled broadband light sources, continuous spectrum broadband LEDs, superluminescent diodes, semiconductor light emitting diodes, wide spectrum LED white light sources, multi-LED integrated white light sources, or any combination thereof.
[0112] In other embodiments, the method includes illuminating with a narrowband light source that emits a specific wavelength or narrow range of wavelengths, such as a light source that emits light in a narrow wavelength range, such as a range of 40 nm or less, e.g., 30 nm or less, e.g., 25 nm or less, e.g., 20 nm or less, e.g., 15 nm or less, e.g., 10 nm or less, e.g., 5 nm or less, e.g., 2 nm or less, and a light source that emits a specific wavelength of light (i.e., monochromatic light), such as a range of 50 nm or less. When the method includes illuminating with a narrowband light source, the subject narrowband light source protocol may include, but is not limited to, a narrow wavelength LED, a laser diode, or a broadband light source coupled to one or more optical bandpass filters, a diffraction grating, a monochromator, or any combination thereof.
[0113] In certain embodiments, the method includes irradiating the fluid stream with one or more lasers. As mentioned above, the type and number of lasers will vary depending on the sample and the desired light to be collected, and can be pulsed or continuous wave lasers. For example, the lasers can be gas lasers such as helium neon lasers, argon lasers, krypton lasers, xenon lasers, nitrogen lasers, CO2 lasers, CO2 lasers, argon fluorine (ArF) excimer lasers, krypton fluorine (KrF) excimer lasers, xenon chlorine (XeCl) excimer lasers or xenon fluorine (XeF) excimer lasers or combinations thereof, dye lasers such as stilbene, coumarin, or rhodamine lasers, helium cadmium (HeCd) lasers, helium-mercury (HeHg) lasers, helium-selenium (HeSe) lasers, helium-silver (HeAg) lasers, strontium lasers, neon copper lasers, and the like. The laser may be a metal vapor laser, such as a (NeCu) laser, a copper laser or a gold laser, and combinations thereof; a solid-state laser, such as a ruby laser, a Nd:YAG laser, a NdCrYAG laser, an Er:YAG laser, a Nd:YLF laser, a Nd:YVO4 laser, a Nd:YCa4O(BO3)3 laser, a Nd:YCOB laser, a titanium sapphire laser, a thorium YAG laser, a ytterbium YAG laser, a Yb2O3 laser or a cerium doped laser, and combinations thereof; a semiconductor diode laser; an optically pumped semiconductor laser (OPSL); or a frequency doubled or tripled implementation of any of the above lasers.
[0114] The sample may be illuminated with one or more of the above light sources, including, for example, two or more light sources, for example, three or more light sources, for example, four or more light sources, for example, five or more light sources, and ten or more light sources. The light sources may include a combination of any type of light source. For example, in some embodiments, the method includes one or more gas lasers, one or more dye lasers, and one or more It involves irradiating samples in a fluid stream with an array of lasers, such as an array having solid state lasers.
[0115] The sample may be illuminated with wavelengths in the range of 200 nm to 1500 nm, including, for example, 250 nm to 1250 nm, for example, 300 nm to 1000 nm, for example, 350 nm to 900 nm, and 400 nm to 800 nm. For example, if the light source is a broadband light source, the sample may be illuminated with wavelengths in the range of 200 nm to 900 nm. In other cases, if the light source includes multiple narrowband light sources, the sample may be illuminated with specific wavelengths in the range of 200 nm to 900 nm. For example, the light source may be multiple narrowband LEDs (1 nm to 25 nm) each independently emitting light having a wavelength range of 200 nm to 900 nm. In other embodiments, the narrowband light source includes one or more lasers (such as a laser array), and the sample is illuminated with specific wavelengths in the range of 200 nm to 700 nm with a laser array having gas lasers, excimer lasers, dye lasers, metal vapor lasers, and solid-state lasers, as described above.
[0116] When two or more light sources are used, the sample may be illuminated with the light sources simultaneously or sequentially, or a combination thereof. For example, the sample may be illuminated with each of the light sources simultaneously. In other embodiments, the fluid stream is illuminated sequentially with each of the light sources. When two or more light sources are used to sequentially illuminate the sample, the time for which each light source illuminates the sample may be alone 0.001 microseconds or more, including, for example, 0.01 microseconds or more, such as 0.1 microseconds or more, such as 1 microseconds or more, such as 5 microseconds or more, such as 10 microseconds or more, such as 30 microseconds or more, and 60 microseconds or more. For example, the method may include illuminating the sample with a light source (e.g., a laser, etc.) for a period ranging from 0.001 microseconds to 100 microseconds, including, for example, 0.01 microseconds to 75 microseconds, such as 0.1 microseconds to 50 microseconds, such as 1 microseconds to 25 microseconds, and 5 microseconds to 10 microseconds. In embodiments in which the sample is illuminated sequentially with two or more light sources, the duration for which the sample is illuminated by each light source may be the same or different.
[0117] The period between illumination by each light source may also vary, as desired, separated individually by a delay of 0.001 microseconds or more, including, for example, 0.01 microseconds or more, such as 0.1 microseconds or more, such as 1 microsecond or more, such as 5 microseconds or more, such as 10 microseconds or more, such as 15 microseconds or more, such as 30 microseconds or more, and 60 microseconds or more. For example, the period between illumination by each light source may range from 0.001 microseconds to 60 microseconds, including, for example, 0.01 microseconds to 50 microseconds, such as 0.1 microseconds to 35 microseconds, such as 1 microseconds to 25 microseconds, and 5 microseconds to 10 microseconds. In certain embodiments, the period between illumination by each light source is 10 microseconds. In embodiments in which the sample is illuminated sequentially by more than two (i.e., three or more) light sources, the delay between illumination by each light source may be the same or different.
[0118] The sample may be illuminated continuously or at discrete intervals. In some cases, the method includes illuminating the sample with the light source continuously. In other cases, the sample is illuminated with the light source at discrete intervals, including every 0.001 milliseconds, every 0.01 milliseconds, every 0.1 milliseconds, every 1 milliseconds, every 10 milliseconds, every 100 milliseconds, and every 1000 milliseconds, or some other interval.
[0119] Depending on the light source, the sample may be illuminated from a distance that varies, including, for example, 0.01 mm or more, such as 0.05 mm or more, for example 0.1 mm or more, such as 0.5 mm or more, for example 1 mm or more, such as 2.5 mm or more, such as 5 mm or more, for example 10 mm or more, such as 15 mm or more, such as 25 mm or more, and 50 mm or more. Also, the angle or illumination may vary, for example, at an angle of 90°, in the range of, for example, 10° to 90°, including, for example, 15° to 85°, such as 20° to 80°, such as 25° to 75°, and 30° to 60°.
[0120] In practicing the subject methods, light from an illuminated sample is measured, for example, by collecting light from the sample over a range of wavelengths (e.g., 200 nm to 1000 nm, etc.). In embodiments, the methods may include one or more of measuring light absorption by the sample (e.g., bright field light data, etc.), measuring light scattering (e.g., forward scattered light data or side scattered light data, etc.), and measuring light emission by the sample (e.g., fluorescence data, etc.).
[0121] The light from the sample may be measured at one or more wavelengths, for example 5 or more different wavelengths, such as 10 or more different wavelengths, for example 25 or more different wavelengths, such as 50 or more different wavelengths, for example 100 or more different wavelengths, such as 200 or more different wavelengths, for example 300 or more different wavelengths, and including measuring the collected light at 400 or more different wavelengths.
[0122] The light may be collected over one or more of the wavelength ranges of 200 nm to 1200 nm. In some cases, the method includes measuring light from the sample over a range of wavelengths, including, for example, 200 nm to 1200 nm, for example, 300 nm to 1100 nm, for example, 400 nm to 1000 nm, for example, 500 nm to 900 nm, and 600 nm to 800 nm. In other cases, the method includes measuring the light collected at one or more specific wavelengths. For example, the light collected may be measured at one or more of 450 nm, 518 nm, 519 nm, 561 nm, 578 nm, 605 nm, 607 nm, 625 nm, 650 nm, 660 nm, 667 nm, 670 nm, 668 nm, 695 nm, 710 nm, 723 nm, 780 nm, 785 nm, 647 nm, 617 nm, and any combination thereof. In certain embodiments, the method includes measuring a wavelength of light that corresponds to the fluorescence peak wavelength of a particular fluorescent material.
[0123] The collected light may be measured continuously or at discrete intervals. In some cases, the method includes measuring the light continuously. In other cases, the light is measured at discrete intervals, including measuring the light every 0.001 milliseconds, every 0.01 milliseconds, every 0.1 milliseconds, every 1 millisecond, every 10 milliseconds, every 100 milliseconds, and every 1000 milliseconds, or some other interval.
[0124] Measurements of the collected light may be made one or more times during the subject methods, including, for example, two or more, such as three or more, such as five or more, and ten or more. In certain embodiments, the light from the sample is measured two or more times, and in certain cases, the data is averaged.
[0125] In some embodiments, the method includes further conditioning the light from the sample prior to detecting the light. For example, the light from the sample source may pass through one or more lenses, mirrors, pinholes, slits, gratings, optical refractors, and any combination thereof. In some cases, the collected light passes through one or more focusing lenses to reduce the light profile. In other cases, the light emitted from the sample passes through one or more collimators to reduce the light beam divergence.
[0126] In certain embodiments, the method includes illuminating the sample with two or more beams of frequency-shifted light. As described above, a light beam generator component having a laser and an acousto-optic device for frequency shifting of the laser light may be employed. In these embodiments, the method includes illuminating the acousto-optic device with a laser. Depending on the desired wavelength of light generated in the output laser beam (e.g., for use in illuminating a sample in a fluid stream), the laser may have a particular wavelength that varies between 200 nm and 1500 nm, including, for example, 250 nm to 1250 nm, for example, 300 nm to 1000 nm, for example, 350 nm to 900 nm, and 400 nm to 800 nm. The acousto-optic device may include, for example, two or more lasers, for example, three or more lasers, for example, four or more lasers, for example, five or more lasers, and one or more lasers. The acousto-optic device may be illuminated with one or more lasers, including zero or more lasers. The lasers may include any combination of several types of lasers. For example, in some embodiments, the method includes illuminating the acousto-optic device with an array of lasers, such as an array having one or more gas lasers, one or more dye lasers, and one or more solid state lasers.
[0127] When two or more lasers are used, the acousto-optic device may be irradiated with the lasers simultaneously or sequentially, or a combination thereof. For example, the acousto-optic device may be irradiated with each of the lasers simultaneously. In other embodiments, the acousto-optic device is irradiated sequentially with each of the lasers. When two or more lasers are employed to sequentially irradiate the acousto-optic device, the time for which each laser irradiates the acousto-optic device may be singly 0.001 microseconds or more, including, for example, 0.01 microseconds or more, such as 0.1 microseconds or more, such as 1 microseconds or more, such as 5 microseconds or more, such as 10 microseconds or more, such as 30 microseconds or more, and 60 microseconds or more. The method may include irradiating the acousto-optic device with the laser for a duration ranging from 0.001 microseconds to 100 microseconds, including, for example, 0.01 microseconds to 75 microseconds, such as 0.1 microseconds to 50 microseconds, such as 1 microseconds to 25 microseconds, and 5 microseconds to 10 microseconds. In embodiments in which the acousto-optic device is illuminated sequentially with two or more lasers, the duration for which the acousto-optic device is illuminated by each laser may be the same or different.
[0128] The period between illumination by each laser may also vary, as desired, separated individually by a delay of 0.001 microseconds or more, including, for example, 0.01 microseconds or more, such as 0.1 microseconds or more, such as 1 microsecond or more, such as 5 microseconds or more, such as 10 microseconds or more, such as 15 microseconds or more, such as 30 microseconds or more, and 60 microseconds or more. For example, the period between illumination by each light source may range from 0.001 microseconds to 60 microseconds, including, for example, 0.01 microseconds to 50 microseconds, such as 0.1 microseconds to 35 microseconds, such as 1 microseconds to 25 microseconds, and 5 microseconds to 10 microseconds. In certain embodiments, the period between illumination by each laser is 10 microseconds. In embodiments in which the acousto-optic device is illuminated sequentially by more than two (i.e., three or more) lasers, the delay between illumination by each laser may be the same or different.
[0129] The acousto-optical device can be illuminated continuously or at discrete intervals. In some cases, the method includes illuminating the acousto-optical device with a laser continuously. In other cases, the acousto-optical device is illuminated with a laser at discrete intervals, including every 0.001 milliseconds, every 0.01 milliseconds, every 0.1 milliseconds, every 1 milliseconds, every 10 milliseconds, every 100 milliseconds, and every 1000 milliseconds, or some other interval.
[0130] Depending on the laser, the acousto-optic device may be illuminated from a distance that varies, including, for example, 0.01 mm or more, such as 0.05 mm or more, for example 0.1 mm or more, such as 0.5 mm or more, for example 1 mm or more, such as 2.5 mm or more, such as 5 mm or more, for example 10 mm or more, such as 15 mm or more, such as 25 mm or more, and 50 mm or more. Also, the angle or illumination may vary in the range of 10° to 90°, including, for example, an angle of 90°, for example, from 15° to 85°, for example from 20° to 80°, for example from 25° to 75°, and from 30° to 60°.
[0131] In an embodiment, a method includes applying a high frequency drive signal to an acousto-optic device to generate an angularly deflected laser beam. Applying two or more high frequency drive signals to the acousto-optic device to generate an angularly deflected laser beam, e.g., three or more high frequency drive signals, e.g., four or more high frequency drive signals, e.g., five or more high frequency drive signals, e.g., six or more high frequency drive signals, e.g., seven or more high frequency drive signals, e.g., eight or more high frequency drive signals, e.g., nine or more high frequency drive signals, e.g., ten or more high frequency drive signals, e.g., fifteen or more high frequency drive signals, e.g., twenty-five or more high frequency drive signals. An output laser beam having any desired number of angularly deflected laser beams may be generated, including signals, for example, 50 or more high frequency drive signals, and 100 or more high frequency drive signals.
[0132] The angularly deflected laser beams generated by the high frequency drive signals each have an intensity based on the amplitude of the applied high frequency drive signal. In some embodiments, the method includes applying a high frequency drive signal having an amplitude sufficient to generate an angularly deflected laser beam at a desired intensity. In some cases, each applied high frequency drive signal has an amplitude of about 0.001 V to about 500 V, including, for example, about 0.005 V to about 400 V, for example, about 0.01 V to about 300 V, for example, about 0.05 V to about 200 V, for example, about 0.1 V to about 100 V, for example, about 0.5 V to about 75 V, for example, about 1 V to about 50 V, for example, about 2 V to about 40 V, for example, 3 V to about 30 V, and about 5 V to about 25 V. Each applied high frequency drive signal, in some embodiments, has a frequency of about 0.001 MHz to about 500 MHz, including, for example, about 0.005 MHz to about 400 MHz, for example, about 0.01 MHz to about 300 MHz, for example, about 0.05 MHz to about 200 MHz, for example, about 0.1 MHz to about 100 MHz, for example, about 0.5 MHz to about 90 MHz, for example, about 1 MHz to about 75 MHz, for example, about 2 MHz to about 70 MHz, for example, about 3 MHz to about 65 MHz, for example, about 4 MHz to about 60 MHz, and about 5 MHz to about 50 MHz.
[0133] In these embodiments, the angularly deflected laser beams within the output laser beam are spatially separated. Depending on the applied high frequency drive signal and the desired illumination profile of the output laser beam, the angularly deflected laser beams may be separated by 0.001 μm or more, including, for example, 0.005 μm or more, for example, 0.01 μm or more, for example, 0.05 μm or more, for example, 0.1 μm or more, for example, 0.5 μm or more, for example, 1 μm or more, for example, 5 μm or more, for example, 10 μm or more, for example, 100 μm or more, for example, 500 μm or more, for example, 1000 μm or more, and 5000 μm or more. In some embodiments, the angularly deflected laser beams overlap with adjacent angularly deflected laser beams, for example, along the horizontal axis of the output laser beam. The overlap between adjacent angularly deflected laser beams (e.g., beam spot overlap) can be 0.001 μm or more, including, for example, 0.005 μm or more overlap, for example, 0.01 μm or more overlap, for example, 0.05 μm or more overlap, for example, 0.1 μm or more overlap, for example, 0.5 μm or more overlap, for example, 1 μm or more overlap, for example, 5 μm or more overlap, for example, 10 μm or more overlap, and 100 μm or more overlap.
[0134] In certain cases, the fluid stream is illuminated with multiple beams of frequency-shifted light, and cells within the fluid stream are imaged by fluorescence imaging using radio frequency tagged emission (FIRE) to generate frequency-encoded images, such as those described in Diebold, et al. Nature Photonics Vol. 7(10); 806-810 (2013), as well as U.S. Pat. Nos. 9,423,353, 9,784,661, and 10,006,852, and U.S. Patent Publication Nos. 2017 / 0133857 and 2017 / 0350803, the disclosures of which are incorporated herein by reference.
[0135] In an embodiment, the method includes generating an image mask of cells in the fluid stream from the detected light. The image mask may be generated from detected light absorption, detected light scattering, detected light emission, or any combination thereof. In some cases, the image mask is generated from detected light absorption from the sample, such as from a brightfield light detector. In these cases, the image mask is generated based on brightfield image data from cells in the fluid stream. In other cases, the image mask is generated from detected light scattering from the sample, such as by a side scatter detector, a forward scatter detector, or a combination of a side scatter detector and a forward scatter detector. In these cases, the image mask is generated based on scattered light image data. In still other cases, the image mask is generated based on light from other sources, such as light from fluorescent substances added to the sample. In some cases, the image mask is generated from emitted light from the sample. In these cases, the image mask is generated based on fluorescence image data (i.e., imaging data from fluorescent moieties on or in the cells). In still other cases, the image mask is generated from a combination of detected light absorption, detected light scattering, and detected light emission.
[0136] One or more image masks may be generated from the detected light. In some embodiments, a single image mask is generated from each form of detected light. For example, a first image mask of the cells is generated from detected light absorption, a second image mask of the cells is generated from detected light scattering, and a third image mask of the cells is generated from detected light emission. In other embodiments, two or more image masks, including, for example, three or more, for example four or more, for example five or more, and for example ten or more image masks, or combinations thereof, are generated from each form of detected light.
[0137] To generate the image mask, the method according to certain embodiments includes generating an image of cells in the fluid stream. In some embodiments, the image is a grayscale image of cells in the fluid stream. The term "grayscale" is used in the conventional sense herein to refer to an image of cells in the fluid stream that is composed of various shades of gray based on the light intensity of each pixel. In embodiments, the pixel intensity threshold is determined from the grayscale image, which is used to convert each pixel into a binary value, which is used to generate the image mask of the cells, as described in more detail below. In some embodiments, the pixel intensity threshold is determined by minimizing the intra-class variance of the grayscale image and calculating the pixel intensity threshold based on the minimized intra-class variance. In some embodiments, the pixel intensity threshold is determined using an algorithm in which the detected light data includes two classes of pixels (including foreground and background pixels) according to a bimodal histogram, and calculating an optimal threshold that separates the two classes such that the combined intra-class variance is minimized. In other embodiments, the method includes calculating an optimal threshold that separates the two classes such that the inter-class variance is maximized.
[0138] In generating the image mask, each pixel in the grayscale image is compared to the determined intensity threshold and converted to a binary pixel value. Each pixel in the grayscale image may be compared to the determined intensity threshold in any order as desired. In some embodiments, pixels along each horizontal column in the grayscale image are compared to the determined intensity threshold. In some cases, each pixel is compared to the determined intensity threshold from the left side of the grayscale image to the right side of the grayscale image. In other cases, each pixel is compared to the determined intensity threshold from the right side of the grayscale image to the left side of the grayscale image. In other embodiments, pixels along each vertical column in the grayscale image are compared to the determined intensity threshold. In some cases, each pixel is compared to the determined intensity threshold along each vertical column from the top of the grayscale image to the bottom of the grayscale image. In other cases, each pixel is compared to the determined intensity threshold along each vertical column from the bottom of the grayscale image to the top of the grayscale image.
[0139] Depending on the size of the cell being imaged and the size of the optics (described in more detail below) used to collect light from the sample, a portion of the entire grayscale image may be compared to the intensity threshold. For example, in practicing the subject methods, 50% or more of the pixels in the grayscale image may be compared to the intensity threshold, including, for example, 60% or more, for example, 70% or more, for example, 80% or more, for example, 90% or more, for example, 95% or more, for example, 97% or more, or for example, 99% or more of the pixels of the grayscale image. In certain embodiments, all (100%) of the pixels of the grayscale image of the cell may be compared to the intensity threshold.
[0140] As summarized above, each pixel in a grayscale image is converted to a binarized pixel value. Depending on the type of light detected, each pixel is assigned a binarized pixel value of 1 or a binarized pixel value of 0. In one embodiment, the method includes detecting light absorption from the fluid stream (e.g., bright field image data) and assigning each pixel of the grayscale image a binarized pixel value of 1 if the pixel intensity is below an intensity threshold and a binarized pixel value of 0 if the pixel intensity of the grayscale image is greater than an intensity threshold. In another embodiment, the method includes detecting light scattering from cells in the fluid stream and assigning each pixel of the grayscale image a binarized pixel value of 1 if the pixel intensity is greater than an intensity threshold and a binarized pixel value of 0 if the pixel intensity is less than the intensity threshold. In yet another embodiment, the method includes detecting fluorescence from cells in the fluid stream and assigning each pixel of the grayscale image a binarized pixel value of 1 if the pixel intensity is greater than an intensity threshold and a binarized pixel value of 0 if the pixel intensity is less than the intensity threshold.
[0141] If binarized pixel values are assigned to each pixel of the grayscale image across a horizontal column, in some embodiments the method further includes determining a first pixel in the horizontal column having a binarized pixel value of 1 and determining a last pixel in the horizontal column having a binarized pixel value of 1. In one embodiment, the method includes determining a first pixel from a left side of the horizontal column having an assigned binary pixel value of 1 and determining a last pixel from a left side of the horizontal column having an assigned binary pixel value of 1. In another embodiment, the method includes determining a first pixel from a right side of the horizontal column having an assigned binary pixel value of 1 and determining a last pixel from a right side of the horizontal column having an assigned binary pixel value of 1. In another embodiment, the method further includes determining a first pixel in the horizontal column having a binarized pixel value of 0 and determining a last pixel in the horizontal column having a binarized pixel value of 0. In one embodiment, the method includes determining a first pixel from a left side of the horizontal column having an assigned binary pixel value of 0 and determining a last pixel from a left side of the horizontal column having an assigned binary pixel value of 0. In another embodiment, the method includes determining a first pixel from the right side of the horizontal row that has an assigned binary pixel value of 0, and determining a last pixel from the right side of the horizontal row that has an assigned binary pixel value of 0.
[0142] If a binarized pixel value is assigned to each pixel of the grayscale image along a vertical column, in some embodiments the method further includes determining a first pixel along the vertical column that has a binarized pixel value of 1, and determining a last pixel along the vertical column that has a binarized pixel value of 1. In one embodiment, the method includes determining a first pixel from the top of the vertical column that has an assigned binary pixel value of 1, and determining a last pixel from the top of the vertical column that has an assigned binary pixel value of 1. In another embodiment, the method includes determining a first pixel from the bottom of the vertical column that has an assigned binary pixel value of 1, and determining a last pixel from the bottom of the vertical column that has an assigned binary pixel value of 1. In another embodiment, the method further includes determining a first pixel along the vertical column that has an assigned binary pixel value of 0, and determining a last pixel along the vertical column that has an assigned binary pixel value of 0. In one embodiment, the method includes determining a first pixel from the top of the vertical column that has an assigned binary pixel value of 0, and determining a last pixel from the top of the vertical column that has an assigned binary pixel value of 0. In another embodiment, the method includes determining a first pixel from the bottom of the vertical column that has an assigned binary pixel value of 0, and determining a last pixel from the bottom of the vertical column that has an assigned binary pixel value of 0.
[0143] In some embodiments, the method further comprises calculating image moments from the image mask. As used herein, the term "image moment" is used in its conventional sense to refer to a weighted average of pixel intensities in an image (e.g., a generated image mask). As described below, image moments determined from an image mask may include the total intensity of pixels of cells in the image mask, the total area occupied by cells in the image mask, the image mass of the cells, the total area occupied by cells in the image mask, the image moment ... The image moments may be used to calculate the orientation of the cells in the image mask as well as the center of mass (i.e., geometric center) of the cells in the image mask. In some embodiments, the image moments are calculated from the image mask according to:
[0144]
number
[0145] where m is the image moment calculated along the x-axis of the image mask and n is the image moment calculated along the y-axis of the image mask.
[0146] Methods according to certain embodiments include determining one or more properties of cells in the fluid stream based on the generated image mask. For example, the methods may include determining a size of the cells, a center of mass of the cells, or an eccentricity of the cells based on the image mask. In these embodiments, the methods include calculating one or more image moments of the image mask and determining the properties of the cells based on the image mask and the calculated image moments.
[0147] In some cases, the center of mass may be calculated from the image moments of the image mask. For example, the center of mass may be calculated from the image moments of the image mask according to:
[0148]
number
[0149] In other cases, the orientation of the cell may be calculated from the image moments of the image mask. For example, the orientation of the cell may be calculated from the image moments of the image mask according to:
[0150]
number
[0151] In yet other cases, the eccentricity of the cell may be calculated from the image moments of the image mask. For example, the eccentricity of the cell may be calculated from the image moments of the image mask according to:
[0152]
number
[0153] In some embodiments, the method includes generating a masked image of the cells in the fluid stream. The masked image is generated by multiplying each pixel value from the image mask with the pixel value of the image of the cells. The image of the cells may be the grayscale image from which the image mask was generated, or may be other images of the cells, such as frequency encoded image data obtained from detecting light (bright field, scattered or emitted) from a sample in the fluid stream.
[0154] In some embodiments, the method further includes calculating image moments from the masked image. In some instances, the image moments from the masked image are calculated according to:
[0155]
number
[0156] where m is the image moment calculated along the x-axis of the masked image and n is the image moment calculated along the y-axis of the masked image.
[0157] Based on the masked image and the calculated image moments, one or more properties of the cell may be determined, such as, for example, cell size, cell orientation, and cell eccentricity. Comparison of the image mask to the masked image may also be used to determine the variance of the optical signal within the boundaries of the image mask. In one embodiment, the center of mass may be calculated from the image moments of the masked image. For example, the center of mass may be calculated from the image moments of the masked image according to:
[0158]
number
[0159] In other examples, the orientation of the cell may be calculated from the image moments of the masked image. For example, the orientation of the cell may be calculated from the image moments of the masked image according to:
[0160]
number
[0161] In yet another embodiment, the eccentricity of the cell may be calculated from the image moments of the masked image. For example, the eccentricity of the cell may be calculated from the image moments of the masked image according to:
[0162]
number
[0163] In some embodiments, the method includes comparing, for each cell, two or more of the image, the image mask, and the masked image. In some cases, the image of the cell and the image mask may be compared. In other cases, the image of the cell and the masked image may be compared. In still other cases, the image mask of the cell and the masked image may be compared. In other embodiments, the method includes generating and comparing two or more different image masks of the cell, two or more different images of the cell, or two or more different masked images of the cell.
[0164] In some embodiments, a colocalization coefficient is calculated, which is a measure of the degree of colocalization for one or more features of cells. The features of cells may be, for example, organelles (e.g., nuclei, mitochondria) or macromolecules (e.g., proteins, nucleic acids) between cells. In some cases, the colocalization coefficient is calculated from two or more different image masks of the cell. In other cases, the colocalization coefficient is calculated from two or more different images of the cell. In still other cases, the colocalization coefficient is calculated from two or more different masked images of the cell. In some embodiments, the colocalization coefficient is calculated from an image of the cell and an image mask. In other embodiments, the colocalization coefficient is calculated from an image of the cell and a masked image. In still other embodiments, the colocalization coefficient is calculated from an image mask and a masked image of the cell.
[0165] In certain embodiments, the colocalization coefficient for a cellular feature is calculated according to:
[0166]
number
[0167] where x is a pixel of the first image, first image mask, or first masked image; y is a pixel of the second image, second image mask, or second masked image; x is the average pixel value of the first image, first image mask, or first masked image; and y is the average pixel value of the second image, second image mask, or second masked image.
[0168] In other embodiments, the colocalization coefficient for a cellular feature is calculated according to the following:
[0169]
number
[0170] In other embodiments, the colocalization coefficient for a cellular feature is calculated according to:
[0171]
number
[0172] According to a particular embodiment, FIG. 1 shows a flow chart for imaging and characterizing cells in a fluid stream. In step 101, light (light absorption, scattered light, or emission) from cells in the fluid stream is detected. In step 102, an image of the cells (e.g., a grayscale image, etc.) is generated. In step 103, a pixel intensity threshold is determined based on the pixels of the image. In step 104, each pixel of the image is converted to a binary pixel value by comparing the intensity of each pixel with the determined pixel intensity threshold. Then, in step 105, the binary pixel values are used to generate an image mask. In step 106, the image mask may be used to generate a masked image. In step 107, two or more image masks may be used to calculate co-localization of one or more features of the cells (e.g., organelles, etc.), or in step 108, the image mask and the masked image may be used to calculate co-localization.
[0173] As summarized above, the method of the present disclosure also includes sorting cells in a sample. The term "sorting" is used herein in its conventional sense to refer to separating components of a sample (e.g., droplets containing cells, droplets containing non-cellular particles such as biopolymers) and, in some cases, delivering the separated components to one or more sample collection vessels. For example, the method may include sorting two or more components of a sample, including, for example, three or more components, for example, four or more components, for example, five or more components, for example, ten or more components, for example, fifteen or more components, and twenty-five or more components of a sample. In an embodiment, the method includes sorting cells based on a generated image mask of the cells.
[0174] In sorting cells, the methods include, for example, computer-assisted data acquisition, analysis, and recording, where multiple data channels record data from each detector (e.g., scatter detector, bright field detector, or fluorescence detector) used in generating the cell image, image mask, or masked image. In these embodiments, the analysis includes sorting and counting particles such that each particle is represented as a set of digitized parameter values. The subject systems (described below) can be set to trigger on selected parameters to distinguish particles of interest from background and noise.
[0175] A particular subpopulation of interest can then be further analyzed by "gating" based on the data collected for the entire population. To select an appropriate gate, the data is plotted to obtain the best possible separation of the subpopulations. This procedure can be performed by plotting forward light scatter (FSC) versus side (i.e., orthogonal) light scatter (SSC) on a two-dimensional dot plot. A subpopulation of particles (i.e., those cells within the gate) is then selected, and particles not within the gate are excluded. If necessary, a gate can be selected by drawing a line around the desired subpopulation using a cursor on the computer screen. Then, only those particles within the gate are detected by, for example, fluorescence, etc. These particles may then be further analyzed by plotting other parameters, such as the particle size, the particle distribution ...
[0176] In some embodiments, a method for sorting components of a sample includes sorting particles (such as cells in a biological sample) using a particle sorting module having a deflector plate, for example, as described in U.S. Patent Publication No. 2017 / 0299493, filed March 28, 2017, the disclosure of which is incorporated herein by reference. In certain embodiments, cells in a sample are sorted using a sorting determination module having multiple sorting determination units, such as that described in U.S. Provisional Patent Application No. 62 / 803,264, filed February 8, 2019, the disclosure of which is incorporated herein by reference.
[0177] System for sorting particles of a sample As summarized above, aspects of the present disclosure include a system for sorting particles in a sample. The system according to certain embodiments includes a light source configured to illuminate a sample containing cells in a fluid stream, a light detection system with one or more light detectors, a processor operably coupled to a memory such that the memory includes instructions stored therein, and a cell sorting component configured to cause the processor to generate an image mask of cells in the fluid stream and sort cells in the sample based on the generated image mask when the instructions are executed by the processor. In some embodiments, the subject system is configured to sort components of a sample, such as cells in a biological sample. As mentioned above, sorting is used herein in its conventional sense to refer to separating components of a sample (e.g., cells, non-cellular particles such as biopolymers, etc.) and, in some cases, delivering the separated components to one or more sample collection vessels. For example, the subject system can be configured to sort a sample having two or more components, including separating a sample having, for example, three or more components, for example, four or more components, for example, five or more components, for example, ten or more components, for example, fifteen or more components, and twenty-five or more components. One or more of the sample components may be separated from the sample and delivered to a sample collection container, for example, two or more sample components, such as three or more sample components, for example four or more sample components, such as five or more sample components, for example ten or more sample components, and including fifteen or more sample components may be separated from the sample and delivered to a sample collection container.
[0178] The subject system includes a light source configured to illuminate a sample having cells in a fluid stream. In embodiments, the light source may be any suitable broadband or narrowband light source. Depending on the components in the sample (e.g., cells, beads, non-cellular particles, etc.), the light source may be configured to emit wavelengths of light that vary in the range of 200 nm to 1500 nm, including, for example, 250 nm to 1250 nm, such as 300 nm to 1000 nm, such as 350 nm to 900 nm, and 400 nm to 800 nm. For example, the light source may include a broadband light source that emits light having a wavelength of 200 nm to 900 nm. In other cases, the light source includes a narrowband light source that emits a wavelength in the range of 200 nm to 900 nm. For example, the light source may be a narrowband LED (1 nm to 25 nm) that emits light having a wavelength in the range of 200 nm to 900 nm.
[0179] In some embodiments, the light source is a laser. Lasers of interest may include pulsed or continuous wave lasers. For example, the laser may be a gas laser, such as a helium neon laser, an argon laser, a krypton laser, a xenon laser, a nitrogen laser, a CO2 laser, a CO2 laser, an argon fluorine (ArF) excimer laser, a krypton fluorine (KrF) excimer laser, a xenon chlorine (XeCl) excimer laser, or a xenon fluorine (XeF) excimer laser, or a combination thereof, a dye laser, such as a stilbene, coumarin, or rhodamine laser, a helium cadmium (HeCd) laser, a helium-mercury (HeHg) laser, a helium-selenium (HeSe) laser, a helium-silver (HeAg) laser, a strontium laser, a neon copper (NeCu) laser, a copper laser, or a gold laser. The laser may be a metal vapor laser, such as a ruby laser, a Nd:YAG laser, a NdCrYAG laser, an Er:YAG laser, a Nd:YLF laser, a Nd:YVO4 laser, a Nd:YCa4O(BO3)3 laser, a Nd:YCOB laser, a titanium sapphire laser, a thorium YAG laser, a ytterbium YAG laser, a Yb2O3 laser or a cerium doped laser, and combinations thereof, a semiconductor diode laser, an optically pumped semiconductor laser (OPSL), or a frequency doubled or tripled implementation of any of the above lasers.
[0180] In other embodiments, the light source is a non-laser light source such as a lamp, including but not limited to a halogen lamp, a deuterium arc lamp, a xenon arc lamp, a light emitting diode such as a broadband LED with a continuous spectrum, a superluminescent diode, a semiconductor light emitting diode, a broad spectrum LED white light source, a multi-LED integration, etc. In some cases, the non-laser light source is a stabilized fiber-coupled broadband light source, a white light source, other light sources among others, or any combination thereof.
[0181] In certain embodiments, the light source is an optical beam generator configured to generate two or more beams of frequency-shifted light. In some cases, the optical beam generator includes a laser, a radio frequency generator configured to apply a radio frequency drive signal to an acousto-optic device to generate two or more angularly deflected laser beams. In these embodiments, the laser may be a pulsed laser or a continuous wave laser. For example, the laser in the subject optical beam generator may be a gas laser, such as a helium neon laser, an argon laser, a krypton laser, a xenon laser, a nitrogen laser, a CO2 laser, a CO2 laser, an argon fluorine (ArF) excimer laser, a krypton fluorine (KrF) excimer laser, a xenon chlorine (XeCl) excimer laser, or a xenon fluorine (XeF) excimer laser or combinations thereof, a dye laser, such as a stilbene, coumarin, or rhodamine laser, a helium cadmium (HeCd) laser, a helium-mercury (HeHg) laser, a helium-selenium (HeS) laser, or a combination thereof. e) metal vapor lasers such as helium-silver (HeAg) lasers, strontium lasers, neon copper (NeCu) lasers, copper lasers or gold lasers and combinations thereof; solid state lasers such as ruby lasers, Nd:YAG lasers, NdCrYAG lasers, Er:YAG lasers, Nd:YLF lasers, Nd:YVO4 lasers, Nd:YCa4O(BO3)3 lasers, Nd:YCOB lasers, titanium sapphire lasers, thorium YAG lasers, ytterbium YAG lasers, Yb2O3 lasers or cerium doped lasers and combinations thereof.
[0182] The acousto-optical device may be any convenient acousto-optical protocol configured to frequency shift laser light using applied acoustic waves. In certain embodiments, the acousto-optical device is an acousto-optical deflector. The acousto-optical device in the subject system is configured to generate an angularly deflected laser beam from light from a laser and an applied high frequency drive signal. The high frequency drive signal may be applied to the acousto-optical device with any suitable high frequency drive signal source, such as a direct digital synthesizer (DDS), an arbitrary waveform generator (AWG), or an electrical pulse generator.
[0183] In an embodiment, the controller is configured to apply high frequency drive signals to the acousto-optic device to generate a desired number of angularly deflected laser beams in the output laser beam, such as being configured to apply three or more high frequency drive signals, including being configured to apply four or more high frequency drive signals, such as five or more high frequency drive signals, such as six or more high frequency drive signals, such as seven or more high frequency drive signals, such as eight or more high frequency drive signals, such as nine or more high frequency drive signals, such as ten or more high frequency drive signals, such as fifteen or more high frequency drive signals, such as twenty-five or more high frequency drive signals, such as fifty or more high frequency drive signals, and one hundred or more high frequency drive signals.
[0184] In some cases, to generate an intensity profile of the angularly deflected laser beam within the output laser beam, the controller is configured to apply a high frequency drive signal having an amplitude that varies from about 0.001 V to about 500 V, including, for example, from about 0.005 V to about 400 V, for example, from about 0.01 V to about 300 V, for example, from about 0.05 V to about 200 V, for example, from about 0.1 V to about 100 V, for example, from about 0.5 V to about 75 V, for example, from about 1 V to about 50 V, for example, from about 2 V to about 40 V, for example, from about 3 V to about 30 V, and from about 5 V to about 25 V. Each applied high frequency drive signal, in some embodiments, has a frequency of about 0.001 MHz to about 500 MHz, including, for example, about 0.005 MHz to about 400 MHz, for example, about 0.01 MHz to about 300 MHz, for example, about 0.05 MHz to about 200 MHz, for example, about 0.1 MHz to about 100 MHz, for example, about 0.5 MHz to about 90 MHz, for example, about 1 MHz to about 75 MHz, for example, about 2 MHz to about 70 MHz, for example, about 3 MHz to about 65 MHz, for example, about 4 MHz to about 60 MHz, and about 5 MHz to about 50 MHz.
[0185] In certain embodiments, the controller includes a processor with a memory operably coupled to the processor such that the memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate an output laser beam having an angularly deflected laser beam with a desired intensity profile. For example, the memory may include instructions for generating two or more angularly deflected laser beams, including, for example, three or more, such as four or more, such as five or more, such as ten or more, such as twenty-five or more, such as fifty or more, having the same intensity, and the memory may include instructions for generating one hundred or more angularly deflected laser beams having the same intensity. In other embodiments, the memory may include instructions for generating two or more angularly deflected laser beams, including, for example, three or more, such as four or more, such as five or more, such as ten or more, such as twenty-five or more, such as fifty or more, having different intensities, and the memory may include instructions for generating one hundred or more angularly deflected laser beams having different intensities.
[0186] In certain embodiments, the controller includes a processor with a memory operatively coupled to the processor such that the memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate an output laser beam having an intensity that increases from the edge to the center of the output laser beam along a horizontal axis. In these cases, the intensity of the angularly deflected laser beam at the center of the output beam can range from 0.1% to about 99% of the intensity of the angularly deflected laser beam at the edge of the output laser beam along the horizontal axis, including, for example, 0.5% to about 95%, for example, 1% to about 90%, for example, about 2% to about 85%, for example, about 3% to about 80%, for example, about 4% to about 75%, for example, about 5% to about 70%, for example, about 6% to about 65%, for example, about 7% to about 60%, for example, about 8% to about 55%, and about 10% to about 50% of the intensity of the angularly deflected laser beam at the edge of the output laser beam along the horizontal axis. In other embodiments, the controller includes a processor with a memory operatively coupled to the processor such that the memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate an output laser beam having an intensity that increases from the edge to the center of the output laser beam along a horizontal axis. In these cases, the intensity of the angularly deflected laser beam at the edge of the output beam can range from 0.1% to about 99% of the intensity of the angularly deflected laser beam at the center of the output laser beam along the horizontal axis, including, for example, 0.5% to about 95%, for example, 1% to about 90%, for example, about 2% to about 85%, for example, about 3% to about 80%, for example, about 4% to about 75%, for example, about 5% to about 70%, for example, about 6% to about 65%, for example, about 7% to about 60%, for example, about 8% to about 55%, and about 10% to about 50% of the intensity of the angularly deflected laser beam at the center of the output laser beam along the horizontal axis. In yet another embodiment, the controller comprises a processor with a memory operatively coupled to the processor such that the memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate an output laser beam having an intensity profile with a Gaussian distribution along a horizontal axis. In yet another embodiment, the controller comprises a processor with a memory operatively coupled to the processor such that the memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate an output laser beam having a top-hat intensity profile along a horizontal axis.
[0187] In embodiments, the subject optical beam generator may be configured to generate angularly polarized laser beams within the spatially separated output laser beam. Depending on the applied high frequency drive signal and the desired illumination profile of the output laser beam, the angularly polarized laser beams may be separated by 0.001 μm or more, including, for example, 0.005 μm or more, for example, 0.01 μm or more, for example, 0.05 μm or more, for example, 0.1 μm or more, for example, 0.5 μm or more, for example, 1 μm or more, for example, 5 μm or more, for example, 10 μm or more, for example, 100 μm or more, for example, 500 μm or more, for example, 1000 μm or more, and 5000 μm or more. In some embodiments, the system is configured to generate angularly polarized laser beams in the output laser beam that overlap with adjacent angularly polarized laser beams, for example, along the horizontal axis of the output laser beam. The overlap between adjacent angularly deflected laser beams (e.g., beam spot overlap) can be 0.001 μm or more, including, for example, 0.005 μm or more overlap, for example, 0.01 μm or more overlap, for example, 0.05 μm or more overlap, for example, 0.1 μm or more overlap, for example, 0.5 μm or more overlap, for example, 1 μm or more overlap, for example, 5 μm or more overlap, for example, 10 μm or more overlap, and 100 μm or more overlap.
[0188] In certain cases, the light beam generator configured to generate two or more beams of frequency-shifted light includes a laser excitation module as described in U.S. Pat. Nos. 9,423,353, 9,784,661, and 10,006,852, and U.S. Patent Publication Nos. 2017 / 0133857 and 2017 / 0350803, the disclosures of which are incorporated herein by reference.
[0189] In an embodiment, the system includes a light detection system having one or more light detectors for detecting and measuring light from the sample. The light detectors of interest may be configured to measure light absorption (e.g., for brightfield light data), light scattering (e.g., forward or side scatter light data), light emission (e.g., fluorescent light data), or a combination thereof from the sample. The light detectors of interest may include optical sensors such as, but not limited to, active pixel sensors (APS), avalanche photodiodes, image sensors, charge-coupled devices (CCDs), intensified charge-coupled devices (ICCDs), light-emitting diodes, photon counters, bolometers, pyroelectric detectors, photoresistors, solar cells, photodiodes, photomultiplier tubes, phototransistors, quantum dot photoconductors or photodiodes, as well as combinations thereof, among other light detectors. In certain embodiments, the light from the sample is measured with a charge-coupled device (CCD), a semiconductor charge-coupled device (CCD), an active pixel sensor (APS), a complementary metal oxide semiconductor (CMOS) image sensor, or an N-type metal oxide semiconductor (NMOS) image sensor.
[0190] In some embodiments, the subject light detection system includes a plurality of light detectors. In some cases, the light detection system includes a plurality of solid-state detectors, such as photodiodes. In certain cases, the light detection system includes a light detector array, such as an array of photodiodes. In these embodiments, the light detector array can include four or more light detectors, including, for example, 10 or more light detectors, for example, 25 or more light detectors, for example, 50 or more light detectors, for example, 100 or more light detectors, for example, 250 or more light detectors, for example, 500 or more light detectors, for example, 750 or more light detectors, and 1000 or more light detectors. For example, the detectors can include, for example, 10 or more photodiodes, for example, 25 or more photodiodes, for example, 50 or more photodiodes, for example, 100 or more photodiodes, for example, 250 or more photodiodes, for example, 50 ...250 or more photodiodes, for example, 250 or more photodiodes, for example, 250 or more photodiodes, for example, 250 or more photodiodes, for example, 250 or more photodiodes, for example, 250 or more photodiode For example, the photodiode array may have four or more photodiodes, including 750 or more photodiodes, and 1000 or more photodiodes.
[0191] The photodetectors may be arranged in any geometric configuration as desired, including, but not limited to, square, rectangular, trapezoidal, triangular, hexagonal, heptagonal, octagonal, non-rectangular, decagonal, dodecagonal, circular, elliptical, and irregular patterned configurations. The photodetectors in the photodetector array may be oriented at angles in the range of 10° to 180° relative to one another (as referenced in the XZ plane), including, for example, 15° to 170°, for example, 20° to 160°, for example, 25° to 150°, for example, 30° to 120°, and 45° to 90°. The photodetector array may be of any suitable shape, including, for example, rectilinear shapes such as square, rectangular, trapezoidal, triangular, hexagonal, curvilinear shapes such as circle, ellipse, and irregular shapes such as, for example, a parabolic base coupled to a planar top. In certain embodiments, the photodetector array has a rectangular active surface.
[0192] Each photodetector (e.g. photodiode) in the array may have an active surface having a width in the range of 5 μm to 250 μm, for example, including 10 μm to 225 μm, for example 15 μm to 200 μm, for example 20 μm to 175 μm, for example 25 μm to 150 μm, for example 30 μm to 125 μm, and 50 μm to 100 μm, and a length in the range of 5 μm to 250 μm, for example, including 10 μm to 225 μm, for example 15 μm to 200 μm, for example 20 μm to 175 μm, for example 25 μm to 150 μm, for example 30 μm to 125 μm, and 50 μm to 100 μm, and the surface area of each photodetector (e.g. photodiode) in the array may be, for example, 50 μm. 2 ~9000μm 2 , e.g. 75 μm 2 ~8000μm 2 , e.g. 100 μm 2 ~7000μm 2 , e.g. 150 μm 2 ~6000μm 2, and 200 μm 2 ~5000μm 2 Including 25μm 2 ~10000μm 2 The range is.
[0193] The size of the photodetector array may vary depending on the amount and intensity of light, the number of photodetectors, and the desired sensitivity, and may have a length ranging from 0.01 mm to 100 mm, including, for example, 0.05 mm to 90 mm, such as 0.1 mm to 80 mm, such as 0.5 mm to 70 mm, such as 1 mm to 60 mm, such as 2 mm to 50 mm, such as 3 mm to 40 mm, such as 4 mm to 30 mm, and 5 mm to 25 mm. The width of the photodetector array may also vary from 0.01 mm to 100 mm, including, for example, 0.05 mm to 90 mm, such as 0.1 mm to 80 mm, such as 0.5 mm to 70 mm, such as 1 mm to 60 mm, such as 2 mm to 50 mm, such as 3 mm to 40 mm, such as 4 mm to 30 mm, and 5 mm to 25 mm. Thus, the active surface of the photodetector array may be, for example, 0.5 mm. 2 ~5000mm 2 , e.g. 1mm 2 ~1000mm 2 , e.g. 5mm 2 ~500mm 2 , and 10mm 2 ~100mm 2 Including 0.1mm 2 ~10000mm 2 The range may be:
[0194] The subject light detectors are configured to measure light collected at one or more wavelengths, including measuring light emitted by a sample in the fluid stream at, for example, two or more wavelengths, such as five or more different wavelengths, such as ten or more different wavelengths, such as 25 or more different wavelengths, such as 50 or more different wavelengths, such as 100 or more different wavelengths, such as 200 or more different wavelengths, such as 300 or more different wavelengths, and 400 or more different wavelengths.
[0195] In some embodiments, the photodetector is configured to measure light collected over a range of wavelengths (e.g., 200 nm to 1000 nm). In certain embodiments, the photodetector of interest is configured to collect a spectrum of light over a range of wavelengths. For example, the system may include one or more detectors configured to collect a spectrum of light over one or more of the wavelength ranges of 200 nm to 1000 nm. In yet other embodiments, the subject detectors are configured to measure light from a sample in the fluid stream at one or more specific wavelengths. For example, the system may include one or more detectors configured to measure light at one or more of 450 nm, 518 nm, 519 nm, 561 nm, 578 nm, 605 nm, 607 nm, 625 nm, 650 nm, 660 nm, 667 nm, 670 nm, 668 nm, 695 nm, 710 nm, 723 nm, 780 nm, 785 nm, 647 nm, 617 nm, and any combination thereof.
[0196] The light detection system may be configured to measure the light continuously or at discrete intervals. In some cases, the target light detector is configured to continuously measure the collected light. In other cases, the light detection system is configured to measure at discrete intervals, such as measuring the light every 0.001 milliseconds, every 0.01 milliseconds, every 0.1 milliseconds, every 1 millisecond, every 10 milliseconds, every 100 milliseconds, and every 1000 milliseconds, or some other interval.
[0197] In embodiments, the system is configured to analyze light from the illuminated sample and generate an image mask of cells in the fluid stream in real time, and cells from the sample can be sorted based on the generated image mask. Systems of interest can include a computer control system including one or more computers for full or partial automation of the system for performing the methods described herein. In some embodiments, the system includes a computer having a computer readable storage medium having a computer program stored thereon, the computer program, when loaded into the computer, includes instructions for illuminating a flow cell containing a sample in the fluid stream with a light source and detecting light from the flow cell by a light detection system having a plurality of light detectors, instructions for generating an image mask of cells in the fluid stream, and instructions for sorting cells in the sample based on the generated image mask.
[0198] In some embodiments, the system includes a computer having a computer-readable storage medium having a computer program stored thereon, the computer program further including instructions, when loaded into the computer, for generating an image of the cells in the fluid stream from the detected light. The image may be generated from detected light absorption, detected light scattering, detected light emission, or any combination thereof. In certain embodiments, the image of the cells in the fluid stream is a grayscale image. In some cases, the grayscale image is generated by the subject system from detected light absorption from the sample, such as, for example, from a brightfield light detector. In these cases, the grayscale image is generated based on brightfield image data from the cells in the fluid stream. In other cases, the grayscale image is generated by the subject system from detected light scattering from the sample, such as from a side scatter detector, a forward scatter detector, or a combination of a side scatter detector and a forward scatter detector. In these cases, the grayscale image is generated based on scattered light image data. In still other cases, the grayscale image is generated by the subject system from light emission from the sample, such as light from a fluorescent substance added to the sample. In these cases, the grayscale image is generated based on fluorescent image data (i.e., imaging data from fluorescent components on or in the cells). In yet other cases, grayscale images are generated by the subject systems from a combination of detected light absorption, detected light scattering, and detected light emission.
[0199] In some embodiments, the system includes a computer having a computer readable storage medium having a computer program stored thereon, the computer program further including instructions, when loaded into the computer, for determining a pixel intensity threshold from the grayscale image. In some embodiments, the computer program includes instructions, which are executed by a processor to When executed, the method causes the processor to determine a pixel intensity threshold by minimizing the within-class variance of the grayscale image and calculating a pixel intensity threshold based on the minimized within-class variance (or the maximum between-class variance).
[0200] The system includes a memory having instructions for comparing each pixel of the grayscale image to the determined intensity threshold and for converting each pixel to a binary pixel value. In some embodiments, the memory includes instructions for comparing each pixel along each horizontal column in the grayscale image to the determined intensity threshold. In some cases, the memory includes instructions for comparing each pixel from the left side of the grayscale image to the right side of the grayscale image to the determined intensity threshold. In other cases, the memory includes instructions for comparing each pixel from the right side of the grayscale image to the left side of the grayscale image to the determined intensity threshold. In other embodiments, the memory includes instructions for comparing each pixel along each vertical column in the grayscale image to the determined intensity threshold. In some cases, the memory includes instructions for comparing each pixel along each vertical column from the top of the grayscale image to the bottom of the grayscale image to the determined intensity threshold. In other cases, the memory includes instructions for comparing each pixel along each vertical column from the bottom of the grayscale image to the top of the grayscale image to the determined intensity threshold.
[0201] Depending on the type of light detected, each pixel is assigned a binarized pixel value of 1 or a binarized pixel value of 0. In one embodiment, the system includes a computer program including instructions for detecting light absorption from the fluid stream (e.g., bright field image data) and for assigning to each pixel of the grayscale image a binarized pixel value of 1 if the pixel intensity is below an intensity threshold and a binarized pixel value of 0 if the pixel intensity of the grayscale image is above an intensity threshold. In another embodiment, the system includes a computer program including instructions for detecting light scattering from cells in the fluid stream and for assigning to each pixel of the grayscale image a binarized pixel value of 1 if the pixel intensity is above an intensity threshold and a binarized pixel value of 0 if the pixel intensity is below the intensity threshold. In yet another embodiment, the system includes a computer program including instructions for detecting fluorescence from cells in the fluid stream and for assigning to each pixel of the grayscale image a binarized pixel value of 1 if the pixel intensity is above an intensity threshold and a binarized pixel value of 0 if the pixel intensity is below the intensity threshold.
[0202] When binarized pixel values are assigned by the subject system to each pixel of the grayscale image across a horizontal column, in some embodiments the system includes a computer program including instructions for further determining a first pixel in the horizontal column that has a binarized pixel value of 1, and for further determining a last pixel in the horizontal column that has a binarized pixel value of 1. In one embodiment, the system includes a computer program including instructions for determining a first pixel from a left side of the horizontal column that has an assigned binary pixel value of 1, and for determining a last pixel from a left side of the horizontal column that has an assigned binary pixel value of 1. In another embodiment, the system includes a computer program including instructions for determining a first pixel from a right side of the horizontal column that has an assigned binary pixel value of 1, and for determining a last pixel from a right side of the horizontal column that has an assigned binary pixel value of 1. In another embodiment, the system includes a computer program including instructions for further determining a first pixel in the horizontal column that has a binarized pixel value of 0, and for determining a last pixel in the horizontal column that has a binarized pixel value of 0. In one embodiment, the system includes a computer program including instructions for determining a first pixel from a left side of a horizontal row that has an assigned binary pixel value of 0, and instructions for determining a last pixel from a left side of a horizontal row that has an assigned binary pixel value of 0. In another embodiment, the system includes a computer program including instructions for determining a first pixel from a right side of a horizontal row that has an assigned binary pixel value of 0, and instructions for determining a last pixel from a right side of a horizontal row that has an assigned binary pixel value of 0. The present invention includes a computer program comprising:
[0203] If a binarized pixel value is assigned to each pixel of the grayscale image along a vertical column, in some embodiments the system includes a computer program including instructions for further determining a first pixel along the vertical column having a binarized pixel value of 1, and instructions for further determining a last pixel along the vertical column having a binarized pixel value of 1. In one embodiment, the system includes a computer program including instructions for determining a first pixel from a top of the vertical column having an assigned binary pixel value of 1, and instructions for determining a last pixel from a top of the vertical column having an assigned binary pixel value of 1. In another embodiment, the system includes a computer program including instructions for determining a first pixel from a bottom of the vertical column having an assigned binary pixel value of 1, and instructions for determining a last pixel from a bottom of the vertical column having an assigned binary pixel value of 1. In another embodiment, the system includes instructions for further determining a first pixel along the vertical column having a binary pixel value of 0, and instructions for further determining a last pixel along the vertical column having a binary pixel value of 0. In one embodiment, the system includes a computer program including instructions for determining a first pixel from the top of a vertical column that has an assigned binary pixel value of 0, and instructions for determining a last pixel from the top of a vertical column that has an assigned binary pixel value of 0. In another embodiment, the system includes a computer program including instructions for determining a first pixel from the bottom of a vertical column that has an assigned binary pixel value of 0, and instructions for determining a last pixel from the bottom of a vertical column that has an assigned binary pixel value of 0.
[0204] In some embodiments, the system includes a computer having a computer readable storage medium having a computer program stored thereon, the computer program further including instructions, when loaded into the computer, for calculating image moments of the image mask. In some cases, the system includes a computer program including instructions for calculating image moments from the image mask according to:
[0205]
number
[0206] where m is the image moment calculated along the x-axis of the image mask and n is the image moment calculated along the y-axis of the image mask.
[0207] In certain embodiments, the system includes a computer program including instructions for determining one or more properties of cells in the fluid stream based on the generated image mask. For example, the system may include a computer program including instructions for determining a size of a cell, a center of mass of a cell, or an eccentricity of a cell based on the image mask. In these embodiments, the system includes a computer program including instructions for calculating one or more image moments of the image mask and for determining a property of a cell based on the image mask and the calculated image moments.
[0208] In some cases, the system includes a computer program including instructions for calculating the center of mass from the image moments of the image mask. For example, the center of mass may be calculated by the subject system from the image moments of the image mask according to:
[0209]
number
[0210] In other cases, the system includes a computer program including instructions for calculating the orientation of the cell from the image moments of the image mask. For example, the orientation of the cell may be calculated by the subject system from the image moments of the image mask according to:
[0211]
number
[0212] In yet other instances, the system includes a computer program including instructions for calculating the eccentricity of the cell from the image moments of the image mask. For example, the eccentricity of the cell may be calculated by the subject system from the image moments of the image mask according to:
[0213]
number
[0214] In some embodiments, the system includes a computer having a computer readable storage medium having a computer program stored thereon, the computer program further including instructions, when loaded into the computer, for generating a masked image of the cells in the fluid stream. In these embodiments, to generate the masked image, the system includes a computer program including instructions for multiplying each pixel value of the image mask with each pixel value from the image of the cells. The image of the cells used by the system to generate the masked image may be the grayscale image from which the image mask was generated, or may be other images of the cells, such as frequency encoded image data obtained from detecting light (bright field, scattered or emitted) from a sample in the fluid stream.
[0215] In some embodiments, the system includes a computer program including instructions for calculating image moments from the masked image. In some cases, the system includes a computer program including instructions for calculating image moments from the masked image according to:
[0216]
number
[0217] where m is the image moment calculated along the x-axis of the masked image and n is the image moment calculated along the y-axis of the masked image.
[0218] Based on the masked image and the calculated image moments, the subject system may be configured to determine one or more properties of the cell, such as, for example, cell size, cell orientation, and cell eccentricity. The subject system may also be configured to compare the image mask with the masked image to determine a variance of the optical signal within the boundaries of the image mask. In one embodiment, the system includes a computer program including instructions for calculating a center of mass from the image moments of the masked image according to:
[0219]
number
[0220] In another embodiment, the system includes a computer program comprising instructions for calculating the orientation of the cells from the image moments of the masked image according to:
[0221]
number
[0222] In yet another embodiment, the system includes a computer program comprising instructions for calculating the eccentricity of the cell from the image moments of the masked image according to:
[0223]
number
[0224] In some embodiments, the system includes a computer having a computer readable storage medium having a computer program stored thereon, the computer program further including instructions for comparing two or more of the image, the image mask, and the masked image for each cell when loaded into the computer. In some cases, the system includes a computer program including instructions for comparing the image of the cell and the image mask. In other cases, the system includes a computer program including instructions for comparing the image of the cell and the masked image. In still other cases, the system includes a computer program including instructions for comparing the image mask of the cell and the masked image. In other embodiments, the system includes a computer program including instructions for generating and comparing two or more different image masks of a cell, two or more different images of a cell, or two or more different masked images of a cell.
[0225] In certain embodiments, the system comprises: The system is configured to calculate a colocalization coefficient for one or more features of a cell in the masked image. In some cases, the system includes a computer program including instructions for calculating a colocalization coefficient from two or more different image masks of a cell. In other cases, the system includes a computer program including instructions for calculating a colocalization coefficient from two or more different images of a cell. In still other cases, the system includes a computer program including instructions for calculating a colocalization coefficient from two or more different masked images of a cell. In some embodiments, the system includes a computer program including instructions for calculating a colocalization coefficient from an image of a cell and an image mask. In other embodiments, the system includes a computer program including instructions for calculating a colocalization coefficient from an image of a cell and a masked image. In other embodiments, the system includes a computer program including instructions for calculating a colocalization coefficient from an image mask of a cell and a masked image.
[0226] In some embodiments, the system includes a computer having a computer readable storage medium having a computer program stored thereon, the computer program further including instructions, when loaded into the computer, for calculating a colocalization coefficient for a cellular feature according to:
[0227]
number
[0228] where x is a pixel of the first image, first image mask, or first masked image; y is a pixel of the second image, second image mask, or second masked image; x is the average pixel value of the first image, first image mask, or first masked image; and y is the average pixel value of the second image, second image mask, or second masked image.
[0229] In other embodiments, the system comprises a computer program comprising instructions for calculating a colocalization coefficient for a cellular feature according to the following:
[0230]
number
[0231] In other embodiments, the system comprises a computer program comprising instructions for calculating a colocalization coefficient for a cellular feature according to the following:
[0232]
number
[0233] A sorting system according to some embodiments may include a display and an operator input device. The operator input device may be, for example, a keyboard, a mouse, etc. The processing module includes a processor that accesses a memory having stored instructions to perform the steps of the subject method. The processing module may include an operating system. The processor may include a system, a graphical user interface (GUI) controller, a system memory, memory storage devices, and an input / output controller, cache memory, data backup units, and many other devices. The processor may be a commercially available processor or one of other processors that are or become available. The processor executes an operating system, which interfaces with firmware and hardware in a well-known manner to facilitate the processor coordinating and executing the functions of various computer programs, which may be written in a variety of programming languages, such as Java, Perl, C++, other high-level or low-level languages, and combinations thereof, as known in the art. The operating system typically cooperates with the processor to coordinate and execute the functions of the other components of the computer. The operating system also provides scheduling, input / output control, file and data management, memory management, and communication control and related services, all in accordance with known techniques. The processor may be any suitable analog or digital system. In some embodiments, the processor includes analog electronics that provide feedback control, such as, for example, negative feedback control.
[0234] The system memory can be any of a variety of known or future memory storage devices. Examples include any commonly available random access memory (RAM), magnetic media such as a resident hard disk or tape, optical media such as a read-write compact disk, a flash memory device, or other memory storage device. The memory storage device can be any of a variety of known or future devices, including a compact disk drive, a tape drive, a removable hard disk drive, or a diskette drive. Such types of memory storage devices typically read from and / or write to a program storage medium (not shown), such as a compact disk, a magnetic tape, a removable hard disk, or a magnetic disk, respectively. Any of these program storage media, or others now in use or that may later be developed, may be considered a computer program product. As will be appreciated, these program storage media typically store computer software programs and / or data. Computer software programs, also referred to as computer control logic, are typically stored in the system memory and / or in program storage devices used in conjunction with the memory storage devices.
[0235] In some embodiments, a computer program product is described comprising a computer usable medium having control logic (computer software program including program code) stored therein. The control logic, when executed by a processor of the computer, causes the processor to perform the functions described herein. In other embodiments, some functions are implemented primarily in hardware, for example using hardware state machines. The implementation of hardware state machines to perform the functions described herein will be apparent to one skilled in the relevant art.
[0236] The memory may be any suitable device from which the processor can store and retrieve data, such as a magnetic, optical, or solid-state storage device (including a magnetic or optical disk, or tape, or RAM, or any other suitable device, either fixed or portable). The processor may include a general-purpose digital microprocessor that is suitably programmed from a computer-readable storage medium carrying the necessary program code. The programming may be provided remotely to the processor over a communication channel, or may be pre-stored in a computer program product, such as a memory or some other portable or fixed computer-readable storage medium, using any of those devices together with the memory. For example, a magnetic disk or optical disk may carry the programming and be read by a disk writer / reader. This The inventive system also includes programming, e.g., in the form of a computer program product, algorithms for use in implementing the above-described methods. Programming according to the present invention may be recorded on a computer-readable storage medium, e.g., any medium that can be directly read and accessed by a computer. Such media include, but are not limited to, magnetic storage media, such as magnetic disks, hard disk storage media, and magnetic tapes, optical storage media, such as CD-ROMs, electrical storage media, such as RAM and ROM, portable flash drives, and hybrids of these categories, such as magnetic / optical storage media.
[0237] The processor may also have access to a communication channel for communicating with a user at a remote location, meaning that the user does not have direct contact with the system, but rather relays input information to the input manager from an external device, such as a computer connected to a wide area network ("WAN"), a telephone network, a satellite network, or any other suitable communication channel, including a cellular phone (i.e., a smartphone).
[0238] In some embodiments, a system according to the present disclosure may be configured to include a communication interface. In some embodiments, the communication interface includes a receiver and / or a transmitter for communicating with a network and / or another device. The communication interface may be configured for wired or wireless communication, including, but not limited to, radio frequency (RF) communication (e.g., radio frequency identification (RFID)), Zigbee communication protocol, WiFi, infrared, wireless universal serial bus (USB), ultra-wideband (UWB), Bluetooth® communication protocol, and cellular communication, such as Code Division Multiple Access (CDMA) or Global System for Mobile Communications (GSM).
[0239] In one embodiment, the communications interface is configured to include one or more communications ports, e.g., a physical port or interface such as a USB port, an RS-232 port, or any other suitable electrical connection port, to enable data communications between the subject system and other external devices, such as a computer terminal (e.g., in a clinic or hospital environment) configured for similar complementary data communications.
[0240] In one embodiment, the communications interface is configured for infrared communications, Bluetooth® communications, or any other suitable wireless communications protocol to enable the subject system to communicate with other devices, such as a computer terminal and / or network, a communications-enabled mobile phone, a personal digital assistant, or any other communications device that a user may use in conjunction with.
[0241] In one embodiment, the communication interface is configured to provide a connection for data transfer utilizing the Internet Protocol (IP) via a cellular network, Short Message Service (SMS), a wireless connection to a personal computer (PC) on a local area network (LAN) connected to the Internet, or a WiFi connection to the Internet at a WiFi hotspot.
[0242] In one embodiment, the subject system is configured to communicate wirelessly with the server device via a communication interface using common standards such as, for example, 802.11 or Bluetooth® RF protocols, or IrDA infrared protocols. The server device may be another portable device, such as a smartphone, a personal digital assistant (PDA) or a notebook computer, or a larger device, such as a desktop computer, an appliance, etc. In some embodiments, the server device has a display, such as a liquid crystal display (LCD), and input devices, such as buttons, a keyboard, a mouse, or a touch screen.
[0243] In some embodiments, the communications interface is configured to automatically or semi-automatically communicate data stored within the subject system, e.g., within any data storage unit, with a network or server device using one or more of the communications protocols and / or mechanisms described above.
[0244] The output controller may include a controller for any of a variety of known display devices for presenting information to a user, whether human or machine, local or remote. Where one of the display devices provides visual information, this information may typically be logically and / or physically organized as an array of pixels. The graphical user interface (GUI) controller may include any of a variety of known or future software programs for providing a graphical input and output interface between the system and the user, and for processing user input. The functional elements of the computer may communicate with each other via a system bus. Some of these communications may be accomplished in alternative embodiments using a network or other type of remote communication. The output manager may also provide information generated by the processing module to a user at a remote location, for example, via the Internet, telephone, or satellite network, in accordance with known techniques. Presentation of data by the output manager may be performed in accordance with a variety of known techniques. As some examples, the data may include SQL, HTML, or XML documents, emails or other files, or other forms of data. The data may include Internet URL addresses to allow the user to retrieve additional SQL, HTML, XML, or other documents or data from remote sources. The one or more platforms present in the subject system are typically of a class of computers commonly referred to as servers, but may be any type of known or future developed computer platform. However, they may be mainframe computers, workstations, or other computer types. They may be connected via any known or future type of cabling or other communication systems, including wireless systems, either networked or not. They may be co-located or physically separated.In some cases, depending on the type and / or configuration of the computer platform selected, various operating systems may be employed on any of the computer platforms. Suitable operating systems include Windows 10, Windows NT, Windows XP, Windows 7, Windows 8, iOS, Sun Solaris, Linux, OS / 400, Compaq Tru64 Unix, SGI IRIX, Siemens Reliant Unix, Ubuntu, Zorin OS, etc.
[0245] In certain embodiments, the subject systems include one or more optical conditioning components for conditioning light, such as light irradiated to the sample (e.g., from a laser) or light collected from the sample (e.g., scattered light, fluorescence). For example, the optical conditioning can be increasing the size of the light, the focal length of the light, or collimating the light. In some examples, the optical conditioning is an expansion protocol to increase the size of the light (e.g., beam spot), such as increasing the size by 5% or more, including increasing the size by 10% or more, such as 25% or more, such as 50% or more, and 75% or more. In other embodiments, the optical conditioning includes focusing the light to reduce the size of the light by 5% or more, including reducing the size of the beam spot by 10% or more, such as 25% or more, such as 50% or more, and 75% or more. In certain embodiments, the optical conditioning includes collimating the light. The term "collimate" is used in a general sense to refer to optically adjusting the collinearity of light propagation or reducing the divergence of the light from a common axis of propagation. In some examples, collimating includes narrowing the spatial cross-section of the light beam (e.g., reducing the beam profile of a laser).
[0246] In some embodiments, the optical adjustment component includes a focusing lens having a magnification of 0.1 to 0.95, including, for example, a magnification of 0.2 to 0.9, such as a magnification of 0.3 to 0.85, such as a magnification of 0.35 to 0.8, such as a magnification of 0.5 to 0.75, and a magnification of 0.55 to 0.7, such as a magnification of 0.6. For example, the focusing lens is a dichromatic reduction lens having a magnification of about 0.6 in a particular example. The focal length of the focusing lens can vary in the range of 5 mm to 20 mm, including, for example, a focal length range of 6 mm to 19 mm, such as a focal length range of 7 mm to 18 mm, such as a focal length range of 8 mm to 17 mm, such as a focal length range of 9 mm to 16, and 10 mm to 15 mm. In a particular embodiment, the focusing lens has a focal length of about 13 mm.
[0247] In other embodiments, the optical adjustment component is a collimator. The collimator can be any convenient collimating protocol, such as one or more mirrors or curved lenses, or a combination thereof. For example, the collimator is a single collimating lens in certain examples. In other examples, the collimator is a collimating mirror. In yet other examples, the collimator includes two lenses. In yet other examples, the collimator includes a mirror and a lens. When the collimator includes one or more lenses, the focal length of the collimating lens can vary in the range of, for example, 5 mm to 40 mm, including focal lengths in the range of, for example, 6 mm to 37.5 mm, for example, 7 mm to 35 mm, for example, 8 mm to 32.5 mm, for example, 9 mm to 30 mm, for example, 10 mm to 27.5 mm, for example, 12.5 mm to 25 mm, and 15 mm to 20 mm.
[0248] In some embodiments, the subject systems include a flow cell nozzle having a nozzle orifice configured to cause a fluid stream to flow through the flow cell nozzle. The subject flow cell nozzle includes an orifice that propagates a fluid sample to a sample testing region, and in some embodiments, the flow cell nozzle includes a proximal cylindrical portion defining a longitudinal axis and a distal frustoconical portion terminating in a flat surface having the nozzle orifice, transverse to the longitudinal axis. The length of the proximal cylindrical portion (measured along the longitudinal axis) can vary, for example, from 1 mm to 15 mm, including 1.5 mm to 12.5 mm, for example, from 2 mm to 10 mm, including 3 mm to 9 mm, and 4 mm to 8 mm. The length of the distal frustoconical portion (measured along the longitudinal axis) can similarly vary, for example, from 1 mm to 10 mm, including 2 mm to 9 mm, including 3 mm to 8 mm, and 4 mm to 7 mm. The diameter of the flow cell nozzle chamber can vary in some embodiments, for example, from 1 mm to 10 mm, including, for example, from 2 mm to 9 mm, such as from 3 mm to 8 mm, and from 4 mm to 7 mm.
[0249] In certain examples, the nozzle chamber does not include a cylindrical portion, and the entire flow cell nozzle chamber is formed in a frusto-conical shape. In these embodiments, the length of the frusto-conical nozzle chamber (measured along a longitudinal axis transverse to the nozzle orifice) may range from 1 mm to 15 mm, for example, including 1.5 mm to 12.5 mm, for example, 2 mm to 10 mm, for example, including 3 mm to 9 mm, and 4 mm to 8 mm. The diameter of the proximal portion of the frusto-conical nozzle chamber may range from 1 mm to 10 mm, for example, including 2 mm to 9 mm, for example, including 3 mm to 8 mm, and 4 mm to 7 mm.
[0250] In embodiments, the sample fluid stream emerges from an orifice at the distal end of the flow cell nozzle. Depending on the desired characteristics of the fluid stream, the flow cell nozzle orifice can be of any suitable shape, including, but not limited to, rectilinear cross-sectional shapes, such as square, rectangular, trapezoidal, triangular, hexagonal, curvilinear cross-sectional shapes, such as circular, elliptical, and irregular shapes, such as a parabolic base joined to a planar top. In certain embodiments, the subject flow cell nozzle has a circular orifice. The size of the nozzle orifice may vary in some embodiments from 1 μm to 20,000 μm, including, for example, 2 μm to 17,500 μm, for example, 5 μm to 15,000 μm, for example, 10 μm to 12,500 μm, for example, 15 μm to 10,000 μm, for example, 25 μm to 7,500 μm, for example, 50 μm to 5,000 μm, for example, 75 μm to 1,000 μm, for example, 100 μm to 750 μm, and 150 μm to 500 μm. In certain embodiments, the nozzle orifice is 100 μm.
[0251] In some embodiments, the flow cell nozzle includes a sample injection port configured to provide a sample to the flow cell nozzle. In embodiments, the sample injection system is configured to provide a suitable flow of the sample to the flow cell nozzle chamber. Depending on the desired characteristics of the fluid stream, the velocity of the sample delivered by the sample injection port to the flow cell nozzle chamber can be 1 μL / sec or more, including, for example, 2 μL / sec or more, for example, 3 μL / sec or more, for example, 5 μL / sec or more, for example, 10 μL / sec or more, for example, 15 μL / sec or more, for example, 25 μL / sec or more, for example, 50 μL / sec or more, for example, 100 μL / sec or more, for example, 150 μL / sec or more, for example, 200 μL / sec or more, for example, 250 μL / sec or more, for example, 300 μL / sec or more, for example, 350 μL / sec or more, for example, 400 μL / sec or more, for example, 450 μL / sec or more, and 500 μL / sec or more. For example, the flow rate of the sample may be in the range of 1 μL / sec to about 500 μL / sec, including, for example, 2 μL / sec to about 450 μL / sec, for example, 3 μL / sec to about 400 μL / sec, for example, 4 μL / sec to about 350 μL / sec, for example, 5 μL / sec to about 300 μL / sec, for example, 6 μL / sec to about 250 μL / sec, for example, 7 μL / sec to about 200 μL / sec, for example, 8 μL / sec to about 150 μL / sec, for example, 9 μL / sec to about 125 μL / sec, and 10 μL to about 100 μL / sec.
[0252] The sample injection port may be an orifice located in the wall of the nozzle chamber or may be a conduit located at the proximal end of the nozzle chamber. When the sample injection port is an orifice located in the wall of the nozzle chamber, the sample injection port orifice may be of any suitable shape, including, but not limited to, rectilinear cross-sectional shapes, such as square, rectangular, trapezoidal, triangular, hexagonal, curved cross-sectional shapes, such as circular, elliptical, and irregular shapes, such as a parabolic bottom joined to a planar top. In certain embodiments, the sample injection port has a circular orifice. The size of the sample injection port orifice may vary depending on the shape, with certain examples having openings ranging from 0.1 mm to 5.0 mm, including, for example, 0.2 to 3.0 mm, such as 0.5 mm to 2.5 mm, such as 0.75 mm to 2.25 mm, such as 1 mm to 2 mm, and 1.25 mm to 1.75 mm, such as 1.5 mm.
[0253] In certain embodiments, for example, the sample injection port is a conduit positioned at the proximal end of the flow cell nozzle chamber. For example, the sample injection port can be a conduit positioned to have the sample injection port orifice aligned with the flow cell nozzle orifice. When the sample injection port is a conduit positioned in line with the flow cell nozzle orifice, the cross-sectional shape of the sample injection tube can be any suitable shape, including, but not limited to, rectilinear cross-sectional shapes such as square, rectangular, trapezoidal, triangular, hexagonal, curved cross-sectional shapes such as circular, elliptical, and irregular shapes such as a parabolic bottom joined to a flat top. The size of the orifice of the conduit may vary depending on the shape, with certain examples having openings ranging from 0.1 mm to 5.0 mm, including, for example, 0.2 mm to 3.0 mm, for example, 0.5 mm to 2.5 mm, for example, 0.75 mm to 2.25 mm, for example, 1 mm to 2 mm, and 1.25 mm to 1.75 mm, for example, 1.5 mm. The shape of the tip of the sample injection port may be the same as or different from the cross-sectional shape of the sample injection tube. For example, the orifice of the sample injection port may have a bevel angle of, for example, 2° to 9°, for example, 3° to 8°, for example, 4° to 7°, and 5°. It may include a beveled tip having a bevel angle in the range of 1° to 10°.
[0254] In some embodiments, the flow cell nozzle also includes a sheath fluid injection port configured to provide a sheath fluid to the flow cell nozzle. In embodiments, the sheath fluid injection system is configured to provide a flow of sheath fluid to the flow cell nozzle chamber, e.g., in conjunction with the sample, to produce a laminated fluid stream of sheath fluid surrounding the sample fluid stream. Depending on the desired characteristics of the fluid stream, the velocity of the sheath fluid delivered to the flow cell nozzle chamber can be 25 μL / sec or more, including, e.g., 50 μL / sec or more, e.g., 75 μL / sec or more, e.g., 100 μL / sec or more, e.g., 250 μL / sec or more, e.g., 500 μL / sec or more, e.g., 750 μL / sec or more, e.g., 1000 μL / sec or more, and 2500 μL / sec or more. For example, the flow rate of the sheath fluid may be in the range of 1 μL / sec to about 500 μL / sec, including, for example, 2 μL / sec to about 450 μL / sec, for example, 3 μL / sec to about 400 μL / sec, for example, 4 μL / sec to about 350 μL / sec, for example, 5 μL / sec to about 300 μL / sec, for example, 6 μL / sec to about 250 μL / sec, for example, 7 μL / sec to about 200 μL / sec, for example, 8 μL / sec to about 150 μL / sec, for example, 9 μL / sec to about 125 μL / sec, and 10 μL / sec to about 100 μL / sec.
[0255] In some embodiments, the sheath fluid injection port is an orifice located in the wall of the nozzle chamber. The orifice of the sheath fluid injection port may be of any suitable shape, including, but not limited to, rectilinear cross-sectional shapes, such as, for example, square, rectangular, trapezoidal, triangular, hexagonal, curved cross-sectional shapes, such as, for example, circular, elliptical, as well as irregular shapes, such as, for example, a parabolic bottom coupled to a planar top. The size of the sample injection port orifice may vary depending on the shape, with certain examples having openings ranging from 0.1 mm to 5.0 mm, including, for example, 0.2 to 3.0 mm, such as, for example, 0.5 mm to 2.5 mm, such as, for example, 0.75 mm to 2.25 mm, such as, for example, 1 mm to 2 mm, and 1.25 mm to 1.75 mm, such as, for example, 1.5 mm.
[0256] In certain examples, the subject systems include a sample inspection region in fluid communication with the flow cell nozzle orifice. In these examples, the sample fluid stream emerges from an orifice at the distal end of the flow cell nozzle, and particles within the fluid stream may be illuminated with a light source in the sample inspection region. The size of the inspection region may vary depending on the characteristics of the flow nozzle, such as the size of the nozzle orifice and the size of the sample injection port. In embodiments, the inspection region may have a width of 0.01 mm or greater, including, for example, 0.05 mm or greater, such as 0.1 mm or greater, such as 0.5 mm or greater, such as 1 mm or greater, such as 2 mm or greater, such as 3 mm or greater, such as 5 mm or greater, and 10 mm or greater. The length of the test region may also vary, and in some instances may vary in a range along 0.01 mm or more, including, for example, 0.1 mm or more, such as 0.5 mm or more, such as 1 mm or more, such as 1.5 mm or more, such as 2 mm or more, such as 3 mm or more, such as 5 mm or more, such as 10 mm or more, such as 15 mm or more, such as 20 mm or more, such as 25 mm or more, and 50 mm or more.
[0257] The inspection region may be configured to facilitate illumination of a planar cross-section of the generating fluid stream, or may be configured to facilitate illumination of a diffuse field (e.g., by a diffuse laser or lamp) of a predetermined length. In some embodiments, the inspection region includes a transparent window to facilitate illumination of a predetermined length of the generating fluid stream, such as, for example, 1 mm or more, e.g., 2 mm or more, e.g., 3 mm or more, e.g., 4 mm or more, e.g., 5 mm or more, and 10 mm or more. Depending on the light source used to illuminate the generating fluid stream (as described below), the inspection region may be configured to pass light in the range of 100 nm to 1500 nm, including, for example, 150 nm to 1400 nm, e.g., 200 nm to 1300 nm, e.g., 250 nm to 1200 nm, e.g., 300 nm to 1100 nm, e.g., 350 nm to 1000 nm, e.g., 400 nm to 900 nm, and 500 nm to 800 nm. The inspection region may therefore be formed from any transparent material that passes the desired range of wavelengths, including, but not limited to, optical glass, borosilicate glass, Pyrex glass, ultraviolet quartz, infrared quartz, sapphire, and copolymers of these thermoplastics, such as, for example, polycarbonate, polyvinyl chloride (PVC), polyurethane, polyether, polyamide, polyimide, or copolymers of these thermoplastics, such as PETG (glycol modified polyethylene terephthalate), including polyesters, among other polymeric plastic materials, including, but not limited to, poly(ethylene terephthalate) (PET), bottle grade PET (copolymers made based on monoethylene glycol, terephthalic acid, and other comonomers such as isophthalic acid, cyclohexane dimethanol), poly(alkylene terephthalates), such as poly(butylene terephthalate) (PBT), and poly(hexamethylene terephthalate), poly(ethylene adipate), poly(1,4-butylene adipate), and poly(hexamethylene adipate). poly(alkylene adipates) such as poly(ethylene adipate), poly(alkylene suberates) such as poly(ethylene suberate), poly(alkylene sebacates) such as poly(ethylene sebacate), poly(ε-caprolactone) and poly(β-propiolactone), poly(alkylene isophthalates) such as poly(ethylene isophthalate), poly(alkylene 2,6-naphthalene-dicarboxylate) such as poly(ethylene 2,6-naphthalene-dicarboxylate), poly(ethylenesulfonyl-4,4'-dibenzoate) Poly(alkylenesulfonyl-4,4'-dibenzoates) such as poly(p-phenylene alkylene dicarboxylates) such as poly(p-phenylene ethylene dicarboxylate), poly(trans-1,4-cyclohexanediyl alkylene dicarboxylates) such as poly(trans-1,4-cyclohexanediyl ethylene dicarboxylate), poly(1,4-cyclohexane-dimethylene alkylene dicarboxylates) such as poly(1,4-cyclohexane-dimethylene ethylene dicarboxylate), poly([2.2.Examples of suitable poly([2.2.2]-bicyclooctane-1,4-dimethylene alkylene dicarboxylate), lactic acid polymers and copolymers, such as (S)-polylactide, (R,S)-polylactide, poly(tetramethylglycolide), and poly(lactide-co-glycolide), and polycarbonates of bisphenol A, 3,3'-dimethylbisphenol A, 3,3',5,5'-f tetrachlorobisphenol A, 3,3',5,5'-tetramethylbisphenol A, polyamides, such as poly(p-phenylene terephthalamide), polyesters, such as polyethylene terephthalate, e.g., Mylar™ polyethylene terephthalate, and the like. In some embodiments, the subject systems include a cuvette positioned within the sample testing region. In embodiments, the cuvette may transmit light in the range of 100 nm to 1500 nm, including, for example, 150 nm to 1400 nm, for example, 200 nm to 1300 nm, for example, 250 nm to 1200 nm, for example, 300 nm to 1100 nm, for example, 350 nm to 1000 nm, for example, 400 nm to 900 nm, and 500 nm to 800 nm.
[0258] In some embodiments, the subject systems include a particle sorting component for sorting cells in a sample. In certain examples, the particle sorting component is a particle sorting module, such as those described in U.S. Patent Publication No. 2017 / 0299493, filed March 28, 2017, and U.S. Provisional Patent Application No. 62 / 752,793, filed October 30, 2018, the disclosures of which are incorporated herein by reference. In certain embodiments, the particle sorting component includes one or more droplet deflectors, such as those described in U.S. Patent Publication No. 2018 / 0095022, filed June 14, 2017, the disclosures of which are incorporated herein by reference.
[0259] In some embodiments, the subject systems include a flow cell that employs the above-described weighted least squares algorithm for analyzing and sorting particles in a sample (e.g., cells in a biological sample). Suitable flow cytometry systems include, but are not limited to, those described in Ormerod (ed.), Flow Cytometry: A Practical Approach, Oxford Univ. Press (1997); Jaroszeski et al. (eds.), Flow Cytometry Protocols, Methods in Molecular Biology No. 91, Humana Press (1997); Practical Flow Cytometry, 3rd ed., Wiley-Liss (1995); Virgo, et al. (2012) Ann Clin Biochem. Jan; 49(pt1): 17-28; Linden, et al., Semin Thromb Hemost. 2004 Oct; 30(5): 502-11; Alison, et al. J Pathol, 2010 Dec; 222(4): 335-344; and Herbig, et al. (2007) Crit Rev Ther Drug Carrier Syst. 24(3):203-255, the disclosures of which are incorporated herein by reference. A Practical Approach, Oxford Univ. Press (1997); Jaroszeski et al. In certain instances, the flow cytometry systems of interest are BD Biosciences FACSCanto™ II flow cytometer, BD Accuri™ flow cytometer, BD Biosciences FACSCelesta™ flow cytometer, BD Biosciences FACSLyric™ flow cytometer, BD Biosciences FACSVerse™ flow cytometer, BD Biosciences FACSymphony™ flow cytometer, BD Biosciences LSRFortessa™ flow cytometer, BD Biosciences LSRFortess™ X-20 flow cytometer, and BD Biosciences FACSCanto™ II ... FACSCelesta™ flow cytometer, BD Biosciences FACSCelesta™ flow cytometer, BD Biosciences FACSCelesta™ flow cytometer, BD Biosciences FACSCelesta™ flow cytometer, BD Biosciences FACSCelesta™ flow cytometer, BD Biosciences FACSCelesta™ flow cytometer, BD BD Biosciences FACSCalibur™ cell sorter, a BD Biosciences FACSCount™ cell sorter, a BD Biosciences FACSLyric™ cell sorter, and a BD Biosciences These include the Via™ cell sorter, BD Biosciences Influx™ cell sorter, BD Biosciences Jazz™ cell sorter, BD Biosciences Aria™ cell sorter, and BD Biosciences FACSMelody™ cell sorter.
[0260] In some embodiments, the subject particle sorting systems may be configured as described in, for example, U.S. Pat. Nos. 10,006,852, 9,952,076, 9,933,341, 9,784,661, 9,726,527, 9,453,789, 9,200,334, 9,097,640, 9,095,494, 9,092,034, 8,975,595, 8,753,573, 8,233,146, 8,140,300, and flow cytometry systems such as those described in Nos. 7,544,326, 7,201,875, 7,129,505, 6,821,740, 6,813,017, 6,809,804, 6,372,506, 5,700,692, 5,643,796, 5,627,040, 5,620,842, and 5,602,039, the disclosures of which are incorporated by reference in their entireties.
[0261] In certain instances, the subject system is a flow cytometry system configured to image particles in a fluid stream by fluorescence imaging using radio frequency tagged emission (FIRE), such as those described in Diebold, et al. Nature Photonics Vol. 7(10); 806-810 (2013), as well as those described in U.S. Pat. Nos. 9,423,353, 9,784,661, and 10,006,852, and U.S. Patent Publication Nos. 2017 / 0133857 and 2017 / 0350803, the disclosures of which are incorporated herein by reference.
[0262] Integrated Circuit Devices Aspects of the present disclosure also include integrated circuit devices that are programmed to generate an image mask of cells in a fluid stream and sort the cells based on the generated image mask. In some embodiments, the subject integrated circuit devices include field programmable gate arrays (FPGAs). In other embodiments, the integrated circuit devices include application specific integrated circuits (ASICs). In yet other embodiments, the integrated circuit devices include complex programmable logic devices (CPLDs).
[0263] In some embodiments, the integrated circuit device is programmed to generate a grayscale image of cells in the fluid stream from the detected light. In these embodiments, the integrated circuit device is programmed to determine a pixel intensity threshold from the grayscale image. In some embodiments, the integrated circuit device is programmed to determine the pixel intensity threshold by minimizing the within-class variance of the grayscale image and calculating the pixel intensity threshold based on the minimized within-class variance (or the between-class variance is maximized).
[0264] The integrated circuit device is programmed to compare each pixel of the grayscale image to the determined intensity threshold and convert each pixel to a binary pixel value. In some embodiments, the integrated circuit device is programmed to compare each pixel along each horizontal column in the grayscale image to the determined intensity threshold. In some cases, the integrated circuit device is programmed to compare each pixel from the left side of the grayscale image to the right side of the grayscale image to the determined intensity threshold. In other cases, the integrated circuit device is programmed to compare each pixel from the right side of the grayscale image to the left side of the grayscale image to the determined intensity threshold. In other embodiments, the integrated circuit device is programmed to compare each pixel along each vertical column in the grayscale image to the determined intensity threshold. In some cases, the integrated circuit device is programmed to compare each pixel along each vertical column from the top of the grayscale image to the bottom of the grayscale image to the determined intensity threshold. In other cases, the integrated circuit device is programmed to compare each pixel along each vertical column from the bottom of the grayscale image to the top of the grayscale image to the determined intensity threshold.
[0265] Depending on the type of light detected, each pixel is assigned by the integrated circuit device a binarized pixel value of 1 or a binarized pixel value of 0. In one embodiment, the integrated circuit device is programmed to assign each pixel of the grayscale image a binarized pixel value of 1 if the pixel intensity is below an intensity threshold and a binarized pixel value of 0 if the pixel intensity of the grayscale image is greater than the intensity threshold. In another embodiment, the integrated circuit device is programmed to assign each pixel of the grayscale image a binarized pixel value of 1 if the pixel intensity is greater than the intensity threshold and a binarized pixel value of 0 if the pixel intensity is below the intensity threshold.
[0266] If binarized pixel values are assigned to each pixel of the grayscale image across a horizontal column, in some embodiments the integrated circuit device is programmed to further determine a first pixel in the horizontal column having a binarized pixel value of 1, and further determine a last pixel in the horizontal column having a binarized pixel value of 1. In one example, the integrated circuit device is programmed to determine a first pixel from the left side of the horizontal column that has an assigned binary pixel value of 1, and determine a last pixel from the left side of the horizontal column that has an assigned binary pixel value of 1. In another example, the integrated circuit device is programmed to determine a first pixel from the right side of the horizontal column that has an assigned binary pixel value of 1, and determine a last pixel from the right side of the horizontal column that has an assigned binary pixel value of 1. The integrated circuit device is programmed to determine a first pixel from the left side of the horizontal column that has an assigned binary pixel value of 0 and to determine a last pixel from the right side of the horizontal column. In another embodiment, the integrated circuit device is programmed to further determine a first pixel in the horizontal column that has an assigned binary pixel value of 0 and to determine a last pixel in the horizontal column that has an assigned binary pixel value of 0. In one embodiment, the integrated circuit device is programmed to determine a first pixel from the left side of the horizontal column that has an assigned binary pixel value of 0 and to determine a last pixel from the left side of the horizontal column that has an assigned binary pixel value of 0. In another embodiment, the integrated circuit device is programmed to determine a first pixel from the right side of the horizontal column that has an assigned binary pixel value of 0 and to determine a last pixel from the right side of the horizontal column that has an assigned binary pixel value of 0.
[0267] If a binarized pixel value is assigned to each pixel of the grayscale image along a vertical column, in some embodiments the integrated circuit device is programmed to further determine a first pixel along the vertical column having a binarized pixel value of 1 and further determine a last pixel along the vertical column having a binarized pixel value of 1. In one embodiment, the integrated circuit device is programmed to determine a first pixel from a top of the vertical column that has an assigned binary pixel value of 1 and to determine a last pixel from a top of the vertical column that has an assigned binary pixel value of 1. In another embodiment, the integrated circuit device is programmed to determine a first pixel from a bottom of the vertical column that has an assigned binary pixel value of 1 and to determine a last pixel from a bottom of the vertical column that has an assigned binary pixel value of 1. In another embodiment, the integrated circuit device is programmed to further determine a first pixel along the vertical column that has an assigned binary pixel value of 0 and further determine a last pixel along the vertical column that has an assigned binary pixel value of 0. In one embodiment, the integrated circuit device is programmed to determine a first pixel from a top of the vertical column that has an assigned binary pixel value of 0 and to determine a last pixel from a top of the vertical column that has an assigned binary pixel value of 0. In another embodiment, the integrated circuit device is programmed to determine the first pixel from the bottom of a vertical column that has an assigned binary pixel value of 0 and to determine the last pixel from the bottom of a vertical column that has an assigned binary pixel value of 0.
[0268] In some embodiments, the integrated circuit device is programmed to calculate image moments from the image mask. In some cases, the integrated circuit device is programmed to calculate image moments from the image mask according to:
[0269]
number
[0270] where m is the image moment calculated along the x-axis of the image mask and n is the image moment calculated along the y-axis of the image mask.
[0271] In certain embodiments, the integrated circuit device is programmed to determine one or more properties of the cells in the fluid stream based on the generated image mask. For example, the integrated circuit device may be programmed to determine a size of the cells, a center of mass of the cells, or an eccentricity of the cells based on the image mask. In these embodiments, the integrated circuit device is programmed to calculate one or more image moments of the image mask and determine a property of the cells based on the image mask and the calculated image moments.
[0272] In some cases, the integrated circuit device is programmed to calculate the center of mass from image moments of the image mask. For example, the center of mass may be calculated according to good.
[0273]
number
[0274] In other cases, the integrated circuit device is programmed to calculate the orientation of the cell from the image moments of the image mask. For example, the orientation of the cell may be calculated according to:
[0275]
number
[0276] In yet other instances, the integrated circuit device is programmed to calculate the eccentricity of the cell from the image moments of the image mask. For example, the eccentricity of the cell may be calculated according to:
[0277]
number
[0278] In some embodiments, the integrated circuit device is programmed to generate a masked image of cells in the fluid stream, hi these embodiments, the integrated circuit device is programmed to multiply each pixel value of the image mask with each pixel value from the image of the cells.
[0279] In some embodiments, the integrated circuit device is programmed to calculate image moments from the masked image. In some cases, the integrated circuit device is programmed to calculate image moments from the masked image according to:
[0280]
number
[0281] where m is the image moment calculated along the x-axis of the masked image and n is the image moment calculated along the y-axis of the masked image.
[0282] The subject integrated circuit device may be programmed to compare the image mask with the masked image to determine the variance of the optical signal within the boundaries of the image mask. In one embodiment, the integrated circuit device is programmed to calculate the center of mass from the image moments of the masked image according to:
[0283]
number
[0284] In another embodiment, the integrated circuit device is programmed to calculate the orientation of the cell from the image moments of the masked image according to:
[0285]
number
[0286] In yet another embodiment, the integrated circuit device is programmed to calculate the eccentricity of the cell from the image moments of the masked image according to:
[0287]
number
[0288] In some embodiments, the integrated circuit device is programmed to compare, for each cell, two or more of the image, the image mask, and the masked image. In some cases, the integrated circuit device is programmed to compare the image of the cell with the image mask. In other cases, the integrated circuit device is programmed to compare the image of the cell with the masked image. In still other cases, the integrated circuit device is programmed to compare the image mask of the cell with the masked image. In other embodiments, the integrated circuit device is programmed to generate and compare two or more different image masks of the cell, two or more different images of the cell, or two or more different masked images of the cell.
[0289] In certain embodiments, the integrated circuit device is programmed to calculate a colocalization coefficient for one or more features of a cell in the generated image, image mask, or masked image. In some cases, the integrated circuit device is programmed to calculate a colocalization coefficient from two or more different image masks of a cell. In other cases, the integrated circuit device is programmed to calculate a colocalization coefficient from two or more different images of a cell. In still other cases, the integrated circuit device is programmed to calculate a colocalization coefficient from two or more different masked images of a cell. In some embodiments, the integrated circuit device is programmed to calculate a colocalization coefficient from an image of a cell and an image mask. In another embodiment, the integrated circuit device is programmed to calculate a colocalization coefficient from the image of the cell and the masked image. In yet another embodiment, the integrated circuit device is programmed to calculate a colocalization coefficient from the image mask of the cell and the masked image.
[0290] In some embodiments, the integrated circuit device is programmed to calculate a colocalization coefficient for a cellular feature according to:
[0291]
number
[0292] where x is a pixel of the first image, first image mask, or first masked image; y is a pixel of the second image, second image mask, or second masked image; x is the average pixel value of the first image, first image mask, or first masked image; and y is the average pixel value of the second image, second image mask, or second masked image.
[0293] In another embodiment, the integrated circuit device is programmed to calculate a colocalization coefficient for a cellular feature according to the following:
[0294]
number
[0295] In yet another embodiment, the integrated circuit device is programmed to calculate a colocalization coefficient for a cellular feature according to the following:
[0296]
number
[0297] kit Aspects of the present disclosure further include kits, the kits including one or more of the integrated circuit devices described herein. In some embodiments, the kits may further include programming for the subject systems, such as in the form of a computer-readable storage medium (e.g., flash drive, USB storage, compact disc, DVD, Blu-ray disc, etc.) or instructions to download programming from an Internet web protocol or cloud server. The kits may further include instructions for practicing the subject methods. These instructions may be present in the subject kits in a variety of forms, one or more of which may be present in the kit. One form in which these instructions may be present is as information printed on a suitable medium or substrate, such as one or more sheets of paper on which the information is printed, the kit packaging, in-package print, etc. Yet another form in which these instructions may be present is a computer-readable storage medium having the information recorded thereon, such as a diskette, a compact disc (CD), a portable flash drive, etc. Yet another form in which these instructions may be present is as a computer-readable storage medium having the information recorded thereon, such as a diskette, a compact disc (CD), a portable flash drive, etc. A website address that can be used over the Internet to access information at a remote location.
[0298] Utilities The subject systems, methods, and computer systems find use in a variety of applications where it is desirable to analyze and separate particulate components in a sample in a fluid medium, such as a biological sample. In some embodiments, the systems and methods described herein find use in flow cytometric characterization of biological samples labeled with fluorescent tags. In other embodiments, the systems and methods find use in spectroscopy of emitted light. Additionally, the subject systems and methods find use in enhancing the available signal of light collected from a sample (e.g., in a fluid stream). In certain instances, the present disclosure finds use in increasing the measurement of light collected from a sample illuminated in a fluid stream of a flow cytometer. Embodiments of the present disclosure find use where it is desirable to provide a flow cytometer with improved cell sorting accuracy, enhanced particle collection, particle charging efficiency, more accurate particle charging, and enhanced particle deflection during cell sorting.
[0299] The embodiments of the present disclosure also find use in applications where cells prepared from a biological sample may be desired for use in research, laboratory testing, or therapy. In some embodiments, the subject methods and devices may facilitate obtaining individual cells prepared from a fluid or tissue biological sample of interest. For example, the subject methods and systems may facilitate obtaining cells from a fluid or tissue sample used as a research or diagnostic specimen for a disease such as cancer. Similarly, the subject methods and systems may facilitate obtaining cells from a fluid or tissue sample used in therapy. The methods and devices of the present disclosure allow for the separation and collection of cells from biological samples (e.g., organs, tissues, tissue fragments, fluids, etc.) with increased efficiency and reduced cost compared to conventional flow cytometry systems.
[0300] Regardless of the scope of the appended claims, the present disclosure is also defined by the following caveats. 1. A method for sorting cells in a sample, comprising: detecting light from a sample containing cells in the fluid stream; generating an image mask of cells within the fluid stream; Sorting the cells based on the generated image mask. A method comprising: 2. The method of claim 1, wherein detecting light from a sample in the fluid stream includes light absorption, light scattering, fluorescence, or a combination thereof. 3. The method of claim 1 or 2, wherein generating an image mask includes generating a grayscale image of cells within the fluid stream. 4. The method of claim 3, further comprising determining a pixel intensity threshold from the grayscale image. 5. Comparing each pixel of the laser-scale image with the determined threshold; Converting each pixel into a binary pixel value The method of claim 4, comprising:
[0301] 6. Detecting optical absorption from the fluid stream; assigning a pixel value of 1 to each pixel of the grayscale image if the pixel intensity of the grayscale image is less than the intensity threshold, and assigning a pixel value of 0 to each pixel of the grayscale image if the pixel intensity of the grayscale image is greater than the intensity threshold; The method of claim 5, comprising: 7. The method of claim 6, comprising determining a first pixel and a second pixel across a horizontal column of the grayscale image that have an assigned pixel value of 1. 8. The method of claim 7, wherein the first pixel is the first pixel in a horizontal row whose pixel value is 1. 9. The method of claim 7 or 8, wherein the second pixel is the last pixel in the horizontal row having a pixel value of 1. 10. Detecting light scattering from cells in the fluid stream; To assign a pixel value of 1 to each pixel of the grayscale image if the pixel intensity is greater than a threshold value, and a pixel value of 0 if the pixel intensity is less than the threshold value. The method of claim 5, comprising:
[0302] 11. Detecting fluorescence from cells in the fluid stream; To assign a pixel value of 1 to each pixel of the grayscale image if the pixel intensity is greater than a threshold value, and a pixel value of 0 if the pixel intensity is less than the threshold value. The method of claim 5, comprising: 12. The method of claim 10 or 11, comprising comparing each pixel intensity value of the grayscale image to the determined threshold across a horizontal row. 13. The method of any one of appendixes 5 to 12, wherein the image mask contains pixels having a pixel value of 1. 14. The method of any one of claims 1 to 13, further comprising determining a size of the cell based on the image mask. 15. The method of any one of claims 1 to 13, further comprising determining the center of mass of the cell based on the image mask.
[0303] 16. The method of claim 15, further comprising determining the eccentricity of the cell based on the image mask. 17. The method of any one of claims 1 to 16, further comprising generating a second image mask of the cell. 18. The method of claim 17, further comprising comparing the first image mask and the second image mask of the cell. 19. The method of claim 18, further comprising determining that the image mask of the cell contains a doublet.
[0304] 20. The method of any one of claims 1 to 13, further comprising calculating image moments from the image mask according to the following:
[0305]
number
[0306] where m is the image moment calculated along the x-axis of the image mask and n is the image moment calculated along the y-axis of the image mask. 21. The method of claim 20, further comprising calculating the center of mass of the cell from the image moments according to:
[0307]
number
[0308] 22. The method of claim 20, further comprising calculating the orientation of the cell from the image moments according to:
[0309]
number
[0310] 23. The method of claim 20, further comprising calculating the eccentricity of the cell from the image moments according to:
[0311]
number
[0312] 24. The method of any one of claims 1 to 23, further comprising generating an image of the cell. 25. The method of claim 24, further comprising multiplying each pixel from the image of the cell with the image mask to generate a masked image.
[0313] 26. The method of claim 25, further comprising calculating image moments from the masked image according to:
[0314]
number
[0315] where m is the image moment calculated along the x-axis of the masked image and n is the image moment calculated along the y-axis of the masked image. 27. The method of claim 26, further comprising calculating the center of mass of the cell in the masked image from the image moments according to:
[0316]
number
[0317] 28. The method of claim 26, further comprising calculating the orientation of cells in the masked image from the image moments according to:
[0318]
number
[0319] 29. The method of claim 26, further comprising calculating the eccentricity of the cell in the masked image from the image moments according to:
[0320]
number
[0321] 30.(1) Two or more different image masks of a cell; (2) Two or more different images of a cell; or (3) The method of any one of claims 1 to 29, comprising generating two or more different masked images of the cell. 31. The method of claim 30, further comprising calculating a colocalization coefficient for cellular features in two or more different image masks of a cell, two or more different images of a cell, or two or more different masked images of a cell. 32. The method of claim 31, wherein the feature is an intercellular organelle. 33. The method of claim 31, wherein the characteristic is an intercellular biopolymer. 34. The method according to claim 33, wherein the biological macromolecule is a protein.
[0322] 35. The method according to any one of claims 31 to 34, wherein the colocalization coefficient is calculated according to the following:
[0323]
number
[0324] where x is a pixel of the first image, the first image mask, or the first masked image, y is a pixel of the second image, the second image mask, or the second masked image, bar x is the average pixel value of the first image, the first image mask, or the first masked image, and bar y is the average pixel value of the second image, the second image mask, or the second masked image. 36. The method of claim 35, wherein the colocalization coefficient is calculated according to the following:
[0325]
number
[0326] 37. The method according to any one of claims 31 to 36, wherein the colocalization coefficient is calculated according to the following:
[0327]
number
[0328] 38. The method of any one of claims 1 to 37, wherein the image mask is generated by a field programmable gate array. 39. The method of any one of claims 1 to 38, further comprising illuminating the fluid stream with a light source. 40. The method of claim 39, wherein the fluid stream is irradiated by a light source in the wavelength range of 200 nm to 800 nm.
[0329] 41. The method of claim 39 or 40, comprising irradiating the fluid stream with a first beam of frequency-shifted light and a second beam of frequency-shifted light. 42. The method of claim 41, wherein the first beam of frequency-shifted light comprises a local oscillator (LO) beam and the second beam of frequency-shifted light comprises a radio frequency comb beam. 43. Applying a high frequency drive signal to an acousto-optic device; illuminating the acousto-optic device with a laser to generate a first beam of frequency-shifted light and a second beam of frequency-shifted light; 43. The method of claim 41 or 42, further comprising: 44. The method of claim 43, wherein the laser is a continuous wave laser.
[0330] 45. A light source configured to illuminate a sample containing cells in a fluid stream; a light detection system having a light detector; a processor having a memory operatively coupled thereto; It is equipped with The memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate an image mask of cells in the fluid stream; a cell sorting component configured to sort cells in the sample based on the generated image mask. system. 46. The system of claim 45, wherein the optical detection system includes an optical detector configured to detect one or more of light absorption, light scattering, and fluorescence. 47. The system of claim 45 or 46, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate a grayscale image of cells in the fluid stream. 48. The system of claim 47, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to determine a pixel intensity threshold from the grayscale image. 49. A memory contains instructions stored within it, and when the instructions are executed by a processor The processor: Comparing each pixel of the grayscale image with the determined threshold value; 49. The system of claim 48, wherein each pixel is converted to a binary pixel value.
[0331] 50. The memory contains instructions stored therein that, when executed by the processor, cause the processor to: detecting optical absorption from the fluid stream; 50. The system of claim 49, wherein each pixel of the grayscale image is assigned a pixel value of 1 if the pixel intensity is less than an intensity threshold, and a pixel value of 0 if the pixel intensity is greater than the intensity threshold. 51. The system of claim 50, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to determine first and second pixels across a horizontal column of a grayscale image that have an assigned pixel value of 1. 52. The system of claim 51, wherein the first pixel is the first pixel in a horizontal row whose pixel value is 1. 53. The system of claim 51 or 52, wherein the second pixel is the last pixel in the horizontal row having a pixel value of 1. 54. The memory contains instructions stored therein that, when executed by the processor, cause the processor to detecting light scattering from cells in the fluid stream; 54. The system of claim 53, wherein each pixel of the grayscale image is assigned a pixel value of 1 if the pixel intensity is greater than a threshold and a pixel value of 0 if the pixel intensity is less than the threshold.
[0332] 55. The memory contains instructions stored therein that, when executed by the processor, cause the processor to: detecting fluorescence from cells in the fluid stream; 55. The system of claim 54, wherein each pixel of the grayscale image is assigned a pixel value of 1 if the pixel intensity is greater than a threshold and a pixel value of 0 if the pixel intensity is less than the threshold. 56. The system of claim 54 or 55, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to compare each pixel intensity value of the grayscale image across a horizontal column with the determined threshold value. 57. The system of any one of Appendices 49 to 56, wherein the image mask includes pixels having a pixel value of 1. 58. A system according to any one of appendices 45 to 57, wherein the memory includes instructions stored therein that, when executed by the processor, cause the processor to determine a cell size based on an image mask. 59. The system of any one of appendices 45 to 58, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to determine a center of mass of a cell based on an image mask.
[0333] 60. The system of claim 59, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to determine eccentricity of the cell based on the image mask. 61. The system of any one of appendices 45 to 60, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate a second image mask of the cells. 62. The system of claim 61, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to compare a first image mask and a second image mask of the cell. 63. A memory contains instructions stored within it, and when the instructions are executed by a processor 63. The system of claim 62, further comprising a processor for determining that an image mask of a cell includes a doublet. 64. The system of any one of appendixes 45-60, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate image moments from the image mask according to:
[0334]
number
[0335] where m is the image moment calculated along the x-axis of the image mask and n is the image moment calculated along the y-axis of the image mask. 65. The system of claim 64, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate a center of mass of the cell from the image moments according to:
[0336]
number
[0337] 66. The system of claim 64, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate the orientation of the cell from the image moments according to:
[0338]
number
[0339] 67. The system of claim 64, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate the eccentricity of the cell from the image moments according to:
[0340]
number
[0341] 68. The system of any one of appendices 45 to 67, wherein the memory includes instructions stored therein that, when executed by the processor, cause the processor to generate an image of the cell. 69. The system of claim 68, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to multiply each pixel of the image of the cell with the image mask to generate a masked image. 70. The system of claim 69, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate image moments from the masked image according to:
[0342]
number
[0343] where m is the image moment calculated along the x-axis of the masked image and n is the image moment calculated along the y-axis of the masked image. 71. The system of claim 70, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate a center of mass of a cell in a masked image from image moments according to:
[0344]
number
[0345] 72. The system of claim 70, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate the orientation of cells in the masked image from the image moments according to:
[0346]
number
[0347] 73. The system of claim 70, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate the eccentricity of cells in the masked image from the image moments according to:
[0348]
number
[0349] 74. The memory contains instructions stored therein that, when executed by the processor, cause the processor to 1) Two or more different image masks of cells, 2) two or more different images of a cell, or 3) A system described in any one of appendices 45 to 73, which generates two or more different masked images of a cell. 75. The system of claim 74, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate colocalization coefficients for cellular features of two or more different image masks of a cell, two or more different images of a cell, or two or more different masked images of a cell.
[0350] 76. The system of claim 75, wherein the feature is an intercellular organelle. 77. The system of claim 75, wherein the feature is an intercellular biopolymer. 78. The system according to claim 77, wherein the biological macromolecule is a protein. 79. The system of any one of claims 74 to 78, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate a colocalization coefficient according to:
[0351]
number
[0352] where x is a pixel in the first image, the first image mask, or the first masked image; y is a pixel of the second image, the second image mask, or the second masked image; x is the average pixel value of the first image, the first image mask, or the first masked image; y is the average pixel value of the second image, the second image mask, or the second masked image.
[0353] 80. The system of claim 79, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate a colocalization coefficient according to:
[0354]
number
[0355] 81. The system of any one of claims 74 to 80, wherein the memory includes instructions stored thereon that, when executed by the processor, cause the processor to calculate a colocalization coefficient according to:
[0356]
number
[0357] 82. The system of any one of appendixes 45 to 81, comprising a field programmable gate array configured to generate an image mask. 83. The system of any one of notes 45 to 82, wherein the light source includes a light beam generator component configured to generate at least a first beam of frequency-shifted light and a second beam of frequency-shifted light. 84. The system of claim 83, wherein the optical beam generator includes an acousto-optic deflector. 85. The system of claim 83 or 84, wherein the optical beam generator includes a direct digital synthesis (DDS) RF comb generator.
[0358] 86. The system of any one of notes 83 to 85, wherein the optical beam generator component is configured to generate a frequency-shifted local oscillator beam. 87. The system of any one of notes 83-86, wherein the optical beam generator component is configured to generate a plurality of frequency-shifted comb beams. 88. The system of any one of notes 45 to 87, wherein the light source includes a laser. 89. The system of claim 88, wherein the laser is a continuous wave laser. 90. A system described in any one of appendices 45 to 89, wherein the system is a flow cytometer.
[0359] 91. The system of any one of claims 45 to 90, wherein the cell sorting component includes a droplet deflector. 92.A flow cell nozzle has an orifice and a sample inspection region in communication with the flow cell nozzle orifice for illuminating a sample in the fluid stream with a light source; The system of any one of appendixes 45 to 91, further comprising: 93. The system of claim 92, further comprising a cuvette positioned in the sample testing area. 94. Generating an image mask of cells in the fluid stream detected by a light detection system having a light detector; An integrated circuit programmed to sort cells based on the generated image mask. 95. The integrated circuit of claim 94, programmed to generate a grayscale image of cells in a fluid stream.
[0360] 96. The integrated circuit of claim 95, programmed to determine a threshold value from a grayscale image. 97. Comparing each pixel of the grayscale image to a determined threshold value; 97. The integrated circuit of claim 96 programmed to convert each pixel into a binary pixel value. 98. The integrated circuit of claim 97, programmed to assign to each pixel of the grayscale image a pixel value of 1 if the pixel intensity is less than a threshold value and a pixel value of 0 if the pixel intensity is greater than the threshold value. 99. The integrated circuit of claim 97, programmed to assign a pixel value of 1 to each pixel of the grayscale image if the pixel intensity is greater than a threshold value and a pixel value of 0 if the pixel intensity is less than the threshold value. 100. The integrated circuit of claim 97, programmed to determine first and second pixels across a horizontal column of a grayscale image that have an assigned pixel value of one.
[0361] 101. The integrated circuit of claim 100, wherein the first pixel is the first pixel in a horizontal row whose pixel value is one. 102. The integrated circuit of any one of appendixes 100 to 101, wherein the second pixel is the last pixel in the horizontal row whose pixel value is 1. 103. The integrated circuit of any one of appendices 94 to 102, programmed to determine a cell size based on an image mask. 104. The integrated circuit of any one of appendices 94 to 102, programmed to determine a center of mass of a cell based on an image mask. 105. The integrated circuit of any one of appendices 94 to 102, programmed to determine cell eccentricity based on an image mask.
[0362] 106. The integrated circuit of any one of appendices 94 to 104, programmed to generate a second image mask of cells. 107. The integrated circuit of claim 106, programmed to compare a first image mask and a second image mask of a cell. 108. The integrated circuit of claim 107, programmed to determine that an image mask of a cell includes a doublet.
[0363] 109. The integrated circuit of any one of claims 94 to 108, programmed to calculate image moments from an image mask according to:
[0364]
number
[0365] where m is the image moment calculated along the x-axis of the image mask and n is the image moment calculated along the y-axis of the image mask.
[0366] 110. The integrated circuit of claim 109, programmed to calculate a center of mass of a cell from image moments according to:
[0367]
number
[0368] 111. The integrated circuit of claim 109, programmed to calculate cell orientation from image moments according to:
[0369]
number
[0370] 112. The integrated circuit of claim 109, programmed to calculate cell eccentricity from image moments according to the following:
[0371]
number
[0372] 113. The integrated circuit of any one of appendices 94 to 112, programmed to generate an image of a cell. 114. The integrated circuit of claim 113, programmed to multiply each pixel of the image of the cell with an image mask to generate a masked image.
[0373] 115. The integrated circuit of claim 113, programmed to calculate image moments from a masked image according to:
[0374]
number
[0375] where m is the image moment calculated along the x-axis of the masked image and n is the image moment calculated along the y-axis of the masked image. 116. The integrated circuit of claim 113, programmed to calculate a center of mass of a cell in a masked image from image moments according to:
[0376]
number
[0377] 117. The integrated circuit of claim 116, programmed to calculate an orientation of a cell in a masked image from the image moments according to:
[0378]
number
[0379] 118. The integrated circuit of claim 116, programmed to calculate eccentricity of a cell in a masked image from image moments according to:
[0380]
number
[0381] 119.(1) Two or more different image masks of a cell; (2) Two or more different images of a cell; or (3) The integrated circuit of any one of appendices 94 to 118, programmed to generate two or more different masked images of a cell. 120. The integrated circuit of claim 119, programmed to calculate a colocalization coefficient for a cellular feature in two or more different image masks of a cell, two or more different images of a cell, or two or more different masked images of a cell.
[0382] 121. The integrated circuit of claim 120, wherein the feature is an intercellular organelle. 122. The integrated circuit of claim 120, wherein the feature is an intercellular biopolymer. 123. The integrated circuit according to claim 122, wherein the biological polymer is a protein. 124. An integrated circuit according to any one of appendices 120 to 123, wherein the colocalization coefficient is calculated according to the following:
[0383]
number
[0384] where x is a pixel of the first image, the first image mask, or the first masked image, y is a pixel of the second image, the second image mask, or the second masked image, bar x is the average pixel value of the first image, the first image mask, or the first masked image, and bar y is the average pixel value of the second image, the second image mask, or the second masked image. 125. The integrated circuit of claim 124, programmed to calculate a colocalization coefficient according to the following:
[0385]
number
[0386] 126. The integrated circuit of claim 124 or 125, programmed to calculate a colocalization coefficient according to the following:
[0387]
number
[0388] 127. The integrated circuit of any one of notes 94 to 126, which is a field programmable gate array (FPGA). 128. The integrated circuit of any one of appendices 94 to 126, which is an application specific integrated circuit (ASIC). 129. The integrated circuit of any one of appendixes 94 to 126, which is a complex programmable logic device (CAPLD).
[0389] Although the foregoing invention has been described in some detail by way of illustration and example for clarity of understanding, it will be readily apparent to those skilled in the art that certain changes and modifications may be made in light of the teachings of the invention without departing from the spirit or scope of the appended claims.
[0390] Thus, the foregoing description merely illustrates the principles of the present invention. It is understood that those skilled in the art can devise various arrangements that embody the principles of the present invention and fall within the spirit and scope thereof, although not expressly described or shown herein. Furthermore, all examples and conditional language recited herein are intended primarily to aid the reader in understanding the principles of the present invention and the concepts contributed by the inventor to further advance the art, and should not be construed as being limited to such specifically recited examples and conditions. Furthermore, all statements herein reciting principles, aspects, and embodiments of the present invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. In addition, such equivalents are intended to include both currently known equivalents and equivalents developed in the future, i.e., any elements developed to perform the same function, regardless of structure. Furthermore, nothing disclosed herein is intended to be dedicated to the public, regardless of whether such disclosure is expressly recited in the claims.
[0391] Thus, the scope of the present invention is not intended to be limited to the exemplary embodiments shown and described herein. Rather, the scope and spirit of the present invention is embodied in the appended claims. In the claims, 35 U.S.C. §112(f) or 35 U.S.C. §112(6) is expressly defined as being invoked for a limitation in a claim only if the precise phrase "means for" or the precise phrase "step for" is recited at the beginning of such limitation in the claim, and 35 U.S.C. §112(f) or 35 U.S.C. §112(6) is not invoked if such precise phrase is not used in the limitation in the claim.
[0392] CROSS-REFERENCE TO RELATED APPLICATIONS Pursuant to 35 U.S.C. §119(e), this application claims priority to the filing date of U.S. Provisional Application No. 62 / 824,903, filed March 27, 2019, the disclosure of which is incorporated herein by reference.
Claims
1. 1. A method for sorting cells in a sample, comprising: detecting light from a sample containing cells in the fluid stream; generating a binary image mask of cells in the fluid stream by converting each pixel of the grayscale image of each cell to a binary pixel value; Sorting the cells based on the generated image mask; A method comprising:
2. The method of claim 1, wherein detecting light from a sample containing cells in the fluid stream includes light absorption, light scattering, fluorescence, or a combination thereof.
3. The method described in claim 1, wherein generating the binary image mask includes generating a grayscale image of cells within the fluid stream.
4. The method of claim 3, further comprising determining a pixel intensity threshold from the grayscale image.
5. Comparing each pixel from the grayscale image with the determined pixel intensity threshold; Converting each pixel into a binary pixel value; The method of claim 4, comprising:
6. Detecting optical absorption from the fluid stream; assigning a pixel value of 1 to each pixel of the grayscale image if the pixel intensity of the grayscale image is less than the pixel intensity threshold, and assigning a pixel value of 0 to each pixel of the grayscale image if the pixel intensity of the grayscale image is greater than the pixel intensity threshold; The method of claim 5 , comprising:
7. The method of claim 6, further comprising determining a first pixel and a second pixel across a horizontal column of the grayscale image that have an assigned pixel value of 1.
8. The method described in claim 7, wherein the first pixel is the first pixel in a horizontal row having a pixel value of 1.
9. The method described in claim 1, further comprising determining the center of mass of a cell based on the image mask.
10. The method of claim 1, further comprising generating a second image mask of the cell.
11. The method described in claim 10, further comprising comparing the image mask of the cell with the second image mask.
12. The method of claim 11, further comprising determining that the image mask of the cell includes a doublet.
13. The method of claim 1, further comprising generating an image of the cell.
14. The method of claim 1, further comprising determining a threshold for converting each pixel from the grayscale image to a binary pixel value by calculating a pixel intensity threshold that minimizes the intra-class variance of the pixels of the grayscale image.
15. Generating the binary image mask comprises: determining a first pixel from the top of each vertical column of the generated binary image mask having a binary pixel value of 1, and determining a last pixel from the top of each vertical column of the generated binary image mask having a binary pixel value of 1; determining a first pixel from the bottom of each vertical column of the generated binary image mask having a binary pixel value of 1, and determining a last pixel from the bottom of each vertical column of the generated binary image mask having a binary pixel value of 1; The method of claim 1 , comprising:
16. Generating the binary image mask comprises: determining a first pixel from the left side of each horizontal column of the generated binary image mask having a binary pixel value of 1, and determining a last pixel from the left side of each horizontal column of the generated binary image mask having a binary pixel value of 1; determining a first pixel from the right side of each horizontal column of the generated binary image mask having a binary pixel value of 1; and determining a last pixel from the right side of each horizontal column of the generated binary image mask having a binary pixel value of 1. The method of claim 1 , comprising:
17. A method of detecting a cell-containing sample in a fluid stream, comprising: a light detection system having a light detector; a processor having a memory operatively coupled thereto; It is equipped with the memory includes instructions stored thereon that, when executed by the processor, cause the processor to generate an image mask of cells in the fluid stream; a cell sorting component configured to sort cells in the sample based on an image mask generated according to the method of any one of claims 1 to 16; system.
18. A method for generating an image mask of cells in a fluid stream detected by an optical detection system having an optical detector; Sorting cells based on the generated image mask according to the method of any one of claims 1 to 16. An integrated circuit that is programmed to