SYSTEMS AND METHODS FOR DETERMINING A CELL OF ORIGIN FROM VARIANT CALLING DATA

DE602020072613T2Active Publication Date: 2026-05-27ROCHE DIAGNOSTICS GMBH
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
ROCHE DIAGNOSTICS GMBH
Filing Date
2020-07-20
Publication Date
2026-05-27

AI Technical Summary

Technical Problem

Current methods for classifying the cell of origin in diffuse large B cell lymphoma (DLBCL) are limited by the need for tissue samples and rely heavily on RNA expression data, which is challenging to obtain from formalin-fixed and paraffin-embedded samples.

Method used

A computer-implemented method using machine learning algorithms, specifically decision trees and ensemble models, to classify DLBCL cell of origin based on variant calling data from blood or plasma samples, incorporating a broader set of genes and variant location data for improved accuracy.

Benefits of technology

Enables accurate classification of DLBCL cell of origin using non-invasive blood or plasma samples, overcoming the limitations of RNA-based methods and expanding the applicability of COO determination beyond tissue samples.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

FIELD

[0001] Embodiments of the invention related generally to classification of biological samples, and more specifically to cell of original classification.BACKGROUND

[0002] After naive B cells migrate from bone marrow to the germinal center, they undergo rapid proliferation and iterative rounds of somatic hypermutation, affinity maturation and clonal selection, as well as class switch recombination, with the aim of favoring the emergence of cells that produce antibodies with increased affinity for the antigen and capable of distinct effector functions. Pasqualucci, L. et al. (2018). Blood, 131, 2307-19. GCB lymphoma cells lack the expression of early post germinal center differentiation markers whereas ABC lymphomas display the transcriptional signature similar to that of activated B-cells. Kurtz D. et al. (2018). J Clinical Oncology, 36(28), 2845-53.

[0003] Diffuse large B cell lymphoma (DLBCL) shows a wide range of biological and molecular heterogeneity. Due to this diversity, personalized risk stratification and treatment are promising avenues to improving outcomes for DLBCL subjects, but these techniques rely on molecular or genomic data which are often hard to obtain in clinical settings. The most common classification scheme in DLBCL relies on determination of the tumor's cell of origin (COO). Two major COO classes, germinal center B cell-like (GCB) and activated B cell-like (ABC) lymphomas, have been defined, where patients with ABC subtype have inferior outcomes to standard therapy. See Alizadeh, A. et al. (2000). Nature, 403(6769), 503-511. Moreover, the ABC-like DLBCL has been shown to have superior response rates to targeted therapies including BTK inhibition. Unfortunately, current methods to assess COO remain limited by the need for tissue samples. Scherer, F. et al. (2016). Science Translational Medicine, 8(364). In addition, many methods to assess COO are dependent on expression data, based on RNA. Because most tissue samples are stored formalin fixed and paraffin embedded (FFPET), isolation of useable RNA from these samples is a challenge.

[0004] Accordingly, it would be desirable to provide new systems and methods for COO classification that can be performed on blood or plasma samples.

[0005] WO 2019 / 067092 A1 describes methods and materials for identifying a subject as having cancer in which the presence of members of two or more classes of biomarkers are detected, or two or more members of at least one class of biomarkers and the presence of aneuploidy are detected. US 2013 / 195843 A1 describes a method of identifying a subject as having B-cell non-Hodgkin lymphoma such as testing a sample from a subject for a mutation in one or more biomarkers. WO 2020 / 146554 A2 describes the use of molecular profiling data to identify biomarker signatures that predict a tumor primary lineage or organ group. WO 2020 / 028563 A1 describes methods of determining cell of origin for diffuse large B cell lymphoma using DNA for the analysis.

[0006] Daisuke Ennishi et al. ("Genetic profiling of MYC and BCL2 in diffuse large B-cell lymphoma determines cell-of-origin-specific clinical impact", Blood, The American Society of Hematology, vol. 129, no. 20, 28 March 2017, pages 2760-2770) describes that the incidence of MYC / BCL2 genetic alterations and their clinical significance were largely dependent on COO subtypes. Jordina Rovira et al. ("MYD88 L265P Mutations, But No Other Variants, Identify a Subpopulation of DLBCL Patients of Activated B-Cell Origin, Extranodal Involvement, and Poor Outcome", Clinical Cancer Research, vol. 22, no. 11, 20 January 2016, pages 2755-2764) describes that MYD88 L265P mutations, but no other variants, identify a subgroup of DLBCL mainly of ABC origin, with extranodal involvement and poor outcome. Bolen Christopher et al. ("Systematic Analysis of the Prognostic Impact of Somatic Mutations in Diffuse Large B-Cell Lymphoma (DLBCL) with Evaluation of Cell-of-Origin Dependence: Results from the Phase 3 GOYA Trial in Previously Untreated DLBCL", Blood, The American Society of Hematology, vol. 130, no. Suppl. 1, 7 December 2017, page 2729) describes the characterization of the mutational profile of DLBCL by targeted next-generation sequencing, and evaluation of the prognostic impact of somatic mutations and its relation to COO. Jun Chin Ang et al. ("Supervised, Unsupervised, and Semi-Supervised Feature Selection", IEEE / ACM Transactions on Computational Biology and Bioinformatics, IEEE Service Center, New York, NY, US, vol. 13, no. 5, 1 September 2016, pages 971-989) describes the basic taxonomy of feature selection, and also reviews the state-of-the-art gene selection methods by grouping the literatures into three categories: supervised, unsupervised, and semi-supervised.SUMMARY OF THE DISCLOSURE

[0007] The claimed invention is defined by the appended claims.

[0008] The present invention relates generally to classification of biological samples, and more specifically to cell of original classification. In particular, embodiments of the invention relate to diffuse large B cell lymphoma cell of origin classification.

[0009] In a first aspect, a computer-implemented method for cell of origin determination for a type of cancer is provided. The method includes constructing a plurality of decision trees based on a collection of features, each decision tree comprising a random subset of features from the collection of features, wherein the features are genes that were identified based on one or more criteria from a plurality of blood or plasma samples from subjects having the type of cancer; and training the plurality of decision trees based on the collection of features to create a cell of origin classifier.

[0010] The type of cancer is diffuse large B cell lymphoma.

[0011] At least 10 of the features from the collection of features is selected from the group of genes consisting of EZH2, SGK1, GNAI3, IRF8, TNFRSF14, STAT6, BCL7A, KMT2D, SOCS1, RHOA, BCL2, STAT3, POU2F2, CD83, NFKBIA, CREBBP, CD58, TET2, KLHL6, CARD11, BCL6, MYC, PAX5, ZNF608, DUSP2, FOXO1, EP300, CCND3, ETS1, TMEM30A, PRDM1, IRF4, KLHL14, PIM1, IGLL5, CDKN2A, TBL1XR1, ZEB2, CD79B, MYD88.

[0012] In some embodiments, at least 20 of the features from the collection of features is selected from the group of genes consisting of EZH2, SGK1, GNAI3, IRF8, TNFRSF14, STAT6, BCL7A, KMT2D, SOCS1, RHOA, BCL2, STAT3, POU2F2, CD83, NFKBIA, CREBBP, CD58, TET2, KLHL6, CARD11, BCL6, MYC, PAX5, ZNF608, DUSP2, FOXO1, EP300, CCND3, ETS1, TMEM30A,PRDM1, IRF4, KLHL14, PIM1, IGLL5, CDKN2A, TBL1XR1, ZEB2, CD79B, MYD88.

[0013] In some embodiments, at least 30 of the features from the collection of features is selected from the group of genes consisting of EZH2, SGK1, GNAI3, IRF8, TNFRSF14, STAT6, BCL7A, KMT2D, SOCS1, RHOA, BCL2, STAT3, POU2F2, CD83, NFKBIA, CREBBP, CD58, TET2, KLHL6, CARD11, BCL6, MYC, PAX5, ZNF608, DUSP2, FOXO1, EP300, CCND3, ETS1, TMEM30A,PRDM1, IRF4, KLHL14, PIM1, IGLL5, CDKN2A, TBL1XR1, ZEB2, CD79B, MYD88.

[0014] The criteria for identifying a gene includes at least one of the following conditions: (1) at least about 2% of the subjects from a first cell of origin class or a second cell of origin class have a variant in the gene; (2) at most about 30% of all subjects with variants in the gene are unclassified; and (3) a ratio of a first cell of origin class to a second cell of original class GCB or a ratio of the second cell of original class to the first cell of origin class is at least 55:45.

[0015] The method further includes receiving a file comprising variant data from a patient, wherein the variant data was obtained from a blood or plasma sample from the patient; and using the cell of origin classifier to determine a cell of origin based on the variant data in the file.

[0016] In some embodiments, one of the features in the collection is variant location data.

[0017] In some embodiments, the variant location data includes at least one of: (1) a position of a variant in a gene; (2) information about a domain region of a protein which is modified in a variant; (3) information about a structural motif of a protein which is modified in a variant; and (4) functional region of a protein which is modified in a variant.

[0018] In some embodiments, one of the features in the collection is variant allele fraction data.

[0019] Described herein is a computer-implemented method for cell of origin classification for a type of cancer. The method includes constructing an ensemble model from a plurality of individual models, each individual model comprising an initial decision tree; and iteratively training each individual model to generate a plurality of successive decision trees that are added to each individual model, wherein each successive decision tree is configured to correct for an error in a previous decision tree, wherein each decision tree comprises a subset of features from a collection of features, wherein the features are genes that were identified based on one or more criteria from a plurality of blood or plasma samples from subjects having the type of cancer.

[0020] In some examples, each initial decision tree comprises a random subset of features from the collection of features.

[0021] In some examples, each individual model is trained for no more than 25 iterations.

[0022] In some examples, each individual model is trained for no more than 50 iterations.

[0023] In some examples, each individual model is trained for no more than 75 iterations.

[0024] In some examples, each individual model is trained for no more than 100 iterations.

[0025] In some examples, the type of cancer is diffuse large B cell lymphoma lymphoma.

[0026] In some examples, the collection of features includes at least ten features that are selected from the group of features consisting of EZH2_SNV, GNA13_SNV, BCL2 _Fusion, CD79B_SNV, PIM1_SNV, IGLL5_Indel, PIM1_Indel, SGK1_SNV, MYD88L273P_SNV, STAT6_SNV, TNFRSF14_SNV, P2RY8_SNV, CIITA_Indel, EGR1_SNV, ATG5_Indel, IRF4_SNV, S1PR2_SNV, SOCS1_SNV, CD58_Indel, and CNTNAP2_SNV.

[0027] In some examples, the collection of features includes at least 20 features that are selected from the group of features consisting of EZH2_SNV, GNA13_SNV, BCL2 _Fusion, CD79B_SNV, PIM1_SNV, IGLL5_Indel, PIM1_Indel, SGK1_SNV, MYD88L273P_SNV, STAT6_SNV, TNFRSF14_SNV, P2RY8_SNV, CIITA_Indel, EGR1_SNV, ATG5_Indel, IRF4_SNV, S1PR2_SNV, SOCS1_SNV, CD58_Indel, and CNTNAP2_SNV.

[0028] In some examples, the collection of features is selected from a larger pool of potential features based on an improvement to the ensemble models prediction accuracy.BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The novel features of the invention are set forth with particularity in the claims that follow. A better understanding of the features and advantages of the present invention will be obtained by reference to the following detailed description that sets forth illustrative embodiments, in which the principles of the invention are utilized, and the accompanying drawings of which: FIG. 1 is a is a block diagram illustrating an embodiment of a computer system configured to implement one or more aspects of the present invention. FIG. 2 is a plot that illustrates the number of samples containing ABC or GCB variants in each gene. FIG. 3 is a diagram that illustrates an embodiment of a random forest algorithm. FIGS. 4, 5A, and 5B are diagrams that illustrate various aspects of an embodiment of a gradient boosted decision tree algorithm. FIG. 6 illustrates is a plot that illustrates the number of subjects each feature was detected in and the difference between the subjects' subtypes. FIG. 7 is a diagram that illustrates an embodiment of the ensemble model. FIGS. 8-10 present results from the ensemble model. DETAILED DESCRIPTION

[0030] The invention described here is a system and method based on a machine learning algorithm for COO determination, which is based on the variants present in a plasma sample, a blood sample, or a tissue sample, for example. Because the invention is based on variant calling, it is able call COO in plasma samples, blood samples, or in tissue samples, including FFPET samples, meaning it can be used much more broadly than previous methods.

[0031] Previously, a method for COO calling based on variant determination was described by Scherer, F. et al. Science Translational Medicine, 8(364)(2016) ("Scherer"). Briefly, the method described in Scherer is a Naive Bayes Classifier, assigning relative probabilities for GCB or ABC for each of 31 genes. Then, for a given sample, the probabilities from the variant-containing genes in the sample are combined to give an overall probability of ABC or GCB for a given sample. While this proved to be a useful technique for COO determination, the technique was based only on data from one publication (Pasqualucci, L. et al. Analysis of the coding genome of diffuse large B-cell lymphoma, Nature Genetics, 43, 830 (2011)), with only 48 DLBCL samples for training.

[0032] Described herein are (1) modifications and improvements to the COO determination method described by Scherer as well as (2) a new method of COO classification as described herein. The updates to the Scherer method are as follows: 1. New Machine Learning algorithms based on a broader set of publicly available data, using 40 genes for ABC vs GCB classifications 2. Use of further variant location data in the classifications-instead of simply using the gene which contained the variant, the domain or position within the gene can be incorporated 3. For plasma samples, use of the variant allele fraction (AF) as more information to weigh the probabilities of each variant-containing gene or location. Exemplary Computer System for Implementing a Machine Learning Algorithm

[0033] The machine learning algorithms can be implemented on a computer system. For example, FIG. 1 is a block diagram illustrating one embodiment of a computer system 100 configured to implement one or more aspects of the present invention. As shown, computer system 100 includes, without limitation, a central processing unit (CPU) 102 and a system memory 104 coupled to a parallel processing subsystem 112 via a memory bridge 105 and a communication path 113. Memory bridge 105 is further coupled to an I / O (input / output) bridge 107 via a communication path 106, and I / O bridge 107 is, in turn, coupled to a switch 116.

[0034] In operation, I / O bridge 107 is configured to receive user input information from input devices 108 (e.g., a keyboard, a mouse, a video / image capture device, etc.) and forward the input information to CPU 102 for processing via communication path 106 and memory bridge 105. In some embodiments, the input information is a live feed from a camera / image capture device or video data stored on a digital storage media on which object detection operations execute. Switch 116 is configured to provide connections between I / O bridge 107 and other components of the computer system 100, such as a network adapter 118 and various add-in cards 120 and 121.

[0035] As also shown, I / O bridge 107 is coupled to a system disk 114 that may be configured to store content and applications and data for use by CPU 102 and parallel processing subsystem 112. As a general matter, system disk 114 provides non-volatile storage for applications and data and may include fixed or removable hard disk drives, flash memory devices, and CD-ROM (compact disc read-only-memory), DVD-ROM (digital versatile disc-ROM), Blu-ray, HD-DVD (high definition DVD), or other magnetic, optical, or solid state storage devices. Finally, although not explicitly shown, other components, such as universal serial bus or other port connections, compact disc drives, digital versatile disc drives, film recording devices, and the like, may be connected to I / O bridge 107 as well.

[0036] In various embodiments, memory bridge 105 may be a Northbridge chip, and I / O bridge 107 may be a Southbridge chip. In addition, communication paths 106 and 113, as well as other communication paths within computer system 100, may be implemented using any technically suitable protocols, including, without limitation, AGP (Accelerated Graphics Port), HyperTransport, or any other bus or point-to-point communication protocol known in the art.

[0037] In some embodiments, parallel processing subsystem 112 comprises a graphics subsystem that delivers pixels to a display device 110 that may be any conventional cathode ray tube, liquid crystal display, light-emitting diode display, or the like. In such embodiments, the parallel processing subsystem 112 incorporates circuitry optimized for graphics and video processing, including, for example, video output circuitry. As described in greater detail below in FIG. 2, such circuitry may be incorporated across one or more parallel processing units (PPUs) included within parallel processing subsystem 112. In other embodiments, the parallel processing subsystem 112 incorporates circuitry optimized for general purpose and / or compute processing. Again, such circuitry may be incorporated across one or more PPUs included within parallel processing subsystem 112 that are configured to perform such general purpose and / or compute operations. In yet other embodiments, the one or more PPUs included within parallel processing subsystem 112 may be configured to perform graphics processing, general purpose processing, and compute processing operations. System memory 104 includes at least one device driver 103 configured to manage the processing operations of the one or more PPUs within parallel processing subsystem 112. The system memory 104 also includes a software application 125 that executes on the CPU 102 and may issue commands that control the operation of the PPUs.

[0038] In various embodiments, parallel processing subsystem 112 may be integrated with one or more other the other elements of FIG. 1 to form a single system. For example, parallel processing subsystem 112 may be integrated with CPU 102 and other connection circuitry on a single chip to form a system on chip (SoC).

[0039] It will be appreciated that the system shown herein is illustrative and that variations and modifications are possible. The connection topology, including the number and arrangement of bridges, the number of CPUs 102, and the number of parallel processing subsystems 112, may be modified as desired. For example, in some embodiments, system memory 104 could be connected to CPU 102 directly rather than through memory bridge 105, and other devices would communicate with system memory 104 via memory bridge 105 and CPU 102. In other alternative topologies, parallel processing subsystem 112 may be connected to I / O bridge 107 or directly to CPU 102, rather than to memory bridge 105. In still other embodiments, I / O bridge 107 and memory bridge 105 may be integrated into a single chip instead of existing as one or more discrete devices. Lastly, in certain embodiments, one or more components shown in FIG. 1 may not be present. For example, switch 116 could be eliminated, and network adapter 118 and add-in cards 120, 121 would connect directly to I / O bridge 107. Sequencing

[0040] As described herein, variant calling data can be used in the systems and models describe herein for cell of origin classification. The variant calling data can be obtained in an electronic data file (i.e., a variant call format (VCF) file) that has been generated from sequencing nucleic acid molecules from a sample to generate sequencing data and performing primary and secondary analysis of the sequence data to identify variants. For example, the prepared nucleic acid molecules of interest (e.g., a sequencing library) can be sequenced using a sequencing assay as part of the procedure for determining sequencing reads for a plurality of microsatellite loci. Any of a number of sequencing technologies or sequencing assays can be utilized. The term "Next Generation Sequencing (NGS)" as used herein refers to sequencing methods that allow for massively parallel sequencing of clonally amplified molecules and of single nucleic acid molecules.

[0041] Non-limiting examples of sequence assays that are suitable for use with the methods disclosed herein include nanopore sequencing (US Pat. Publ. Nos. 2013 / 0244340, 2013 / 0264207, 2014 / 0134616, 2015 / 0119259 and 2015 / 0337366), Sanger sequencing, capillary array sequencing, thermal cycle sequencing (Sears et al., Biotechniques, 13:626-633 (1992)), solid-phase sequencing (Zimmerman et al., Methods Mol. Cell Biol., 3:39-42 (1992)), sequencing with mass spectrometry such as matrix-assisted laser desorption / ionization time-of-flight mass spectrometry (MALDI-TOF / MS; Fu et al., Nature Biotech., 16:381-384 (1998)), sequencing by hybridization (Drmanac et al., Nature Biotech., 16:54-58 (1998), and NGS methods, including but not limited to sequencing by synthesis (e.g., HiSeq ™< , MiSeq ™< , or Genome Analyzer, each available from Illumina), sequencing by ligation (e.g., SOLiD ™< , Life Technologies), ion semiconductor sequencing (e.g., Ion Torrent ™< , Life Technologies), and SMRT ®< sequencing (e.g., Pacific Biosciences).

[0042] Commercially available sequencing technologies include: sequencing-by-hybridization platforms from Affymetrix Inc. (Sunnyvale, Calif.), sequencing-by-synthesis platforms from Illumina / Solexa (San Diego, Calif.) and Helicos Biosciences (Cambridge, Mass.), sequencing-by-ligation platform from Applied Biosystems (Foster City, Calif.). Other sequencing technologies include, but are not limited to, the Ion Torrent technology (ThermoFisher Scientific), and nanopore sequencing (Genia Technology from Roche Sequencing Solutions, Santa Clara, Cal.); and Oxford Nanopore Technologies (Oxford, United Kingdom).1. MODIFIED AND IMPROVED MACHINE LEARNING ALGORITHM BASED ON A BROADER SET OF DATA, USING 40 GENES FOR ABC VS GCB CLASSIFICATIONS:

[0043] While the previous Scherer et al. COO caller was based only on 48 samples from Pasqualucci et al., described herein is an improved COO caller based on 945 samples from two different publications (Reddy, A. et al. (2017). Genetic and Functional Drivers of Diffuse Large B Cell Lymphoma. Cell, 171(2), 481-494; and Chapuy, B. et al. (2018). Molecular subtypes of diffuse large B cell lymphoma are associated with distinct pathogenic mechanisms and outcomes. Nature Medicine, 24(5), 679-690), allowing a broader basis for separation of ABC and GCB. Using data from these datasets, for each gene, the percent of DLBCL patients with a variant in the gene who were ABC vs GCB was determined. To choose genes to incorporate in the algorithm, genes were selected that met the following conditions: (1) Data from both datasets agreed on whether a variant in the gene was more likely to be present in GCB subjects or ABC subjects; (2) at least 25 subjects from one class (ABC or GCB) have variants in the gene; (3) at most 30% of all subjects with variants in the gene are unclassified; (4) the ratio of ABC:GCB or GCB:ABC subjects with a variant in the gene is at least 55:45. In other embodiments, data can be obtained from one or more public sources such as data from academic and / or medical journals, and / or from private sources such as privately run clinical trials and / or medical health records.

[0044] For example, genes that can be used as features in the ABC / GCB classifier algorithms described herein are listed in Table 1 with the proportion of samples labeled ABC, GCB or Unclassified (UNC) for each gene. These genes met the four conditions listed above. This table of genes is not meant to be exhaustive, and other genes that pass the criteria established above can also be included in the collection of features used by the classifier algorithm. The collection of features used by the classifier may include any combination of the genes listed in Table 1. For example, in some embodiments, the collection of features can include all 40 of the genes listed in Table 1. In other embodiments, the collection of features can include at least 5, 10, 15, 20, 25, 30, or 35 genes from Table 1. In other embodiments, the collection of features can include no more than 5, 10, 15, 20, 25, 30, 35, or 40 genes from Table 1. Table 1 proportion of samples labeled ABC, GCB or Unclassified for each geneGene ABC GCB UNC Gene ABC GCB UNC EZH20.090.850.06BCL60.290.480.23SGK10.110.700.19MYC0.310.500.19GNAI30.150.710.13PAX50.360.520.12IRF80.160.700.14ZNF6080.380.540.08TNFRSF140.190.690.13DUSP20.380.520.11STAT60.180.650.17FOXO10.340.460.20BCL7A0.220.640.14EP3000.400.520.08KMT2D0.230.630.15CCND30.440.310.26SOCS10.220.600.18ETS10.510.330.16RHOA0.260.670.08TMEM30A0.480.300.22BCL20.260.630.12PRDM10.590.350.07STAT30.240.610.15IRF40.460.270.27POU2F20.260.630.11KLHL140.530.280.19CD830.260.630.11PIM10.620.280.10NFKBIA0.270.650.08IGLL50.610.270.12CREBBP0.270.610.11CDKN2A0.570.250.18CD580.260.510.23TBL1XR10.620.230.15TET20.270.510.22ZEB20.620.200.18KLHL60.310.550.14CD79B0.750.170.08CARDI110.310.530.17MYD880.720.160.12

[0045] Examples of genes used in the ABC / GCB classifier are also shown in FIG. 2 with the number of subjects or samples containing ABC or GCB variants in each gene.

[0046] In other embodiments, condition (2) is set so that at least about 0.25, 0.5, 0.75, 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10% of the subjects from one class (ABC or GCB) have variants in the gene. In other embodiments, condition (3) is set so that at most about 5, 10, 15, 20, 25, 30, 35, 40, 45, or 50% of all subjects with variants in the gene are unclassified. In other embodiments, condition (4) is set so that the ratio of ABC:GCB or GCB:ABC subjects with a variant in the gene is at least about 60:40, 65:35, 70:30, 75:25, 80:20, 85:15, or 90:10. In some embodiments, the genes selected for inclusion into the classification algorithm can be determined using any combination of the conditions listed herein.

[0047] Different machine learning algorithms may be useful for COO classification. For example, ensemble based machine learning algorithms and / or decision tree based machine learning algorithms can be used to perform COO classification. Ensemble methods combine multiple learning algorithm algorithms into a single aggregate model. For example, a model based on a plurality of decision trees can be considered an ensemble method. Decision tree algorithms include (1) a basic decision tree based on a plurality of conditions; (2) a bootstrap aggregating or bagging algorithm is an ensemble algorithm that combines predictions from a plurality of decision trees through a majority voting approach; (3) a random forest algorithm is a bagging-based algorithm where only a subset of features are selected at random for each decision tree to build a plurality (i.e., a forest) of decision trees; (4) a boosting algorithm builds each decision tree sequentially by minimizing the errors from previous models (i.e., decision trees) while increasing (i.e. boosting) the weight or influence of high-performing models (i.e. decision trees); (5) a gradient boosting algorithm uses a gradient descent algorithm to minimize errors in sequential model (i.e. boosting algorithm in (4)); and (6) optimized gradient boosting algorithm (i.e. XGBoost) which may employ parallel processing, tree-pruning, handling missing values, and regularization to reduce overfitting and / or bias in gradient boosting algorithms. Any of these algorithms, alone or in combination, can be used for the COO classifier.Random Forest Classifier

[0048] For example, a Random Forest classifier algorithm can be used as described herein to perform a COO classification, such as classifying a cell as ABC or GCB. FIG. 3 is a high level diagram that illustrates the general structure and process of a random forest classifier. In the random forest classifier, each decision tree 200 of a plurality of decision trees is constructed using a random subset of features 202 from of a collection of features 202, such as the genes listed in Table 1.

[0049] Once the plurality of trees 200 are constructed, the plurality of trees 200 can be trained using a training data set. For example, the training data set can be obtained through published papers in academic, medical, or scientific journals, such as Reddy and Chapuy as mentioned above. Alternatively or in addition, the training data set can be obtained from real world sequencing data and / or variant calling data obtained from patients.

[0050] After training, the random forest classifier can be used to classify sample data 204 (i.e. data contained in a variant call format (VCF) file) from a patient or subject. In other embodiments, the data can be obtained by sequencing the sample and then identifying the variants in the sequence data. Each tree 200 processes the sample data and independently determines and votes for a class 206 for the sample. The random forest classifier then determines the most popular class 208 using, for example, a majority or plurality voting process (i.e., class that receives the most votes is selected as the most popular class), which is assigned by the classifier to the sample.

[0051] Other parameters of the random forest classifier that can be adjusted include the number of trees and the number of features that are randomly selected at each node of the tree to determine the split. For example, the number of trees can be at least 2, 3, 4, 5, 6, 7, 8, 9, 10, 20, 30, 40, 50, 60, 70, 80, 90, 100, 200, 300, 400, 500, 600, 700, 800, 900, 1000, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, or 10000. In some embodiments, the number of trees can be no more than 10, 20, 30, 40, 50, 60, 70, 80, 90, 100, 200, 300, 400, 500, 600, 700, 800, 900, 1000, 2000, 3000, 4000, 5000, 6000, 7000, 8000, 9000, or 10000. In some embodiments, the number of features that are randomly selected at each node is at least 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10. In some embodiments, the number of features that are randomly selected at each node is no more than 2, 3, 4, 5, 6, 7, 8, 9, or 10.(2). A NEW MODEL FOR COO CLASSIFICATIONXGBoost Classifier

[0052] In another example, XGBoost can be used for the classifier. XGBoost is an optimized variation of a gradient boosted decision tree algorithm, and is shown at a high level in FIG. 4. One of the primary differences between the random forest algorithm and a boosted decision tree algorithm is in how the models are trained. In the random forest model, all the trees are trained together as a group, while in a boosted decision tree model, the training and construction of the model occurs iteratively, as shown in FIG. 4. For example, in a boosted decision tree algorithm, at step 400 a first decision tree can be constructed and trained. Then in step 402, the error of the first decision tree can be determined. Depending on the type of error function or algorithm used to determine and minimize the error, the model can be considered a boosted decision tree, a gradient boosted decision tree, or an optimized gradient boosted decision tree such as XGBoost. For example, a gradient boosted decision tree algorithm uses a gradient descent algorithm to minimize the error. In step 404, a second decision tree can be constructed using the feedback from the error determination step and then trained. In step 406, the new decision tree can be added to the first decision tree to form an ensemble model. Steps 402, 404, and 406 can be repeated until the ensemble model contains a selectable or predetermined number of trees, or the ensemble model satisfies one or more performance criteria, such as not exceeding a selectable or predetermined level of error. FIGS. 5A and 5B illustrate the iterative addition of decisions trees as described above in connection with FIG. 4, starting with a first tree 500, then adding a second tree 502, and then adding a N-th tree 504. Additionally, the error of the new decision tree is illustrated in the error bar 500', 502', 504' below the respective decision tree 500, 502, 504, with the ratio of the lighter portion to the darker portion of the bar representing the magnitude of the error.

[0053] To identify or determine the features for the model, targeted next generation sequencing (NGS) was performed on plasma samples from 310 and 43 previously untreated DLBCL subjects enrolled in the GOYA study (A Study of Obinutuzumab in Combination With CHOP Chemotherapy Versus Rituximab With CHOP in Participants With CD20-Positive Diffuse Large B-Cell Lymphoma (GOYA; https: / / clinicaltrials.gov / ct2 / show / NCT01287741) and the Cavalli study (A Safety and Pharmacokinetics (PK) Study of Venetoclax in Participants With Non-Hodgkin's Lymphoma; https: / / clinicaltrials.gov / ct2 / show / NCT02055820), respectively, using an adapted version of the AVENIO ctDNA Analysis kit (Roche Sequencing Solutions, Pleasanton, California) workflow with a custom DLBCL-specific panel. Cell free DNA (cfDNA) was isolated from plasma, up to 50ng of which was used as input for sequencing. Library preparation and NGS were done with a ctDNA analysis workflow and a custom panel of 314kb in size designed to cover regions relevant for cell of origin determination and minimal residual disease in DLBCL. Single nucleotide variants (SNVs), insertions and / or deletions (indels) and fusions were called from sequencing data using upgraded versions of the AVENIO ctDNA Analysis variant callers, and non-tumor specific variants were filtered out using publicly available data such as COSMIC, dbSNP and ExAC.

[0054] COO for these subjects were predetermined from tissue using NanoString Lymph2Cx, a gene expression based assay. Lymph2Cx assay reports a Linear Predictor Score (LPS) for each sample that determines its subtype. When the LPS score is close to the ABC / GCB threshold, the assay does not assign a subtype and reports UNCLASSIFIED. LPS was used as the ground truth and the target for the prediction.

[0055] In some embodiments, a threshold LPS score can be determined, and samples with a score below the threshold score by a set or predetermined amount, such as about 5, 10, 15, 20, or 25 % below the threshold LPS score (i.e., a GCB threshold score), can be identified as GCB, and samples with a score above the threshold LPS score by a set or predetermined amount, such as about 5, 10, 15, 20, or 25% above the threshold (i.e., a ABC threshold score), can be identified as ABC, and samples with a score between the GCB threshold score and the ABC threshold score can be left unclassified. For example, in one embodiment, the threshold LPS core can be about 2170, the GCB threshold score can be about 1910; the ABC threshold score can be about 2430, and scores between about 2170 and 2430 can be unclassified.

[0056] The dataset was divided into the following groups as summarized in Table 2 below. Table 2Group Study Total Subjects ABC GCB Unclassified Building the modelGOYA2309910922Validation set (blind during training)GOYA80214415External dataset (blind set)Cavalli4141

[0057] An ensemble of XGBoost models, which may also be referred to as XGBoost predictors when used for feature selection, with low subsampling rates on the 230 subjects in the training and test sets was used to select significant features. Features considered were variant type-gene pairs and / or genes with any indels or fusions or SNV (e.g. fusion in BCL2 or indel in PIM1). In one case (MYD88 L273P), only a single variant within a gene was considered, as it is a known common driver for ABC-type DLBCL. The models were trained against LPS and the top 20 most significant features from a much larger pool of potential features were selected based on the improvement of prediction accuracy (gain), as shown in Table 3 (list of potential features) and Table 4 (top 20 features selected from pool of potential features by ensemble of XGBoost models) below. The selected feature list includes 13 SNVs, 6 indels and one fusion. FIG. 6 shows the number of subjects each potential feature was detected in and the difference between the subjects' subtypes. Table 3: Potential featuresVariantsEZH2_SNVHMCN1_SNVCAPZA3_SNVHIST1H2BC_IndelGNA13_SNVIRF8_SNVCD58_SNVB2M_IndelBCL2_FusionIGHJ5_IndelPTEN_IndelCCND3_SNVCD79B_SNVAC096579.13_IndelPIK3CD_IndelTNFRSF14_IndelPIM1_SNVCDKN2A_IndelTMSB4X_IndelSRRM2_SNVIGLL5_IndelDKC1_IndelMAP3K13_IndelSPRED2_IndelPIM1_IndelACTB_SNVKLHL14_SNVHIST1H2BC_SNVSGK1_SNVB2M_SNVPCDH17_SNVMYC_SNVMYD88L273P_SNVMALAT1_IndelBORCS8-MEF2B_IndelTBL1XR1_IndelSTAT6_SNVXPO1_IndelHIST1H4K_IndelFOXO1_SNVTNFRSF14_SNVRP11-731F5.2_IndelBCL6_SNVIGHG1_SNVP2RY8_SNVHIST1H1E_SNVHMCN1_IndelHIST1H1C_SNVCIITA_IndelLINGO2_SNVZFP42_SNVITPKB_SNVEGR1_SNVBCL6_IndelEPHA7_SNVIGKJ5_IndelATG5_IndelCREBBP_SNVBCR_Indelchr14 54_IndelIRF4_SNVIGHG4-MIR8071-2_IndelWDPCP_SNVCDKN2A_SNVS1PR2_SNVTLR2_SNVDTX1_SNVBTG2_SNVSOCS1_SNVSTAT3_SNVCD83_IndelKLHL6_IndelCD58_IndelBCL6_FusionPRDM1_SNVHIST1H3J_IndelCNTNAP2_SNVZFP36L1_IndelTP53_SNVKLHL6_SNVDNMT1_IndelBCL2_IndelIGHV2-70-IGHV3-71_IndelHIST1H2BK_IndelMC5R_SNVIGHJ6_IndelBCL10_SNVACTB_IndelHIST1H2BO_SNVGNA13_IndelCXCR4_IndelPIK3R1_SNVCARD11_SNVPAX5_IndelBTG1_IndelMYD88_SNVCD83_SNVBCL6-RP11-30015.1_IndelRP11-353P15.1-CTD-2320B12.3_IndelNFKBIA _SNVPTEN_SNVEP300_IndelTNFAIP3_SNVNOTCH2_SNVIGHG1_IndelBCL2_SNVACTG1_IndelBTG1_SNVIGHV2-70_IndelPDCD1LG2_SNVRP11-731F5.1_IndelCREBBP_IndelBRCA2_IndelXBP1_IndelBTG2_IndelMSH6_SNVTP53_IndelCXCR5_SNVBCL7A_IndelPCSK5_SNVMAGEC2_IndelGK2_SNVCXCR4_SNVPSD3_IndelEP300_SNVPCDHA1_IndelFAS_IndelF2RL2_SNVTET2_Indelchr14 14_IndelMUM1_IndelNFATC1_IndelSGK1_IndelFAS_SNVBMS1P8-ENPP7P13_IndelPCDH17_IndelPCLO_SNVCDH19_SNVACTG1_SNVMIR5195_IndelMAGEC2_SNVLRMP_IndelNMRAL2P_IndelPLCG2_SNVCD70_SNVMAP2K1_SNVCACNA1S_SNVKRAS_SNVS1PR2_IndelCD53_SNVHIST1H2AC_IndelKLF10_SNVDNAH5_IndelRHOH_IndelHIST1H3C_IndelZFP42_IndelHIST1H1D_SNVNFIA_SNVTCL1A_IndelBTG3_SNVLRRN3_SNVTNFAIP3_IndelTBL1XR1_SNVGSDMC_SNVBNC2_SNVTMSB4X_SNVIGHA1_IndelSCML4_SNVITPKB_IndelNEXMIF_IndelHIST1H3F_SNVCSMD1_SNVKMT2D_SNVLPP_IndelEGR1_IndelNCOA3_IndelMEX3C_SNVIGHJ4_IndelNOTCH1_SNVCSMD1_IndelTSPOAP1-AS1_IndelIGHV4-59_IndelTHBD_SNVIGHM_IndelBCR_SNVRFTN1_SNVMC5R_IndelFAT1_IndelHIST1H1E_IndelDUSP2_SNVP2RY8_IndelZEB2_SNVIMMP2L_IndelDMD_IndelHIST1H2BJ_IndelASAP1_IndelBRINP3_SNVchr14 15_IndelCLSTN2_SNVAHCYL1_IndelBCL10_IndelERICH1_SNVCD36_SNVWRAP73_SNVFGFR4_IndelGSDMC_IndelDNAH5_SNVIGHV3-7_IndelPOU2F2_SNVC1orf194_SNVID3_IndelPSD3_SNVHIST1H2AM_SNVDHX33_IndelCAPZA3_IndelMYO15A_SNVMYC_IndelSORCS2_SNVPOM121L2_SNVMPEG1_IndelIGLC2_IndelMIR4537_IndelPDCD1_SNVCFL1_SNVBIRC3_Indelchr14 9_IndelAFF3_IndelKLK13_IndelIRF8_IndelXBP1_SNVMFHAS1_SNVRHOA_IndelPPP4C_SNVHIST1H2AE_SNVIGKC_SNVFGFR4_SNVMYC_FusionIGLC3_IndelSRRM2_IndelLIPH_IndelSTAMBPL1_IndelHIST1H2AG_IndelLAMA1_SNVEZH2_IndelAC092170.1-AC009312.1_IndelDPAGT1_IndelACAD8_SNVBCL11A_SNVBRCA2_SNVBCHE_SNVTCL1A_SNVHOOK2_IndelRIMS2_SNVCD70_IndelBTK_IndelYTHDF2_SNVDSEL_SNVSTAT3_IndelZCCHC7-RP11-397D12.4_IndelHIST1H4K _SNVIRF1_SNVZEB2_IndelHIST1H2BM_SNVEDIL3_SNVRASSF9_SNVKCND2_SNVIZUMO3_SNVHIST1H3A_SNVMEF2B_SNVADAMTS9_SNVCACNA1E_IndelLINC00470-RP11-476K15.1_IndelHIST1H2AC_SNVCARD11_IndelAC246787.1_IndelNCAPD3_SNVJUNB_SNVKMT2D_IndelTNFRSF14-PABPC1_SNVAS1_IndelNFATC1_SNVHIST1H2BO_IndelClorf194_IndelCTNND2_SNVCOL22A1_IndelETS1_IndelHIST1H3F_IndelMORN1_IndelKLHL14_IndelLIPN_SNVIQGAP2_IndelIGKJ1_IndelMYD88_IndelMAGEB16_SNVMIR5571_IndelRUBCNL_IndelBCL2-KDSR_IndelNTNG1_SNVHIST1H3A_IndelTMEM30A_IndelIGHA2_IndelPOU2AF1_IndelIGKJ3_IndelTNFRSF1A_SNVKIF2B_SNVIGHV1-18_IndelKLHL4_SNVIRF1_IndelELAVL1_SNVEHBP1_IndelFBXW7_SNVPLCG2_IndelFAT1_SNVMAGEB16_IndelCRISPLD1_SNVZNF577_SNVSLITRK1_SNVAC118562.1-RP11-427M20.1_IndelLRP1B_SNVHIST1H2BG_SNVIGLV7-43_IndelIGLV3-1_IndelARID1A_IndelRBFA_IndelCD274_IndelHDAC7_SNVIGHV3-23_IndelMRO_SNVMED12_IndelIRF4_IndelIGHJ2P_IndelIGKV3D-11_IndelADAMTS9_IndelHIST1H2AE_IndelEIF2AK3_IndelELK2BP-IGHA2_IndelFOXO1_IndelMAP3K13_SNVIGHM_SNVIGLV1-41_IndelDTX1_IndelADAMTS16_SNVEPHA7_IndelIGKV3-20_IndelBACH2_IndelIGHD2-2_IndelHIST1H2BJ_SNVPLCL1_IndelEBF3_SNVBRAF_IndelREL_IndelSMAD4_SNVZFP36L1_SNVST6GAL1_IndelIGHG3_IndelSLC38A9_IndelIGHJ3P_IndelBTK_SNVCRYAB_IndelCDH19_IndelATP8B1_SNVHIST1H2BD_IndelMDH1_SNVHIST1H3D_IndelCD274_SNVKIAA2022_SNVNFKBIA_IndelIGHD3-3_IndelPCDHA6_SNVIZUMO3_IndelIGF2BP2_IndelLIPH_SNVNEAT1_IndelHAS2_SNVLINC02202_IndelRTN4_IndelMFHAS1_IndelIGHV4-34_IndelGRM7_IndelMPDZ_IndelHIST1H1B_SNVTMEM30A_SNVABCB11_IndelPLEKHG1_IndelRMI2_IndelADAMTS16_IndelUSP34_SNVIGHG4_SNVMPEG1_SNVHIST1H2AL _SNVDSEL_IndelELAC1_IndelKLHL25_SNVIGLJ2-IGLC2_Indelchr14 11_IndelIGHJ4_SNVARID1A_SNVACAD8_IndelIGLJ3_IndelELAC1_SNVERICH1_IndelKLK13_SNVHIST1H3C_SNVTAS2R16_SNVHIST1H2AJ_IndelHIST1H3H_SNVMYO15A_IndelMPDZ_SNVREL_SNVMYC-PVT1_IndelEHBP1_SNVHIST1H2BG_IndelIGHG2_IndelCASC11-MYC_IndelCTNND2_IndelIGLV3-9_IndelIGKC_IndelHIST1H2BN_IndelTGFBI _SNVPLCL1_SNVHIST1H3D_SNVchr14 17_IndelRASSF9_IndelKRAS_IndelCRISPLD1_IndelHIST1H1C_IndelIGHG3_SNVSERPINE3_SNVIGKJ4_IndelID3_SNVLIPM_SNVADAMTS1_SNVCTNNA2_SNVNOTCH1_IndelDLAT_IndelRHOA_SNVCCND3_IndelCXCR5_IndelCDH12_SNVchr2 28_IndelPXDN_SNVHIST1H3I _SNVIGHG2_SNVEPS8_IndelZNF608_SNVABCB11_SNVELAVL1_IndelDRG2_SNVBCHE_IndelHIST1H2AG_SNVKHDRBS3_SNVATP8B1_IndelCSMD3_SNVBCL11A_IndelCSMD3_IndelCOL22A1_SNVLRRTM4_SNVCOL24A1_SNVAFF1_IndelBRINP3_IndelTET2_SNVFAM30A_IndelNOTCH2_IndelHIST1H1B_IndelKLHL4_IndelCDKN2B_SNVCLSTN2_IndelCDKN2B-AS1_IndelPIK3C2G_SNVIGHA2-AL928742.1_IndelIGHV1-69_IndelCD79B_IndelGRM7_SNVHIST1H1D_IndelADAMTS1_IndelZNF608_IndelHIST1H2BK_SNVHIST1H2BD_SNVTRPS1_SNVHIST1H3B_SNVIGLV7-43-IGLVI-42_IndelXPO1_SNVBNC2_IndelSLC22A16_SNVIGHV4-39_IndelACVR2A_IndelIGHV3-48_Indelchr22 29_IndelSI_SNVDUSP2_IndelCNTNAP2_IndelRP11-44H4.1_IndelATP1B4_IndelARHGAP5_IndelNFRKB_SNVRER1_IndelIGHG4_Indel Table 4 Top 20 most significant features selected by the XGBoost models Feature Gain total EZH2_SNV4.320095226GNA13_SNV3.354813644BCL2_Fusion3.06984999CD79B_SNV2.329705116PIM1_SNV2.262074135IGLL5_Indel1.906037699PIM1_Indel1.71874648SGK1_SNV1.569275931MYD88L273P_SNV1.538712245STAT6_SNV1.535833008TNFRSF14_SNV1.386520606P2RY8_SNV1.355164869CIITA_Indel1.311255188EGR1_SNV1.255471684ATG5_Indel1.246242948IRF4_SNV1.226126648S1PR2_SNV1.203884924SOCS1_SNV1.202961181CD58_Indel1.171491699CNTNAP2_SNV1.079906928

[0058] An ensemble model of 100 XGBoost models was built that were parameterized similarly to compensate for the high variability due to data sparsity. See FIG. 7. Only 25 iterations of training were used for prediction to avoid overfitting to the training data. The median of predicted score from these models was used. While the range of predicted scores for the ABC and GCB subtypes were differentiable, the score ranges for the subjects in the UNCLASSIFIED subtype overlapped the ones for ABC subjects. Hence, the reported subtypes were labeled GCB and non-GCB.

[0059] The ensemble model did not detect any relevant variants in eight and four of the subjects in the validation and external datasets, so no calls were returned for them. One to ten features were detected for the remaining subjects in the validation and external datasets, with 62% of the subjects having less than four features. The results are summarized in FIGS. 8-10.

[0060] The results show that variant calls from plasma can be effective as a tissue-free method for COO calling in DLBCL subjects. The ensemble model described herein is a significant improvement over the cfDNA-based COO classifier described by Scherer. An ensemble of boosting algorithms can be an effective strategy to compensate for the bias introduced be a highly sparse dataset.2. Use of further variant location data in the classification algorithms:

[0061] The Scherer at al. method only uses the presence of a variant in a gene to contribute to COO classification. However, not every variant in a given gene is likely to have the same impact. For example, variants in kinase or other enzymatic regions of proteins are more likely to be oncogenic. For this reason, in some embodiment, incorporation of more information about the variants within a gene can be used to further refine COO calls. Using the exact position and / or information about the domain and / or structural motif and / or functional (i.e., enzymatic or binding) region of the protein which is modified within a gene can improve COO calling. Therefore, in some embodiments, the variant location data and / or the information regarding the modification of a particular domain and / or structural motif and / or functional region can be additional features that may be included in the collection of features analyzed by the classification algorithms described herein. In some embodiments, these features may be directly included in each tree or algorithm of the ensemble, rather than merely being included in the collection of features from with a subset of features is randomly selected.3. For plasma samples, use of the variant AF as more information to weigh the probabilities of each variant-containing gene or location:

[0062] Since the cell of origin is by definition clonal (it is the definition of the initial cell type from which DLBCL arose), variants that contribute to the cell of origin are more likely to be clonal variants than subclonal variants. In order to account for the likelihood of each variant to contribute to the COO information, the relative allele fractions (AF) of each variant detected can be incorporated into COO calling allowing heavier weighting of variants with higher AFs that are more likely to be clonal. This should allow separation of variants that truly represent cell of origin vs. the noise of low AF variants which only occurred well after tumorigenesis. Therefore, in some embodiments, the variant AF may be included in the collection of features analyzed by the classification algorithms. In some embodiments, these features may be directly included in each tree or algorithm of the ensemble, rather than merely being included in the collection of features from with a subset of features is randomly selected.Alternative embodiments

[0063] In some embodiments, instead of using an ensemble of XGBoost models for feature selection, other types of decision tree based models as described herein can be used for feature selection. Once the features are selected, an ensemble of XGBoost models or other decision tree based models can then be constructed. Feature selection can be performed as described above, or can be performed using another technique. For example, feature selection methods include supervised, unsupervised, and semi-supervised feature selection. See J. C. Ang, A. Mirzal, H. Haron and H. N. A. Hamed, "Supervised, Unsupervised, and Semi-Supervised Feature Selection: A Review on Gene Selection," in IEEE / ACM Transactions on Computational Biology and Bioinformatics, vol. 13, no. 5, pp. 971-989, 1 September 2016; Li, Jundong et al. "Feature Selection." ACM Computing Surveys 50.6 (2017): 1-45. Supervised feature selection involves using labeled data (i.e. labeled features), such as the identified genes and gene variants described above, in the feature selection process, while unsupervised feature selection involves unlabeled data and uses various structures and / or properties of the data, such as data variance, separability, and data distribution, in the feature selection process. Semi-supervised feature selection involves using a mix of labeled data with unlabeled data in the feature selection process.

[0064] In some embodiments, the data set can be separated into a training data set for feature evaluation and selection and constructing the model, and a validation data set for evaluating the performance and prediction accuracy of the models.

[0065] In some embodiments, features are classified and / or ranked according to their relevance or importance to the performance (i.e., prediction accuracy) of the model. In some embodiments, the features are also classified by their level of redundancy, by for example, identifying a level of correlation of one feature with one or more other features. In some embodiments, features that are highly correlated with another feature may be redundant and may be eliminated.

[0066] Feature evaluation can be performed using a variety of methods, such as the following: (1) filter or open-loop method that evaluate the feature characteristics based on dependency, information, distance, and consistency; (2) wrapper or closed looped method that uses error rate or performance accuracy to evaluate the features; (3) embedded method that integrates the feature selection algorithm into the machine learning algorithm; (4) hybrid model that utilizes two or more methods for feature evaluation, such as the filtering and wrapper methods; and (5) ensemble method that uses a plurality of models that each use a subsample of the data set for feature evaluation and selection, which are then combined and evaluated to form an aggregated set of selected features. Stopping criteria for determining when to stop the feature selection process can include (1) predetermined number of features, (2) predetermined number of iterations, (3) percentage of improvement over two consecutive iteration steps, and (4) use of an evaluation function (i.e. minimizing a cost or loss function).

[0067] When a feature or element is herein referred to as being "on" another feature or element, it can be directly on the other feature or element or intervening features and / or elements may also be present. In contrast, when a feature or element is referred to as being "directly on" another feature or element, there are no intervening features or elements present. It will also be understood that, when a feature or element is referred to as being "connected", "attached" or "coupled" to another feature or element, it can be directly connected, attached or coupled to the other feature or element or intervening features or elements may be present. In contrast, when a feature or element is referred to as being "directly connected", "directly attached" or "directly coupled" to another feature or element, there are no intervening features or elements present. Although described or shown with respect to one embodiment, the features and elements so described or shown can apply to other embodiments. It will also be appreciated by those of skill in the art that references to a structure or feature that is disposed "adjacent" another feature may have portions that overlap or underlie the adjacent feature.

[0068] Terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. For example, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof. As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".

[0069] Spatially relative terms, such as "under", "below", "lower", "over", "upper" and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if a device in the figures is inverted, elements described as "under" or "beneath" other elements or features would then be oriented "over" the other elements or features. Thus, the exemplary term "under" can encompass both an orientation of over and under. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly. Similarly, the terms "upwardly", "downwardly", "vertical", "horizontal" and the like are used herein for the purpose of explanation only unless specifically indicated otherwise.

[0070] Although the terms "first" and "second" may be used herein to describe various features / elements (including steps), these features / elements should not be limited by these terms, unless the context indicates otherwise. These terms may be used to distinguish one feature / element from another feature / element. Thus, a first feature / element discussed below could be termed a second feature / element, and similarly, a second feature / element discussed below could be termed a first feature / element without departing from the teachings of the present invention.

[0071] Throughout this specification and the claims which follow, unless the context requires otherwise, the word "comprise", and variations such as "comprises" and "comprising" means various components can be co-jointly employed in the methods and articles (e.g., compositions and apparatuses including device and methods). For example, the term "comprising" will be understood to imply the inclusion of any stated elements or steps but not the exclusion of any other elements or steps.

[0072] As used herein in the specification and claims, including as used in the examples and unless otherwise expressly specified, all numbers may be read as if prefaced by the word "about" or "approximately," even if the term does not expressly appear. The phrase "about" or "approximately" may be used when describing magnitude and / or position to indicate that the + / - 10% of the stated value (or range of values), etc. Any numerical values given herein should also be understood to include about or approximately that value, unless the context indicates otherwise. For example, if the value "10" is disclosed, then "about 10" is also disclosed. Any numerical range recited herein is intended to include all sub-ranges subsumed therein. It is also understood that when a value is disclosed that "less than or equal to" the value, "greater than or equal to the value" and possible ranges between values are also disclosed, as appropriately understood by the skilled artisan. For example, if the value "X" is disclosed the "less than or equal to X" as well as "greater than or equal to X" (e.g., where X is a numerical value) is also disclosed. It is also understood that the throughout the application, data is provided in a number of different formats, and that this data, represents endpoints and starting points, and ranges for any combination of the data points. For example, if a particular data point "10" and a particular data point "15" are disclosed, it is understood that greater than, greater than or equal to, less than, less than or equal to, and equal to 10 and 15 are considered disclosed as well as between 10 and 15. It is also understood that each unit between two particular units are also disclosed. For example, if 10 and 15 are disclosed, then 11, 12, 13, and 14 are also disclosed.

Claims

1. A computer-implemented method for cell of origin determination for a type of cancer, wherein the type of cancer is diffuse large B cell lymphoma, the method comprising: constructing a plurality of decision trees based on a collection of features, each decision tree comprising a random subset of features from the collection of features, wherein the features are genes that were identified based on one or more criteria from a plurality of blood or plasma samples from subjects having the type of cancer, wherein at least 10 of the features from the collection of features is selected from the group of genes consisting of EZH2, SGK1, GNAI3, IRF8, TNFRSF14, STAT6, BCL7A, KMT2D, SOCS1, RHOA, BCL2, STAT3, POU2F2, CD83, NFKBIA, CREBBP, CD58, TET2, KLHL6, CARD11, BCL6, MYC, PAX5, ZNF608, DUSP2, FOXO1, EP300, CCND3, ETS1, TMEM30A, PRDM1, IRF4, KLHL14, PIM1, IGLL5, CDKN2A, TBL1XR1, ZEB2, CD79B, MYD88, and wherein the criteria for identifying a gene comprises at least one of the following conditions: (1) at least about 2% of the subjects from a first cell of origin class or a second cell of origin class have a variant in the gene; (2) at most about 30% of all subjects with variants in the gene are unclassified; and (3) a ratio of a first cell of origin class to a second cell of original class GCB or a ratio of the second cell of original class to the first cell of origin class is at least 55:45; and training the plurality of decision trees based on the collection of features to create a cell of origin classifier receiving a file comprising variant data from a patient, wherein the variant data was obtained from a blood or plasma sample from the patient; and using the cell of origin classifier to determine a cell of origin based on the variant data in the file.

2. The method of claim 1, wherein at least 20 of the features from the collection of features is selected from the group of genes consisting of EZH2, SGK1, GNAI3, IRF8, TNFRSF14, STAT6, BCL7A, KMT2D, SOCS1, RHOA, BCL2, STAT3, POU2F2, CD83, NFKBIA, CREBBP, CD58, TET2, KLHL6, CARD11, BCL6, MYC, PAX5, ZNF608, DUSP2, FOXO1, EP300, CCND3, ETS1, TMEM30A, PRDM1, IRF4, KLHL14, PIM1, IGLL5, CDKN2A, TBL1XR1, ZEB2, CD79B, MYD88.

3. The method of claim 1, wherein at least 30 of the features from the collection of features is selected from the group of genes consisting of EZH2, SGK1, GNAI3, IRF8, TNFRSF14, STAT6, BCL7A, KMT2D, SOCS1, RHOA, BCL2, STAT3, POU2F2, CD83, NFKBIA, CREBBP, CD58, TET2, KLHL6, CARD11, BCL6, MYC, PAX5, ZNF608, DUSP2, FOXO1, EP300, CCND3, ETS1, TMEM30A, PRDM1, IRF4, KLHL14, PIM1, IGLL5, CDKN2A, TBL1XR1, ZEB2, CD79B, MYD88.

4. The method of claim 1, wherein one of the features in the collection is variant location data.

5. The method of claim 4, wherein the variant location data comprises at least one of: (1) a position of a variant in a gene; (2) information about a domain region of a protein which is modified in a variant; (3) information about a structural motif of a protein which is modified in a variant; and (4) functional region of a protein which is modified in a variant.

6. The method of claim 1, wherein one of the features in the collection is variant allele fraction data.