Nanopore measurement signal analysis
The method uses a slice machine learning system to combine array and signal slices for enhanced detection of modified polymer units during nanopore translocation, addressing sensitivity limitations and improving accuracy in detecting chemical modifications in DNA and RNA.
Patent Information
- Application Number
- JP2024523741
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-11-29
- Filing Date
- 2022-11-23
- Publication Date
- 2024-11-19
Smart Images

Figure 2024542960000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to the analysis of measurement signals derived from a polymer, for example but not limited to a polynucleotide, during the translocation of the polymer into a nanopore. [Background technology]
[0002] Measurement systems are known for estimating the target sequence of polymer units in a polymer using a nanopore, in which the polymer is translocated relative to the nanopore. Some properties of the system, such as the current through the nanopore, depend on the interaction of the polymer units with the nanopore, and measurements of the properties are obtained. This property depends on the identity of the polymer units that translocate relative to the nanopore, so the signal over time allows the sequence of the polymer units to be estimated. Each polymer unit can be very small compared to the dimensions of the pore, which allows multiple polymer units to affect the signal in a given period of time. There can also be longer-range effects due to interactions between the polymer chains and the nanopore, intrachain properties such as rolling or stacking, or interactions between the polymer units and any system used to control their translocation. Summary of the Invention
[0003] The measurement signal needs to be analyzed to estimate the underlying polymer units. The accuracy of such an analysis is limited due to the extreme sensitivity of the measurement system. As a practical matter, high accuracy estimation requires the application of complex algorithms. Such an analysis can be performed using machine learning systems, e.g. neural networks, to provide an output representing an estimate of the identity of the polymer units within the polymer, e.g. nucleotides if the polymer is a polynucleotide.
[0004] The present invention is directed to improving such analyses to improve the estimation of polymer units. [Means for solving the problem]
[0005] Some embodiments of the invention relate to the detection of modified forms of canonical polymer units. In the case of DNA polynucleotides, the canonical nucleotides can be any of the four bases, adenosine, guanosine, cytidine, thymidine, and the modified forms can be nucleotides in which a covalent chemical modification is present, such as 5-methyl-cytosine (5mC), 5-hydroxymethyl-cytosine (5hmC), and 6-methyl-adenosine (6mA).
[0006] Chemical modifications to DNA and RNA can affect the function of DNA and RNA by regulating gene expression, and chemical modifications play an important role in the epigenetic control of gene expression (the way genes are read) in animals and plants. Thus, there is a significant need to be able to determine modifications to both DNA and RNA during sequencing. Due to the chemical nature of many common biological modifications, it is often difficult to detect modified bases. As a result, methods have been developed to convert modified bases and aid in their detection. Bisulfite sequencing involves treating DNA with bisulfite to determine methylation, converting canonical cytosine (but not 5mC or 5hmC) to uracil (U), so that canonical cytosine can be fairly easily distinguished from 5mC and 5hmC (but not 5mC and 5hmC) (e.g., Yu, M., Hon, GC, Szulwach, KE, Song, C., Jin, P., Ren, B., He, C. Tet-assisted bisulfite sequencing of 5-hydroxymethylcytosine: Nat. Protocols 2012, 7, 2159). Methods have been developed to distinguish 5mC from 5hmC (e.g., Liu Y, Siejka-Zielinska P, Velikova G, Bi Y, Yuan F, Tomkova M, Bai C, Chen J. et al., J. Immunol. 2013, 13, 111-115). L, Schuster-Bockler B, Song CX. Bisulfite-free direct detection of 5-methylcytosine and 5-hydroxymethylcytosine at base resolution. Nat Biotechnol. 2019 Apr;37(4):424-429. doi:10.1038 / s41587-019-0041-2. Epub 2019 Feb 25. PMID:30804537), but there are no known methods for converting many other common and biologically important modified bases.Furthermore, treatment with bisulfite can result in degradation of DNA, and incomplete desulfonation of pyrimidine residues during the conversion reaction can make subsequent amplification of the DNA difficult due to inhibition of some polymerases.Therefore, there is a need to be able to detect modifications directly without relying on external data (converted sequence data using bisulfite) or requiring chemical or other pretreatment modification steps.
[0007] Such modifications change the measurement signal derived from the polymer during its translocation into the nanopore, which in principle makes it possible to detect modified forms of the canonical polymer units, however such detection can be difficult in practice since the changes in the measurement signal are typically small.
[0008] Other embodiments of the invention relate to providing estimates of the identity of one or more target polymer units, thereby enabling detection of errors in previously derived estimates of the sequence of the polymer units and / or detection of changes from a reference sequence.
[0009] According to a first aspect of the present invention, there is provided a method of analysing a measurement signal measured from a polymer during translocation of the polymer through a nanopore, the polymer comprising an array of polymer units, the method comprising deriving an input sequence estimate of the array of polymer units and a mapping between the measured signal and the input sequence estimate, and supplying a sequence slice derived from a slice of the input sequence estimate around a target polymer unit within the array of polymer units, and a signal slice of the measured signal, the sequence slice and the signal slice being mapped to each other by the mapping as input to a slice machine learning system which provides an output representing an estimate of the identity of the target polymer unit.
[0010] The inventors have shown that when a sequence slice derived from a slice of the input sequence estimate around a target polymer unit in a sequence of polymer units and a signal slice of the measured signal are used, and the sequence slice and signal slice are mapped to each other by a mapping between the measured signal and the input sequence estimate, an estimate of the identity of the target polymer unit is provided with higher accuracy compared to other techniques.
[0011] The input sequence estimate can take different forms.
[0012] In one form, the input sequence estimate may be an initial estimate of the sequence of polymer units provided as the output of an initial machine learning system to which the measured signal is provided as input.
[0013] In another form, the input sequence estimate can be a reference sequence for the polymer, for example a known reference extracted from a library, or a consensus sequence derived from a plurality of measurement signals derived from a common polymer. In that case, the mapping between the measurement signal and the input sequence estimate, i.e., the reference sequence, can be derived using an initial machine learning system that receives the measurement signal as input and provides an output that is an initial sequence estimate of the sequence of the polymer unit. Then, both the reference mapping between the reference sequence and the initial sequence estimate, and the signal mapping between the measurement signal and the initial sequence estimate can be derived. This allows the desired mapping to be derived from the reference mapping and the signal mapping.
[0014] In some types of embodiments, the output may represent an estimate of the identity of the subject polymeric unit between a category that includes the canonical polymeric unit and at least one modified form of the canonical polymeric unit, allowing detection of the modified form of the canonical polymeric unit with high accuracy.
[0015] In another type of embodiment, the output may represent an estimate of the identity of the subject polymeric unit among categories comprising the set of canonical polymeric units, allowing for detection of errors in previously derived estimates of the sequence of the polymeric units and / or detection of changes from a reference sequence.
[0016] The method may be performed on a single polymer unit of interest or on multiple polymer units of interest within a sequence of polymer units, for example, the method may be applied to a polymer unit of interest that forms part of a predetermined motif, such as a CpG site that is known to be relatively likely to be modified.
[0017] According to a second aspect of the invention there is provided a computer program comprising instructions which, when executed by a computer, cause the computer to carry out the method according to the first aspect of the invention. The computer program may be stored on a computer storage medium.
[0018] According to a third aspect of the invention, there is provided a method comprising deriving a measurement signal from a polymer during translocation of the polymer relative to a nanopore, the polymer comprising a sequence of polymer units, and analysing the measurement signal using a method according to the first aspect of the invention.
[0019] According to a fourth aspect of the invention there is provided an analytical apparatus comprising a processor configured to carry out the method according to the first aspect of the invention. The analytical apparatus may form part of a nanopore measurement and analysis system further comprising a measurement system configured to derive a measurement signal from the polymer during translocation of the polymer relative to the nanopore.
[0020] According to a fifth aspect of the present invention, there is provided a method for training a slice machine learning system to provide an output representing an estimate of the identity of a target polymer unit of a polymer by providing to the machine learning system a training signal comprising a plurality of pairs of training sequence slices around a target polymer unit within a sequence of polymer units of the polymer, and a training signal slice of a measured measurement signal from the polymer during translocation of the polymer relative to the nanopore.
[0021] To enable a better understanding, embodiments of the invention will now be described, by way of non-limiting example, with reference to the accompanying drawings, in which: [Brief description of the drawings]
[0022] [Figure 1] FIG. 1 is a schematic diagram of a nanopore measurement and analysis system. [Diagram 2] 1 is a plot of a typical measurement signal over time. [Diagram 3] 1 is a flowchart of a method for deriving initial sequence estimates using an initial machine learning system. [Figure 4] 4 is a flow chart illustrating a method for deriving an initial mapping between an initial sequence estimate and a measured signal. [Diagram 5] 1 is a flowchart of a method for deriving outputs using a sliced machine learning system. [Figure 6] 1 is a flow chart illustrating a method for deriving input mappings in an example where the input sequence estimate is a reference sequence. [Figure 7] 13A-13C are diagrams illustrating a method for generating array slices mapped to signal slices. [Figure 8] FIG. 1 illustrates an example of a sliced machine learning system that is a neural network. [Figure 9] FIG. 1 illustrates training of a neural network as an example of a slice machine learning system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] 1 illustrates a nanopore measurement and analysis system 1, which includes a measurement system 2 and an analysis system 3. The measurement system 2 derives a measurement signal 10 from a polymer comprising a series of polymer units during translocation of the polymer into the nanopore. The analysis system 3 performs a method for analyzing the measurement signal 10 to derive an estimate of the series of polymer units.
[0024] In general, the polymer can be of any type, for example, a polynucleotide (or nucleic acid), a polypeptide such as a protein, or a polysaccharide. The polymer can be natural or synthetic. The polynucleotide can include homopolymeric regions. The homopolymeric regions can include between 5 and 15 nucleotides.
[0025] In the case of polynucleotides or nucleic acids, the polymeric units can be nucleotides. Polynucleotides can typically be deoxyribonucleic acid (DNA), ribonucleic acid (RNA), or synthetic nucleic acids known in the art, such as peptide nucleic acid (PNA), glycerol nucleic acid (GNA), threose nucleic acid (TNA), locked nucleic acid (LNA), or other synthetic polymers with nucleotide side chains. The PNA backbone is composed of repeating N-(2-aminoethyl)-glycine units linked by peptide bonds. The GNA backbone is composed of repeating glycol units linked by phosphodiester bonds. The TNA backbone is composed of repeating threose sugars linked together by phosphodiester bonds. LNA is formed from the ribonucleotides discussed above with an extra bridge connecting the 2' oxygen and the 4' carbon in the ribose moiety. Nucleic acids can be single-stranded, double-stranded, or contain both single-stranded and double-stranded regions. Nucleic acids can include a single strand of RNA hybridized to a single strand of DNA. Typically, the cDNA, RNA, GNA, TNA, or LNA is single stranded.
[0026] The polymer unit can be any type of nucleotide. The nucleotide can be a natural or artificial nucleotide. For example, the method can be used to verify the sequence of a manufactured oligonucleotide. The nucleotide typically contains a nucleobase, a sugar, and at least one phosphate group. The nucleobase and the sugar form a nucleoside. The nucleobase is specifically adenine, guanine, thymine, uracil, and cytosine. The sugar is typically a pentose sugar. Suitable sugars include, but are not limited to, ribose and deoxyribose. The nucleotide is typically a ribonucleotide or a deoxyribonucleotide. The nucleotide typically contains a monophosphate, a diphosphate, or a triphosphate.
[0027] A polymer unit can be a canonical polymer unit. For example, if the polymer is a DNA polynucleotide, the canonical bases are adenine (A), cytosine (C), guanine (G), and thymine (T). In contrast, ribonucleic acid (RNA) contains the canonical bases A, C, and G, with uracil (U) instead of thymine.
[0028] The nucleotide may be a modified polymer unit, such as a damaged base or an epigenetic base. For example, the polynucleotide may contain pyrimidine dimers. Such dimers are typically associated with UV damage and are the main cause of skin melanoma. The nucleotide may be labeled or modified to act as a marker with a distinct signal. This technique may be used, for example, to identify missing bases in a polynucleotide, such as abasic units or spacers. The method may also be applied to any type of polymer.
[0029] In the case of polypeptides, the polymer units can be naturally occurring or synthetic amino acids.
[0030] In the case of a polysaccharide, the polymer units may be monosaccharides.
[0031] In particular, where the measurement system 2 comprises a nanopore and the polymer comprises a polynucleotide, the polynucleotide under investigation may typically range in length from 500 nucleotides (500b) to over 2 Mb in length. However, polynucleotides of shorter lengths may be measured with a lower limit estimated to be approximately 10-20 bases in length depending on the length of the nanopore channel, including mRNA, tRNA and cfDNA.
[0032] The characteristics of the measurement system 2 and the resulting measurement signal 10 are as follows:
[0033] The measurement system 2 is a nanopore system comprising one or more nanopores. In a simple version, the measurement system 2 has only a single nanopore, but more practical measurement systems 2 employ multiple nanopores, typically in an array, to provide parallel collection of information.
[0034] The measurement signal 10 may be recorded during translocation of the polymer to, and typically through, the nanopore.
[0035] Nanopores are pores that typically have a size on the order of nanometers, which allows polymers to pass through them.
[0036] The nanopore may be a protein pore or a solid pore. The dimensions of the pore may be such that only one polymer at a time can translocate the pore.
[0037] When the nanopore is a protein pore, it may have the following properties:
[0038] The biological pore may be a transmembrane protein pore. The transmembrane protein pore for use according to the present invention may be derived from a β-barrel pore or an α-helix bundle pore. A β-barrel pore comprises a barrel or channel formed from β-strands. Suitable β-barrel pores include, but are not limited to, β-toxins such as α-hemolysin, anthrax toxin, and leukocidin, and bacterial outer membrane proteins / porins such as Mycobacterium smegmatisporin (Msp), e.g., MspA, MspB, MspC, or MspD, lysenin, outer membrane porin F (OmpF), outer membrane porin G (OmpG), outer membrane phospholipase A, and Neisseria autotransporter lipoprotein (NalP). An α-helix bundle pore comprises a barrel or channel formed from α-helices. Suitable α-helix bundle pores include, but are not limited to, inner membrane proteins and α-outer membrane proteins, e.g., WZA and ClyA toxins. The transmembrane pore may be derived from Msp or α-hemolysin (α-HL). The transmembrane pore may be derived from lysenin. A suitable pore derived from lysenin is disclosed in WO2013 / 153359. A suitable pore derived from MspA is disclosed in WO2012 / 107778. The pore may be derived from CsgG, as disclosed in WO-2016 / 034591 and WO2019 / 002893, both of which are incorporated herein by reference in their entirety. The pore may be a DNA origami pore.
[0039] The protein pore may be a naturally occurring pore or may be a mutant pore.
[0040] The protein pore can be inserted into an amphiphilic layer, such as a biological membrane, for example a lipid bilayer. An amphiphilic layer is a layer formed from amphiphilic molecules, such as phospholipids, that have both hydrophilic and lipophilic properties. The amphiphilic layer can be a monolayer or a bilayer. The amphiphilic layer can be a coblock polymer, as disclosed in Gonzalez-Perez et al., Langmuir, 2009, 25, 10447-10450, WO2014 / 064444, or US6723814, which are incorporated herein by reference in their entirety. Alternatively, the protein pore can be inserted into an opening in a solid layer, as disclosed, for example, in WO2012 / 005857.
[0041] A suitable apparatus for providing an array of nanopores is disclosed in WO-2014 / 064443. Nanopores may be provided across each well and electrodes are provided in each respective well in electrical communication with an ASIC for measuring current flow through each nanopore. A suitable current measuring apparatus may include a current sensing circuit as disclosed in WO-2016 / 181118.
[0042] The nanopore may comprise an opening formed in a solid layer, which may be referred to as a solid pore. The opening may be a well, gap, channel, trench, or slit provided in the solid layer through which the analyte may pass along or enter the opening. Such a solid layer is not of biological origin. In other words, the solid layer is not derived from or isolated from a biological environment such as an organism or cell, or a synthetically manufactured version of a biologically available structure. The solid layer may be formed from both organic and inorganic materials, including but not limited to microelectronic materials, insulating materials such as Si3N4, A1203, and SiO, organic and inorganic polymers such as polyamides, plastics such as Teflon or elastomers such as two-component addition cure silicone rubber, and glass. The solid layer may be formed from graphene. Suitable graphene layers are disclosed in WO-2009 / 035647, WO-2011 / 046706, or WO-2012 / 138357. A suitable method for preparing an array of solid-state pores is disclosed in WO2016 / 187519.
[0043] Such solid-state pores are typically openings in a solid layer. The openings can be modified chemically or otherwise to enhance their properties as nanopores. Solid-state pores can be used in combination with additional components that provide alternative or additional measurements to the polymer, such as tunneling electrodes (Ivanov AP et al., Nano Lett. 2011 Jan 12; 11(1): 279-85), or field effect transistor (FET) devices (e.g., as disclosed in WO-2005 / 124888). Solid-state pores can be formed by known processes, including, for example, the processes described in WO-00 / 79257.
[0044] The nanopore may be a hybrid of a solid pore and a protein pore.
[0045] The measurement system 2 performs a series of measurements of a property that depends on the polymer units that translocate relative to the pores. The series of measurements forms a measurement signal 10.
[0046] The measured property may be related to the interaction between the polymer and the pore, which may occur in the constricted region of the pore.
[0047] In one type of measurement system 2, the measured property can be the ionic current flowing through the nanopore. These and other electrical properties can be performed using standard single channel recording equipment as described in Stoddart D et al., Proc Natl Acad Sci, 12; 106(19): 7702-7, Lieberman KR et al, J Am Chem Soc. 2010; 132(50): 17961-72, and WO-2000 / 28312. Alternatively, the measurement of electrical properties can be performed using multi-channel systems as described, for example, in WO-2009 / 077734, WO-2011 / 067559, or WO-2014 / 064443.
[0048] Ionic solutions may be provided on either side of the membrane layer or the solid layer, and these ionic solutions may be present in the respective compartments. A sample containing the polymer analyte of interest may be added to one side of the membrane and allowed to migrate relative to the nanopore, e.g., under a potential difference or chemical gradient. A measurement signal 10 may be derived during the migration of the polymer relative to the pore, e.g., obtained during translocation of the polymer through the nanopore. The polymer may partially translocate the nanopore.
[0049] To allow measurements to be taken as the polymer translocates through the nanopore, the rate of translocation can be controlled by the polymer-binding moiety. Typically, the moiety can move the polymer through the nanopore with or against an applied electric field. The moiety can be a molecular motor using enzymatic activity, for example when the moiety is an enzyme, or a molecular brake. When the polymer is a polynucleotide, there are several methods proposed to control the rate of translocation, including the use of polynucleotide-binding enzymes. Suitable enzymes for controlling the rate of translocation of polynucleotides include, but are not limited to, polymerases, helicases, exonucleases, single-stranded and double-stranded binding proteins, and topoisomerases such as gyrases. For other polymer types, moieties that interact with the polymer type can be used. Polymer interacting moieties have been disclosed in WO2010 / 086603, WO2012 / 107778, and Lieberman KR et al, J Am Chem Soc. 2010; 132(50): 17961-72) and voltage gating methods have been disclosed (Luan B et al., Phys Rev Lett. 2010; 104(23): 238103). The rate of polymer translocation through the nanopore can be controlled by voltage controlled pulses for the step of passing the polymer through the nanopore, as disclosed in WO2019 / 006214. Polymer translocation can be controlled by a molecular hopper, as disclosed in WO2020 / 016573.
[0050] The polymer-binding moiety can be used in several ways to control the movement of the polymer. The moiety can move the polymer through the nanopore with or against an applied electric field. The polynucleotide-binding enzyme does not need to exhibit enzymatic activity, as long as it can bind the target polynucleotide and control the movement of the target polynucleotide through the pore. For example, the enzyme can be modified to remove its enzymatic activity or used under conditions that prevent it from acting as an enzyme. Such conditions are discussed in more detail below.
[0051] The polynucleotide binding enzyme may be a Dda helicase as disclosed in WO2015 / 055981, the entirety of which is incorporated herein by reference.
[0052] Translocation of the polymer through the nanopore can occur either cis to trans or trans to cis, either with or against an applied potential. Translocation can occur under an applied potential, which can control the translocation. The bound enzyme is typically held against the cis or trans opening of the nanopore during translocation of the polynucleotide through the nanopore under an applied potential.
[0053] Exonucleases that act processively or processively on double-stranded DNA can be used on the cis side of the pore to deliver the remaining single strand under an applied potential or on the trans side under a reverse potential. Similarly, helicases that unwind double-stranded DNA can be used in a similar manner. There are also potential sequencing applications that require strand translocation against an applied potential, but the DNA must first be "captured" by the enzyme under a reverse or no potential. Then, when the potential is returned following binding, the strand passes through the pore from cis to trans and is held in an extended conformation by current flow. Single-stranded DNA exonucleases or single-stranded DNA-dependent polymerases can act as molecular motors to pull the newly translocated single strand back through the pore in a controlled, stepwise manner from trans to cis against an applied potential. Alternatively, single-stranded DNA-dependent polymerases can act as molecular brakes that slow down the movement of the polynucleotide through the pore. To control the movement of the polymer, any of the moieties, techniques, or enzymes described in WO2012 / 107778 or WO2012 / 033524 may be used.
[0054] However, the measurement system 2 may be an alternative type of system that includes one or more nanopores.
[0055] Similarly, the measured property can be a type of property other than ionic current. Some examples of alternative types of properties include, but are not limited to, electrical properties and optical properties. Suitable optical methods, including the measurement of fluorescence, are disclosed by J.Am.Chem.Soc.2009,131 1652-1653. Possible electrical properties include ionic current, impedance, tunneling properties, such as tunneling current (e.g., as disclosed in Ivanov AP et al., Nano Lett.2011 Jan 12;11(1):279-85), and FET (field effect transistor) voltage (e.g., as disclosed in WO2005 / 124888). One or more optical properties can be used, optionally combined with electrical properties (Soni GV et al., Rev Sci Instrum.2010 Jan;81(1):014301). The property can be a transmembrane current, such as an ionic current flow through a nanopore. The ion current may typically be a DC ion current, although in principle an AC current flow (ie, the magnitude of an AC current that flows under the application of an AC voltage) may be used as an alternative.
[0056] In some types of measurement systems 2, the measurement signal 10 can be characterized as including measurements from a series of events, each event providing a group of measurements. FIG. 2 illustrates a typical example of such a measurement signal 10 when measuring current. The group of measurements from each event has a similar level, but with some differences. This can be considered as a noisy step wave, with each step corresponding to an event. The events can have biochemical significance, for example, resulting from a given state or interaction of the measurement system 2. This can result in some cases from the translocation of a polymer through a nanopore occurring in a ratchet fashion. However, this type of signal is not generated by all types of measurement systems, and the methods described herein are not dependent on the type of signal. For example, when the translocation rate approaches the measurement sampling rate, for example when measurements are made at 1, 2, 5, or 10 times the translocation rate of the polymer units, events may be less clear or absent compared to slower sequencing rates or faster sampling rates.
[0057] In addition, when an event is present, there is usually no a priori knowledge of the number of measurements in a group, and the number of measurements varies unpredictably. These variances and lack of knowledge of the number of measurements can make it difficult to distinguish some of the groups, for example when the groups are short and / or the levels of measurements in two consecutive groups are close to each other.
[0058] The set of measurements corresponding to each event typically has a consistent level over the time scale of the event, but in most types of measurement systems 2 may be dispersed over short time scales. Such dispersion may arise for example from measurement noise arising from the electrical circuitry and signal processing, and in particular from amplifiers in the specific case of electrophysiology. Such measurement noise is unavoidable due to the small magnitude of the properties being measured. Such dispersion may also arise from inherent variations or spread of the physical or biological system underlying the measurement system 2, e.g. changes in interactions that may be caused by conformational changes in a polymer.
[0059] Most types of measurement systems 2 experience, to a greater or lesser extent, such inherent variations. For any given type of measurement system 2, both sources of variation may contribute, or one of these noise sources may dominate.
[0060] As the sequencing rate, which is the rate at which polymer units translocate relative to the nanopore, increases, events become less prominent and therefore difficult to identify or may be lost, and analytical methods that rely on such event detection may therefore become less efficient as the sequencing rate increases.
[0061] However, the methods disclosed herein do not depend on the detection of such events.The methods described below are also effective at relatively fast sequencing rates, including sequencing rates at which the polymer translocates at a rate of at least 10 polymer units per second, preferably 100 polymer units per second, more preferably 500 polymer units per second, or more preferably 1000 polymer units per second.
[0062] The sample rate is the rate at which measurements are taken on a signal. Typically, the sample rate is faster than the sequencing rate. For example, the sample rate may be in the range of 100 Hz to 30 kHz, but this is not limiting. In practice, the sample rate may depend on the nature of the measurement system 2.
[0063] The analysis system 3 may be physically associated with the measurement system 2 and may also provide control signals to the measurement system 2. In that case, the nanopore measurement and analysis system 1 comprising the measurement system 2 and the analysis system 3 may be configured as disclosed in any of WO-2008 / 102210, WO-2009 / 07734, WO-2010 / 122293, WO-2011 / 067559, or WO2014 / 04443.
[0064] Alternatively, the analysis system 3 may be implemented in a separate device, in which case the series of measurements are transferred from the measurement system 2 to the analysis system 3 by any suitable means, typically a data network. For example, one convenient cloud-based implementation is for the analysis system 3 to be a server that is supplied with input signals via the internet.
[0065] The analysis system 3 may be implemented by a computing device running a computer program, by a dedicated hardware device, or by any combination thereof. In either case, the data used in the method is stored in the memory of the analysis system 3.
[0066] In the case of a computing device that executes a computer program, the computing device may be any type of computer system, but is typically of conventional construction. The computer program may be written in any suitable programming language. The computer program may be stored on a computer-readable storage medium, which may be of any type, for example, a storage medium that can be inserted into a drive of a computing system and that can store information magnetically, optically or magneto-optically, a fixed storage medium of a computer system such as a hard drive, or a computer memory.
[0067] If the computing device is implemented by a dedicated hardware device, any suitable type of device may be used, for example an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). In a preferred embodiment, parts of the computer program may be implemented using hardware that embraces parallelization of computations, such as a Graphics Processing Unit (GPU).
[0068] A method of using the nanopore measurement and analysis system 1 is carried out as follows.
[0069] The measurement signal 10 is derived using the measurement system 2. For example, a polymer is translocated through and relative to the pore, and the measurement signal 10 is derived while the polymer is translocating. The polymer may be translocated relative to the pore by providing conditions that allow for the polymer to translocate, such that the translocation may occur spontaneously. The analysis system 3 implements a method for analyzing the measurement signal 10, as will now be described.
[0070] The measurement signal 10 is a raw nanopore signal representative of a measurement made by the measurement signal. Typically, the measurement system 2 uses a sensor to make the measurement and derives a value output from a data acquisition device (DAQ) having, for example, a digital to analog converter (DAC), a digital integer value representing the signal read out from the nanopore sequencing device. Typically, the absolute level of the output from the DAQ depends on the electronics used. Therefore, to make the signal more useful, as in most of the known nanopore analysis systems, the measurement signal 10 is normalized before subsequent processing, which will be described below.
[0071] Several methods for performing this signal normalization process are known in the art. For example, such normalization may involve centering the measurement signal 10 at zero and scaling the measurement signal 10 to have an approximate standard deviation of one. Alternatively, the normalization aims to reflect a physical current measurement (in amperes or picoamperes). Other signal normalization processes are also known. Optionally, the signal normalization process may change the sampling rate.
[0072] In this context, the term "raw", when used to describe the measurement signal 10, refers to the normalized signal 10 after such normalization, and not to the output from the DAQ.
[0073] 3 illustrates a method of deriving an initial sequence estimate 12 of the sequence of polymer units of a polymer from which a measurement signal 10 is obtained using an initial machine learning system 11. Specifically, the measurement signal 10 is provided as an input to the initial machine learning system 11, which is trained to provide an output that is the initial sequence estimate 12. In general, the initial machine learning system 11 may take any suitable form, but is typically a neural network. For example, the initial machine learning system 11 may be a neural network of the type disclosed below.Hochreiter, S. and Schmidhuber, J., 1997. Long short-term memory. Neural computation, 9(8), pp. 1735-1780; Cho, K., Van Merrienboer, B., Bahdanau, D. and Bengio, Y., 2014. On the properties of neural machine translation: Encoder-decoder approaches. arXiv preprint arXiv:1409.1259;Kriman,S.,Beliaev,S.,Ginsburg,B.,Huang,J.,Kuchaiev,O.,Lavrukhin,V.,Leary,R.,Li,J.and Zhang,Y.,2020,May.Quartznet: Deep automatic speech recognition with 1d time-channel separable convolutions. In ICASSP 2020-2020 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) (pp. 6124-6128). IEEE; or Teng, H., Cao, MD, Hall, MB, Duarte, T., Wang, S. and Coin, LJ, 2018. Chiron: translating nanopore raw signal directly into nucleotide sequence using deep learning. GigaScience, 7(5), standard training techniques are applied to these neural networks.
[0074] The initial sequence estimate 12 may be a categorical output. It may represent an estimate of the identity of the polymer units in the sequence between categories that include a set of predefined canonical polymer units. For example, if the polymer units are DNA polynucleotides, the canonical nucleotides may be the four bases adenine (A), cytosine (C), guanine (G), and thymine (T). In general, such a categorical output may be implemented as a vector of probabilities across categories. However, for use in the subsequent method, it becomes a difficult choice. It is the most likely category, e.g., the most likely canonical polymer unit, that is selected and represented in the initial sequence estimate 12.
[0075] Optionally, the initial machine learning system 11 may also output an initial mapping 13 between the measurement signals 10 and the initial sequence estimates 12. Typically, such an initial mapping 13 is generated during operation of the machine learning system, such as an essentially neural network. This is often referred to as a "move table" in the literature and prior art on nanopore base calling. Typically, this initial mapping 13 is discarded, as the output typically desired is simply a sequence estimate. However, typically, an initial mapping 13 may be obtained and output from the initial machine learning system 11, if desired.
[0076] The initial mapping 13 simply represents the origin position of each polymer unit in the initial sequence estimate 12 along with the corresponding sample in the measured signal 10. The initial mapping 13 may be encoded in several equivalent forms. For example, an array of indices having elements corresponding to the length of the initial sequence estimate 12 and the positions of the samples in the measured signal 10 would fully represent this mapping. Similarly, the length of each polymer unit in the initial sequence estimate 12 in units of the number of signal positions would fully describe this mapping in a more compact manner.
[0077] It is assumed that the position of a polymer unit in the measured signal 10 is not prior to the position of a polymer unit. In other words, a later polymer unit in the initial sequence estimate 12 may not be assigned to an earlier position in the measured signal 10. It is also assumed that each input sequence polymer unit is assigned a starting position in the signal array, suggesting that many signal positions can be assigned to a single sequence base, which is often the case.
[0078] As an alternative to the initial mapping 13 output from the initial machine learning system 11, the initial mapping 13 can be derived from the measured signals 10 and the initial signal estimates 12 themselves. In the prior art for generating such sequence-to-signal mappings, several methods are described, for example, in Stoiber, MH et al. De novo Identification of DNA Modifications Enabled by Genome-Guided Nanopore Signal Processing. bioRxiv (2016); or Simpson, Jared T., et al. “Detecting DNA cytosine methylation using nanopore sequencing.” nature methods 14.4 (2017): 407-410. Such methods can be applied here.
[0079] As an example, FIG. 4 illustrates a preferred method for deriving an initial mapping 13 from a measured signal 10 and an initial sequence estimate 12 that may be applied as follows.
[0080] The initial sequence estimate 12 is fed to a model 15, which is a model of the measurement system 2 used to provide the measured signal 10. The model generates a signal prediction 16, which is a prediction of the signal predicted by the model 15 generated from the initial sequence estimate 12. The model 15 may use a small window of polymer units ("k-mers") to determine the expected signal level at a particular sequence location.
[0081] In a comparison step C1, the signal predictions 16 are compared with the measured signals 10 to derive an initial mapping 13 based on the comparison. The expected signal levels are directly attributable to the polymer units of the initial sequence estimates 12, and thus define the initial mapping 13. In general, a dynamic programming algorithm may be used here.
[0082] Further processing of the measurement signal 10 performed after use of the initial machine learning system 11 will now be described.
[0083] FIG. 5 illustrates a method for using the slice machine learning system 41 as follows.
[0084] The method has three inputs: 1) the measurement signals 10, 2) the input sequence estimates 22, and 3) an input mapping 23 between the measurement signals 10 and the input sequence estimates 22. The form of the input sequence estimates 22 is discussed further below, but is generally based on the initial sequence estimates 12 output from an initial machine learning system 11.
[0085] In the derivation step S1, two slices are derived that are input to the slice machine learning system 41: 1) sequence slice 31 and signal slice 32. Sequence slice 31 is derived from a slice of the input sequence estimate 22 around a target polymer unit in a sequence of polymer units. Signal slice 32 is a slice of the measured signal 10. Importantly, sequence slice 31 and signal slice 32 are mapped to each other by an input mapping 23 between the measured signal 10 and the input sequence estimate 22.
[0086] To summarize this at a high level, the method involves inputting sequence slices 31, which are canonical sequences, and measurement slices 32, which are raw measurement signals, of measurement signals 10, directly into a slice machine learning system 41. This may be referred to as multi-headed input. In contrast, known canonical base calling systems are typically based on single-headed neural networks as only a single form of data, the raw nanopore signal, is input to the neural network. To enable multi-headed input, sequence slices 31 and signal slices 32 are presented in a manner that is further described below.
[0087] Returning to the input sequence estimate 22, this can take different forms, which are derived as follows.
[0088] In one form, the input sequence estimate 22 may simply be an initial sequence estimate 12 provided as an output of an initial machine learning system 11 fed with the measured signal slice 10 as input. This is the simplest form of the input sequence estimate 22, and the slice machine learning system 41 improves accuracy and / or information content compared to simply considering the initial sequence estimate 12. In this case, the input mapping 23 between the measured signal 10 and the input sequence estimate 22 is simply an initial mapping 13 between the measured signal 10 and the initial sequence estimate 12. This alternative form is referred to herein as "base call anchoring" in that it refers, in some embodiments, to a nucleic acid base. (However, the term "base call" is not used herein to imply that the polymer unit is a base in all cases, and the term may be equally applied to other types of polymer units, e.g., protein monomers).
[0089] In another form, the input sequence estimate 22 may be a reference sequence for the polymer. This alternative is referred to herein as "reference anchoring." The reference sequence for the polymer may be obtained from a standard resource or library, such as a resource provided by the National Center for Biotechnology Information (NCBI) or the Ensembl resource. Alternatively, the reference sequence may be generated from an aggregate (or consensus) of measurement signals 10 from the same sample, or in the case of synthetic polymers, from a known ground truth.
[0090] The initial sequence estimate 12 generally contains some errors. It has been shown that, especially when using a relatively low-quality initial machine learning system 11 (e.g., using fewer computational resources or computational time), the accuracy of the estimate by the slice machine learning system can be significantly improved by moving from base call anchoring to reference anchoring.
[0091] In this case, the input mapping 23 between the measurement signal 10 and the input sequence estimate 22, i.e. the reference sequence, may be obtained by a process known as genomic alignment or reference alignment.
[0092] An example of such a method is shown in Figure 6 and is implemented using: 1) a reference sequence 25, 2) an initial sequence estimate 12, which may be derived as described above, and 3) an initial mapping 13 between the measurement signal 10 and the initial sequence estimate 12, which may be derived by any of the techniques described above.
[0093] A reference mapping 26 is derived between the reference sequence 25 and the initial sequence estimate 12. This is achieved by assigning a putative polymer unit of the initial sequence estimate 12 to each polymer unit of the reference sequence 25. An alignment is determined within the boundaries of the matching portions of these two sequences. The reference mapping at the polymer unit level maps stretches of matching positions between the putative polymer units of the initial sequence estimate 12 and the reference positions in the reference sequence 25, as well as the positions of any skipped polymer units in the reference sequence 25 and the initial sequence estimate 12.
[0094] In the combination step D1, the reference mapping 26 is combined with the initial mapping 13 to derive the input mapping 23. This step reconstructs the sequence-to-signal mapping assigned to the reference sequence 25 used as the input sequence estimate 22. For positions in the reference sequence with a direct mapping to a position in the putative polymer unit of the initial sequence estimate 12, the signal position is transferred to the corresponding position in the reference sequence 25. For positions in the reference sequence 25 between stretches of matching positions, any valid index in the measured signal 10 is allowed. Specifically, the signal position assignment in a mismatched reference region should be equal to or greater than the last position before the mismatched reference region and equal to or less than the first matching reference position after the mismatched reference region. This procedure should be performed for each stretch of the mismatched reference sequence 25 to generate a complete mapping 22 that can be applied to the slice machine learning system 41 in the same manner as base call anchoring.
[0095] In the case of reference anchoring, the objective is to make predictions for the target polymer unit from a reference sequence. The reference sequence is provided with the full extent of the region that is determined to be aligned based on the reference alignment. In some cases, this may consist of non-contiguous sections of the reference.
[0096] We now turn to the method of using the slice machine learning system 41 shown in FIG.
[0097] As mentioned above, the sequence slice 31 and the signal slice 32 are derived in a derivation step S1 as slices around the considered polymer unit of interest.
[0098] The method may be applied to a single polymer unit of interest in the input sequence estimate 22, or may be applied iteratively to multiple polymers of interest that are all or any subset of the polymer units in the input sequence estimate 22.
[0099] For example, the method may be performed on a polymer unit of interest that forms part of a given motif that includes multiple canonical polymer units. Often, a motif (a short pattern of polymer units (e.g., nucleotides) that may include several polymer units or positions of ambiguity that allow for variable width of polymer units of the polymer units used to identify related polymer units of interest. For example, a "CG" motif, also referred to as a CpG site, is the most common motif where methylation occurs in most mammals and may form a motif as used herein.
[0100] An example of the derivation of the sequence slices 31 and the signal slices 32 in the derivation step S1 will now be described in more detail. As mentioned above, the sequence slices 31 are derived from slices of the input sequence estimates 22 around the polymer units of interest, and the signal slices 32 are slices of the measured signals 10, and the sequence slices 31 and the signal slices 32 are mapped to each other by the input mapping 23. There are various ways to achieve this, for example:
[0101] The measurement signal 10, input sequence estimate 22, and input mapping 23 are generally provided as a complete sequencing read corresponding to the entire nanopore read, which is typically very long, e.g., consisting of tens to millions of individual polymer units in some types of measurement system 2. However, the derivation step S1 provides the sequence slices 31 and signal slices 32 with corresponding lengths selected for a suitable accuracy for the slice machine learning system 41.
[0102] In one approach, the signal slice 32 is a predefined length of the measurement signal 10 around a location in the measurement signal 10 that maps to a polymer unit of interest. In this case, once a polymer unit of interest in the input sequence estimate 22 is identified, a location in the measurement signal 10 to which the polymer unit of interest is assigned from the input mapping 23 is identified. The center of this stretch of the measurement signal 10 is defined as the center of the region of interest. From this location, a fixed width of signal is extracted using a user-defined range around this location.
[0103] In this case, the predetermined length of the measurement signal 10 may be, for example, in the range of 20 sample points to 1000 sample points, such as 100 sample points. A larger length of the measurement signal 10 may be more than 1000 sample points. The signal slices 32 may be symmetrically or asymmetrically positioned around the sample points mapped to the polymer unit of interest.
[0104] In addition to extracting a signal slice 32 from this region, a sequence slice 31 is selected as the polymer unit that is mapped to an extension of the signal slice 32 by the input mapping 23. Thus, the length of the sequence slice 31 varies for different target polymer units.
[0105] In another approach, the sequence slice 31 is a predetermined length, i.e., a predetermined number of polymer units, of the input sequence estimate 22. In this case, once the sequence slice 31 is extracted, the signal slice 32 is derived as the portion of the measured signal 10 that is mapped to the sequence slice 31 by the input mapping 23. Thus, the length of the signal slice 32 varies for different polymer units of interest.
[0106] In this case, the predetermined number of polymer units can range from 1 polymer unit to 100 polymer units. The range of polymer units considered can depend on the type of nanopore used.
[0107] Optionally, sequence slices 31 may be selected to take into account nanopore kinetics, as follows: when the rate of polynucleotide translocation through the nanopore is controlled by a molecular brake in the form of an enzyme, it is believed that, for example, modified bases will affect the enzyme kinetics, such as the kinetics of unwinding a double-stranded polynucleotide by a particular helicase. In the case of a helicase as a bound enzyme that can help to unwind double-stranded DNA and control the passage of the resulting single-stranded DNA strand through the nanopore, taking into account those nucleotides in the enzyme binding region may provide further information about the signal.
[0108] It may therefore be useful to provide such information to a nanopore modified base detection algorithm. This can be accomplished by a sequence slice 31 that is derived in such a way that one or more nucleotides of the sequence slice 31 are within a region of the enzyme that acts as a molecular brake to control the translocation of the polymer.
[0109] This may improve accuracy compared to providing a signal of the same size, but without including the signal when the base of interest is within the molecular brake. Note that this may provide improved performance over alternative nanopore modified base detection algorithms that attempt to provide this information via a summary of the raw nanopore signal, as signal-to-sequence assignment / alignment algorithms are often highly error prone. Passing the raw nanopore signal through a neural network, as described in other sections, may allow for improved performance that bypasses issues with sequence-to-signal alignment.
[0110] It has been shown that signal changes may be most influenced by nucleotide interactions with one or more constrictions of the nanopore, a constriction being a region of the inner lumen of the nanopore with a narrow cross section; see, for example, Figure 1 in Butler et al., Proceedings of the National Academy of Sciences 105(52), 20647-20652, which shows an MspA nanopore with an internal constriction in the D90N / D91N region, and Figures 1 and 2 in WO2016 / 034591, which show the internal constriction region of a CsgG nanopore. However, interactions with other regions of the nanopore may affect the signal, and it is believed that nucleotides outside the nanopore may also affect the measured signal. In use, the bound enzyme is typically held in contact with the cis or trans opening of the nanopore during translocation of the polynucleotide through the nanopore under an applied potential. Thus, the nucleotide just outside the lumen of the nanopore is typically within the region of a bound enzyme, for example with dDA helicase as the polynucleotide-binding enzyme and CsgG as the nanopore, and the distance between the enzyme and the constriction is estimated to be a distance of 10-14 bases (or approximately 100-140 signal points. Signal point measurements depend on several factors and may vary significantly from these values for other chemical structures of the pore).
[0111] 7 illustrates a particular method for generating sequence slices 31 in a form suitable for input to a slice machine learning system 41 that is mapped to a signal slice 32. This procedure is intended to maximize the information presented to the slice machine learning system 41.
[0112] Initially, a first signal slice 33 is extracted as a slice of the input sequence estimate 22, the first signal slice 33 having a particular nucleotide sequence that, for non-limiting illustrative purposes, in Fig. 7 are different canonical nucleotides selected from the four bases A, C, G, or T. In Fig. 7, the input mapping 23 is graphically represented by dashed lines. In particular, each element of the first sequence slice 33 that is either a nucleotide or a dashed line corresponds to a respective sample point in the corresponding signal slice 32 according to the input mapping 23.
[0113] In step E1, the first sequence slice 33 is encoded into the second sequence slice 34 by replacing each polymer unit with a respective k-mer, the second sequence slice 34 being a sequence of k-mers corresponding to each polymer unit in the first input slice 33. Thus, compared to the first sequence slice 33, the second sequence slice 34 has the same length but increased dimensionality, such that each element of the second sequence slice 34 is a k-dimensional vector (as a non-limiting example, k is 3 in FIG. 7). Each k-mer in the second sequence slice 34 comprises a group of k polymer units (arranged vertically in FIG. 7), where k is a multiple integer. Each k-mer comprises a) the respective polymer unit (along the middle dimension in FIG. 7) and b) (k-1) polymer units adjacent to the respective polymer unit in the input sequence estimate 23. The (k-1) adjacent polymer units are symmetric around the respective polymer unit in FIG. 7, but alternatively, the (k-1) adjacent polymer units are selected asymmetrically. Note that this encoding requires a fixed number of polymer units before and after the first signal slice 33 to allow for the construction of a k-mer.
[0114] This change from polymer unit to k-mer effectively provides additional contextual information to the individual polymer. These k-mers can be thought of as representing portions of the polymer that physically interacted with the nanopore at specific locations in the signal, but that is a conceptual idea that may not fully describe a particular measurement system 2. Nonetheless, when translocating a polymer through a nanopore, k can have a value selected such that the length of the k-mer is greater than the length of the nanopore lumen through which the polymer is translocating.
[0115] Using k-mers in this manner has been shown to improve the accuracy of the inferences performed by the slice machine learning system 41. In general, k may have any value that provides such an improvement, and it should be noted that increasing k increases the size of the data without significantly increasing the computational cost. In some examples, k may have a value in the range of 3 to 50, although higher values are possible.
[0116] Alternatively, step E1 may be omitted such that the following steps are performed on the first array slice 33, although this is likely to reduce the accuracy of the estimation performed by the slice machine learning system 41.
[0117] In step E2, the second sequence slice 34 is extended to a third sequence slice 35 such that it has the same length as the signal slice 32. In this example, the extension is performed by repeated padding, shown graphically in Figure 7 as the replacement of the dashed line by the k-mer preceding it. This extension allows for the efficient design of a slice machine learning system 41, described below.
[0118] In step E3, the third sequence slice 35 is binary encoded into a final sequence slice 36, which is used as the input sequence slice 31 to the slice machine learning system 41. The binary encoding, in this example, uses one-hot encoding to encode each polymer unit into binary form ("1000" for A, "0100" for C, "0010" for G, "0001" for T, and "0000" for unknown or missing bases). For each position in the third sequence slice 35, the k vectors of length 4 for the k polymer units of the k-mer are concatenated to form a vector of length 4k.
[0119] The slice machine learning system 41 is fed with equal length sequence slices 31 and signal slices 32 as double-headed inputs. The slice machine learning system 41 is trained to provide an output 42 representing an estimate of the identity of the target polymer unit. The output 42 is a categorical output. That is, the output 42 estimates the identity of the target polymer unit among a set of categories. Such a categorical output may be implemented as a vector of probabilities over the categories. The slice machine learning system 41 is trained to maximize the probability of a correct output category and minimize the probability of an incorrect output category. To optimize the categorical output type, cross-entropy loss is typically used in the slice machine learning system 41, which is further described below, although there are other loss functions that may be applied to such a categorical output 42.
[0120] The nature of the categories represented by output 42 can take a variety of forms depending on the application.
[0121] In some types of embodiments related to detection of modified forms of canonical polymer units, the categories represented by output 42 can be the canonical polymer unit and at least one modified form of the canonical polymer unit. As non-limiting examples, if the polymer is DNA and the polymer units are nucleotides, the canonical polymer unit can be cytosine or adenosine, and if the canonical polymer unit is cytosine, the at least one modified form of the canonical polymer unit is at least one of 5-methyl-cytosine and 5-hydroxymethyl-cytosine if the canonical polymer unit is cytosine, or 6-methyl-adenosine if the canonical polymer unit is adenosine.
[0122] To think of this more generally, the modified bases 5-methylcytosine (5mC) and 5-hydroxymethyl-cytosine are well-known epigenetic marks that regulate genome transcription (switching on and off the mechanism by which DNA is copied into messenger RNA (mRNA) involved in protein synthesis). Methylation is therefore important as it is the type of modification that categorical output 42 can represent and is generally the most biologically relevant.
[0123] However, the categorical output 42 may generally represent any type of modification without being limited to methylation. By way of example, another modification that the categorical output 42 may represent is oxidation, e.g., oxidation of methylated cytosine (5-mC) to 5-hydroxymethylcytosine (5-hmC), methylation of 5-formylcytosine (5-fC), 5-carboxylcytosine (5-caC), and adenine (A) to N6-methyladenine (6-mA), which have been identified as important epigenetic regulators.
[0124] When the polymer is RNA, modifications are more common, and recent studies have shown that polymers play a role in regulating mRNA stability. mRNA stability can affect the control of gene expression and affect a variety of cellular and biological processes. To date, hundreds of RNA modifications have been characterized and can be represented by categorical outputs 42. Non-limiting examples include N6-methyladenosine (m6A), inosine (I), N6,2'-O-dimethyladenosine (m6Am), 8-oxo-7,8-dihydroguanosine (8-oxoG), pseudouridine (ψ), 5-methylcytidine (m5C), and N4-acetylcytidine (ac4C), which have been shown to regulate mRNA stability and function.
[0125] Another type of embodiment relates to providing an estimate of the identity of one or more subject polymer units, for example to enable detection of errors in a previously derived estimate of the sequence of the polymer unit and / or detection of changes from a reference sequence. In this case, the output 42 represents an estimate of the identity of the subject polymer unit between a category comprising a set of canonical polymer units. For example, if the polymer units are DNA polynucleotides, the canonical nucleotides may be the four bases adenine (A), cytosine (C), guanine (G), and thymine (T).
[0126] This allows the detection of single base substitutions. When base call anchoring is used, this is a corrective procedure aimed at improving the first pass prediction of the origin sequence. When reference anchoring is used, this represents the detection of single nucleotide polymorphisms (SNPs) where the provided reference sequence 23 does not match the origin sample via a single base substitution.
[0127] In addition to single base substitutions, categories can include small insertions or deletions (e.g., less than 50 nucleotides). A further category of modifications that can be detected using the algorithm is when a nucleotide has neither a purine nor a pyrimidine base, known as an abasic site. Abasic sites can occur, for example, due to DNA damage, with apurination being more common. Apurination is thought to play a major role in the initiation of cancer. Abasic sites are routinely present in DNA, but are also known to occur in the RNA of yeast and human cells.
[0128] In this case, the polymer unit prediction task can be adjusted to mask the target polymer units within the sequence slices 32 input to the slice machine learning system 41 so as not to bias the output predictions based on the input bases.
[0129] In general, the slice machine learning system 41 may use a variety of different machine learning techniques. However, the slice machine learning system 41 is particularly advantageously formed as a neural network.
[0130] 8 shows an example where the sliced machine learning system 41 is a neural network 50. Features or components of the neural network 50 and training methods for such a neural network are described herein.
[0131] Neural network 50 includes a first input stage 51 to which array slice 31 is fed, and a second input stage 52 to which signal slice 32 is input.
[0132] The first input stage 51 includes at least one first input neural network layer. The input neural network layer(s) of the first input stage 51 may be a convolutional neural network layer(s).
[0133] The second input stage 52 also includes at least one second input neural network layer. The input neural network layer(s) of the second input stage 52 may be a convolutional neural network layer(s).
[0134] The outputs of the first input stage 51 and the second input stage 52 are fed to a concatenation layer 53, which concatenates them to provide a concatenated output 54 that is fed to the remaining layers, including at least one convolutional neural network layer. The concatenation is performed feature-by-feature such that the temporal correspondence between the inputs to the concatenation layer 53 derived from the sequence slices 31 and the signal slices 32 is preserved. The output values from the concatenation layer 53 are then processed further by layers in the neural network 50 as a single input.
[0135] The further layers are constructed as follows.
[0136] The concatenated output 54 is fed to a combined convolutional neural network stage 56 that includes at least one convolutional neural network layer.
[0137] The convolutional neural network layers of the first and second input stages 51, 52 and the combined convolutional neural network stage 56 may be of conventional construction. Such convolutional neural network layers are well known in the art, but in summary operate on fixed-size moving windows in strides along the input data. In each window, the input features are matrix multiplied by a set of weights to generate the layer's output.
[0138] Each of the first input stage 51 and the second input stage 52 and the combined convolutional neural network stage 56 may include any number of stacked convolutional layers, with different hyperparameters applied to each layer, including window size, stride, and number of parameters / weights. Following each of the convolutional layers may be a batch normalization layer and an activation function (in this case, swish nonlinearity), as well as other standard neural network components. The convolutional layers in the first and second input stages 51 and 52 are designed to produce the same output size in terms of length and feature size. Note that the inputs for each of the first input stage 51 and the second input stage 52 have different feature size sizes.
[0139] Padding is not used in any of the convolutional layers, as is common in some areas of machine learning when using convolutional layers.
[0140] The output of the combined convolutional neural network stage 56 is fed to an LSTM (long short-term memory) stage 57 which includes at least one LSTM layer, which is an example of a recurrent neural network (RNN) layer and may be of conventional construction.
[0141] The LSTM stage 57 is optional and may be omitted.
[0142] The output of the LSTM stage 57, or the output of the combined convolutional neural network stage 56 if the LSTM stage is omitted, is fed to a fully connected stage 58 that includes at least one fully connected layer, which may also be of conventional construction. The fully connected stage 58 produces an output 42.
[0143] A description of recurrent neural network layers that may be applied to the LSTM stage 57 and the fully connected stage 58 is given in Sak, H., Senior, A and Beaufays, F., 2014. Long short-term memory recurrent neural network architectures for large scale acoustic modeling.
[0144] The neural network 50 processes the input in batches. As explained above, the cross-entropy loss is calculated for each batch. An optimizer is used for backpropagation during training. In one illustrative example, the optimizer may be the AdamW optimizer. Backpropagation is performed in the standard manner as described in the prior art (Loshchilov, I. and Hutter, F., 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101).
[0145] Attention layers may also be added to the neural network 50 by computing a "fit" score between the intermediate feature vectors and the global feature vector (final output before activation). The intermediate features are found after the initial convolution of each head of the network (signals and sequences) and after the concatenation of these signals. The fit scores may be in the form of a sum of the feature vectors and the global feature vector or a dot product of the feature vectors and the global feature vector, and a row-wise softmax is applied to convert these into attention vectors. These attention vectors are then used to create an element-wise weighted average of the intermediate feature vectors. These vectors are then concatenated and passed through a final layer as a classification step. The advantage of these layers is that they allow to visualize the attention map, which helps to understand which parts of the signals and / or sequences are being paid attention to in order to make a prediction.
[0146] The neural network 50 may be trained using conventional techniques which involve feeding the neural network a training signal including multiple pairs of training sequence slices 61 around a target polymer unit within a sequence of polymer units of a polymer, and training signal slices 62 of a measurement signal measured from the polymer during translocation of the polymer relative to the nanopore, as shown, for example, in FIG.
[0147] The training sequence slices 61 contain target polymers of known categories.
[0148] Training signal slices 62 are mapped to training sequence slices 61. The input mapping 23 is derived using a consistent procedure between training and subsequent use of the trained neural network 50. When derived from a base calling algorithm, the neural network 50 directs the nucleotide to this position. When derived from a k-mer or level model, followed by dynamic programming, the expected level should represent the input polymer unit. Thus, both methods apply a consistent method to signal mapping with meaningful sequences.
[0149] The training signals are prepared as described above to provide examples of the desired output 42 categories.
[0150] If the category represented by output 42 is a canonical polymer unit and at least one modified form of the canonical polymer unit, the training signal is annotated with the known canonical base sequence and the modified base sequence. As with the canonical substitution model, the raw nanopore signal can be derived from any source biological material that has a known reference or for which a genomic reference can be derived with high accuracy.
[0151] In the case of modified base models, knowledge of the modified base content of a lead may also have several sources.
[0152] For example, the source of ground truth modified bases may come from biological knowledge of a particular procedure or technique. As a specific example, a bacterial methylase enzyme may be purchased from a supplier and used to process previously unmodified biological samples of known origin. It generally converts nucleotides in fixed sequence patterns (biological sequences known as motifs) from canonical to modified forms. As a specific example, M.SssI methyltransferase converts canonical cytosines to 5-methyl-cytosines in any CG context. This biological process may be error prone. Biological or algorithmic methods may be developed to improve or filter this training reference modified markup.
[0153] Additional biological methods can also be applied to generate ground truth sets for modifications further derived from the procedure described above. For example, the ten-eleven translocase (TET) enzyme is known to catalyze an oxidation reaction to convert 5-methyl-cytosine (5mC) to (in order of reaction mechanism) 5-hydroxymethyl-cytosine (5hmC), 5-formyl-cytosine (5fC) and 5-carboxyl-cytosine (5caC). Such samples can be processed by nanopore sequencing and used for training.
[0154] As another example of a type of training signal, modified bases may be printed onto oligonucleotides. These oligonucleotides may be ordered with fixed sequences with modified bases at known positions. Oligonucleotides may also be ordered with selected positions containing random bases. The identity of the random positions may be determined from the raw nanopore signals generated for that read or other aspects of the nanopore run (i.e., paired reads). These ground truth or partially random sequences are processed in the same manner as standard genomic reads to generate raw nanopore signals, ground truth sequences including modified base identities, and a mapping between the two.
[0155] One final modified base training sample again starts with an unmodified reference sample. A polymerase chain reaction (PCR) is performed with this sample as template input, with canonical nucleotide units (dNTPs) and doped with modified bases (e.g., d5mCTP or d5hmCTP). Given an acceptable polymerase that can accept such modified bases, the modified nucleotides are incorporated into the daughter strands of the PCR reaction at random positions. The resulting samples contain strands with known canonical sequences but unknown modified base content. Such samples need to be appropriately marked up with the nanopore modified base detection model. This procedure may be error prone, but may improve the final model performance in future iterations of the model implemented in the slice machine learning system 41, especially if appropriate filtering or other algorithmic steps are applied.
[0156] If the categories represented by output 42 are sets of canonical polymer units, the training signals are sets of reads with known canonical sequences. These training signals are identical to standard base call training, for example, as applied to the initial machine learning system 11.
[0157] The raw nanopore signals for the training signals can be derived from any source biological material that has a known reference sequence or from which a genomic / source reference sequence can be derived with high accuracy.
[0158] Nanopore reads are processed as previously described for reference anchoring, whereby the signal, ground truth sequence, and the mapping between the two are provided as inputs to the Remora algorithm. These are initially provided as whole nanopore read units, and training / inference chunks are selected for each base of interest within the read, as previously described.
[0159] Training can be performed using conventional techniques. The various layers of the neural network 50 described above are connected, and the weight matrices that are subsequently assigned to each are designed so that matrix multiplication is performed with effective dimensions for the outputs and inputs of the connected layers. The application of the neural network generates a vector of values that represent the output category of the prediction problem (modified base or canonical substitution detection). A loss function is applied to this output layer, together with a set of ground truth labels for each training unit. The most common loss function for multi-class prediction is cross-entropy (e.g., Murphy, Kevin P. Machine Learning: A Probabilistic Perspective. MIT Press, 2012.), but other functions are available and applicable here. Training of the neural network 50 is performed to minimize the value of this loss function by iteratively updating the weights of all layers that make up the neural network.
[0160] To minimize this loss value, a batch of inputs is passed to the neural network 50 which applies each layer as designed by the connections in the neural network 50. This produces a value from a loss function. An optimizer is then applied to this loss function. The optimizer observes the partial gradient of each parameter weight with its contribution to the loss value and propagates this difference backwards (from output to input) through the neural network. The weights are updated through fractions according to a learning rate of this difference. These updates move the neural network 50 in a direction that improves the loss function value. This is a standard procedure for training neural networks.
[0161] To efficiently use computing resources, batch processing is applied to the training signal. Larger batches generally produce more robust training, but also slower training due to increased computational requirements. Trade-offs between these values are made taking into account available computational resources.
[0162] Other layers are applied only during training to stabilize the training. For example, a batch normalization layer can be added between any connections of the other layers.
[0163] Nonlinear activation functions (ReLU, Tanh, Sigmoid, Swish, and many others) can also be applied to any connection between neural network layers. (Sharma, Sagar, Simone Sharma, and Anidhya Athaiya. “Activation functions in neural networks.” Toward data science 6.12 (2017): 310-316.) Backpropagation through such layers is defined by statistical principles and conventional techniques.
[0164] A comparison was made between a particular embodiment of the method described above, referred to as the Remora algorithm, and several other prior art methods, applied as an example to the detection of 5-methyl-cytosine (5mC). In particular, the following methods were used in this comparison: ·Tombo:v1.5.1 https: / / nanoporetech.github.io / tombo / ·Deepsignal2:v0.1.1 https: / / github.com / PengNi / deepsignal2 ·f5c: v0.7 https: / / github.com / hasindu2008 / f5c ·Guppy:5.0.16 https: / / community.nanoporetech.com / downloads / guppy ·Megalodon: v2.3.5 https: / / github.com / nanoporetech / megalodon This base calling implemented in the Remora software v0.1.0 https: / / github.com / nanoporetech / remora: an example of the method described above using base call anchoring This reference is implemented in the Remora software v0.1.0: https: / / github.com / nanoporetech / remora: an example of the method described above using reference anchoring
[0165] The Remora algorithm was trained using two enzymatically converted human genomic DNA samples: the first processed by polymerase chain reaction (PCR) to replace all bases with their canonical equivalents, and the second processed synthetically with the bacterial methylase M.Sss1, which converts all cytosines within the CG reference sequence context with 5mC.
[0166] A comparison of correlation coefficients between different nanopore signal tools and bisulfite sequencing for 5-methyl-cytosine detection aggregated at the genomic location level (Darst, Russell P., et al. "Bisulfite sequencing of DNA." Current protocols in molecular biology 91.1 (2010):7-9.) is provided below to demonstrate the relative performance of the algorithm described herein against current prior art. DNA material is extracted from the NA12878 reference human cell line sample (from the HG001 donor individual) (https: / / www.coriell.org / 0 / Sections / Search / Sample_Detail.aspx?Ref=NA12878).
[0167] Nanopore datasets were generated on an ONT MinION flow cell (R9.4.1 / E8) corresponding to the CsgG nanopore (R) and DdA enzyme (E) under standard conditions with a translocation rate of approximately 450 bases / sec, and DNA samples were prepared for nanopore sequencing using the LSK109 library preparation kit, see for example https: / / store.nanoporetech.com / uk / ligation-sequencing-kit.html and https: / / gih.uq.edu.au / research / long-read-sequencing / beads-free-ont-ligation-kit-library-preparation-ultra-long-read-sequencing. Counts were assessed at different sequencing depths from 15 to 60 (average number of reads per genomic position). The results are shown in Table 1. [Table 1]
[0168] As shown in Table 1, from the same source data, the current algorithm (Remora) systematically outperforms other known prior art algorithms in being able to detect 5-methyl-cytosine (5mC).
Claims
1. 16. A method for analyzing a measurement signal measured from a polymer during translocation of the polymer into a nanopore, the polymer comprising an array of polymer units, the method comprising: deriving an input sequence estimate for the sequence of the polymer units and a mapping between the measured signals and the input sequence estimate; a sequence slice derived from a slice of the input sequence estimates around a target polymer unit within the sequence of polymer units; and signal slices of the measurement signal, where the constellation slices and the signal slices are mapped to each other by the mapping; and providing the slices as input to a slice machine learning system that provides an output representing an estimate of the identity of the target polymer unit.
2. 2. The method of claim 1, wherein the output represents an estimate of the identity of the target polymer unit between a category that includes a canonical polymer unit and at least one modified form of the canonical polymer unit.
3. the polynucleotide is DNA, the polymer units are nucleotides, the canonical polymer unit is cytosine or adenosine; 3. The method of claim 2, wherein the at least one modified form of the canonical polymer unit is at least one of 5-methyl-cytosine and 5-hydroxymethyl-cytosine when the canonical polymer unit is cytosine, or is 6-methyl-adenosine when the canonical polymer unit is adenosine.
4. The method of claim 1 , wherein the output represents an estimate of the identity of the target polymer unit among categories comprising a set of canonical polymer units.
5. 5. The method of claim 1, wherein the method is carried out on a subject polymer unit that forms part of a predetermined motif comprising a plurality of canonical polymer units.
6. The method of claim 1 , wherein the method is performed on a plurality of target polymer units within the sequence of polymer units.
7. 7. The method of claim 1, wherein the step of deriving the input sequence estimate comprises providing the measured signal as an input to an initial machine learning system that provides an output that is an initial sequence estimate of the sequence of the polymer unit that is used as the input sequence estimate.
8. the input sequence estimate is a reference sequence for the polymer; the method includes providing the measured signals as inputs to an initial machine learning system that provides an output that is an initial sequence estimate of a sequence of the polymer units; deriving a mapping between the measurement signals and the input constellation estimates, deriving a reference mapping between the reference sequence and the initial sequence estimate and a signal mapping between the measurement signal and the initial sequence estimate; and deriving the mapping between the measured signals and the input sequence estimates from the reference mapping and the signal mapping.
9. The method of claim 7 or 8, wherein the initial machine learning system is configured to provide a further output, which is the mapping between the measurement signals and the initial sequence estimates.
10. deriving the mapping between the measurement signals and the initial sequence estimates, generating a signal prediction of a signal predicted to be generated from the initial sequence estimate by a model of a measurement system used to provide the measurement signal; and deriving the mapping by comparing the signal prediction with the measured signal.
11. 11. The method of any one of claims 1 to 10, wherein the sequence slice is encoded as k-mers corresponding to respective polymer units in the slice of the input sequence estimate, each k-mer comprising a group of k polymer units including the respective polymer unit and (k-1) adjacent polymer units from the input sequence estimate, where k is a multiple integer.
12. The method of claim 11, wherein k has a value in the range of 3 to 50.
13. The method of claim 12, wherein k has a value selected such that the length of the k-mer is greater than the length of the nanopore lumen through which the polymer translocates.
14. 14. The method of claim 1, wherein the signal slice is a predetermined length of the measurement signal around a location in the measurement signal that is mapped to the polymer unit of interest.
15. 15. The method of claim 1, wherein the array slices are expanded to have the same size as the signal slices before feeding the array slices to the slice machine learning system.
16. 16. The method of claim 1, wherein the polymer units represented by the sequence slices are encoded in a binary format prior to feeding the sequence slices to the slice machine learning system.
17. 17. The method of claim 1, wherein the measurement signal is normalized before feeding the signal slices to the slice machine learning system.
18. The method of claim 1 , wherein the slice machine learning system is a neural network.
19. the slice machine learning system comprises at least one first input neural network layer to which the sequence slices are fed, and at least one second input neural network layer to which the signal slices are fed; the sliced machine learning system concatenates outputs of at least one first convolutional neural network layer and at least one second convolutional neural network layer; 20. The method of claim 18, wherein the sliced machine learning system comprises a further neural network layer to which the concatenated outputs are supplied as input.
20. 20. The method of claim 19, wherein the at least one first input neural network layer and the at least one second input neural network layer are convolutional neural network layers.
21. 21. The method of claim 19 or 20, wherein the further neural network layers comprise at least one further convolutional neural network layer and / or at least one recurrent layer and / or at least one fully connected layer.
22. 22. The method of any one of claims 1 to 21, wherein the nanopore is a protein pore.
23. 23. The method of any one of claims 1 to 22, wherein the polymer is a polynucleotide and the polymer units are nucleotides.
24. 24. The method of claim 23, wherein the polynucleotide is DNA.
25. 25. The method of claim 23 or 24, wherein the measurement signal is a measurement signal measured from the polymer during translocation of the polymer through a nanopore, and the translocation rate of the polynucleotide through the nanopore is controlled by a molecular brake.
26. 26. The method of claim 25, wherein the molecular brake is an enzyme.
27. 27. The method of claim 26, wherein one or more nucleotides of the sequence slice are within a region of the enzyme that controls translocation of the polymer.
28. 28. A method according to any one of the preceding claims, wherein the signal is derived from measurements of one or more of the following: ionic current, impedance, tunnelling characteristics, field effect transistor voltage, and optical properties.
29. A computer program comprising instructions which, when said program is executed by a computer, cause said computer to carry out a method according to any one of claims 1 to 28.
30. 30. A computer storage medium storing a computer program according to claim 29.
31. 1. A method for analyzing a polymer, comprising: deriving a measurement signal from the polymer during translocation of the polymer relative to the nanopore, the polymer comprising an array of polymer units; Analysing the measurement signal using a method according to any one of claims 1 to 28.
32. 29. An analytical device comprising a processor configured to carry out the method of any one of claims 1 to 28.
33. 1. A nanopore measurement and analysis system comprising: a measurement system configured to derive a measurement signal from the polymer during translocation of the polymer relative to the nanopore; A system comprising an analysis device according to claim 32.
34. 34. The system of claim 33, wherein the measurement system comprises a CsgG nanopore.
35. 35. The system of claim 33 or 34, wherein the binding enzyme is a helicase.
36. 1. A method of training a sliced machine learning system to provide an output representing an estimate of an identity of a target polymer unit of interest within a polymer by providing a training signal to the sliced machine learning system, the training signal comprising: a training sequence slice around a target polymer unit within a sequence of polymer units of a polymer; The method includes a plurality of pairs of measurement signals measured from the polymer during translocation of the polymer relative to the nanopore with training signal slices.
