Classification of abnormal cardiac activity into different classes

Abstract

To provide a machine learning system and method that separate abnormal heart activities into different classes.SOLUTION: A method implemented by a determination engine is provided. The method includes receiving one or more pairs of heart beats, generating a model based on the one or more pairs of heart beats, and determining whether two given heart beats are part of the same arrythmia to produce a similarity result for algorithmic input.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims the benefit of U.S. Provisional Patent Application No. 63 / 070,574, filed August 26, 2020, the entire contents of which are incorporated herein by reference.

[0002] FIELD OF THE INVENTION The present invention relates to artificial intelligence and machine learning method(s) and system(s) for measuring abnormal cardiac activity, more particularly to machine learning systems and methods for classifying abnormal cardiac activity into different classes. [Background technology]

[0003] An electrophysiological (EP) procedure is an evaluation of the heart's electrical system or activity used to diagnose abnormal heart rhythms or arrhythmias. EP procedures can be performed using body surface (BS) electrodes and / or by inserting one or more catheters into the heart through blood vessels to measure the electrical system or its activity. EP procedures provide cardiac images (also known as cardiac scans or images), including images of the heart tissue, chambers, veins, arteries, and / or pathways, based on the measured electrical system or activity.

[0004] Some methods in EP procedures (e.g., automatic pace mapping, PaSo™ software, intracardiac pattern matching, BS pattern matching, and electrocardiogram (ECG) stress clustering) require conventional correlation algorithms, such as the Pearson product-moment correlation algorithm, to identify whether two heartbeats belong to the same arrhythmia. Conventional correlation algorithms cannot account for deflection noise, ventricular far-field noise, respiratory interference, and analog or digital filter ringing artifacts, which can mimic the correlation between two heartbeats. Conventional correlation algorithms lack the desired accuracy and consistency. A method and system for reliably measuring the strength of the association between two heartbeats for all EP procedures would be beneficial. Summary of the Invention [Means for solving the problem]

[0005] The system and method performed by the decision engine includes receiving one or more pairs of heartbeats, generating a model based on the one or more pairs of heartbeats, and determining whether two given heartbeats are part of the same arrhythmia to generate a similarity result for algorithm input. The system and method may be embodied as a device, a system, and / or a computer program product. [Brief explanation of the drawings]

[0006] A more detailed understanding may be had from the following description, given by way of example in conjunction with the accompanying drawings, in which like reference numerals indicate similar elements and in which: [Figure 1] 1 is a schematic diagram of an exemplary system in which one or more features of the disclosed subject matter may be implemented. [Figure 2] FIG. 1 is a block diagram of an exemplary system for remotely monitoring and transmitting patient biometric indicators. [Figure 3] This is a diagram of an artificial intelligence system. [Figure 4] FIG. 4 is a block diagram of a method performed by the artificial intelligence system of FIG. 3. [Figure 5] 1 illustrates a block diagram of a method according to one or more embodiments. [Figure 6A] 1 illustrates an example of an autoencoder structure for implementing a method according to one or more embodiments. [Figure 6B] 6B shows a block diagram of a method implemented in the autoencoder of FIG. 6A. [Figure 7] 1 shows a screen where the physician selects cycle length and ECG pattern. [Figure 8] 1 illustrates a block diagram of a method according to one or more embodiments. [Figure 9] 1 shows the signal obtained during the EP procedure and the suggestion to select the heart beats of the same arrhythmia. DETAILED DESCRIPTION OF THE INVENTION

[0007] Disclosed herein are methods and systems for artificial intelligence and machine learning. More specifically, systems and methods for measuring the strength of association between two heartbeats for all EP procedures are disclosed. For example, machine learning algorithms are processor-executable code or software that are necessarily rooted in the processing operations of medical device equipment and its hardware to perform automated decisions using neural network(s).

[0008] According to one embodiment, the machine learning algorithm includes a decision engine that receives EP studies (each including at least two heartbeats) and determines, for each EP study, whether the two beats are part of the same arrhythmia. The decision engine generates a corresponding diagnosis that is further used to generate a model. The model is configured to learn to ignore signal mimics (e.g., deflection noise, ventricular far-field, respiratory interference, ringing artifacts of analog or digital filters, etc.) when evaluating a pair of heartbeats.

[0009] According to an embodiment, the machine learning algorithm includes a decision engine that receives one or more pairs of heartbeats and generates a model based on the one or more pairs of heartbeats. The decision engine determines whether two given heartbeats are part of the same arrhythmia and generates a similarity function for the algorithm input.

[0010] The technical effects and benefits of the decision engine include multi-stage manipulation of data corresponding to EP tests to generate improved diagnostic information.

[0011] FIG. 1 is a schematic diagram of a system 100 (e.g., a medical device) in which one or more features of the subject matter herein may be implemented. All or a portion of system 100 may be used to collect information including EP exams, image data, and / or training data sets, and / or may be used to implement machine learning algorithms including a decision engine 101. As shown, system 100 includes a catheter 105 including at least one electrode 106, a probe 110 including, in addition to catheter 105, a shaft 112, a sheath 113, and a manipulator 114, a physician 115 (or medical professional), a heart 120, a patient 125, and a bed 130 (or table). Insets 140 and 150 show heart 120 and catheter 105 in more detail. System 100 also includes a console 160 including one or more processors 161 and memory 162, and a display 165, as shown.

[0012] Each element and / or item of system 100 represents one or more of that element and / or item. The example system 100 shown in FIG. 1 may be modified to implement embodiments disclosed herein. The embodiments of the present disclosure may be similarly applied using other system components and configurations. Furthermore, system 100 may include additional components, such as elements for sensing electrical activity, wired or wireless connectors, processing and display devices, etc.

[0013] The exemplary system 100 can be utilized (e.g., using an evaluation engine) to detect, diagnose, and treat cardiac diseases. Cardiac diseases such as cardiac arrhythmias (particularly atrial fibrillation) persist as common and dangerous medical disorders, especially in the aging population. In a patient (e.g., patient 125) with normal sinus rhythm, the heart (e.g., heart 120), which includes atria, ventricles, and excitatory conduction tissue, is electrically stimulated and beats in a synchronous, patterned manner (note that this electrical excitation may be detected as an intracardiac signal, etc.).

[0014] In a patient with cardiac arrhythmia (e.g., patient 125), abnormal regions of cardiac tissue do not follow the synchronous beating cycle associated with normal conductive tissue, as in a patient with normal sinus rhythm. Conversely, the abnormal regions of cardiac tissue conduct abnormally to adjacent tissue, thereby disrupting the cardiac cycle into an asynchronous cardiac rhythm (note that this asynchronous cardiac rhythm can also be detected as an intracardiac signal). Such abnormal conduction has long been known and occurs in various regions of the heart (e.g., heart 120), along the conduction pathways of the atrioventricular (AV) node, for example, in the region of the sino-atrial (SA) node, or in the myocardial tissue that forms the walls of the ventricular and atrial chambers.

[0015] A catheter 105, which may include at least one electrode 106 and a catheter needle coupled thereto, may be configured to acquire biometric data, including electrical signals, from an internal organ, such as the heart 120, and / or to ablate tissue regions in a chamber of the heart 120. The electrode 106 represents any element (e.g., a tracking coil, a piezoelectric transducer, an electrode, or a combination of elements) configured to ablate tissue regions or acquire biometric data. For example, the catheter 105 may use the electrode 106 to perform intravascular ultrasound and / or MRI catheterization for imaging of the heart 120. Inset 150 shows a close-up of the catheter 105 within a chamber of the heart 120. While the catheter 105 is shown as a point catheter, it will be understood that any shape including one or more electrodes 106 may be used to implement the embodiments disclosed herein. Examples of the catheter 106 include, but are not limited to, a linear catheter having multiple electrodes, a balloon catheter including electrodes distributed on multiple spines forming a balloon, a lasso or loop catheter having multiple electrodes, or any other applicable shape. The linear catheter may be fully or partially elastic so that it can twist, bend, or otherwise change its shape based on received signals and / or the application of an external force (e.g., cardiac tissue) to the linear catheter. The balloon catheter may be designed so that its electrodes can be held in intimate contact with the endocardial surface when deployed within a patient's body. For example, the balloon catheter may be inserted into a lumen such as a pulmonary vein (PV). The balloon catheter may be inserted into the PV in a deflated state so that the balloon catheter does not occupy the full volume of the PV while inserted into the PV. The balloon catheter may be expanded while inside the PV, so that the electrodes on the balloon catheter contact the entire circular portion of the PV. Such contact with the entire circular portion of the PV, or any other lumen, may enable efficient imaging and / or ablation.

[0016] The probe 110 may be navigated by a physician 115 into the heart 120 of a patient 125 residing in a bed 130 to perform focused cardiac imaging. For example, the physician 115 may insert the shaft 112 through the sheath 113 while manipulating the distal end of the shaft 112 using a manipulator 114 near the proximal end of the catheter 105 and / or a deflection from the sheath 113. As shown in inset 140, the catheter 105 may be attached at the distal end of the shaft 112. The catheter 105 may be inserted through the sheath 113 in a collapsed state and then expanded within the heart 120.

[0017] The probe 110, catheter 105, and other items of system 100 may be connected to a console 160. The console 160 may include any computing device that employs machine learning algorithms, represented as a decision engine 101. According to one embodiment, the console 160 includes one or more processors 161 (computing hardware) and memory 162 (non-transitory tangible media), where the one or more processors 161 execute computer instructions for the decision engine 101 and the memory 162 stores these instructions for execution by the one or more processors 161. For example, the console 160 may be programmed by the decision engine 101 to perform the functions of receiving one or more pairs of heartbeats, generating a model based on the one or more pairs of heartbeats, determining whether two given heartbeats are part of the same arrhythmia, and generating a similarity result for algorithm input. According to one or more exemplary embodiments, the decision engine 101 may be external to the console 160, such as located in the catheter 105, an external device, a mobile device, a cloud-based device, or may be a standalone processor. In this regard, the decision engine 101 may be transferable / downloadable in electronic form over a network.

[0018] Console 160 may be any computing device described herein, including software (e.g., decision engine 101) and / or hardware, such as a general-purpose computer, with appropriate front-end and interface circuitry for sending and receiving signals to and from catheter 105 and for controlling other components of system 100. For example, the front-end and interface circuitry may include an input / output (I / O) communication interface that allows console 160 to receive signals from and / or transmit signals to at least one electrode 106. Console 160 may include real-time noise reduction circuitry, typically configured as a field programmable gate array (FPGA), followed by an analog-to-digital (A / D) electrocardiograph or electromyogram (EMG) signal conversion integrated circuit. Console 160 may communicate signals from the A / D ECG or EMG circuitry to a separate processor and / or may be programmed to perform one or more functions disclosed herein.

[0019] In some embodiments, the console 160 can be further configured to receive and process biometric data to determine whether a given tissue region conducts electricity. For example, the biometric data, such as patient biometrics, patient data, or patient biometric data, can include one or more of local temporal activation (LAT), electrical activity, topology, bipolar mapping, dominant frequency, impedance, etc. The LAT can be a time point of threshold activity corresponding to local activation calculated based on a normalized initial starting point (e.g., reference annotation). The electrical activity can be any applicable electrical signal that can be measured based on one or more thresholds and can be detected and / or enhanced based on signal-to-noise ratio and / or other filters. The topology can correspond to the physical structure of a body part or a portion of a body part, and can correspond to changes in the physical structure for different portions of the body part or for different body parts. The dominant frequency can be a frequency or range of frequencies prevalent in a portion of a body part and can differ in different portions of the same body part. For example, the dominant frequency of an ectopic cardiac origin in an aFib can differ from the dominant frequency of healthy tissue in the same heart. Impedance can be a measurement of resistance in a given area of ​​a body part.

[0020] According to one embodiment, the display 165 is connected to the console 160. During a procedure, the console 160 can facilitate the presentation of body part renderings to the physician 115 on the display 165 and store data representing the body part renderings in the memory 162. In some embodiments, the physician 115 may be able to manipulate the body part renderings using one or more input devices, such as a touchpad, mouse, keyboard, gesture recognizer, etc. For example, the input device can be used to change the position of the catheter 105, which updates the rendering. In alternative embodiments, the display 165 can include a touchscreen that can be configured to receive input from the medical professional 115 in addition to presenting the body part renderings. The display 165 can be located at the same location or at a remote location, such as a remote hospital, or within a separate healthcare provider network. Furthermore, the system 100 can be part of a surgical system configured to obtain anatomical and electrical measurements of a patient's organs, such as the heart 120, and to perform cardiac ablation procedures. One example of such a surgical system is the Carto® system sold by Biosense Webster.

[0021] According to one embodiment, the console 160 can be connected by a cable to body surface electrodes, which can include adhesive skin patches that are applied to the patient 125. The processor 161 can interface with the current tracking module to determine position coordinates of the catheter 105 inside the body portion of the patient 125. The position coordinates can be based on impedance or electromagnetic fields measured between the body surface electrodes and the electrodes 106 of the catheter 105 or other electromagnetic component. Additionally or alternatively, location pads can be placed on the surface of the bed 130 or can be separate from the bed 130.

[0022] System 100 can also, and optionally, acquire biometric data, such as anatomical measurements of heart 120, using ultrasound, computed tomography (CT), MRI, or other medical imaging techniques known in the art. System 100 can acquire ECG or electrical measurements using catheters or other sensors that measure electrical properties of heart 120. The biometric data, including the anatomical and electrical measurements, can then be stored in a non-transitory tangible medium of console 160. The biometric data can be transmitted from the non-transitory tangible medium to computing device 161. Alternatively, or additionally, the biometric data may be transmitted to a server, which may be local or remote, using a network as further described herein.

[0023] According to embodiments, catheter 105 can be configured to ablate a tissue region of a chamber of heart 120. Inset 150 shows a close-up of catheter 105 within a chamber of heart 120. According to embodiments disclosed herein, an ablation electrode, such as at least one electrode 106, can be configured to deliver energy to a tissue region of a body organ, such as heart 120. The energy can be thermal energy and can cause damage to the tissue region starting at the surface of the tissue region and extending through the thickness of the tissue region.

[0024] According to one or more embodiments, a catheter containing a position sensor can be used to determine the trajectories of points on the heart surface. These trajectories can be used to infer motion characteristics, such as the contractile force of the tissue. A map indicative of such motion characteristics can be constructed when trajectory information is sampled at a sufficient number of points within the heart 120.

[0025] Electrical activity at a point within the heart 120 can be measured by advancing a catheter 105, which typically contains an electrical sensor at or near its distal tip (e.g., at least one ablation electrode 134), to the point within the heart 120, contacting tissue with the sensor and acquiring data at the point. One drawback with mapping a heart chamber using a catheter 105 containing only a single distal tip electrode is the long period of time required to accumulate data per point over the requisite number of points needed for a detailed map of the heart chamber as a whole. Therefore, multi-electrode catheters have been developed to simultaneously measure electrical activity at multiple points within the heart chamber.

[0026] According to one example, a multi-electrode catheter can be advanced into a chamber of the heart 120. Anteroposterior (AP) and lateral fluorograms can be acquired to establish the position and orientation of each of the electrodes. An EGM can be recorded from each of the electrodes in contact with the cardiac surface relative to a temporal reference, such as the occurrence of a P wave in sinus rhythm from a surface ECG. The system further disclosed herein can distinguish between electrodes that record electrical activity and those that do not due to their lack of proximity to the endocardial wall. After the first EGM is recorded, the catheter can be repositioned, and fluorograms and EGMs can be recorded again. An electrical map can then be constructed from a repetition of the above process.

[0027] Electrodes that record electrical activity and electrodes that do not record electrical activity due to not being in close proximity to the endocardial wall. After the first EGM is recorded, the catheter can be repositioned and a fluorogram and EGM can be recorded again. An electrical map can then be constructed from a repetition of the above process.

[0028] According to one example, cardiac mapping can be generated based on the detection of intracardiac electrical fields. Non-contact methods can be implemented to simultaneously acquire large amounts of cardiac electrical information. For example, a catheter having a distal end portion can include a series of sensor electrodes distributed over its entire surface and connected to insulated conductors for connection to signal sensing and processing means. The size and shape of the end portion can be such that the electrodes are spaced a large distance from the wall of the cardiac chamber. The intracardiac electrical fields can be detected during a single cardiac beat. According to one example, the sensor electrodes can be distributed on a series of circumferentially spaced apart circles in planes. These planes can be perpendicular to the longitudinal axis of the catheter end portion. At least two additional electrodes can be provided adjacent each end of the longitudinal axis of the end portion. As a more specific example, the catheter can include four circumferences with eight electrodes equiangularly spaced apart on each circumference. Thus, in this particular embodiment, the catheter can include at least 34 electrodes (32 circumferential electrodes and two end electrodes).

[0029] According to another example, electrophysiological cardiac mapping systems and techniques based on non-contact and non-expandable multi-electrode catheters can be implemented. EGMs can be obtained using a catheter with multiple electrodes (e.g., 42 to 122 electrodes). According to this implementation, knowledge of the relative geometry of the probe and endocardium can be obtained, for example, through an independent imaging modality such as transesophageal echocardiography. After independent imaging, non-contact electrodes can be used to measure cardiac surface potentials, from which a map can be constructed. This technique may include the following steps (after the independent imaging step): (a) measuring potentials using multiple electrodes disposed on a probe placed within the heart 120; (b) determining the geometric relationship between the probe surface and the endocardium surface; (c) generating a matrix of coefficients representing the geometric relationship between the probe surface and the endocardium surface; and (d) determining the endocardium potentials based on the electrode potentials and the matrix of coefficients.

[0030] According to another example, techniques and devices can be implemented for mapping the electrical potential distribution of a cardiac chamber. An intracardiac multi-electrode mapping catheter assembly can be inserted into a patient's heart 120. This mapping catheter assembly can include a multi-electrode array with an integrated reference electrode, or preferably, a companion reference catheter. These electrodes can be deployed in the form of a substantially spherical array. The electrode array can be spatially referenced to a point on the endocardial surface by the reference electrode or by a reference catheter that contacts the endocardial surface. A preferred electrode array catheter can have a large number of individual electrode sites (e.g., at least 24). Additionally, the method of this example can be implemented by knowing the location of each electrode site on the array and the cardiac geometry. These locations are preferably determined by impedance plethysmography.

[0031] According to another example, a cardiac mapping catheter assembly can include an electrode array defining multiple electrode sites. The mapping catheter assembly can also include a lumen for receiving a reference catheter having a distal tip electrode assembly that can be used to probe the heart wall. The mapping catheter can include a braid of insulated wires (e.g., having 24 to 64 wires within the braid), each of which can be used to form an electrode site. The catheter can be easily positioned in the heart 120 to be used to acquire electrical activity information from a first set of non-contact electrode sites and / or a second set of contact electrode sites.

[0032] According to another example, another catheter for mapping electrophysiological activity within the heart can be implemented. The catheter body can include a distal tip adapted to deliver stimulation pulses for pacing the heart or an ablation electrode for ablating tissue in contact with the tip. The catheter can further include at least one pair of orthogonal electrodes that generate a difference signal indicative of local cardiac electrical activity adjacent the orthogonal electrodes.

[0033] According to another embodiment, a process for measuring electrophysiological data within a heart chamber can be implemented. The method can include, in part, positioning a set of active and passive electrodes within the heart 120, generating an electric field within the heart chamber by applying an electric current to the active electrodes, and measuring the electric field at the passive electrode sites. The passive electrodes are included in an array disposed on an inflatable balloon of a balloon catheter. In an embodiment, the array is said to have 60-64 electrodes.

[0034] According to another example, cardiac mapping can be performed using one or more ultrasound transducers. The ultrasound transducers can be inserted into a patient's heart 120 and can acquire multiple ultrasound slices (e.g., two-dimensional or three-dimensional slices) at various locations and orientations within the heart 120. The location and orientation of a particular ultrasound transducer may be known, and the acquired ultrasound slices can be stored for later display. One or more ultrasound slices corresponding to the position of a probe (e.g., a treatment catheter) can be later displayed, and the probe can be overlaid on one or more ultrasound slices.

[0035] According to another example, body patches and / or body surface electrodes may be positioned on or adjacent to the patient's body. A catheter having one or more electrodes may be positioned within the patient's body (e.g., within the patient's heart 120), and the position of the catheter may be determined by the system based on signals transmitted and / or received between one or more electrodes of the catheter and the body patch and / or body surface electrodes. Additionally, the catheter electrodes may sense biometric data (e.g., LAT values) from within the patient's body (e.g., within the heart 120). The biometric data may be associated with the determined catheter position, such that a rendering of the patient's body part (e.g., heart 120) may be displayed, showing the biometric data superimposed on the body shape.

[0036] Considering system 100, it can be seen that cardiac arrhythmias, including atrial arrhythmias, can be multiwavelet-reentrant, characterized by multiple asynchronous loops of electrical impulses (e.g., another example of intracardiac signals) that scatter and often self-propagate around the atria. Alternatively, or in addition to multiwavelet-reentrant, cardiac arrhythmias can also have a local origin, such as when isolated regions of tissue within the atria are autonomously excited in a rapid, repetitive manner (e.g., another example of intracardiac signals). Ventricular tachycardia (V-tach or VT) is a tachycardia or fast cardiac rhythm that occurs in one of the ventricles. It is a potentially fatal arrhythmia because it can lead to ventricular fibrillation and sudden death.

[0037] For example, aFib occurs when normal electrical impulses generated by the sinoatrial node (e.g., another example of intracardiac signaling) are overwhelmed by chaotic electrical impulses (e.g., signal interference) originating in the atrial tissue and / or PVs, causing irregular impulses to be conducted to the ventricles. This results in an irregular heartbeat that may persist for minutes to weeks, or even years. In many cases, aFib is a chronic condition that often carries a small increase in the risk of death from stroke. The first-line treatment for aFib is medication to reduce the heart rate or restore normal heart rhythm. Furthermore, patients with aFib are often given anticoagulants to protect against stroke. The use of such anticoagulants carries its own risks of internal bleeding. In some patients, medication is insufficient, and their aFib is deemed drug-refractory, i.e., untreatable by standard pharmacological intervention. Synchronized cardioversion can also be used to convert aFib to a normal cardiac rhythm. Alternatively, patients with aFib may be treated with catheter ablation.

[0038] Catheter ablation-based therapy may involve mapping the electrical properties of cardiac tissue, particularly the endocardium and cardiac volume, and selectively ablating the cardiac tissue through the application of energy. Cardiac mapping (an example of cardiac imaging) involves creating a map of the electrical potential of wave propagation along cardiac tissue (e.g., a voltage map) or a map of arrival times (e.g., a LAT map) to points located in various tissues. Cardiac mapping (e.g., a cardiac map) can be used to detect local cardiac tissue dysfunction. Ablation, such as cardiac mapping-based ablation, can stop or alter the propagation of unwanted electrical signals from one portion of the heart 120 to another.

[0039] Ablation techniques disrupt unwanted electrical pathways by creating non-conductive lesions. Various energy delivery modalities have been previously disclosed for creating lesions, including the use of microwave, laser, and more commonly, radiofrequency energy to create conduction blocks along cardiac tissue walls. In a two-stage procedure (e.g., mapping followed by ablation), electrical activity at points within the heart 120 is typically sensed and measured by advancing a catheter 105 containing one or more electrical sensors (e.g., electrodes 106) into the heart 120 and acquiring / collecting data (e.g., ECG data) at multiple points. This data is then used to select a target region of the endocardium where ablation will be performed.

[0040] Cardiac ablation and other cardiac electrophysiology procedures are becoming increasingly complex as clinicians treat challenging conditions such as atrial fibrillation and ventricular tachycardia. Treatment of refractory arrhythmias may currently rely on the use of three-dimensional (3D) mapping systems to reconstruct the anatomy of the targeted heart chamber. In this regard, the decision engine 101 employed by the system 100 herein manipulates and evaluates ECG data to generate improved tissue data that enables more accurate diagnoses, images, scans, and / or maps for treating aFib.

[0041] For example, cardiologists rely on software such as the Complex Fractionated Atrial Electrograms (CFAE) module of the CARTO® 3 3D mapping system manufactured by Biosense Webster, Inc. (Diamond Bar, Calif.) to generate and analyze ECG data. The decision engine 101 of the system 100 enhances this software to generate and analyze improved tissue data, which further provides multiple pieces of information regarding the electrophysiological properties of the heart 120 (including scar tissue) that are representative of the cardiac substrate (anatomical and functional) of aFib.

[0042] Abnormal tissue is generally characterized by low-voltage ECG activity. However, early clinical experience with endocardial-epicardial mapping has demonstrated that low-voltage regions are not always the sole arrhythmogenic mechanism in these patients. Indeed, low- or medium-voltage regions may exhibit ECG fragmentation and prolonged activity during sinus rhythm, corresponding to critical isthmuses identified during sustained, coherent ventricular arrhythmias (e.g., only applicable to nonpermissive ventricular tachycardia). Furthermore, ECG fragmentation and prolonged activity are often observed in regions exhibiting normal or near-normal voltage amplitudes (>1–1.5 mV). These latter regions can be assessed according to voltage amplitude but are not considered normal according to the intracardiac signal and therefore represent true arrhythmogenic substrate. 3D mapping can identify the location of arrhythmogenic substrates on the endocardial and / or epicardial layers of the right and / or left ventricles, whose distribution may vary depending on the primary disease progression.

[0043] These cardiac disease-related substrates have been associated with the presence of disrupted and elongated ECGs in the endocardial and / or epicardial layers of the ventricular chambers (right and left). 3D mapping systems, such as the CARTO® 3, can identify the location of potential arrhythmogenic substrates for cardiomyopathies in relation to abnormal ECG detection.

[0044] Electrode catheters (e.g., catheter 105) are used during medical procedures to stimulate and map electrical activity within the heart and to ablate sites of abnormal electrical activity. In use, the electrode catheter is inserted into a major vein or artery, such as the femoral artery, and then guided into a chamber of the subject's heart. A typical ablation procedure involves inserting a catheter having at least one electrode at its distal end into a chamber of the heart. A reference electrode is typically provided by a second catheter taped to the patient's skin or positioned within or near the heart. Radio frequency (RF) current is applied to the tip electrode of the ablation catheter, causing current to flow through the medium surrounding the tip electrode, i.e., blood and tissue, toward the reference electrode. The distribution of the current depends on the amount of electrode surface in contact with the tissue compared to blood, which has a higher electrical conductivity than tissue. Tissue heating occurs due to the electrical resistance of the tissue. Sufficient tissue heating causes cell destruction in the cardiac tissue, resulting in the formation of lesions in the non-conductive cardiac tissue. During this process, the electrode also heats due to conduction from the heated tissue to the electrode itself. If the electrode temperature becomes high enough, possibly above 60 degrees Celsius, a thin, transparent film of dehydrated blood proteins can form on the electrode's surface. As the temperature continues to rise, this dehydrated layer can gradually thicken, causing blood to coagulate on the electrode surface. Because dehydrated biological material has a higher electrical resistance than endocardial tissue, the impedance to the flow of electrical energy into the tissue also increases.

[0045] Treatment of cardiac disorders, such as cardiac arrhythmias, often requires obtaining detailed mapping of cardiac tissue, chambers, veins, arteries, and / or electrical pathways. For example, a prerequisite for successful catheter ablation is accurate localization of the source of the cardiac arrhythmia within a cardiac chamber. Such localization can be performed by electrophysiological studies, during which spatially resolved electrical potentials are detected by a mapping catheter introduced into the cardiac chamber. This electrophysiological study, also known as electroanatomical mapping, provides 3D mapping data that can be displayed on a monitor. In many cases, mapping and therapy functions (e.g., ablation) are provided by a single catheter or a group of catheters, with the mapping catheter simultaneously acting as a therapy (e.g., ablation) catheter. In this case, the decision engine 101 can be stored and executed directly by the catheter 105.

[0046] Mapping of cardiac regions, such as cardiac regions, tissues, veins, arteries, and / or electrical pathways of a heart (e.g., 120), can result in the identification of problem areas, such as scar tissue, arrhythmia sources (e.g., electrical rotors), and healthy regions. Cardiac regions can be mapped such that a visual rendering of the mapped cardiac region is provided using a display, as further disclosed herein. Furthermore, cardiac mapping (an example of cardiac imaging) can include mapping based on one or more modalities, such as, but not limited to, local activation time (LAT), electrical activity, topology, bipolar voltage mapping, dominant frequency, or impedance. Data corresponding to multiple modalities can be captured using catheters inserted within the patient's body and provided for rendering simultaneously or at different times based on corresponding settings and / or medical professional preferences.

[0047] Cardiac mapping can be performed using one or more techniques. As an example of a first technique, cardiac mapping can be performed by sensing the electrical properties of cardiac tissue, e.g., the LAT, as a function of precise location within the heart. The corresponding data can be acquired using one or more catheters advanced into the heart using catheters having electrical and location sensors at their distal tips. As a specific example, location and electrical activity can be initially measured at several hundred points on the inner surface of the heart. These data points (also referred to as electroanatomical points) can generally be sufficient to generate a preliminary reconstruction or map of the cardiac surface with satisfactory quality. This preliminary map can be combined with data acquired at additional points to generate a more comprehensive map of the cardiac electrical activity. In clinical settings, it is not uncommon to use multi-electrode catheters to aggregate data at thousands of points to generate a detailed and comprehensive map of the electrical activity of the cardiac chambers. The detailed map can then serve as a basis for making decisions regarding therapeutic actions, e.g., tissue ablation, to alter the propagation of the cardiac electrical activity and restore normal cardiac rhythm.

[0048] 2 shows a block diagram of an exemplary system 200 for remotely monitoring and transmitting vital data (i.e., patient vital information, patient data, or patient biometric data). In the example shown in FIG. 2, system 200 includes a monitoring and processing device 202 (i.e., patient data monitoring and processing device) associated with a patient 204, a local computing device 206, a remote computing system 208, a first network 210, and a second network 211. According to one or more embodiments, monitoring and processing device 202 may be an example of catheter 105 of FIG. 1, patient 204 may be an example of patient 125 of FIG. 1, and local computing device 206 may be an example of console 160 of FIG. 1.

[0049] The monitoring and processing device 202 includes patient biometric sensors 212, a processor 214, user input (UI) sensors 216, a memory 218, and a transmitter-receiver (i.e., transceiver) 222. During surgery, the monitoring and processing device 202 acquires biometric data (e.g., electrical signals, blood pressure, temperature, blood glucose levels, or other biometric data) of the patient 204 and / or receives at least a portion of the biometric data representing any acquired patient biometric information and additional information associated with any acquired patient biometric information from one or more other patient biometric monitoring and processing devices. The additional information may be, for example, diagnostic information and / or additional information obtained from additional devices, such as wearable devices. The monitoring and processing device 202 can use machine learning algorithms and evaluation engines described herein to process data, including the acquired biometric data and any biometric data received from one or more other patient biometric monitoring and processing devices.

[0050] The monitoring and processing device 202 can continuously or periodically monitor, store, process, and transmit any number of various patient biometrics (e.g., acquired biometric data) via the network 210. As described herein, examples of patient biometrics include electrical signals (e.g., ECG signals and brain biometrics), blood pressure data, blood glucose data, and temperature data. Patient biometrics can be monitored and transmitted to treat any number of various diseases, such as cardiovascular disease (e.g., arrhythmias, cardiomyopathies, and coronary artery disease) and autoimmune diseases (e.g., type I and type II diabetes).

[0051] The patient biosensor 212 may include, for example, one or more transducers configured to convert one or more environmental conditions into electrical signals, resulting in different types of biometric data being acquired. For example, the patient biosensor 212 may include one or more of an electrode configured to acquire an electrical signal (e.g., a cardiac signal, a brain signal, or other bioelectric signal), a temperature sensor (e.g., a thermocouple), a blood pressure sensor, a blood glucose sensor, a blood oxygen sensor, a pH sensor, an accelerometer, and a microphone.

[0052] As described in more detail herein, the monitoring and processing unit 202 may implement a machine learning algorithm (e.g., decision engine 101 of FIG. 1 ) to receive one or more pairs of heart beats, generate a model based on the one or more pairs of heart beats, determine whether two given heart beats are part of the same arrhythmia, and generate a similarity result for algorithm input. The monitoring and processing unit 202 may implement a machine learning algorithm (e.g., decision engine 101 of FIG. 1 ) to generate improved tissue data that enables more accurate diagnoses, images, scans, and / or maps for treating aFib.

[0053] In another example, the monitoring and processing device 202 may be an ECG monitor for monitoring ECG signals of a heart (e.g., heart 120 in FIG. 1 ). In this regard, the patient biosensor 212 of the ECG monitor may include one or more electrodes (e.g., electrodes of catheter 105 in FIG. 1 ) for acquiring the ECG signals. The ECG signals may be used in the treatment of various cardiovascular diseases.

[0054] The processor 214 can be configured to receive, process, and manage biometric data acquired by the patient biometric sensors 212 and communicate the biometric data to the memory 218 for storage and / or across the network 210 via the transceiver 222. As described in more detail herein, data from one or more other monitoring and processing devices 202 can also be received by the processor 214 through the transceiver 222. Also, as described in more detail herein, the processor 214 can be configured to selectively respond to different tapping patterns (e.g., single tap or double tap) received from the UI sensors 216 (e.g., internal capacitance sensors) such that different tasks of the patch (e.g., data acquisition, storage, or transmission) can be initiated based on the detected pattern. In some embodiments, the processor 214 can generate audible feedback regarding the detection of the gesture.

[0055] The UI sensors 216 include, for example, piezoelectric or capacitive sensors configured to receive user input, such as a tap or touch. For example, the UI sensors 216 may be controlled to implement capacitive coupling in response to the patient 204 tapping or touching the surface of the monitoring and processing device 202. Gesture recognition may be implemented via any one of a variety of capacitive types, such as resistive capacitive, surface capacitive, projected capacitive, surface acoustic wave, piezoelectric, and infrared touch. The capacitive sensors may be positioned over a small area or length of the surface, such that a tap or touch on the surface activates the monitoring device.

[0056] Memory 218 is any non-transitory, tangible medium such as magnetic, optical, or electronic memory (eg, any suitable volatile and / or non-volatile memory, such as random access memory or a hard disk drive).

[0057] The transceiver 222 may include a separate transmitter and a separate receiver, or the transceiver 222 may include a transmitter and receiver integrated into a single device.

[0058] According to an embodiment, the monitoring and processing device 202 may be a device that is internal to the body of the patient 204 (e.g., subcutaneously implantable). The monitoring and processing device 202 may be inserted into the patient 204 via any applicable method, including oral infusion, surgical insertion via a vein or artery, an endoscopic procedure, or a laparoscopic procedure.

[0059] According to some embodiments, the monitoring and processing device 202 may be a device external to the patient 204. For example, as described in further detail herein, the monitoring and processing device 202 may include an attachable patch (e.g., attached to the patient's skin). The monitoring and processing device 202 may also include a catheter with one or more electrodes, a probe, a blood pressure cuff, a weight scale, a bracelet or smartwatch biometric tracker, a glucose monitor, a continuous positive airway pressure (CPAP) machine, or virtually any device that can provide input regarding the patient's health or biometrics.

[0060] According to one embodiment, the monitoring and processing device 202 may include both components internal to the patient and components external to the patient. While a single monitoring and processing device 202 is shown in FIG. 2 , an exemplary system may include multiple patient vital signs monitoring and processing devices. For example, the monitoring and processing device 202 may be in communication with one or more other patient vital signs monitoring and processing devices. Additionally or alternatively, one or more other patient vital signs monitoring and processing devices may be in communication with the network 210 and other components of the system 200.

[0061] The local computing device 206 and / or the remote computing system 208, along with the monitoring and processing unit 202, may be any combination of software and / or hardware that separately or collectively stores, executes, and implements the machine learning algorithms and evaluation engines and their functionality. Furthermore, as described herein, the local computing device 206 and / or the remote computing system 208, along with the monitoring and processing unit 202, may be an electronic computer framework that encompasses and / or uses any number and combination of computing devices and networks that utilize various communication technologies. The local computing device 206 and / or the remote computing system 208, along with the monitoring and processing unit 202, may be easily scalable, extensible, and modular, with the ability to change to different services or reconfigure some features independently of other features.

[0062] According to one embodiment, the local computing device 206 and the remote computing system 208, along with the monitoring and processing unit 202, include at least a processor and a memory, where the processor executes computer instructions related to the machine learning algorithms and the evaluation engine, and the memory stores instructions for execution by the processor.

[0063] The local computing device 206 and / or the remote computing system 208, along with the monitoring and processing unit 202, may be any combination of software and / or hardware that separately or collectively stores, executes, and implements the machine learning algorithms and evaluation engines and their functionality. Furthermore, as described herein, the local computing device 206 and / or the remote computing system 208, along with the monitoring and processing unit 202, may be an electronic computer framework that encompasses and / or uses any number and combination of computing devices and networks that utilize various communication technologies. The local computing device 206 and / or the remote computing system 208, along with the monitoring and processing unit 202, may be easily scalable, extensible, and modular, with the ability to change to different services or reconfigure some features independently of other features.

[0064] According to one embodiment, the local computing device 206 and the remote computing system 208, along with the monitoring and processing unit 202, include at least a processor and a memory, where the processor executes computer instructions related to the machine learning algorithms and the evaluation engine, and the memory stores instructions for execution by the processor.

[0065] The local computing device 206 of the system 200 can be configured to communicate with the monitoring and processing device 202 and to act as a gateway to the remote computing system 208 through a second network 211. The local computing device 206 can be, for example, a smartphone, smartwatch, tablet, or other portable smart device configured to communicate with other devices over the network 211. Alternatively, the local computing device 206 can be a fixed or stand-alone device, such as, for example, a fixed base station including modem and / or router capabilities, a desktop or laptop computer that uses an executable program to communicate information between the processing device 202 and the remote computing system 208 via a wireless module in a PC, or a USB dongle. Biometric data can be communicated between the local computing device 206 and the monitoring and processing device 202 using short-range wireless technology standards (e.g., Bluetooth, Wi-Fi, ZigBee, Z-wave, and other short-range wireless standards) over a short-range wireless network 210, such as a local area network (LAN) (e.g., a personal area network (PAN)). In some embodiments, as described in further detail herein, the local computing device 206 may also be configured to display the acquired patient electrical signals and information associated with the acquired patient electrical signals.

[0066] In some embodiments, remote computing system 208 can be configured to receive at least one of the monitored patient's vital signs and information associated with the monitored patient via network 211, which is a long-range network. For example, if local computing device 206 is a cellular phone, network 211 may be a wireless cellular network, and information may be communicated between local computing device 206 and remote computing system 208 via a wireless technology standard, such as any of the wireless technologies described above. As described in further detail herein, remote computing system 208 can be configured to provide (e.g., visually display and / or audibly provide) the patient's vital signs and / or information associated therewith to a medical professional, physician, healthcare professional, or the like.

[0067] 2, network 210 is an example of a short-range network (e.g., a local area network (LAN) or a personal area network (PAN)). Information may be transmitted between monitoring and processing equipment 202 and local computing device 206 over short-range network 210 using any one of a variety of short-range wireless communication protocols, such as Bluetooth, Wi-Fi, ZigBee, Z-wave, near field communication (NFC), ultra-wideband, Zigbee, or infrared (IR).

[0068] Network 211 may be a wired network, a wireless network, or may include one or more wired and wireless networks, such as an intranet, a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a direct connection or series of connections, a cellular telephone network, or any other network or medium capable of facilitating communication between local computing device 206 and remote computing system 208. Information may be transmitted over network 211 using any one of a variety of long-range wireless communication protocols (e.g., TCP / IP, HTTP, 3G, 4G / LTE, or 5G / New Radio). Wired connections may be implemented using Ethernet, Universal Serial Bus (USB), RJ-11, or any other wired connection commonly known in the art. Wireless connections may be implemented using Wi-Fi, WiMAX, Bluetooth, infrared, cellular networks, satellite, or any other wireless connection technique. Additionally, several networks may operate alone or in communication with each other to facilitate communication within network 211. In some cases, remote computing system 208 may be implemented as a physical server on network 211. In other cases, remote computing system 208 may be implemented as a virtual server on a public cloud computing provider of network 211 (e.g., Amazon Web Services (AWS)).

[0069] Figure 3 shows an illustration of an artificial intelligence system 300 according to one or more embodiments. The artificial intelligence system 300 includes data 310, a machine 320, a model 330, multiple outcomes 340, and underlying hardware 350. Figure 4 shows a block diagram of a method 400 implemented in the artificial intelligence system of Figure 3. The description of Figures 3 and 4 will be made with reference to Figure 2 for ease of understanding.

[0070] Generally, the artificial intelligence system 300 operates the method 400 by using the data 310 to train a machine 320 (e.g., the local computing device 206 of FIG. 2 ) while building a model 330 to enable multiple (predicted) outcomes 340. In such a configuration, the artificial intelligence system 300 can operate against hardware 350 (e.g., the monitoring and processing unit 202 of FIG. 2 ) to train the machine 320, build the model 330, and predict outcomes using algorithms. These algorithms can be used to solve the trained model 330 and predict outcomes 340 associated with the hardware 350. These algorithms can generally be categorized as classification algorithms, regression algorithms, and clustering algorithms.

[0071] At block 410, the method 400 includes collecting data 310 from hardware 350. A machine 320 acts as a controller or data collector associated with the hardware 350 and / or is associated with that hardware. The data 310 may be associated with the hardware 350 and may include electrophysiology tests having therein BS ECG data, IcECG data, location data, and / or position data (e.g., biometric data that may be derived from the monitoring and processing device 202 of FIG. 2), which may further include two or more heartbeats. For example, the data 310 may be ongoing data or output data associated with the hardware 350. The data 310 may also include currently collected data, historical data, or other data from the hardware 350. For example, the data 310 may include measurements taken during a surgical procedure and may be associated with the outcome of the surgical procedure. For example, cardiac temperature (e.g., of the patient 204 of FIG. 2) may be collected and correlated with the outcome of the cardiac procedure. Additionally, the data 310 may include signal mimics such as deflection noise, ventricular far-field, respiratory interference, and ringing artifacts of analog or digital filters. Further examples of signal mimics include, but are not limited to, artifacts remaining after hum removal. These signal mimics mimic the correlation between two or more beats, thereby obscuring whether two or more beats are part of the same arrhythmia.

[0072] At block 420, the method 400 includes training the machine 320, such as with respect to the hardware 350. This training may include analyzing and correlating the data 310 collected at block 410. For example, in the case of two heartbeats, the machine 320 may be trained to determine whether the two heartbeats are part of the same arrhythmia (to generate one or more corresponding diagnoses). That is, the artificial intelligence system 300 may utilize a neural network, as described herein, to determine whether the two heartbeats are part of the same arrhythmia. According to one or more embodiments, the artificial intelligence system 300 trains the neural network by applying an algorithm that measures the strength of the association between the two heartbeats. Thus, unlike traditional correlation algorithms, the artificial intelligence system 300 may learn other features relevant to determining similarity based on the strength of the association.

[0073] At block 430, the method 400 includes building a model 330 on the data 310 associated with the hardware 350 (e.g., generating a model based on one or more corresponding diagnoses by the decision engine 101 of FIG. 1 ). Building the model 330 may include modeling of physical hardware or software, modeling of algorithms, and / or the like. This modeling may aim to represent the collected and trained data 310. According to an embodiment, the model 330 may be configured to model the operation of the hardware 350 and model the data 310 collected from the hardware 350 to predict outcomes achieved by the hardware 350. Furthermore, if the model is trained with high-quality data, the model may learn to ignore signal mimics. The model may be implemented by another algorithm, method, device, or application, such as automatic pace mapping, PaSo™ software, body surface matching, intracardiac pattern matching, or clustering of arrhythmias such as ECG stress charts of a Holter device, a K-means clustering algorithm, etc. Signal mimics include analog and / or digital filter ringing artifacts, deflection noise, ventricular far-field, respiratory interference / artifacts, artifacts remaining after hum removal, etc. When the model is used in the context of atrial IcECG, ventricular far-field may also be considered as a type of signal mimic. Algorithms, methods, devices, or applications implementing the model may include automated pace-mapping, as described in U.S. Patent No. 7,907,994 (B2), entitled "Automated pace-mapping for identification of cardiac arrhythmic conductive pathways and foci," which is incorporated herein by reference in its entirety.

[0074] At block 440, the method 400 includes predicting a plurality of outcomes 340 (e.g., a diagnosis) of the model 330 associated with the hardware 350. This prediction of the plurality of outcomes 340 can be based on the trained model 330. For example, to enhance understanding of the present disclosure, for the heart, if the temperature during the procedure is between 36.5°C and 37.89°C (i.e., between 97.7°F and 100.2°F, respectively), which would result in a positive outcome from the cardiac procedure, then that outcome can be predicted for a given procedure based on the temperature of the heart during the cardiac procedure. Thus, using the predicted outcome 340, the hardware 350 can be configured to provide a particular desired outcome 340 from the hardware 350.

[0075] 5, a block diagram of a method 500 according to one or more embodiments is shown. According to one embodiment, the method 500 may be performed by a decision engine described herein. Any combination of software and / or hardware (e.g., the console 160 of FIG. 1 and / or the local computing device 206 and the remote computing system 208 along with the monitoring and processing unit 202 of FIG. 2), separately or collectively, can store, execute, and implement the decision engine and its functionality.

[0076] Method 500 begins at block 510, where a decision engine aggregates / constructs a dataset. The dataset includes at least a patient's BS ECG and IcECG data. In some cases, the dataset includes validated patient cases in which two heartbeats correlated with the same arrhythmia have been verified (e.g., the decision engine validates the model against a first database after training to ensure accuracy above a threshold or prior training). For example, a particular EP exam can be manually annotated by a physician to identify whether a case includes two heartbeats correlated with the same arrhythmia.

[0077] In block 520, the decision engine trains. More specifically, the decision engine utilizes the data set of block 510 to train one or more components therein. Training can be performed in real time or retrospectively.

[0078] According to one or more exemplary embodiments, one or more components of the decision engine include an internal neural network, the inputs to which may be pairs of one or more of the following: BS ECG, IcECG, absolute position, position relative to a reference catheter, force exerted by the catheter on the tissue, an indication of tissue proximity position within a respiratory cycle, etc. In this regard, the decision engine utilizes a data set to train the internal neural network to discover and learn how two heart beats may or may not be considered part of the same arrhythmia.

[0079] FIG. 6A illustrates an example of an autoencoder architecture 600, and FIG. 6B illustrates a block diagram of a method 601 performed by the autoencoder architecture 600. The autoencoder architecture 600 operates to support the implementation of the machine learning algorithms and evaluation engines described herein. The autoencoder architecture 600 can be implemented in hardware, such as the machine 320 (e.g., the local computing device 206 of FIG. 2) and / or the hardware 350 (e.g., the monitoring and processing unit 202 of FIG. 2). The modules 610, 630, and 650 of the autoencoder 600 collectively operate as a neural network that performs the encoding portion of the autoencoder 600. The modules 850, 670, and 610 of the autoencoder 600 collectively operate as a neural network that performs the decoding portion of the autoencoder 600. Generally, a neural network is a network or circuit of neurons, or in the modern sense, an artificial neural network (ANN) composed of artificial neurons, nodes, or cells.

[0080] For example, an ANN contains a network of processing elements (artificial neurons) that can exhibit complex global behavior determined by the connections between the processing elements and element parameters. These connections in a neuronal network or circuit are modeled as weights. Positive weights reflect excitatory connections, while negative values ​​imply inhibitory connections. The inputs are modified by the weights and summed using linear combinations. An activation function can control the amplitude of the output. For example, the acceptable range of the output is usually 0 to 1, but can also be -1 to 1.

[0081] ANNs are often adaptive systems that change their structure based on external or internal information flowing through the network. In more practical terms, neural networks are nonlinear statistical data modeling or decision-making tools that can be used to model complex relationships between inputs and outputs or to find patterns in data. Therefore, ANNs can be used for predictive modeling and adaptive control applications while being trained through data sets. Note that self-learning arising from experience can occur within ANNs, allowing them to draw conclusions from complex and seemingly unrelated sets of information. The usefulness of artificial neural network models lies in the fact that they can be used to estimate and use functions from observations. Unsupervised neural networks can also be used to learn representations of inputs that capture salient features of the input distribution, and more recently, deep learning algorithms that can implicitly learn distribution functions for observed data. Training with neural networks is particularly useful in applications where the complexity of the data or task makes it impossible to manually design such functions.

[0082] Neural networks can be used in a variety of fields, and the tasks to which ANNs are applied tend to fall into the following broad categories: function approximation or regression analysis, including time series prediction and modeling; classification, including pattern and sequence recognition, novelty detection and sequential decision making; data processing, including filtering, clustering, blind signal separation, and compression.

[0083] Areas of application of ANNs include identification and control of nonlinear systems (vehicle control, process control), game playing and decision making (backgammon, chess, racing), pattern recognition (radar systems, face identification, object recognition), sequence recognition (gesture, speech, handwritten text recognition), medical diagnosis, financial applications, data mining (or knowledge discovery in databases, or "KDD"), visualization, and email spam filtering. For example, it is possible to create semantic profiles of user interests resulting from photographs trained for object recognition.

[0084] According to one or more embodiments, neural network 600 implements a long-short-term memory neural network architecture, a CNN architecture, or the like. Neural network 600 may be configurable with respect to multiple layers, multiple connections (e.g., encoder / decoder connections), regularization techniques (e.g., dropout), and optimization features.

[0085] Long-short-term memory neural network architectures contain feedback connections and can process single data points (e.g., images) along with entire sequences of data (e.g., speech or video). The units of a long-short-term memory neural network architecture can consist of cells, input gates, output gates, and forget gates, where cells store values ​​over any time interval and gates regulate the flow of information to and from the cells.

[0086] A CNN architecture is a shared weight architecture with translational invariance properties, where each neuron in one layer is connected to every neuron in the next layer. The regularization techniques of CNN architectures can exploit hierarchical patterns in the data and organize more complex patterns using smaller, simpler patterns. When neural network 600 implements a CNN architecture, other configurable aspects of the architecture may include the number of filters in each stage, kernel size, and number of kernels per layer.

[0087] Neural network 600 may receive as input incoming beat pairs 610. A form of feature extraction may be performed on the input pairs to identify any number of features within the beat signals before being provided to subsequent module 630 and output by module 650.

[0088] Alternatively, each beat can be represented by a two-dimensional CNN including 10 unipolar and 5 bipolar signals with N samples (128 samples can be used). Pairs of similar beats are reconstructed as described herein and fed into the neural network 600. The input can be an image, which can be converted to a wavelet transform or other known transform as a preprocessing step to the convolutional layer.

[0089] Returning to FIG. 5 , process flow 500 continues at block 530, where the decision engine diagnoses a case. The case can be received in real time during a cardiac procedure (e.g., by the console 160 from the catheter 105 in FIG. 1 ). Thus, the case includes BS ECG and / or IcECG data following initial BS ECG data. That is, the decision engine utilizes a trained neural network to diagnose the case. For example, the trained neural network of the decision engine is used to automatically determine whether two given heartbeats in an EP test belong to the same arrhythmia. In this regard, the trained neural network ignores signal mimicry within the received case. As described herein, the diagnosis (e.g., similarity / dissimilarity) may be used by further algorithms. For example, with an ANN, the output can be a binary result such as similarity / dissimilarity or a similarity rate. The user of the ANN can determine a threshold for considering two beats similar or dissimilar. The similarity ratio is calculated by the ANN and can be displayed directly on a computer screen, leaving room for the doctor's discretion in making the judgment.

[0090] In block 540, the decision engine receives direct feedback. Additionally, the decision engine can receive feedback identifying whether the diagnosis of block 530 was correct (e.g., a physician can correct errors in the decision engine, and the decision engine can improve itself according to these corrections).

[0091] Some EP systems, such as Biosense Webster, Inc.'s CARTO® System 3, require the physician to assign beats that belong to the same arrhythmia to the same map. If the EP system incorrectly assigns a beat to a map, the physician must remove this beat from the map as part of their normal workflow. In one embodiment, this physician action may be used as input to a machine learning algorithm to train a model. For example, if the beats that the physician removed from the map are part of a set R={R1, R2, ..., R m}, and the remaining beats in the map are the set M={M1,M2,...,M n}, then some or all pairs of the Cartesian product of sets M and R, i.e., {{M1,R1},{M1,R2},...,{M n ,R m-1},{M n ,R m}} can be fed to a machine learning model with an expected similarity of 0 or some other low value. n-2 ,M n},{M n-1 ,M n Some or all pairs of}} can be fed to the machine learning model with an expected similarity of 1 or some other high value, so that the machine learning model learns that all remaining beats in the map are similar to each other and that all beats removed from the map are different from the beats that remain in the map.

[0092] A physician may remove some beats not because of arrhythmia dissimilarity but because of some other reason, such as insufficient tissue contact or excessive noise, etc. However, in most practical applications, a machine learning algorithm that mimics the physician by giving a low similarity score even when the physician removes beats for some other reason will aid the process.

[0093] In some EP systems, a physician may create multiple cardiac maps that belong to the same arrhythmia. According to some embodiments, the union of all maps that belong to the same arrhythmia is considered a single map. The fact that multiple maps belong to the same arrhythmia can be automatically determined from the fact that the physician selected the same ECG pattern and / or the same cycle length for the two maps.

[0094] For example, the screen where a physician selects cycle length and ECG pattern in Biosense Webster's CARTO® SYSTEM 3 is shown in Figure 7. Maps with the same selected cycle length and the same selected ECG pattern will show the same arrhythmia. Figure 7 includes a display showing controls related to respiratory gating, cycle length, pattern matching, positional stability, and filtering of electroanatomical points by LAT stability.

[0095] Based on the feedback received in block 540, the decision engine may evolve in block 550, thereby generating improved heartbeat similarities for all subsequent EP exams. The improved heartbeat similarities can then be presented to the physician or provided to further algorithms, allowing appropriate action to be taken during all subsequent cardiac procedures.

[0096] As shown in Figure 6B, method 601 illustrates the operation of a neural network 600 (e.g., an autoencoder of a decision engine) in which an input layer 610 is represented by multiple inputs, such as 612 and 614. With respect to block 620 of method 601, input layer 610 receives multiple inputs, which may be ultrasound signals, radio signals, acoustic signals, or BS ECGs, along with two-dimensional or three-dimensional images.

[0097] In block 625 of this method 601, the neural network 600 utilizes an intracardiac dataset (e.g., the dataset generated by the decision engine in block 510 of FIG. 5) to encode multiple inputs to generate latent representations. The latent representations include one or more intermediate images derived from the multiple inputs. According to one or more embodiments, the latent representations are generated by an element-wise activation function (e.g., a sigmoid function or a rectified linear unit) of the autoencoder of the evaluation engine, which applies a weight matrix to the input intracardiac signals and appends a bias vector to the result. The weights and biases of the weight matrix and bias vector may be randomly initialized and then iteratively updated during training.

[0098] As shown in FIG. 6A, inputs 612 and 614 are fed to hidden layer 630, which is shown to include nodes 632, 634, 636, and 638. The transition between layers 610 and 630 can thus be considered an encoder stage, which takes multiple inputs 612 and 614 and forwards them to a deep neural network, shown in 630, to learn some smaller representation of the inputs (e.g., a resulting latent representation or data encoding). The deep neural network can be a CNN, a long-short-term memory neural network, a fully connected neural network, or a combination thereof. Inputs 612 and 614 can be an intracardiac ECG, an ECG, or an intracardiac ECG and an ECG. This encoding provides a dimensionality reduction of the input intracardiac signal. Dimensionality reduction is the process of reducing the number of random variables (of multiple inputs) under consideration by obtaining a set of key variables. For example, dimensionality reduction can be feature extraction, which transforms data (e.g., multiple inputs) from a high-dimensional space (e.g., greater than 10 dimensions) to a low-dimensional space (e.g., 2-3 dimensions). Technical effects and advantages of dimensionality reduction include reducing the time and storage space required for the data, improving data visualization, and improving parameter interpretation for machine learning. This data transformation can be linear or nonlinear. The receiving (block 620) and encoding (block 625) operations can be considered the data preparation portion of the multi-stage data manipulation by the autoencoder of the decision engine.

[0099] At block 645 of method 610, neural network 600 decodes the latent representation. The decoding stage takes the encoder output (e.g., the resulting latent representation or data encoding) and attempts to recover some form of inputs 612 and 614 using another deep neural network. In this regard, nodes 632, 634, 636, and 638 are combined to generate output 652 in output layer 650, as shown at block 660 of method 610. That is, output layer 650 recovers inputs 612 and 614 with reduced dimensionality but without signal interference, signal artifacts, and signal noise. Examples of output 652 include IcECG, a clean version of IcECG (a denoised version), BS ECG, and denoised ECG.

[0100] Neural network 600 executes processing through a hidden layer 630 of nodes 632, 634, 636, and 638 to exhibit complex global behavior determined by the connections between processing elements and element parameters.

[0101] 8 shows a block diagram of a process flow 700 according to one or more embodiments. According to one embodiment, the process flow 700 is performed by a decision engine described herein. Any combination of software and / or hardware (e.g., the console 160 of FIG. 1 and / or the local computing device 206 and remote computing system 208 along with the monitoring and processing unit 202 of FIG. 2), separately or collectively, can store, execute, and implement the decision engine and its functionality.

[0102] In block 820, the decision engine correlates any received heartbeat pairs 830 for which the similarity is known. As discussed herein, the model may include an ANN. To train the model's ANN, the decision engine requires heartbeat pairs for which the similarity is known. The known similarity may be either binary, such as 0 for "dissimilar" and 1 for "similar," or expressed as a percentage, such as a real number between 0 and 1.

[0103] A function f that gives the same value to f(x,y) and f(y,x) is called a commutative function. In an exemplary situation, the neural network requires only two signals: one signal from the first heartbeat and a second signal from the second heartbeat. Assuming each signal is sampled at 1K samples per second for 1 second, the machine learning model receives 1000 samples from the first heartbeat, and the 1000 samples should form the second heartbeat. If the machine learning model is embodied as an artificial neural network, the neural network should have 2000 scalar inputs. The first input may receive the signal from the first heartbeat, and the next 1000 inputs may receive the signal from the second heartbeat. If the neural network is implemented in a simple manner, the neural network will provide different similarity scores for the pairs {B1,B2} and {B2,B1}. To prevent this and make the neural network learning commutative, pairs are fed to the neural network twice with the same similarity score: once as {B1,B2} and once as {B2,B1}. The more the neural network is presented with the expected beats {B1,B2} and {B2,B1} giving the same similarity score, the better the neural network will learn to function as a commutative function.

[0104] Generally, collecting pairs of heartbeats with known similarities may require manual tagging of the pairs (e.g., by a physician). According to one or more embodiments, to overcome this problem of requiring a human to tag pairs as similar or dissimilar, the decision engine can utilize a mathematical algorithm, such as a rule-based mathematical algorithm (e.g., Pearson's product-moment correlation), to tag pairs with a similarity rate. After training (e.g., receiving and correlating), a model using the results of the mathematical algorithm correlation is expected to be nearly equivalent to the mathematical algorithm correlation.

[0105] The input to the training is two beats (B u and B v Further information related to the two beats may include Pearson correlation, the temporal correspondence of the CS unipolar and bipolar channels as detailed in European Patent Application Publication No. EP3831304(A1) by YARNITSKY J et al., which is incorporated herein by reference, the positional difference of the electrodes, the respiratory index, and the energy similarity (e.g., by the minimization method defined in the following equation): ArgMin{E=Σ i φ i E i}

[0106] 9 shows an example software application that can be provided to a physician to allow the physician to mark which beats belong to the same arrhythmia. Vertical index lines can be superimposed on each beat on different channels. The database built with such an application can be used to train a machine learning model.

[0107] In block 850, the decision engine utilizes the results 860 of the correlation 820 (e.g., predicted output) and the initial pair 830 as inputs to train the model therein. In this regard, the ANN / model / decision may be deployed in the field to replace conventional algorithms in EP testing (e.g., to replace the cross-correlation algorithm described in U.S. Pat. No. 7,907,994 B2, which is incorporated herein by reference).

[0108] After the initial training of block 850, the ANN / model / decision engine can be continuously trained to self-improve (e.g., machine learning). In one example, the ANN of the model is deployed to an EP system within a hospital. EP examinations are performed by using the ANN / model / decision engine in real time to calculate pattern matching, etc. Physicians may be given the option to override the ANN / model / decision engine's decisions. For example, if the EP system determines that two heartbeats are dissimilar, the physician may be given the option to press a button to indicate that the two beats are similar, or vice versa. The physician's corrections may then be uploaded to a central database (e.g., via CD, DVD, memory stick, internet, etc.), and the ANN / model / decision engine may be retrained to include the physician's corrections. As the database includes more physician corrections, the ANN / model / decision engine becomes better than the initial training of block 850. The retrained ANN / model / decision engine may be distributed again to hospitals.

[0109] According to one or more exemplary embodiments, a visual analysis of the corrections can be performed before applying them to the results 860 and / or initial pair 830 to ensure that the physician's corrections make sense. This collection of information may be considered a gold standard database (e.g., ground truth) that is used with each retraining of the ANN / model / decision engine and may be run against the gold standard database to ensure accuracy is above a threshold. Alternatively, accuracy may be required to be better than the previous accuracy after each retraining.

[0110] The technical effects and benefits of the decision engine include multi-stage manipulation of data corresponding to EP tests to generate improved diagnostic information.

[0111] The flow diagrams and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flow diagrams or block diagrams may represent a module, segment, or portion of instructions, which portion of instructions includes one or more executable instructions for implementing a particular logical function. In some alternative implementations, the functions described in the blocks may occur out of the order described in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending on the functionality involved. It should also be noted that each block of the block diagrams and / or flow diagrams, and combinations of blocks in the block diagrams and / or flow diagrams, may be implemented by a dedicated hardware-based system that performs particular functions or operations, or may operate or be executed by a combination of dedicated hardware and computer instructions.

[0112] While features and elements are described above in specific combinations, those skilled in the art will understand that each feature or element can be used alone or in combination with other features and elements. Additionally, the methods described herein can be implemented in a computer program, software, or firmware embodied in a computer-readable medium for execution on a computer or processor. AI chips, such as Intel's Habana® chip, can be used to accelerate training and inference of ANNs. As used herein, computer-readable media should not be construed as being ephemeral signals, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses passing through fiber optic cables), or electrical signals transmitted through electrical lines.

[0113] Examples of computer-readable media include electrical signals (transmitted over wired or wireless connections) and computer-readable storage media. Examples of computer-readable storage media include, but are not limited to, registers, cache memory, semiconductor memory devices, magnetic media such as internal hard disks and removable disks, magneto-optical media, optical media such as compact discs (CDs) and digital versatile discs (DVDs), random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), and memory sticks. A processor in association with software may be used to implement a radio frequency transceiver for use in a WTRU, UE, terminal, base station, RNC, or any host computer.

[0114] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms unless the context clearly dictates otherwise. It should be understood that the terms "comprise" and / or "comprising," as used herein, indicate the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0115] The description of different embodiments herein is provided for illustrative purposes, but is not intended to be exhaustive or limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terms used herein are selected to best explain the principles, practical applications, or technical improvements of the embodiments compared to technologies found on the market, or to enable those skilled in the art to understand the embodiments disclosed herein.

[0116] [Embodiment] (1) A method comprising: receiving, by a decision engine executed by one or more processors, one or more pairs of heartbeats; generating, by the decision engine, a model based on the one or more pairs of heartbeats; determining, by the model of the decision engine, whether two given heart beats are part of the same arrhythmia to generate a similarity result for algorithm input. (2) The method of embodiment 1, wherein the decision engine utilizes a neural network to determine whether the two given heartbeats are part of the same arrhythmia. (3) The method of embodiment 2, wherein the decision engine trains the neural network by applying an algorithm to measure the strength of association between the two given heartbeats. (4) The method of embodiment 1, wherein the one or more pairs of heartbeats comprise known similarities obtained from one or more electrophysiological tests. (5) The method of embodiment 1, wherein the decision engine receives feedback that identifies when the decision engine is correct in determining whether the two heart beats are part of the same arrhythmia.

[0117] (6) The method of embodiment 1, wherein the two given cardiac beats include surface electrocardiogram data, intracardiac electrocardiogram data, absolute position data, position data relative to a reference catheter, data on the force exerted on the tissue by the catheter, and an indication of the tissue proximity position within the respiratory cycle. (7) The method of embodiment 1, wherein the similarity results between the two given heartbeats are used retrospectively or in real time by automatic pace mapping, body surface pattern matching, intracardiac pattern matching, or arrhythmia clustering during electrophysiology testing. (8) The method of embodiment 1, wherein the signal imitation includes artifacts remaining after removal of deflection noise, ventricular far field, respiratory interference, analog or digital filter ringing artifacts, or hum. (9) The method described in embodiment 1, wherein some or all two-element combinations of existing EP maps prepared by a physician are assumed to belong to the same arrhythmia for the purpose of training the machine learning model. (10) The method described in embodiment 1, wherein some or all two-element permutations of the beats in the map and the beats removed from the map are assumed not to belong to the same arrhythmia for purposes of training the machine learning model.

[0118] (11) The method of embodiment 1, wherein the machine learning algorithm is a neural network and all pairs are fed to the neural network twice during the training phase. (12) The method described in embodiment 1, wherein cardiac EP maps selected by the user having the same cycle length and / or the same ECG pattern are assumed to belong to the same arrhythmia for the purpose of training the machine learning model. (13) A system comprising: a memory storing program instructions for a decision engine; one or more processors executing the program instructions to provide the system with: receiving, by the decision engine, one or more pairs of heartbeats; generating, by the decision engine, a model based on the one or more pairs of heartbeats; and and one or more processors configured to cause the model of the decision engine to determine whether two given heart beats are part of the same arrhythmia and generate a similarity result for algorithm input. (14) The system of embodiment 13, wherein the decision engine utilizes a neural network to determine whether the two given heartbeats are part of the same arrhythmia. (15) The system of embodiment 14, wherein the decision engine trains the neural network by applying an algorithm to measure the strength of association between the two given heartbeats.

[0119] (16) The system of embodiment 15, wherein the training of the neural network by the decision engine occurs in real time or retroactively. (17) The system of embodiment 13, wherein the one or more pairs of heartbeats include known similarities obtained from one or more electrophysiological tests. (18) The system of embodiment 13, wherein the decision engine receives feedback that identifies when the decision engine is correct in determining whether the two heart beats are part of the same arrhythmia. (19) The system described in embodiment 13, wherein two-element combinations of some or all of the existing EP maps prepared by a physician are assumed to belong to the same arrhythmia for the purpose of training the machine learning model. (20) The system described in embodiment 13, wherein cardiac EP maps selected by the user having the same cycle length and / or the same ECG pattern are assumed to belong to the same arrhythmia for the purpose of training the machine learning model.

Claims

1. 1. A system comprising: a memory for storing program instructions for the decision engine and algorithms; one or more processors executing the program instructions to provide the system with: receiving, by the decision engine, one or more pairs of heartbeats; generating, by the decision engine, a machine learning model based on the one or more pairs of heartbeats; the decision engine training the machine learning model based on the one or more pairs of heartbeats and the similarity of the heartbeats; and and one or more processors configured to cause the determination engine to use the machine learning model to determine whether two given heartbeats are part of the same arrhythmia caused by the same site of abnormal electrical activity within the heart and generate a similarity result for input to an algorithm indicating the similarity of the heartbeat patterns between the two given heartbeats in the determination; and the algorithm to use the similarity result to compare the similarity of the heartbeat patterns between the two given heartbeats with a threshold and display the result of the comparison on a display of the system.

2. The system of claim 1 , wherein the decision engine utilizes a neural network to determine whether the two given heart beats are part of the same arrhythmia.

3. The system of claim 2 , wherein the decision engine trains the neural network by applying an algorithm to measure the strength of association between the two given heartbeats.

4. The system of claim 3 , wherein the training of the neural network by the decision engine occurs in real time or retrospectively.

5. The system of claim 1 , wherein the one or more pairs of heartbeats include known similarities obtained from one or more electrophysiology studies.

6. The system of claim 1 , wherein the decision engine receives feedback that identifies when it correctly determines whether the two given heart beats are part of the same arrhythmia.

7. 2. The system of claim 1, wherein some or all binary combinations of existing physician-prepared EP maps are assumed to belong to the same arrhythmia for purposes of training the machine learning model.

8. The system described in claim 1, wherein cardiac EP maps selected by a user having the same cycle length and / or the same ECG pattern are assumed to belong to the same arrhythmia for the purpose of training the machine learning model.

9. A method of operating a system, comprising: a decision engine executed by one or more processors of the system receiving one or more pairs of heartbeats having a predefined similarity; the decision engine generating a machine learning model based on the one or more pairs of heartbeats; the decision engine training the machine learning model based on the one or more pairs of heartbeats and the similarity of the heartbeats; The determination engine uses the machine learning model to determine whether two given heartbeats in a cardiac electrophysiological test are part of the same arrhythmia caused by the same site of abnormal electrical activity in the heart, and generates a similarity result for input to an algorithm, the similarity result indicating the similarity of the heartbeat pattern between the two given heartbeats in the determination; a method of operating the system, the method comprising: the algorithm using the similarity result to compare the similarity of the heartbeat pattern between the two given heartbeats with a threshold value, and displaying the result of the comparison on a display of the system.

10. 10. The method of claim 9, wherein the decision engine utilizes a neural network to determine whether the two given heart beats are part of the same arrhythmia.

11. 11. The method of claim 10, wherein the decision engine trains the neural network by applying an algorithm to measure the strength of association between the two given heartbeats.

12. 10. The method of claim 9, wherein the one or more pairs of heartbeats include known similarities obtained from one or more electrophysiology studies.

13. 10. The method of claim 9, wherein the decision engine receives feedback that identifies when it correctly determines whether the two given heart beats are part of the same arrhythmia.

14. 10. The method of operating the system of claim 9, wherein the two given heartbeats include surface electrocardiogram data, intracardiac electrocardiogram data, absolute position data, position data relative to a reference catheter, data of forces exerted on tissue by the catheter, and an indication of tissue proximity position within a respiratory cycle.

15. 10. The method of operation of the system of claim 9, wherein the similarity results between the two given heartbeats are used retrospectively or in real time by automatic pace mapping, body surface pattern matching, intracardiac pattern matching, or arrhythmia clustering during electrophysiology testing.

16. 10. The method of claim 9, wherein the signal mimics include artifacts remaining after removal of deflection noise, ventricular far field, respiratory interference, ringing artifacts of analog or digital filters, or hum.

17. 10. The method of claim 9, wherein binary combinations of some or all existing physician-prepared EP maps are assumed to belong to the same arrhythmia for the purposes of training the machine learning model.

18. 18. The method of claim 17, wherein some or all two-element permutations of the one or more pairs of beats in the EP map and the one or more pairs of beats removed from the EP map are assumed not to belong to the same arrhythmia for purposes of training the machine learning model.

19. 10. The method of claim 9, wherein the machine learning model is a neural network and all pairs are fed to the neural network twice during the training phase.

20. A method of operating the system described in claim 9, wherein cardiac EP maps selected by a user having the same cycle length and / or the same ECG pattern are assumed to belong to the same arrhythmia for the purpose of training the machine learning model.

Images