Automated segmentation of anatomical structures at large circumferential ablation points

Abstract

To provide improved methods for predicting potential gaps, providing anatomical segmentation, and providing contiguity estimation for the WACA ablation points.SOLUTION: The invention provides a method and apparatus for implementing an evaluation engine implemented using a processor coupled to a memory. The evaluation engine receives effective points corresponding to cardiac tissue of a patient. The evaluation engine determines an anatomical structural classification for each of the effective points based on structural segmentation for the cardiac tissue and provides the anatomical structural classification with each of the effective points to support treatment of the cardiac tissue.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims the benefit of U.S. Provisional Patent Application No. 63 / 059,060, filed July 30, 2020, which is incorporated by reference as if fully set forth.

[0002] FIELD OF THE INVENTION The present invention relates to artificial intelligence and machine learning methods and systems, and more particularly to systems and methods that utilize machine learning algorithms to perform automated segmentation of anatomical structures at wide area circumferential ablation (WACA) points. [Background technology]

[0003] Treatment of cardiac conditions often requires cardiac imaging (i.e., imaging of cardiac tissue, chambers, veins, arteries, and / or pathways, also known as a cardiac scan or cardiac imaging) followed by ablation (i.e., removal or destruction of the imaged cardiac tissue, chambers, veins, arteries, and / or pathways). In one example, the cardiac condition of atrial fibrillation can be imaged and treated using atrial fibrillation ablation. A particular type of atrial fibrillation ablation is wide area circumferential ablation (WACA).

[0004] Traditionally, during the cardiac mapping phase, WACA achieves point-by-point (e.g., WACA ablation point) isolation of the right and left pulmonary veins to create annular rings around the left and right pulmonary veins (e.g., in some cases, WACA may extend to the roof of the atrium and into the right atrium). Furthermore, WACA is limited by the presence of potential gaps between WACA ablation points, the presence of potential gaps within the resulting ablation line, and WACA's dependency on anatomical structures. For example, these gaps, if left unaddressed during the ablation phase, can lead to pulmonary vein reconnection and recurrent arrhythmias. To overcome these limitations, traditional methods rely on medical professionals' manual anatomical segmentation of the ablation site and manual WACA ablation point continuity estimation. Summary of the Invention [Problem to be solved by the invention]

[0005] Due to these limitations and in light of traditional manual review methods, there is a need to provide improved methods for predicting potential gaps, providing anatomy segmentation, and providing continuity estimation of WACA ablation points. [Means for solving the problem]

[0006] A method and apparatus are provided for implementing an assessment engine implemented using a processor coupled to a memory, the assessment engine receiving significance points for cardiac tissue of a patient, determining an anatomical structure classification for each of the significance points based on a structural segmentation of the cardiac tissue, and providing an anatomical structure classification with each of the plurality of significance points to support treatment of the cardiac tissue. [Brief explanation of the drawings]

[0007] A more detailed understanding may be had from the following description, given by way of example in conjunction with the accompanying drawings, in which like reference numerals indicate similar elements and in which: [Figure 1]1 illustrates a diagram of an example system in which one or more features may be implemented. [Figure 2] FIG. 1 shows a block diagram of an exemplary system for remote monitoring and communication of patient vital signs. [Figure 3] 1 shows a graphical depiction of an artificial intelligence system. [Figure 4] 4 shows a block diagram of a method implemented in the artificial intelligence system of FIG. 3. [Figure 5] 1 illustrates a block diagram of a method according to one or more embodiments. [Figure 6A] 1 shows an example of an autoencoder structure. [Figure 6B] 6B shows a block diagram of a method implemented in the autoencoder of FIG. 6A. [Figure 7] 1 illustrates a block diagram of a method according to one or more embodiments. [Figure 8] 10 shows a graphical image of an example of a graphical user interface that provides an image of a PV with two separate annular rings. [Figure 9A] 1 shows a graphical image of a user interface showing a data set. [Figure 9B] 1 shows a graphical image of a user interface showing a data set. [Figure 10] 1 shows a graphic depiction of the left and right WACA broken down into anatomical structures. [Figure 11A] A diagram of the right anatomy is shown. [Figure 11B] A diagram of the left anatomy is shown. [Figure 12A] 1 illustrates a block diagram of an exemplary operational classification method for a random forest of the acute reconnection classifier. [Figure 12B] We present a block diagram of a classification method that utilizes random forest classification, fully connected dense layers, and a CNN architecture. [Figure 13] 1 illustrates an exemplary random forest classifier. [Figure 14A] 1 illustrates a block diagram of an exemplary operational classification method for a random forest of the acute reconnection classifier. [Figure 14B] 1 shows a block diagram of an exemplary operational classification method of the Rework / Acute Reconnection Classifier deep learning method. [Figure 14C] 1 shows a graphic image showing acute reconnection points. DETAILED DESCRIPTION OF THE INVENTION

[0008] Disclosed herein are systems and methods for automated segmentation of anatomical structures of wide area circumferential ablation (WACA) points. The systems and methods include artificial intelligence and machine learning. More specifically, the present disclosure relates to systems and methods for automated segmentation of anatomical structures of WACA points, including machine learning algorithms that perform automated segmentation of anatomical structures of effective WACA ablation points and effective ablation points (e.g., effective points) during cardiac mapping. For example, the systems and methods include processor-executable code or software in a process operated by a medical device and in processing hardware of the medical device to perform automated segmentation of anatomical structures of effective points using random forest regression, fully connected dense layers, and convolutional neural network (CNN) architectures.

[0009] According to one embodiment, the system and method include an evaluation engine that provides multi-stage data manipulation for automatic anatomical segmentation, continuity estimation, and identification of significant points for gap prediction. For example, during the cardiac mapping phase, the evaluation engine can determine whether the ablation points are part of the right or left WACA (e.g., whether each WACA point is within a left annular ring around the left pulmonary veins (PVs) or within a right annular ring around the right PVs) and classify the left and right WACA points into multiple anatomical structures, such as nine PVs (e.g., associate each ablation point with one of the anatomical structures). During the cardiac mapping phase, the evaluation engine can determine whether each of the significant points is good or accurate so that the points can help a medical professional isolate the PVs. In determining good or accurate significant points, the evaluation engine can use the right and left WACA information and anatomical structure classification to predict locations for acute reconnection and rework.

[0010] For example, pulmonary vein isolation (PVI) is performed using an ablation catheter with radiofrequency energy in a point-by-point WACA pattern (e.g., a WACA procedure), with the endpoint of the WACA procedure being complete pulmonary vein isolation. After the last ablation WACA point, the physician sequentially places a mapping catheter at each of the PVs to determine whether spontaneous PV reconnection has occurred. If pulmonary vein reconnection has not occurred, a bolus of intravenous adenosine is administered to unmask any sites of dormant conduction. Ablation may be performed at any site of reconnection to achieve PVI. The evaluation engine may attempt to notify the physician in advance after performing a WACA procedure of potential reconnection sites, so that ablation of those sites may result in PVI. The evaluation engine reduces the need for additional ablations in the second and third stages (e.g., after adenosine administration). Even if PV isolation is present, subsequent ablation sessions may result in recurrent atrial fibrillation after the patient is released from the first WACA session. The evaluation engine can provide the physician with guidance to re-ablate specific regions (i.e., predict locations for redo) during the first WACA session.

[0011] Technical effects and benefits of the evaluation engine include automated anatomical segmentation for ablation points, continuity estimation, and potential long-term (redo) reconnection site estimation to provide improved image data of cardiac tissue. The improved image data reduces and / or eliminates the potential presence of gaps between WACA ablation points and resulting ablation lines, as well as the dependency of WACA on anatomical structures. In this manner, the improved image data can be used to effectively treat various cardiovascular diseases by reducing or eliminating the possibility that these gaps could lead to PV reconnections and recurrent arrhythmias. The evaluation engine can be practically applied to ablative ultrasound techniques (e.g., atrial fibrillation ablation and WACA), planning and lesion diagnosis, and magnetic resonance evaluation and diagnosis to address one or more disease states, such as, but not limited to, atrial fibrillation, atrial flutter, general electrophysiology, arrhythmias, ventricular fibrillation, and ventricular tachycardia.

[0012] 1 is a schematic diagram of an example system 100 (e.g., a medical device) in which one or more features of the presently disclosed subject matter may be implemented. All or a portion of system 100 may be used to collect information from an imaging dataset (e.g., a training dataset) and / or all or a portion of system 100 may be used to implement the machine learning algorithms and evaluation engines described herein.

[0013] System 100 may include components such as catheter 105 configured to use intravascular ultrasound and / or MRI catheterization to image internal organs. Catheter 105 may also be further configured to acquire biometric data including electrical signals from the heart (e.g., data at multiple points, such as WACA ablation points). While catheter 105 is shown to be a point catheter, it will be understood that any shape of catheter including one or more elements (e.g., electrodes, tracking coils, piezoelectric transducers, etc.) may be used to practice the embodiments disclosed herein.

[0014] The system 100 includes a probe 110 having a shaft that a doctor or medical professional 115 can navigate into a body part, such as a heart 120, of a patient 125 lying on a bed (or table) 130. According to embodiments, multiple probes may be provided, but for simplicity, a single probe 110 is described herein. However, it is understood that the probe 110 may represent multiple probes.

[0015] The exemplary system 100 can be utilized to detect, diagnose, and treat cardiac diseases (e.g., using an evaluation engine). Cardiac diseases such as cardiac arrhythmias (particularly atrial fibrillation) remain common and dangerous medical conditions, especially in the aging population. In a patient (e.g., patient 125) with normal sinus rhythm, the heart (e.g., heart 120) includes atria, ventricles, and excitatory conduction tissue, and is electrically stimulated to beat in a synchronous, patterned manner (note that this electrical excitation may be detected as an intracardiac signal, etc.).

[0016] In a patient with cardiac arrhythmia (e.g., patient 125), abnormal regions of cardiac tissue do not follow the synchronous beating cycle associated with normal conductive tissue, as in a patient with normal sinus rhythm. Conversely, the abnormal regions of cardiac tissue conduct abnormally to adjacent tissue, thereby disrupting the cardiac cycle into an asynchronous cardiac rhythm (note that this asynchronous cardiac rhythm can also be detected as an intracardiac signal). Such abnormal conduction has long been known to occur in various regions of the heart (e.g., heart 120), for example, along the conduction pathways of the atrioventricular (AV) node, in the region of the sinoatrial (SA) node, or in the myocardial tissue that forms the walls of the ventricular and atrial chambers.

[0017] Furthermore, cardiac arrhythmias, including atrial arrhythmias, may be of the multi-wavelet reentrant type, characterized by multiple asynchronous loops of electrical pulses scattered and often self-propagating around the atria (e.g., another example of an intracardiac signal). Alternatively, or in addition to the multi-wavelet reentrant type, cardiac arrhythmias may also have a local origin, such as when isolated regions of tissue within the atria are autonomously excited in a rapid, repetitive manner (e.g., another example of an intracardiac signal). Ventricular tachycardia (V-tach or VT) is a tachycardia or fast cardiac rhythm that occurs in one of the ventricles. It is a potentially fatal arrhythmia because it can lead to ventricular fibrillation and sudden death.

[0018] Atrial fibrillation, a type of arrhythmia, occurs when normal electrical impulses generated by the sinoatrial node (e.g., another example of intracardiac signaling) are overwhelmed by chaotic electrical impulses originating in the atria and pulmonary veins, causing irregular impulses to be conducted to the ventricles. The resulting irregular heartbeat can persist for minutes to weeks or even years. Atrial fibrillation (AF) is often a chronic condition that carries a small increased risk of death, often from stroke. The first-line treatment for AF is medication to slow the heart rate or restore normal heart rhythm. Furthermore, patients with AF are often given anticoagulants to protect against the risk of stroke. The use of such anticoagulants carries its own risk of internal bleeding. In some patients, medication is insufficient, and their AF is deemed drug-refractory, i.e., untreatable with standard pharmacological interventions. Synchronized cardioversion can also be used to convert AF to a normal cardiac rhythm. Alternatively, patients with AF are treated with catheter ablation.

[0019] Catheter ablation-based therapy may involve mapping the electrical properties of cardiac tissue, particularly the endocardium and cardiac volumes, and selectively ablating the cardiac tissue by application of energy. Cardiac mapping (which is an example of cardiac imaging) involves creating an electrical potential map (e.g., a voltage map) of wave propagation along cardiac tissue or a map of arrival times to various tissue location points (e.g., a local time activation (LAT) map). Cardiac mapping (e.g., a cardiac map) can be used to detect local cardiac tissue dysfunction. Ablation, for example, cardiac mapping-based ablation, can stop or modify the propagation of unwanted electrical signals from one part of the heart to another.

[0020] Ablation techniques disrupt unwanted electrical pathways by creating non-conductive lesions. Various energy delivery modalities have been previously disclosed for creating lesions, including the use of microwave, laser, and more commonly, radiofrequency energy to create conduction blocks along cardiac tissue walls. In a two-stage mapping-followed-by-ablation procedure, electrical activity at points within the heart is typically sensed and measured by advancing a catheter (e.g., catheter 105) containing one or more electrical sensors (e.g., at least one ablation electrode 134 of catheter 105) into the heart (e.g., heart 120) and acquiring data at multiple points. This data (e.g., WACA ablation points) is then used to select endocardial target regions for ablation. It should be noted that, through the use of an evaluation engine employed in the exemplary system 100 (e.g., medical device instrument), data at multiple points (i.e., WACA ablation points) is manipulated into improved image data of the cardiac tissue, including location within the right or left WACA, classification into nine anatomical structures, good or correct determination, and prediction of acute reconnection and redo location. The improved image data may also include stability measures (e.g., extracted from x, y, z positions during ablation) and ablation characteristics (e.g., power, impedance, impedance drop, stability, etc.).

[0021] Cardiac ablation and other cardiac electrophysiology procedures are becoming increasingly complex as physicians treat challenging conditions such as atrial fibrillation and ventricular tachycardia. Treatment of refractory arrhythmias currently relies on the use of three-dimensional (3D) mapping systems to reconstruct the anatomical structure of the cardiac chamber of interest. In this regard, the evaluation engine employed in the exemplary system 100 (e.g., medical device equipment) herein can manipulate and evaluate data at multiple points (e.g., WACA ablation points) to generate improved image data of the cardiac tissue, thereby generating improved images, scans, and / or maps with predictions for treating cardiac conditions.

[0022] For example, cardiologists rely on software such as the Complex Fractionated Atrial Electrograms (CFAE) module of the CARTO® 3 3D mapping system from Biosense Webster, Inc. (Diamond Bar, Calif.) to generate and analyze intracardiac electrograms (EGMs). The evaluation engine of the exemplary system 100 (e.g., a medical device) enhances this software to generate and analyze improved intracardiac images, scans, and / or maps, thereby determining ablation points for the treatment of a wide range of cardiac disorders, including atrial fibrillation. The improved images, scans, and / or maps supported by the evaluation engine can provide multiple pieces of information regarding the electrophysiological properties of internal organs (e.g., the heart and / or organic tissues, including scar tissue) that represent the cardiac substrate (anatomical and functional) of these challenging arrhythmias.

[0023] Cardiomyopathy of different etiologies (e.g., ischemic, dilated cardiomyopathy (DCM), hypertrophic cardiomyopathy (HCM), arrhythmogenic right ventricular dysplasia (ARVD), and left ventricular non-compaction (LVNC)) are characterized by areas of unhealthy tissue surrounded by areas of normally functioning cardiomyocytes with a distinct substrate.

[0024] Abnormal tissue is generally characterized by low-voltage EGMs. However, early clinical experience with endocardial-epicardial mapping has shown that low-voltage regions are not always the sole arrhythmogenic mechanism in these patients. Indeed, low- or intermediate-voltage regions may exhibit EGM fragmentation and delayed activity during sinus rhythm, corresponding to critical stenoses identified during sustained and coherent ventricular arrhythmias, e.g., only in intolerable ventricular tachycardia. Furthermore, EGM fragmentation and delayed activity are often observed in regions exhibiting normal or near-normal voltage amplitudes (>1–1.5 mV). These latter regions can be evaluated according to voltage amplitude but cannot be considered normal based on the intracardiac signal and therefore represent true arrhythmogenic substrates. 3D mapping can identify the location of arrhythmogenic substrates on the endocardial and / or epicardial layers of the right and / or left ventricles, whose distribution may vary depending on the primary disease progression.

[0025] The substrates involved in these cardiac disorders are correlated with the subdivision of the endocardial and / or epicardial layers of the ventricular chambers (right and left) and the presence of delayed EGMs. 3D mapping systems such as the CARTO® 3 can identify the location of potential arrhythmogenic substrates of cardiomyopathies in relation to abnormal EGM detection.

[0026] Electrode catheters (e.g., catheter 105) are used during medical procedures to stimulate and map electrical activity within the heart and to ablate sites of abnormal electrical activity. In use, the electrode catheter is inserted into a major vein or artery, such as the femoral artery, and then guided into a chamber of the subject's heart. A typical ablation procedure involves inserting a catheter having at least one electrode at its distal end into a chamber of the heart. A reference electrode is typically provided by a second catheter taped to the patient's skin or positioned within or near the heart. Radio frequency (RF) current is applied to the tip electrode of the ablation catheter, causing current to flow through the medium surrounding the tip electrode, i.e., blood and tissue, toward the reference electrode. The distribution of the current depends on the amount of electrode surface in contact with the tissue compared to blood, which has a higher electrical conductivity than tissue. Tissue heating occurs due to the electrical resistance of the tissue. Sufficient tissue heating causes cell destruction in the cardiac tissue, resulting in the formation of lesions in the non-conductive cardiac tissue. During this process, the electrode also heats due to conduction from the heated tissue to the electrode itself. If the electrode temperature becomes high enough, possibly above 60 degrees Celsius, a thin, transparent film of dehydrated blood proteins can form on the surface of the electrode. As the temperature continues to rise, this dehydrated layer can gradually thicken, causing blood to coagulate on the electrode surface. Because dehydrated biological material has a higher electrical resistance than endocardial tissue, the impedance to the flow of electrical energy into the tissue also increases. If the impedance becomes high enough, an impedance rise occurs, requiring the catheter to be removed from the body and the tip electrode to be cleaned.

[0027] Treatment of cardiac disorders, such as cardiac arrhythmias, often requires obtaining detailed mapping of cardiac tissue, chambers, veins, arteries, and / or electrical pathways. For example, a prerequisite for successful catheter ablation is accurate localization of the source of the cardiac arrhythmia within a cardiac chamber. Such localization can be performed by electrophysiological studies, during which spatially resolved electrical potentials are detected by a mapping catheter introduced into the cardiac chamber. This electrophysiological study, also known as electroanatomical mapping, provides 3D mapping data that can be displayed on a monitor. Often, mapping and therapy functions (e.g., ablation) are provided by a single catheter or a group of catheters, with the mapping catheter simultaneously acting as a therapy (e.g., ablation) catheter. In this case, the evaluation engine may be stored and executed directly by the catheter 105.

[0028] Mapping of cardiac regions, such as cardiac regions, tissues, veins, arteries, and / or electrical pathways of a heart (e.g., 120), can result in the identification of problem areas, such as scar tissue, arrhythmia sources (e.g., electrical rotors), healthy regions, etc. Cardiac regions can be mapped such that a visual rendering of the mapped cardiac region is provided using a display, as further disclosed herein. Additionally, cardiac mapping (which is an example of cardiac imaging) can include mapping based on one or more modalities, such as, but not limited to, local activation time (LAT), electrical activity, topology, bipolar mapping, dominant frequency, or impedance. Data corresponding to multiple modalities can be captured using catheters inserted within the patient's body and provided for rendering simultaneously or at different times based on corresponding settings and / or medical professional preferences.

[0029] Cardiac mapping can be performed using one or more techniques. As an example of a first technique, cardiac mapping can be performed by sensing the electrical properties of cardiac tissue, e.g., the LAT, as a function of precise location within the heart. The corresponding data can be acquired using one or more catheters advanced into the heart using catheters having electrical and position sensors at their distal tips. As a specific example, location and electrical activity can be initially measured at about 10 to about 20 points on the inner surface of the heart. These data points can generally be sufficient to generate a preliminary reconstruction or map of the cardiac surface of satisfactory quality. This preliminary map can be combined with data acquired at additional points to generate a more comprehensive map of the cardiac electrical activity. In clinical settings, it is not uncommon to accumulate data at 100 or more sites to generate a detailed, comprehensive map of the electrical activity of the cardiac chambers. The detailed map can then serve as a basis for making decisions regarding therapeutic action, e.g., tissue ablation, to alter the propagation of cardiac electrical activity and restore normal cardiac rhythm.

[0030] 1 , to perform cardiac imaging of interest, medical professional 115 can insert shaft 137 through sheath 136 while manipulating the distal end of shaft 137 using manipulator 138 near the proximal end of catheter 105 and / or deflection from sheath 136. As shown in inset 140, catheter 105 can be attached at the distal end of shaft 137. Catheter 105 can be inserted through sheath 136 in a collapsed state and then expanded within heart 120. As described further herein, catheter 105 can include at least one ablation electrode 134 and a catheter needle.

[0031] According to several embodiments, catheter 105 can be configured to ablate a tissue region of a chamber of heart 120. Inset 150 shows a close-up view of catheter 105 inside a chamber of heart 120. As shown, catheter 105 can include at least one ablation electrode 134 coupled to the body of the catheter. According to other embodiments, multiple elements can be connected via splines that define the shape of catheter 105. One or more other elements (not shown) can be provided and can be any element configured to perform ablation or acquire biometric data, such as an electrode, a transducer, or one or more other elements.

[0032] According to embodiments disclosed herein, an ablation electrode, such as at least one ablation electrode 134, can be configured to deliver energy to a tissue region of a body organ, such as heart 120. The energy can be thermal energy and can cause damage to the tissue region starting at the surface of the tissue region and extending through the thickness of the tissue region.

[0033] According to embodiments disclosed herein, the biological data may include one or more of LAT, electrical activity, topology, bipolar mapping, dominant frequency, impedance, etc. The LAT may be a time point of threshold activity corresponding to local activation calculated based on a normalized initial starting point. The electrical activity may be any applicable electrical signal that can be measured based on one or more thresholds and detected and / or enhanced based on signal-to-noise ratio and / or other filters. The topology may correspond to the physical structure of a body part or a portion of a body part, or may correspond to changes in the physical structure for different portions of the body part or for different body parts. The dominant frequency may be a frequency or range of frequencies prevalent in a portion of a body part and may differ in different portions of the same body part. For example, the dominant frequency of a cardiac PV may differ from the dominant frequency of the right atrium of the same heart. The impedance may be a resistance measurement in a given region of a body part.

[0034] 1, the probe 110 and catheter 105 can be connected to a console 160. The console 160 may include a computing device 161 that employs the machine learning algorithms and evaluation engine described herein. According to one embodiment, the console 160 and / or computing device 161 include at least a processor and a memory, where the processor executes computer instructions related to the machine learning algorithms and evaluation engine described herein and the memory stores instructions for execution by the processor.

[0035] The computing device 161 can be any computing device including software and / or hardware, such as a general-purpose computer, with appropriate front-end and interface circuitry 162 for transmitting and receiving signals to and from the catheter 105 and controlling other components of the system 100. The computing device 161 can include real-time noise reduction circuitry, typically configured as a field programmable gate array (FPGA), followed by an analog-to-digital (A / D) electrocardiogram (ECG) or electrocardiograph or electromyogram (EMG) signal conversion integrated circuit. The computing device 161 can pass signals from the A / D ECG or EMG circuitry to a separate processor and / or can be programmed to perform one or more functions disclosed herein. For example, the one or more functions can include receiving significant points for a patient's cardiac tissue, determining an anatomical structure classification for each of the significant points based on a structural segmentation of the cardiac tissue, and providing the anatomical structure classification with each of the significant points to support treatment of the cardiac tissue. The front-end and interface circuit 162 includes an input / output (I / O) communication interface that enables the console 160 to receive signals from and / or transmit signals to at least one ablation electrode 134.

[0036] In some embodiments, computing device 161 may be further configured to receive biometric data, such as electrical activity, and determine whether a given tissue region conducts electricity. According to an embodiment, computing device 161 may be external to console 160, for example, located in a catheter, an external device, a mobile device, a cloud-based device, or may be a stand-alone processor.

[0037] As described above, computing device 161 may include a general-purpose computer that can be programmed with software to perform the functions of the machine learning algorithms and evaluation engine described herein. The software may be downloaded to the general-purpose computer in electronic form, for example, over a network, or alternatively or additionally, provided and / or stored on a non-transitory tangible medium such as magnetic, optical, or electronic memory (e.g., any suitable volatile and / or non-volatile memory, such as random access memory or a hard disk drive). The exemplary configuration shown in FIG. 1 may be modified to implement embodiments disclosed herein. Embodiments of the present disclosure may be similarly applied using other system components and configurations. Additionally, system 100 may include additional components, such as elements for sensing electrical activity, wired or wireless connectors, processing and display devices, etc.

[0038] According to one embodiment, a display 165 is connected to the computing device 161. During a procedure, the computing device 161 can facilitate the presentation of body part renderings to the medical professional 115 on the display 165 and store data representing the body part renderings in memory. In some embodiments, the medical professional 115 may be able to manipulate the body part renderings using one or more input devices, such as a touchpad, mouse, keyboard, gesture recognizer, etc. For example, the input device can be used to change the position of the catheter 105, which updates the rendering. In an alternative embodiment, the display 165 can include a touchscreen that can be configured to receive input from the medical professional 115 in addition to presenting the body part renderings. It should be noted that the display 165 can be located at the same location or at a remote location, such as a separate hospital, or within a separate healthcare provider network. Furthermore, the system 100 can be part of a surgical system configured to obtain anatomical and electrical measurements of a patient's organs, such as the heart 120, and to perform cardiac ablation procedures. An example of such a surgical system is the Carto® system sold by Biosense Webster.

[0039] The console 160 can be connected by a cable to body surface electrodes, which can include adhesive skin patches that are applied to the patient 125. The processor, in conjunction with the current tracking module, can determine position coordinates of the catheter 105 inside a body portion (e.g., the heart 120) of the patient 125. The position coordinates can be based on impedance or electromagnetic fields measured between the body surface electrodes and electrodes or other electromagnetic components (e.g., at least one ablation electrode 134) of the catheter 105. Additionally or alternatively, location pads can be placed on the surface of the bed 130 or can be separate from the bed 130.

[0040] System 100 can also, and optionally, acquire biometric data, such as anatomical measurements of heart 120, using ultrasound, computed tomography (CT), MRI, or other medical imaging techniques known in the art. System 100 can acquire ECG or electrical measurements using catheters or other sensors that measure electrical properties of heart 120. The biometric data, including the anatomical and electrical measurements, can then be stored in a non-transitory tangible medium of console 160. The biometric data can be transmitted from the non-transitory tangible medium to computing device 161. Alternatively or additionally, the biometric data can be transmitted using a network as further described herein to a server, which can be local or remote.

[0041] According to one or more embodiments, a catheter containing a position sensor can be used to determine the trajectories of points on the heart surface. These trajectories can be used to infer motion characteristics, such as the contractile force of the tissue. A map indicative of such motion characteristics can be constructed when trajectory information is sampled at a sufficient number of points within the heart 120.

[0042] Electrical activity at a point within the heart 120 can be measured by advancing a catheter 105, which typically contains an electrical sensor at or near its distal tip (e.g., at least one ablation electrode 134), to the point within the heart 120, contacting tissue with the sensor and acquiring data at the point. One drawback associated with mapping a heart chamber using a catheter 105 containing only a single distal tip electrode is the long period of time required to accumulate data point-by-point across the requisite number of points needed for a detailed map of the heart chamber as a whole. Therefore, multi-electrode catheters have been developed to simultaneously measure electrical activity at multiple points within a heart chamber.

[0043] The multi-electrode catheter can be implemented using any applicable shape, such as a linear catheter with multiple electrodes, a balloon catheter including electrodes distributed over multiple balloon-forming frameworks, a lasso or loop catheter with multiple electrodes, or any other applicable shape (e.g., the Thermocool SmartTouch Irrigated Tip CF Sensing Ablation Catheter). The linear catheter may be fully or partially elastic so that it can twist, bend, or otherwise change its shape based on received signals and / or the application of an external force (e.g., cardiac tissue) to the linear catheter. The balloon catheter may be designed so that its electrodes can be held in close contact against the endocardial surface when deployed within a patient's body. As an example, the balloon catheter can be inserted into a lumen such as the PV. The balloon catheter can be inserted into the PV in a deflated state so that the balloon catheter does not occupy the full volume of the PV while inserted within the PV. The balloon catheter can be inflated inside the PV with such electrodes on the balloon catheter in contact with the entire circular area of the PV. Such contact with the entire circular portion of the PV, or any other lumen, may allow for efficient mapping and / or ablation.

[0044] According to one example, a multi-electrode catheter can be advanced into a chamber of the heart 120. Anteroposterior (AP) and lateral fluorograms can be acquired to establish the location and orientation of each of the electrodes. An EGM can be recorded from each of the electrodes in contact with the cardiac surface relative to a temporal criterion, such as the occurrence of a P wave in sinus rhythm from a surface ECG. The system further disclosed herein can distinguish between electrodes that record electrical activity and those that do not record electrical activity due to their lack of proximity to the endocardial wall. After the first EGM is recorded, the catheter can be repositioned, and fluorograms and EGMs can be recorded again. An electrical map can then be constructed from a repetition of the above process.

[0045] According to one example, cardiac mapping can be generated based on the detection of intracardiac electrical fields. Non-contact methods can be implemented to simultaneously acquire large amounts of cardiac electrical information. For example, a catheter having a distal end portion can include a series of sensor electrodes distributed over its entire surface and connected to insulated conductors for connection to signal sensing and processing means. The size and shape of the end portion can be such that the electrodes are spaced a large distance from the wall of the heart chamber. The intracardiac electrical fields can be detected during one heartbeat. According to one example, the sensor electrodes can be distributed on a series of circumferentially spaced apart planes. These planes can be perpendicular to the longitudinal axis of the catheter end portion. At least two additional electrodes can be disposed adjacent to each end of the longitudinal axis of the end portion. As a more specific example, the catheter can include four circumferences with eight electrodes equiangularly spaced on each circumference. Thus, in this particular implementation, the catheter can include at least 34 electrodes (32 circumferential electrodes and two end electrodes).

[0046] According to another embodiment, an electrophysiological cardiac mapping system and technique based on a non-contact, non-expandable multi-electrode catheter can be implemented. An EGM can be obtained using a catheter with multiple electrodes (e.g., 42-122 electrodes). According to this implementation, knowledge of the relative geometry of the probe and endocardium can be obtained, for example, through an independent imaging technique such as transesophageal echocardiography. After the independent imaging, non-contact electrodes can be used to measure cardiac surface potentials, from which a map can be constructed. This technique may include the following steps (after the independent imaging step): (a) measuring potentials using multiple electrodes disposed on a probe placed within the heart 120; (b) determining the geometric relationship between the probe surface and the endocardium surface; (c) generating a matrix of coefficients representing the geometric relationship between the probe surface and the endocardium surface; and (d) determining the endocardium potentials based on the electrode potentials and the matrix of coefficients.

[0047] According to another embodiment, techniques and devices can be implemented for mapping the electrical potential distribution of a cardiac chamber. An intracardiac multi-electrode mapping catheter assembly can be inserted into a patient's heart 120. The mapping catheter assembly can include a multi-electrode array with an integrated reference electrode, or preferably, a companion reference catheter. These electrodes can be deployed in the form of a substantially spherical array. The electrode array can be spatially referenced to a point on the endocardial surface by a reference electrode or by a reference catheter in contact with the endocardial surface. A preferred electrode array catheter can have a large number of individual electrode sites (e.g., at least 24). Additionally, this example method can be implemented by knowing the location of each electrode site on the array and the cardiac geometry. These locations are preferably determined by impedance plethysmography.

[0048] According to another embodiment, a cardiac mapping catheter assembly can include an electrode array defining multiple electrode sites. The mapping catheter assembly can also include a lumen for receiving a reference catheter having a distal tip electrode assembly that can be used to probe the heart wall. The mapping catheter can include a braid of insulated wires (e.g., having 24 to 64 wires within the braid), each of which can be used to form an electrode site. The catheter can be easily positioned in the heart 120 to be used to acquire electrical activity information from a first set of non-contact electrode sites and / or a second set of contact electrode sites.

[0049] According to another embodiment, another catheter for mapping electrophysiological activity within the heart can be implemented. The catheter body can include a distal tip adapted to deliver stimulation pulses for pacing the heart or an ablation electrode for ablating tissue in contact with the tip. The catheter further includes at least a pair of orthogonal electrodes capable of generating a differential signal indicative of local cardiac electrical activity adjacent the orthogonal electrodes.

[0050] According to another embodiment, a process for measuring electrophysiological data within a heart chamber can be implemented. The method includes, in part, positioning a set of active and passive electrodes within the heart 120, generating an electric field within the heart chamber by applying an electric current to the active electrodes, and measuring the electric field at the passive electrode sites. The passive electrodes are included in an array disposed on an inflatable balloon of a balloon catheter. In a preferred embodiment, the array is said to have 60-64 electrodes.

[0051] According to another embodiment, cardiac mapping can be performed using one or more ultrasound transducers. The ultrasound transducers can be inserted into the patient's heart 120 and can acquire multiple ultrasound slices (e.g., two-dimensional or three-dimensional slices) at various positions and orientations within the heart 120. The position and orientation of a particular ultrasound transducer may be known, and the acquired ultrasound slices can be stored for later display. One or more ultrasound slices corresponding to the position of a probe (e.g., a treatment catheter) can be later displayed, and the probe can be overlaid on one or more ultrasound slices.

[0052] According to another example, body patches and / or body surface electrodes may be positioned on or adjacent to the patient's body. A catheter having one or more electrodes may be positioned within the patient's body (e.g., within the patient's heart 120), and the position of the catheter may be determined by the system based on signals transmitted and / or received between one or more electrodes of the catheter and the body patch and / or body surface electrodes. Additionally, the catheter electrodes may sense biometric data (e.g., LAT values) from within the patient's body (e.g., within the heart 120). The biometric data may be associated with the determined catheter position, such that a rendering of the patient's body part (e.g., heart 120) may be displayed, showing the biometric data superimposed on the body shape.

[0053] 2 illustrates a block diagram of an exemplary system 200 for remotely monitoring and communicating vital data (i.e., patient vital information, patient data, or patient biometric data). In the example illustrated in FIG. 2, system 200 includes a monitoring and processing device 202 (i.e., patient data monitoring and processing device) associated with a patient 204, a local computing device 206, a remote computing system 208, a first network 210, and a second network 211. According to one or more embodiments, monitoring and processing device 202 may be an example of catheter 105 of FIG. 1, patient 204 may be an example of patient 125 of FIG. 1, and local computing device 206 may be an example of console 160 of FIG. 1.

[0054] The monitoring and processing device 202 includes patient biometric sensors 212, a processor 214, user input (UI) sensors 216, a memory 218, and a transmitter-receiver (i.e., transceiver) 222. During surgery, the monitoring and processing device 202 acquires biometric data (e.g., electrical signals, blood pressure, temperature, blood glucose levels, or other biometric data) of the patient 204 and / or receives at least a portion of biometric data representing any acquired patient biometric information and additional information associated with any acquired patient biometric information from one or more other patient biometric monitoring and processing devices. The additional information may be, for example, diagnostic information and / or additional information obtained from additional devices, such as wearable devices. The monitoring and processing device 202 can process data including the acquired biometric data and any biometric data received from one or more other patient biometric monitoring and processing devices using the machine learning algorithms and evaluation engine described herein.

[0055] The monitoring and processing device 202 can continuously or periodically monitor, store, process, and communicate any number of various patient biometrics (e.g., acquired biometric data) via the network 210. As described herein, examples of patient biometrics include electrical signals (e.g., ECG signals and brain biometrics), blood pressure data, blood glucose data, and temperature data. Patient biometrics can be monitored and communicated for treatment across any number of various diseases, such as cardiovascular disease (e.g., arrhythmias, cardiomyopathies, and coronary artery disease) and autoimmune diseases (e.g., type I and type II diabetes).

[0056] The patient biosensor 212 may include, for example, one or more transducers configured to convert one or more environmental conditions into electrical signals, resulting in acquisition of different types of biometric data. For example, the patient biosensor 212 may include one or more electrodes configured to acquire electrical signals (e.g., cardiac signals, brain signals, or other bioelectric signals), a temperature sensor (e.g., a thermocouple), a blood pressure sensor, a blood glucose sensor, a blood oxygen sensor, a pH sensor, an accelerometer, and a microphone.

[0057] As described in more detail herein, the monitoring and processing device 202 can implement machine learning algorithms and an evaluation engine to receive significance points for the patient's cardiac tissue, determine an anatomical structure classification for each of the significance points based on a structural segmentation of the cardiac tissue, and provide an anatomical structure classification with each of the plurality of significance points to support treatment of the cardiac tissue. The monitoring and processing device 202 can implement machine learning algorithms and an evaluation engine to generate improved image data of the cardiac tissue, thereby generating improved images, scans, and / or maps with predictions for treating cardiac disease.

[0058] In another embodiment, the monitoring and processing device 202 may be an ECG monitor for monitoring ECG signals of a heart (e.g., heart 120 in FIG. 1). In this regard, the patient biosensor 212 of the ECG monitor may include one or more electrodes (e.g., electrodes of catheter 105 in FIG. 1) for acquiring the ECG signals. The ECG signals may be used to treat various cardiovascular diseases.

[0059] In another example, the monitoring and processing device 202 may be a continuous glucose monitor (CGM) for continuously monitoring a patient's blood glucose levels on an ongoing basis to treat various diseases, such as type I and type II diabetes. In this regard, the patient biosensor 212 of the CGM may include subcutaneously disposed electrodes (e.g., electrodes of catheter 105 of FIG. 1 ), which may monitor blood glucose levels from the patient's interstitial fluid. The CGM may be a component of a closed-loop system in which blood glucose data is sent to an insulin pump, for example, for calculated delivery of insulin without user intervention.

[0060] The processor 214 can be configured to receive, process, and manage biometric data acquired by the patient biometric sensors 212 and communicate the biometric data to the memory 218 for storage and / or across the network 210 via the transceiver 222. As described in more detail herein, data from one or more other monitoring and processing devices 202 can also be received by the processor 214 through the transceiver 222. Also, as described in more detail herein, the processor 214 can be configured to selectively respond to different tapping patterns (e.g., single tap or double tap) received from the UI sensors 216 (e.g., internal capacitive sensors) such that different tasks of the patch (e.g., data acquisition, storage, or transmission) can be initiated based on the detected pattern. In some embodiments, the processor 214 can generate audible feedback regarding detecting the gesture.

[0061] The UI sensors 216 include, for example, piezoelectric or capacitive sensors configured to receive user input, such as a tap or touch. For example, the UI sensors 216 may be controlled to implement capacitive coupling in response to the patient 204 tapping or touching the surface of the monitoring and processing device 202. Gesture recognition may be implemented via any one of a variety of capacitive types, such as resistive capacitive, surface capacitive, projected capacitive, surface acoustic wave, piezoelectric, and infrared touch. The capacitive sensors may be positioned over a small area or length of the surface, such that a tap or touch on the surface activates the monitoring device.

[0062] Memory 218 is any non-transitory, tangible medium such as magnetic, optical, or electronic memory (eg, any suitable volatile and / or non-volatile memory, such as random access memory or a hard disk drive).

[0063] The transceiver 222 may include a separate transmitter and a separate receiver, or the transceiver 222 may include a transmitter and receiver integrated into a single device.

[0064] According to an embodiment, the monitoring and processing device 202 may be a device that is internal to the body of the patient 204 (e.g., subcutaneously implantable). The monitoring and processing device 202 may be inserted into the patient 204 via any applicable method, including oral infusion, surgical insertion via a vein or artery, an endoscopic procedure, or a laparoscopic procedure.

[0065] According to some embodiments, the monitoring and processing device 202 may be a device external to the patient 204. For example, as described in further detail herein, the monitoring and processing device 202 may include an attachable patch (e.g., attached to the patient's skin). The monitoring and processing device 202 may also include a catheter with one or more electrodes, a probe, a blood pressure cuff, a weight scale, a bracelet or smartwatch biometric tracker, a glucose monitor, a continuous positive airway pressure (CPAP) machine, or virtually any device that can provide input regarding the patient's health or biometric information.

[0066] According to one embodiment, the monitoring and processing device 202 may include both components internal to the patient and components external to the patient.

[0067] 2, an exemplary system may include multiple patient vital signs monitoring and processing devices. For example, the monitoring and processing device 202 may be in communication with one or more other patient vital signs monitoring and processing devices. Additionally or alternatively, one or more other patient vital signs monitoring and processing devices may be in communication with the network 210 and other components of the system 200.

[0068] The local computing device 206 and / or the remote computing system 208, along with the monitoring and processing unit 202, may be any combination of machine learning algorithms and evaluation engines, and software and / or hardware that separately or collectively store, execute, and implement their functionality. Furthermore, as described herein, the local computing device 206 and / or the remote computing system 208, along with the monitoring and processing unit 202, may be an electronic computer framework that encompasses and / or uses any number and combination of computing devices and networks that utilize various communication technologies. The local computing device 206 and / or the remote computing system 208, along with the monitoring and processing unit 202, may be easily scalable, extensible, and modular, with the ability to change to different services or reconfigure some features independently of other features.

[0069] According to one embodiment, the local computing device 206 and the remote computing system 208, along with the monitoring and processing unit 202, include at least a processor and memory, where the processor executes computer instructions related to the machine learning algorithms and the evaluation engine, and the memory stores instructions for execution by the processor.

[0070] The local computing device 206 of the system 200 can be configured to communicate with the monitoring and processing device 202 and to act as a gateway to the remote computing system 208 through the second network 211. The local computing device 206 may be, for example, a smartphone, smartwatch, tablet, or other portable smart device configured to communicate with other devices over the network 211. Alternatively, the local computing device 206 may be a fixed or standalone device, such as, for example, a fixed base station including modem and / or router capabilities, a desktop or laptop computer using an executable program to communicate information between the processing device 202 and the remote computing system 208 via a wireless module in a PC, or a USB dongle. Biometric data may be communicated between local computing device 206 and monitoring and processing device 202 using short-range wireless technology standards (e.g., Bluetooth, Wi-Fi, ZigBee, Z-wave, and other short-range wireless standards) over a short-range wireless network 210, such as a local area network (LAN) (e.g., a personal area network (PAN)). In some embodiments, local computing device 206 may also be configured to display the acquired patient electrical signals and information associated with the acquired patient electrical signals, as described in further detail herein.

[0071] In some embodiments, remote computing system 208 can be configured to receive at least one of the monitored patient vital signs and information associated with the monitored patient via network 211, which is a long-range network. For example, if local computing device 206 is a cellular phone, network 211 can be a wireless cellular network, and information can be communicated between local computing device 206 and remote computing system 208 via a wireless technology standard, such as any of the wireless technologies described above. As described in further detail herein, remote computing system 208 can be configured to provide (e.g., visually display and / or audibly provide) at least one of the patient vital signs and associated information to a medical professional, physician, healthcare professional, etc.

[0072] 2, network 210 is an example of a short-range network (e.g., a local area network (LAN) or a personal area network (PAN)). Information may be transmitted between monitoring and processing equipment 202 and local computing device 206 over short-range network 210 using any one of a variety of short-range wireless communication protocols, such as Bluetooth, Wi-Fi, ZigBee, Z-wave, near field communication (NFC), ultra-wideband, Zigbee, or infrared (IR).

[0073] Network 211 may be a wired network, a wireless network, or may include one or more wired and wireless networks, such as an intranet, a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a direct connection or series of connections, a cellular network, or any other network or medium capable of facilitating communication between local computing device 206 and remote computing system 208. Information may be transmitted over network 211 using any one of a variety of long-range wireless communication protocols (e.g., TCP / IP, HTTP, 3G, 4G / LTE, or 5G / New Radio). Wired connections may be implemented using Ethernet, Universal Serial Bus (USB), RJ-11, or any other wired connection commonly known in the art. Wireless connections may be implemented using Wi-Fi, WiMAX, Bluetooth, infrared, cellular networks, satellite, or any other wireless connection method. Additionally, several networks may operate alone or in communication with each other to facilitate communication within network 211. In some cases, remote computing system 208 may be implemented as a physical server on network 211. In other cases, remote computing system 208 may be implemented as a virtual server on a public cloud computing provider of network 211 (e.g., Amazon Web Services (AWS)).

[0074] Figure 3 shows a graphical depiction of an artificial intelligence system 300 in accordance with one or more embodiments. The artificial intelligence system 300 includes data 310, a machine 320, a model 330, multiple outcomes 340, and underlying hardware 350. Figure 4 shows a block diagram of a method 400 implemented in the artificial intelligence system of Figure 3. The description of Figures 3-4 will be made with reference to Figure 2 for ease of understanding.

[0075] Generally, the artificial intelligence system 300 operates the method 400 by using the data 310 to train a machine 320 (e.g., the local computing device 206 of FIG. 2 ) while building a model 330 to enable multiple (predicted) outcomes 340. In such a configuration, the artificial intelligence system 300 can operate against hardware 350 (e.g., the monitoring and processing unit 202 of FIG. 2 ) to train the machine 320, build the model 330, and predict outcomes using algorithms. These algorithms can be used to solve the trained model 330 and predict outcomes 340 associated with the hardware 350. These algorithms can generally be categorized as classification algorithms, regression algorithms, and clustering algorithms.

[0076] At block 410, the method 400 includes collecting data 310 from hardware 350. A machine 320 acts as a controller or data collector associated with the hardware 350 and / or is associated with that hardware. The data 310 (e.g., biometric data that may originate from the monitoring and processing unit 202 of FIG. 2) may be associated with the hardware 350. For example, the data 310 may be ongoing data or output data associated with the hardware 350. The data 310 may also include currently collected data, historical data, or other data from the hardware 350. For example, the data 310 may include measurements taken during a surgical procedure and may be associated with the outcome of the surgical procedure. For example, cardiac temperature (e.g., of the patient 204) may be collected and correlated with the outcome of the cardiac procedure.

[0077] At block 420, the method 400 includes training a machine 320, such as on the hardware 350. This training may include analyzing and correlating the data 310 collected in block 410. For example, in the cardiac case, temperature and outcome data 310 may be trained to determine if a correlation or association exists between the temperature of the heart (e.g., of the patient 204) during a cardiac procedure and the outcome.

[0078] At block 430, the method 400 includes building a model 330 on the data 310 associated with the hardware 350. Building the model 330 may include modeling of physical hardware or software, modeling of algorithms, and / or the like. The modeling may be intended to represent the collected and trained data 310. According to an embodiment, the model 330 may be configured to model the operation of the hardware 350 and model the data 310 collected from the hardware 350 to predict outcomes achieved by the hardware 350. According to one or more embodiments, the model 330, with respect to the evaluation engine, receives significance points for the patient's cardiac tissue, determines an anatomical structure classification for each of the significance points based on a structural segmentation of the cardiac tissue, and provides an anatomical structure classification with each of the significance points to support treatment of the cardiac tissue.

[0079] At block 440, the method 400 includes predicting a plurality of outcomes 340 of the model 330 associated with the hardware 350. This prediction of the plurality of outcomes 340 can be based on the trained model 330. For example, to enhance understanding of the present disclosure, in the case of a heart, if a temperature between 36.5°C and 37.89°C (i.e., 97.7°F and 100.2°F) during the procedure produces a more positive outcome from the cardiac procedure, then the outcome can be predicted for a given procedure based on the temperature of the heart during the cardiac procedure. Thus, using the predicted outcome 340, the hardware 350 can be configured to provide a particular desired outcome 340 from the hardware 350.

[0080] 5 shows a block diagram of a method 500 according to one or more embodiments. According to one embodiment, the method 500 may be performed by a rating engine. Any combination of software and / or hardware (e.g., the local computing device 206 and the remote computing system 208 in cooperation with the monitoring and processing unit 202), separately or collectively, can store, execute, and implement the rating engine and its functionality.

[0081] In general, the evaluation engine provides automatic anatomical segmentation of significant points, continuity estimation, and gap prediction to provide improved image data of the cardiac tissue. The evaluation engine provides improved image data of the cardiac tissue to support, guide, and recommend to the physician regarding the overall effectiveness of the ablation procedure. Anatomical segmentation is the ability of the evaluation engine to determine in which segment of the left and right pulmonary veins each significant point resides (e.g., left and right WACA detection and classification / segmentation of WACA points into nine anatomical structures). According to one or more embodiments, combinations of other structures are contemplated in addition to or in place of the nine anatomical structures, such as left WACA, right WACA, ostial PVI, roofline, left carina, right carina, posterior line, inferior line, mitral isthmus line, anterior line, anterior line, and at least one of cavotricuspid isthmus and superior vena cava isolation. Continuity estimation is the evaluation engine's ability to determine indirect contact between two separate annular rings around the left and right PVs, and between the two separate annular rings and structural elements outside the left and right pulmonary veins. For example, a physician may wish to deliver contiguous lesions with a center-to-center distance between two ablation points of ≤6 mm. The evaluation engine examines the effectiveness of each lesion and estimates its size and depth to determine whether the lesion is sufficient. Thus, continuity can be evaluated by the evaluation engine in a local sense, i.e., whether the lesion between two ablation points is effective. The evaluation engine also operates in a global sense, i.e., testing all ablation points in the left (or right) WACA and estimating the likelihood of recognizing potential reconnections. Gap prediction is the evaluation engine's ability to determine the space between effective points where PV reconnections may occur. According to one or more embodiments, the evaluation engine can automatically classify / segment all ablation points so that left and right isthmus or carina ablation lines are automatically detected.

[0082] Method 500 begins at block 510, where the evaluation engine builds a dataset including annotated anatomical structures of cardiac tissue (e.g., a human heart), all ablation points with their characteristics (e.g., force, force over time, impedance, impedance drop, duration, x, y, z location), and intracardiac ECG (an optional input to all algorithms). The annotated anatomical structures may include a three-dimensional data file that can depict the human heart and validated valid points (e.g., data for classifying the anatomical structures includes the x, y, z location of the ablation points, actual anatomical structures such as a mesh file and three-dimensional visualization of the atria, and ablation characteristics that can leverage intracardiac ECG characteristics around the ablation points, if present). According to one or more embodiments, each ablation type can be described by annotations, i.e., potential retry locations, potential acute reconnection locations, and whether it is a valid ablation point (e.g., a yes or no determination for each point).

[0083] According to one or more embodiments, the annotated anatomical structure is training data initially constructed by manual continuity estimation and annotation that validates valid points generated by the cardiac mapping stage. The manual continuity estimation can be ablation points added after the cardiac mapping stage. The manual annotation can be markings made by a medical professional. According to one or more embodiments, the medical professional can mark the location and / or ablation type. Note that ablation types can include acute reconnection points (e.g., after pacing, the physician identifies the reconnection location and adds ablation points to isolate the vein), long-term reconnection (redo) ablation points (e.g., long after the case is completed, the patient has atrial fibrillation and the physician decides to perform another ablation procedure), and efficient ablation.

[0084] At block 520, the evaluation engine receives a case. The case may be received in real time (or retrospectively) during the cardiac mapping phase of a WACA session. The case includes significant points that map cardiac tissue, creating two separate annular rings around the left and right PVs. The case is evaluated by the evaluation engine. It should be noted that the evaluation engine can provide a support tool for retrospective analysis of physician decisions, for example, to improve the work of physician colleagues.

[0085] At block 530, the evaluation engine determines right and left WACA positions for each significant point of the received case. For example, a sub-algorithm of the evaluation engine is used to automatically compare the position information of the significant point with dimensional information along an axis (e.g., using an X-axis with a first range for left positions and a second range for right positions). The significant points are then divided based on the comparison.

[0086] In block 540, the evaluation engine determines an anatomical structure classification for each valid point of the received cases (e.g., based on manual annotation of the training data using the dataset from block 510, similar segments / groups as ablation points that have the same anatomical code and associate them with the same anatomical structure). Note the WACA anatomical structure codes, as described further herein.

[0087] At block 550, the evaluation engine estimates the continuity of two separate annular rings around the left and right PVs. The output of this estimation may include a probability of continuity for each significant point. According to one or more embodiments, each significant point is designated by a 0 or a 1, with a 0 representing a "bad" ablation point and a 1 representing a "good" ablation point. Additionally, the distance between each significant point and the next and previous ablation in the ring may contribute to the "bad / good" determination.

[0088] At block 560, the evaluation engine generates improved image data of the cardiac tissue being mapped (e.g., by merging the estimations of block 550 and the decisions of blocks 530 and 540). The improved image data can then be used to predict locations of acute reconnections and redoes, allowing appropriate action (by a physician or medical professional) to be taken in real time during the ablation phase.

[0089] According to one or more embodiments, the training dataset is utilized by the evaluation engine to automatically generate continuity estimates and annotations on the annotated anatomical structures, such that machine-learned data is created and added to the dataset. The machine-learned data may comprise a large portion of the dataset relative to the training data, and tagged data (e.g., tagged ablation type and / or anatomical structure type) may be added to the dataset based on feedback from medical professionals.

[0090] FIG. 6A illustrates an example of an autoencoder architecture 600, and FIG. 6B illustrates a block diagram of a method 601 performed by the autoencoder architecture 600. The autoencoder architecture 600 operates to support implementation of the machine learning algorithms and evaluation engines described herein. The autoencoder architecture 600 can be implemented in hardware, such as the machine 320 (e.g., the local computing device 206 of FIG. 2) and / or the hardware 350 (e.g., the monitoring and processing unit 202 of FIG. 2). The modules 610, 630, and 650 of the autoencoder 600 collectively operate as a neural network that performs the encoding portion of the autoencoder 600. The modules 750, 670, and 610 of the autoencoder 600 collectively operate as a neural network that performs the decoding portion of the autoencoder 600. Generally, a neural network is a network or circuit of neurons, or in the modern sense, an artificial neural network (ANN) composed of artificial neurons, nodes, or cells.

[0091] For example, an ANN contains a network of processing elements (artificial neurons) that can exhibit complex global behavior determined by the connections between the processing elements and element parameters. These connections in a neuronal network or circuit are modeled as weights. Positive weights reflect excitatory connections, while negative values imply inhibitory connections. The inputs are modified by the weights and summed using linear combinations. An activation function can control the amplitude of the output. For example, the acceptable range of the output is usually 0 to 1, but can also be -1 to 1.

[0092] ANNs are often adaptive systems that change their structure based on external or internal information flowing through the network. In more practical terms, neural networks are nonlinear statistical data modeling or decision-making tools that can be used to model complex relationships between inputs and outputs or to find patterns in data. Therefore, ANNs can be used for predictive modeling and adaptive control applications while being trained through data sets. Note that self-learning arising from experience can occur within ANNs, allowing them to draw conclusions from complex and seemingly unrelated sets of information. The usefulness of artificial neural network models lies in the fact that they can be used to estimate and use functions from observations. Unsupervised neural networks can also be used to learn representations of inputs that capture salient features of the input distribution, and more recently, deep learning algorithms that can implicitly learn distribution functions for observed data. Training with neural networks is particularly useful in applications where the complexity of the data or task makes it impossible to manually design such functions.

[0093] Neural networks can be used in a variety of fields, and the tasks to which ANNs are applied tend to fall into the following broad categories: function approximation or regression analysis, including time series prediction and modeling; classification, including pattern and sequence recognition, novelty detection and sequential decision making; data processing, including filtering, clustering, blind signal separation, and compression.

[0094] Areas of application of ANNs include identification and control of nonlinear systems (vehicle control, process control), game playing and decision making (backgammon, chess, racing), pattern recognition (radar systems, face identification, object recognition), sequence recognition (gesture, speech, handwritten text recognition), medical diagnosis, financial applications, data mining (or knowledge discovery in databases, or "KDD"), visualization, and email spam filtering. For example, it is possible to create semantic profiles of user interests resulting from photographs trained for object recognition.

[0095] According to one or more embodiments, neural network 600 implements a long-short-term memory neural network architecture, a CNN architecture, or the like. Neural network 600 may be configurable with respect to multiple layers, multiple connections (e.g., encoder / decoder connections), regularization techniques (e.g., dropout), and optimization features.

[0096] Long-short-term memory neural network architectures contain feedback connections and can process single data points (e.g., images) along with entire sequences of data (e.g., speech or video). The units of a long-short-term memory neural network architecture can consist of cells, input gates, output gates, and forget gates, where cells store values over any time interval and gates regulate the flow of information to and from the cells.

[0097] A CNN architecture is a shared weight architecture with translational invariance properties, where each neuron in one layer is connected to every neuron in the next layer. The regularization techniques of CNN architectures can exploit hierarchical patterns in the data and organize more complex patterns using smaller, simpler patterns. When neural network 600 implements a CNN architecture, other configurable aspects of the architecture may include the number of filters in each stage, kernel size, and number of kernels per layer.

[0098] As shown in FIG. 6B, method 601 illustrates the operation of a neural network 600 (e.g., an autoencoder of an evaluation engine). In this neural network 600, an input layer 610 is represented by multiple inputs, such as 612 and 614. With reference to block 620 of this method 601, the input layer 610 receives multiple inputs (e.g., data at multiple points, such as WACA points) as an initial operation. The multiple inputs may be ultrasound signals, radio signals, acoustic signals, or two-dimensional or three-dimensional images / models. More specifically, the multiple inputs may be represented as input data (X), which is raw data recorded from the cardiac mapping phase of a WACA session.

[0099] In block 625 of this method 601, the neural network 600 utilizes an intracardiac dataset (e.g., the dataset generated by the evaluation engine in block 510 of FIG. 5) to encode multiple inputs to generate latent representations. The latent representations include one or more intermediate images derived from the multiple inputs. According to one or more embodiments, the latent representations are generated by an element-wise activation function (e.g., a sigmoid function or a rectified linear unit) of the evaluation engine's autoencoder, which applies a weighting matrix to the input intracardiac signals and appends a bias vector to the result. Note that the weights and biases of the weighting matrix, as well as the bias vector, may be randomly initialized and then iteratively updated during training.

[0100] As shown in FIG. 6A, inputs 612 and 614 are fed to hidden layer 630, which is shown to include nodes 632, 634, 636, and 638. Layers 610, 630, and 650 can thus be considered an encoder stage that takes multiple inputs 612 and 614 and forwards them to a deep neural network, shown in 630, to learn some smaller representation of the inputs (e.g., resulting latent representation or data encoding 652). The deep neural network can be a CNN, a long-short-term memory neural network, a fully connected neural network, or a combination thereof. Inputs 612 and 614 can be intracardiac ECG, ECG, or intracardiac ECG and ECG. This encoding provides a dimensionality reduction of the input intracardiac signal. Dimensionality reduction is the process of reducing the number of random variables (of multiple inputs) under consideration by obtaining a set of key variables. For example, dimensionality reduction can be feature extraction, which transforms data (e.g., multiple inputs) from a high-dimensional space (e.g., greater than 10 dimensions) to a low-dimensional space (e.g., 2-3 dimensions). Technical effects and advantages of dimensionality reduction include reducing the time and storage space required for the data, improving data visualization, and improving parameter interpretation for machine learning. This data transformation can be linear or nonlinear. The receiving (block 620) and encoding (block 625) operations can be considered the data preparation portion of the multi-stage data manipulation by the evaluation engine's autoencoder.

[0101] In block 660 of method 610, neural network 600 decodes the latent representation to generate an output intracardiac signal. The decoding stage takes the encoder output (e.g., the resulting latent representation or data encoding 652) and attempts to recover some form of the inputs 612 and 614 using another deep neural network 660. In this regard, nodes 672, 674, 676, and 678 are combined to generate outputs 692 and 694 in output layer 690, as shown in block 699. That is, output layer 690 recovers inputs 612 and 614 with reduced dimensionality but without signal interference, signal artifacts, and signal noise. Examples of outputs 692 and 694 include an intracardiac ECG, a clean version of the intracardiac ECG (a denoised version), an ECG, and a denoised ECG. The denoised version of the intracardiac ECG may be free of one or more of far-field suppression, power line noise, contact noise, deflection noise, baseline drift, respiratory noise, and Fluro noise.

[0102] Neural network 600 performs processing through hidden layer 630 of nodes 632, 634, 636, and 638 to exhibit complex global behavior determined by the connections between processing elements and element parameters. Target data in output layer 650 includes ventricular activity (Y1) of target data type 1 and input data (Y2) of target data type 2 after far-field reduction.

[0103] According to one embodiment, the evaluation engine's autoencoder may be a denoising autoencoder for finding a mapping function (f, g) such that f(X) = Y1 and g(X) = Y2. Any combination of software and / or hardware (e.g., local computing device 206 and remote computing system 208 in cooperation with monitoring and processing unit 202) can store, execute, and implement the denoising autoencoder and its functionality, separately or collectively. The denoising autoencoder trains the hidden layer (e.g., hidden layer 630 in FIG. 6) to discover more robust features (i.e., useful features that constitute a better, higher-level representation of the input) and to prevent the autoencoder from learning specific identities (i.e., always reverting to the same value). In this regard, the denoising autoencoder encodes the input (e.g., to preserve information about the input) and reverses the effects of the corruption process probabilistically applied to the autoencoder's input.

[0104] 7 illustrates a block diagram of a method 700 according to one or more embodiments. Any combination of software and / or hardware (e.g., the local computing device 206 and the remote computing system 208, in cooperation with the monitoring and processing unit 202) can store, execute, and implement the method 700, separately or collectively, within the context of the evaluation engine and its functions. Generally, the method 700 can be implemented in the context of WACA treatment, including WACA point mapping and WACA stages. That is, implementing the method 700 in the context of WACA treatment allows physicians and / or medical professionals to more effectively treat various cardiovascular diseases with ablation itself.

[0105] For example, catheter-based WACA therapy utilizing method 700 maps the electrical properties of the left and right PVs and provides direct information to physicians and / or medical professionals. In this regard, the mapping and direct information may include automated anatomical segmentation of WACA points, continuity estimation, and gap prediction.

[0106] Process flow 700 begins at block 720, where the evaluation engine receives a case. The case may be received in real time during the WACA point mapping phase of WACA treatment. The case includes WACA points that map the left and right PVs, and the WACA points themselves create two separate annular rings around the left and right PVs.

[0107] In block 730, the evaluation engine determines the right and left WACA positions for each WACA point of the received case, or at least one of the left WACA, right WACA, ostial PVI, roof line, left carina, right carina, posterior line, inferior line, mitral isthmus line, anterior line, anterior line, cavotricuspid isthmus line, and superior vena cava isolation line. For example, sub-algorithms of the evaluation engine evaluate the WACA points to estimate left and right WACA rings. This estimation can be considered feature extraction to determine morphological ring characteristics. In some cases, the evaluation engine can automatically compare WACA point position information with axial dimensional information (e.g., using an X-axis with a first range of left positions and a second range of right positions). Also referring to FIG. 8 , a graphical image 801 is shown in accordance with one or more embodiments. The graphical image 801 is an example of a graphical user interface providing an image of a PV having two distinct annular rings. Each ring includes a WACA point, such as those generated in block 720.

[0108] At block 735, the evaluation engine utilizes a dataset. In one embodiment, the dataset includes over 370 cases, each of which includes manual annotations and / or ablation features (e.g., radio frequency index (RF index), force time integral (FTI, how much force is induced between ablation points), etc.).

[0109] 9A and 9B, which illustrate graphical images 902 and 907, respectively, of a user interface showing a dataset in accordance with one or more embodiments. Graphical image 902 is an example of manual annotation of nine anatomical structures. Graphical image 907 is an example of manual annotation of an ablation type.

[0110] At block 740, the evaluation engine determines an anatomical structure classification for each WACA point of the received case (e.g., based on manual annotation of the training data). Anatomical structure classification (e.g., segmentation) is the evaluation engine's ability to determine in which segment of the left and right pulmonary veins each WACA point resides. At block 745, the evaluation engine displays the results of the anatomical structure classification. In this regard, a physician or medical professional can use the displayed results for more effective treatment of various cardiovascular diseases.

[0111] According to one or more embodiments, anatomical structure classifications may be defined across nine structures. Table 1 shows the nine structures or segments: right posterior, right inferior, right roof, right anterior, left posterior, left inferior, left roof, left ridge, and left anterior.

[0112] [Table 1]

[0113] Each structure or segment may be represented by a unique code, as indicated in the name column of Table 1 and / or by a set of numbers (e.g., 1-9). Other structure combinations may be utilized in addition to or in place of the nine structures or segments, such as left WACA, right WACA, ostial PVI, roofline, left carina, right carina, posterior line, inferior line, mitral isthmus line, anterior line, anterior line, and at least one of cavotricuspid isthmus, superior vena cava isolation.

[0114] 10 shows a graphical representation 1008 of the classification of left and right WACA points into anatomical structures by manual annotation. The graphical representation 1008 shows the left atrium with the ablation point, and the text represents the assessment engine's determination (if the text is a first color, such as green, the assessment engine is accurate; if the text is a second color, such as red, the assessment engine is inaccurate).

[0115] 11A shows a diagram of a right anatomical structure identified as the right WACA 1100. The right WACA 1100 includes a right posterior region 1110, an inferior inferior region 1120, an upper roof region 1130, and a left anterior region 1140.

[0116] 11B shows a diagram of the left anatomical structure identified as the left WACA 1101. The left WACA 1101 includes a left posterior region 1150, an inferior inferior region 1160, a superior roof region 1170, an upper right ridge region 1180, and a lower right anterior region 1190.

[0117] Comparison of the elements of Table 1 with diagrams 1100, 1101 in Figures 11A and 11B shows nine structures or segments arranged around the right and left PVs.

[0118] In an exemplary operation of block 740, FIG. 12A shows a block diagram of a classification method 1212, and FIG. 12B shows a block diagram of a classification method 1211. Method 1211 is an exemplary operation of a random forest (e.g., a random forest classifier) of an acute reconnection classifier. As described herein, method 1212 of FIG. 12 accepts inputs to the anatomy classification, which may include a set of characteristics / features for each ablation point, a 3D representation (e.g., a VTK file) of the atrium, CT scan, ultrasound, rapid anatomical mapping, etc., and an IC ECG or body surface ECG. The output 1249 of the anatomy classifier is an anatomy code k (k=1...K). According to one or more embodiments, the 3D representation of the atrium can be processed using a deep CNN network to obtain an initial estimate of a KxM probability matrix indicating the likelihood that each one of the m (m=1,...,M) ablation points is associated with each one of the k anatomical structures (k=1,...,K). The IC ECG can be processed using a deep autoencoder to obtain a set of features. All the features (and characteristics) can be processed into anatomy predictions by a set of dense neural networks.

[0119] More specifically, method 1212 includes utilizing a random forest classification, a fully connected dense layer, and a CNN architecture. In this manner, a five-layer CNN receives the anatomical structure of the left atrium from a VTK file (block 1240), a fully connected layer receives ablation features (block 1241), and a fully connected layer receives morphological features along with the ablation features (block 1242). For example, as described herein, the location of the ablation point (x, y, z) and the characteristics of the ablation are processed in the VTK file using a deep CNN network to obtain a set of features. The features can be passed to several dense layers to generate an anatomical structure code. The outputs of the five-layer CNN and two fully connected layers are then passed to another two fully connected networks (e.g., processed as per blocks 1245 and 1247) to provide a final anatomical code determination (e.g., output as per block 1249).

[0120] Method 1211 includes providing morphological features to a random forest classifier (block 1223) and running the random forest classifier (block 1225) to output an anatomical structure code (block 1227). The morphological features can be derived from the estimation and feature extraction by the sub-algorithms. In this regard, the morphological features can be organized by the evaluation engine according to the left and right WACA rings. For example, because the primary "information" for classifying anatomical structures is based on the x, y, and z locations of the ablation points, the evaluation engine executes a sub-algorithm that forms rings based on the proximity of the ablation points. From the morphological features of those rings, the evaluation engine extracts, for example, the total surface area of the ring, the number of points within the ring, and the angle of each point (if the rings are "clock-like"). In one embodiment, the morphological features can be a number along the range of 10 to 50, such as 25.

[0121] According to one or more embodiments, the morphological features may be for nine anatomical structures defined within an algorithmic feature space. For example, the algorithmic feature space may include (x_left, y_left, z_left), where the average of all points is associated with a left and right ring; (x_right, y_right, z_right); (x_norm, y_norm, z_norm), where x, y, and z are normalized by range; and (x_norm_ring, y_norm_ring, z_norm_ring), where the normalized points are based on the range of the ring (left or right). The algorithmic feature space may further include optional features such as a VTK file, a minimum distance of the ablation point to the anatomical structure, and ablation characteristics (e.g., power, impedance, impedance drop, stability, etc.). The output of method 1211 may be an anatomical structure code and / or a number within a set of digits 1-9.

[0122] Random forest classifiers generally include ensemble learning methods for classification, regression, and other tasks that operate by building multiple decision trees during training and outputting a class that is the mode of the individual trees' classifications or average predictions.

[0123] FIG. 13 illustrates an exemplary random forest classifier for classifying clothing color. As shown in FIG. 13, the random forest classifier includes five decision trees 13101, 13102, 13103, 13104, and 13105 (collectively or generally referred to as decision trees 1310). Each tree is designed to classify clothing color. In this illustration, three of the five trees (13101, 13102, 13104) determine that the clothing is blue, one determines that the clothing is green (13103), and the remaining tree determines that the clothing is red (13105). The random forest receives these actual predictions of the five trees and calculates the mode of the actual predictions to provide the random forest's answer that the clothing is blue.

[0124] Returning to FIG. 12 , method 1212 includes leveraging random forest regression, fully connected dense layers, and a CNN architecture. In this manner, a five-layer CNN receives the VTK anatomical structure (block 1240), a fully connected layer receives the ablation features (block 1241), and a fully connected layer receives the morphological features (block 1242). The VTK anatomical structure may be the anatomical structure of the left atrium stored in a VTK file. According to one or more embodiments, the ablation points, locations, and characteristics comprising the VTK file are processed using a deep CNN network to obtain a set of features that are passed through several dense layers to generate an anatomical structure code. The outputs of the five-layer CNN and two fully connected layers are then passed through two other fully connected networks (e.g., blocks 1245 and 1247) to provide a final output anatomical structure code (e.g., block 1249).

[0125] Returning to FIG. 7 , in block 750, the evaluation engine estimates the continuity of two separate annular rings around the left and right PVs (e.g., acute reconnection continuity estimation). Continuity estimation is the evaluation engine's ability to determine indirect contact between the two separate annular rings around the left and right PVs, and between the two separate annular rings and structural elements outside the left and right pulmonary veins. The output of this estimation may include a probability of continuity for each ablation point. In block 755, the evaluation engine displays the results of the continuity estimation. In this regard, a physician or medical professional can use the displayed results for more effective treatment of various cardiovascular diseases.

[0126] In an example operation of block 750, Figure 14A shows a block diagram of a classification method 1412, Figure 14B shows a block diagram of a classification method 1411, and Figure 14C shows a graphic image 1416. Method 1411 is an example operation of a random forest (e.g., a random forest classifier as described herein) for an acute reconnection classifier. Method 1412 is an example operation of a deep learning method for a redo / acute reconnection classifier. Graphic image 1416 shows acute reconnection points (shown in purple).

[0127] The method 1411 includes providing the ablation features and morphological features to a random forest classifier (block 1423), running the random forest classifier (block 1425), and outputting a continuity probability (block 1427). The ablation features and morphological features for continuity estimation (redo or acute reconnection) can include updated position-based features based on nine anatomical structures defined in the algorithm feature space: (x_left, y_left, z_left), where the average of all points is associated with the left and right rings; (x_right, y_right, z_right), where x, y, and z are normalized by range (x_norm, y_norm, z_norm), and where the normalized points are based on the range of the ring (left or right) (x_norm_ring, y_norm_ring, z_norm_ring).

[0128] The algorithm feature space can include optional features such as mesh-based features, a VTK file of the atrial anatomy (e.g., a CNN of feature phases), minimum distance from the ablation point to the anatomy, and ablation characteristics (e.g., power, impedance, impedance drop, stability, temperature, RF index, FTI, features, time-based features, etc.). The output of method 1211 can be an anatomy code and / or a number in the set of digits 1-9.

[0129] Returning to method 1412 of FIG. 14A, as described herein, inputs to the rework / acute reconnection classifier can include a set of characteristics / features for each ablation point, a 3D representation (e.g., VTK file) of the atrium / CT scan / ultrasound / rapid anatomical mapping, etc., and an IC ECG or body surface ECG.

[0130] The output of the redo / acute reconnection classifier may include a 1 or 0 for each voxel of interest, with a 1 representing an acute / long-term reconnection site. A voxel may be a point in three-dimensional space, such as a unit of graphic information (e.g., a 2 mm x 2 mm x 2 mm cube). For example, a pixel defines a point in two-dimensional space with an x-coordinate and a y-coordinate, while a voxel requires a third z-coordinate. According to one or more embodiments, in the 3D space, each voxel may be further defined in terms of location, color, and density. Based on the output, the acute / long-term reconnection site may be displayed.

[0131] According to one or more embodiments, the 3D representation of the atria can be processed using a deep CNN network to obtain a set of features, and the IC ECG can be processed using a deep autoencoder to obtain a set of features. Furthermore, the IC ECG can be processed to obtain additional features such as bipolar voltage, conduction velocity, cycle length (milliseconds), spatiotemporal dispersion level, distance from the focal source, and voxel-wise fractional level of the object. All features (and characteristics) can be processed by a set of dense neural networks to generate a continuity prediction.

[0132] More specifically, method 1412 includes utilizing a random forest classification, a fully connected dense layer, and a CNN architecture. According to one or more embodiments, method 1412 includes utilizing a random forest classification for acute / redo classification and a CNN+ dense layer for continuity estimation. In this manner, a five-layer CNN receives the left atrium anatomical structure from the VTK file (block 1440), a fully connected layer receives ablation features (block 1441), and in some cases, the fully connected layer receives morphological features along with the ablation features (block 1442). For example, as described herein, the location of the ablation point (x, y, z) and the characteristics of the ablation are processed in the VTK file using a deep CNN network to obtain a set of features. All features are then passed through several dense layers to generate an anatomical structure code. The outputs of the five-layer CNN and the two fully connected layers are then passed to another two fully connected networks (e.g., processed with respect to blocks 1445 and 1447) to provide the final continuity probabilities (e.g., output with respect to block 1449).

[0133] At block 760, the evaluation engine generates a redo prediction (e.g., predicts ablation points to be annotated as redo). At block 765, the evaluation engine displays the redo prediction results. In this regard, a physician or medical professional may use the displayed results for more effective treatment of various cardiovascular diseases.

[0134] The flow diagrams and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flow diagrams or block diagrams may represent a module, segment, or portion of instructions, which portion of instructions includes one or more executable instructions for implementing particular logical function(s). In some alternative implementations, the functions described in the blocks may occur out of the order described in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending on the functionality involved. It should also be noted that each block of the block diagrams and / or flow diagrams, and combinations of blocks in the block diagrams and / or flow diagrams, may be implemented by a dedicated hardware-based system that performs particular functions or operations, or a combination of dedicated hardware and computer instructions may be executed.

[0135] While features and elements are described above in particular combinations, those skilled in the art will understand that each feature or element can be used alone or in combination with other features and elements. Additionally, the methods described herein may be implemented in a computer program, software, or firmware embodied in a computer-readable medium for execution on a computer or processor. As used herein, a computer-readable medium should not be construed as being a transitory signal itself, such as an electric wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse passing through a fiber optic cable), or an electrical signal transmitted through a wire.

[0136] Examples of computer-readable media include electrical signals (transmitted via wired or wireless connections) and computer-readable storage media. Examples of computer-readable storage media include, but are not limited to, registers, cache memory, semiconductor memory devices, magnetic media such as internal hard disks and removable disks, magneto-optical media, optical media such as compact discs (CDs) and digital versatile discs (DVDs), random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), and memory sticks. A processor together with software can implement a radio frequency transceiver for use in a terminal, a base station, or any host computer.

[0137] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms unless the context clearly indicates otherwise. It should be understood that the terms "comprise" and / or "comprising," as used herein, indicate the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0138] The description of different embodiments herein is provided for illustrative purposes, but is not intended to be exhaustive or limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terms used herein are selected to best explain the principles, practical applications, or technical improvements of the embodiments compared to technologies found on the market, or to enable those skilled in the art to understand the embodiments disclosed herein.

[0139] [Embodiment] (1) A method comprising: receiving, by a processor-implemented evaluation engine, a plurality of effective points for the patient's cardiac tissue; determining, by the evaluation engine, an anatomical structure classification for each of the plurality of significance points based on the structural segmentation of the cardiac tissue; providing, by the evaluation engine, the anatomical structure classification having each of the plurality of significance points to support treatment of the cardiac tissue; Including, method. (2) The method of embodiment 1, wherein the evaluation engine determines right and left global circumferential ablation positions for the left and right pulmonary veins of the cardiac tissue for the plurality of effective points. (3) The method of embodiment 1, wherein the evaluation engine utilizes manual annotation of training data to determine the anatomical structure classification. (4) The method of embodiment 1, wherein the structural segmentation of the cardiac tissue includes at least one of the right posterior, right inferior, right roof, right anterior, left posterior, right inferior, right roof, left ridge, and left anterior of the left and right pulmonary veins. (5) The method of embodiment 1, wherein the structural segmentation of the cardiac tissue includes at least one of the left WACA, right WACA, inlet PVI, roof line, left carina, right carina, posterior line, inferior line, mitral isthmus line, anterior line, anterior line, and cavotricuspid isthmus, superior vena cava isolation.

[0140] (6) The method of embodiment 1, wherein the evaluation engine extracts morphological features from the plurality of valid points according to the structural segmentation. (7) The method of embodiment 6, wherein the algorithmic feature space of the morphological features includes (x_left, y_left, z_left), (x_right, y_right, z_right), (x_norm, y_norm, z_norm), and (x_norm_ring, y_norm_ring, z_norm_ring). (8) The method of embodiment 1, wherein the anatomical structure classification comprises an anatomical structure code based on a set of numbers from 1 to 9. (9) The method of embodiment 1, wherein the evaluation engine determines the anatomical structure classification based on the effective points and a three-dimensional model of the atrium as input. (10) The method of embodiment 9, wherein the evaluation engine determines the anatomical structure classification based on at least one of an intracardiac electrocardiogram, a VTK anatomical structure file, and a surface ECG.

[0141] (11) The method described in embodiment 10, wherein the VTK anatomical structure file provides a 3D shell of the atrium. (12) A system comprising: a memory configured to store processor-executable program instructions for the rating engine; a processor executing the program instructions of the rating engine to cause the device to: receiving a plurality of effective points relative to the patient's cardiac tissue; determining an anatomical structure classification for each of the plurality of significant points based on the structural segmentation of the cardiac tissue; providing the anatomical structure classification having the respective ones of the plurality of significant points to support treatment of the cardiac tissue; a processor configured to Equipped with system. (13) The system of embodiment 12, wherein the evaluation engine determines right and left global circumferential ablation positions for the left and right pulmonary veins of the cardiac tissue for the plurality of effective points. (14) The system of embodiment 12, wherein the evaluation engine utilizes manual annotations of training data to determine the anatomical structure classification. (15) The system of embodiment 12, wherein the structural segmentation of the cardiac tissue includes at least one of the right posterior, right inferior, right roof, right anterior, left posterior, right inferior, right roof, left ridge, and left anterior of the left and right pulmonary veins.

[0142] (16) The system of embodiment 12, wherein the structural segmentation of the cardiac tissue includes at least one of the left WACA, right WACA, inlet PVI, roof line, left carina, right carina, posterior line, inferior line, mitral isthmus line, anterior line, anterior line, cavotricuspid isthmus, and superior vena cava isolation. (17) The system of embodiment 12, wherein the evaluation engine extracts morphological features from the plurality of valid points according to the structural segmentation. (18) The system of embodiment 17, wherein the algorithmic feature space of the morphological features includes (x_left, y_left, z_left), (x_right, y_right, z_right), (x_norm, y_norm, z_norm), and (x_norm_ring, y_norm_ring, z_norm_ring). (19) The system of embodiment 12, wherein the anatomical structure classification includes an anatomical structure code based on a set of numbers from 1 to 9. (20) The system of embodiment 12, wherein the evaluation engine determines the anatomical structure classification based on the effective points and a three-dimensional model of the atrium as input.

Claims

1. 1. A system comprising: a memory configured to store processor-executable program instructions for the rating engine; a processor executing the program instructions of the rating engine to provide the system with: receiving a plurality of effective points relative to the patient's cardiac tissue; determining an anatomical structure classification for each of the plurality of significant points based on the structural segmentation of the cardiac tissue; providing the anatomical structure classification having the respective ones of the plurality of significant points to support treatment of the cardiac tissue; a processor configured to Equipped with system.

2. The system of claim 1 , wherein the evaluation engine determines right and left global circumferential ablation locations for left and right pulmonary veins of the cardiac tissue for the plurality of effective points.

3. The system of claim 1 , wherein the evaluation engine utilizes manual annotations of training data to determine the anatomical structure classification.

4. 2. The system of claim 1, wherein the structural segmentation of the cardiac tissue includes at least one of right posterior, right inferior, right roof, right anterior, left posterior, left inferior, left roof, left ridge, and left anterior of the left and right pulmonary veins.

5. 2. The system of claim 1, wherein the structural segmentation of the cardiac tissue includes at least one of left WACA, right WACA, ostial PVI, roof line, left carina, right carina, posterior line, inferior line, mitral isthmus line, anterior line, cavotricuspid isthmus, and superior vena cava isolation.

6. The system of claim 1 , wherein the evaluation engine extracts morphological features from the plurality of significant points according to the structural segmentation.

7. The system of claim 1 , wherein the anatomical structure classification comprises an anatomical structure code based on a set of numbers from 1 to 9.

8. The system described in claim 1, wherein the evaluation engine determines the anatomical structure classification based on the effective points and a three-dimensional model of the atrium as input.

9. 1. A method comprising: receiving, by a processor-implemented evaluation engine, a plurality of effective points for the patient's cardiac tissue; determining, by the evaluation engine, an anatomical structure classification for each of the plurality of significance points based on the structural segmentation of the cardiac tissue; providing, by the evaluation engine, the anatomical structure classification having each of the plurality of significance points to support treatment of the cardiac tissue; Including, method.

10. 10. The method of claim 9, wherein the evaluation engine determines right and left global circumferential ablation locations for left and right pulmonary veins of the cardiac tissue for the plurality of effective points.

11. The method of claim 9 , wherein the evaluation engine utilizes manual annotations of training data to determine the anatomical structure classification.

12. 10. The method of claim 9, wherein the structural segmentation of the cardiac tissue includes at least one of right posterior, right inferior, right roof, right anterior, left posterior, left inferior, left roof, left ridge, and left anterior of the left and right pulmonary veins.

13. 10. The method of claim 9, wherein the structural segmentation of the cardiac tissue includes at least one of the left WACA, right WACA, ostial PVI, roof line, left carina, right carina, posterior line, inferior line, mitral isthmus line, anterior line, cavotricuspid isthmus, and superior vena cava isolation.

14. The method of claim 9 , wherein the evaluation engine extracts morphological features from the plurality of significant points according to the structural segmentation.

15. The method of claim 9, wherein the anatomical structure classification comprises an anatomical structure code based on a set of numbers from 1 to 9.

16. The method described in claim 9, wherein the evaluation engine determines the anatomical structure classification based on the effective points and a three-dimensional model of the atrium as input.

17. The method described in claim 16, wherein the evaluation engine determines the anatomical structure classification based on at least one of an intracardiac electrocardiogram, a VTK anatomical structure file, and a surface ECG.

18. 18. The method of claim 17, wherein the VTK anatomical structure file provides a 3D shell of the atrium.

Images