Method for characterizing cardiac lesions and associated system
Patent Information
- Application Number
- EP2024702501
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-01-25
- Filing Date
- 2024-01-25
- Publication Date
- 2025-12-03
AI Technical Summary
Current methods for characterizing heart injuries, particularly subendocardial scars, using late gadolinium enhancement MRI struggle with low contrast between myocardial lesions and blood, leading to inaccurate and time-consuming manual segmentation by radiologists.
A method combining black blood and white blood MRI images, utilizing a convolutional neural network for automated segmentation and characterization of myocardial lesions, including lesion size and transmurality calculations, to enhance precision and reproducibility.
This approach enables precise, automated, and reproducible characterization of cardiac lesions, reducing the time and variability associated with manual segmentation while improving diagnostic accuracy.
Smart Images

Figure EP2024051797_02082024_PF_FP
Abstract
Description
[0001] Description
[0002] Title: METHOD FOR LESION CHARACTERIZATION OF THE HEART AND ASSOCIATED SYSTEM
[0003] Field of invention
[0004] The invention relates to the field of cardiac magnetic resonance imaging (MRI) by late gadolinium enhancement or LGE, with reference to the English expression “Late Gadolinium Enhancement”.
[0005] The field of application of the invention relates more particularly to methods and systems for lesion characterization of the heart. This characterization makes it possible, in particular, to guide ablations.
[0006] The gold standard technique for characterizing regional lesions including myocardial fibrosis is bright-blood late gadolinium enhancement (BR-LGE) imaging using inversion recovery such as the PSIR (phase-sensitive inversion-recovery) sequence. In this type of imaging, the viable myocardial signal is canceled using inversion-recovery pulses, allowing lesions to be visualized with high contrast between healthy myocardial tissue and lesions. However, for myocardial lesions adjacent to the blood chambers of the heart (right and left ventricles), the high intensity of the signal from the blood and therefore the low contrast between the lesions and the blood prevents automatic, accurate, reliable, and robust characterization of scars, particularly subendocardial scars.
[0007] To circumvent this problem, dark blood LGE (BL-LGE) imaging techniques have been proposed. They allow simultaneous cancellation of signals from healthy myocardium and blood, thus providing high contrast both between lesions and between blood and between lesions and healthy myocardium.
[0008] However, dark blood imaging techniques do not allow for correct characterization of lesions, in particular to locate them precisely in relation to the myocardium, as the contrast between the blood and the healthy myocardium is not high enough.
[0009] Given the above-mentioned drawbacks, scar characterization is currently performed by radiologists by manually segmenting lesions from images from PSIR sequences, which then allows their transmurality and size to be calculated. However, this process is time-consuming since 25 to 30 minutes are required for the radiologist to perform such a segmentation. Furthermore, such segmentation is imprecise and not reproducible. Indeed, the low contrast between the lesion and the blood often leads the radiologist to imagine the subendocardial wall, which leads to an overestimation or underestimation of the scar characteristics.
[0010] One aim of the invention is to limit at least one of the aforementioned drawbacks.
[0011] To this end, the subject of the invention is a method for lesion characterization of the heart using images of an area to be imaged comprising the heart of a patient, the heart comprising a myocardium delimiting a cavity of the heart, the images comprising:
[0012] - a dark blood image generated from signals acquired during a dark blood magnetic resonance acquisition by late gadolinium enhancement,
[0013] - a white blood image generated from signals acquired during a late gadolinium enhancement white blood magnetic resonance acquisition, the white blood magnetic resonance acquisition being distinct from an inversion recovery sequence, the method comprising:
[0014] - computer segmentation of the white blood image so as to generate positioning data for a set of at least one wall delimiting the myocardium,
[0015] - lesion characterization of the heart, by computer, from the black blood image and positioning data, of at least one wall of the set of at least one wall, taken from the positioning data of a set of at least one wall delimiting the myocardium.
[0016] Advantageously, the segmentation uses a learning function to segment the white blood image so as to obtain the positioning data. Advantageously, the learning function is a convolutional neural network.
[0017] Advantageously, the learning function is trained from a set of training images of the area to be imaged generated from signals acquired during respective acquisition steps by white blood magnetic resonance by late gadolinium enhancement distinct from inversion recovery sequences.
[0018] Advantageously, the assembly of at least one wall comprises a first wall delimiting and surrounding the myocardium.
[0019] Advantageously, the characterization includes lesion segmentation to locate a myocardial lesion on the dark blood image using data from first wall positioning data.
[0020] Advantageously, the lesion segmentation comprises the selection of pixels of the black blood image having an intensity greater than a predetermined threshold, the pixels being taken only from among the pixels of the black blood image surrounded by the first wall.
[0021] Advantageously, the assembly of at least one wall comprises a second wall delimiting the myocardium and surrounded by the first wall.
[0022] Advantageously, the characterization comprises the calculation of data representative of a lesion size from data originating from the positioning data of the first wall and possibly of a second wall surrounded by the first wall.
[0023] Advantageously, the characterization includes the calculation of data representative of a percentage of transmurality of the lesion from data derived from the positioning data of the first wall and the second wall.
[0024] Advantageously, the method comprises the display, on a screen, of a representation of data calculated during the characterization step.
[0025] Advantageously, the method comprises:
[0026] - acquisition by magnetic resonance in black blood by late gadolinium enhancement,
[0027] - generation of the black blood image from the signals acquired during acquisition by magnetic resonance in black blood by late gadolinium enhancement, called white blood acquisition. - acquisition by magnetic resonance in white blood by late gadolinium enhancement,
[0028] - generation of the white blood image from the signals acquired during the acquisition by magnetic resonance in black blood by late gadolinium enhancement, called black blood acquisition.
[0029] Advantageously, the black blood acquisition and the white blood acquisition belong to an acquisition sequence comprising an elementary acquisition sequence each comprising a white blood acquisition and a black blood acquisition.
[0030] Advantageously, in each elementary acquisition sequence, the black blood acquisition and the white blood acquisition are implemented during a pair of interbeats consisting of two consecutive interbeats.
[0031] Advantageously, the elementary acquisition sequences are implemented during consecutive respective interbeat pairs.
[0032] Advantageously, the method comprises lesion segmentation and characterization from black blood and white blood images generated from white blood images and black blood images generated from signals acquired during elementary sequences of the acquisition sequence.
[0033] Advantageously, the method comprises the acquisition sequence.
[0034] Advantageously, the method comprises generating the black blood image and the white blood image.
[0035] Advantageously, the black blood image and the white blood image are two-dimensional.
[0036] The invention also relates to a system comprising the hardware and software elements for implementing the method according to the invention.
[0037] The system advantageously comprises a processing unit configured to implement the segmentation step and the lesion characterization step.
[0038] Advantageously, the processing unit is a processing unit.
[0039] Advantageously, the system comprises a set of measuring equipment comprising a magnetic resonance imaging device capable of implementing acquisition by magnetic resonance in black blood and acquisition by magnetic resonance in white blood. Advantageously, the processing unit is configured to generate commands intended for the MRI device so that it implements acquisition by magnetic resonance in black blood and acquisition by magnetic resonance in white blood.
[0040] Alternatively and / or additionally, the processing unit is configured to generate the white blood and black blood images from the signals acquired during the respective acquisitions.
[0041] Advantageously, the system comprises an electrocardiograph configured to acquire an electrocardiogram of the patient during the respective acquisitions.
[0042] The invention also relates to a computer program product comprising instructions which cause the system according to the invention to execute the steps of the method according to the invention.
[0043] The invention also relates to a computer-readable medium, on which the computer program according to the invention is recorded.
[0044] Brief description of the figures
[0045] Other characteristics and advantages of the invention will emerge on reading the detailed description which follows, with reference to the appended figures, which illustrate:
[0046] [Fig. 1]: an example of an embodiment of a system according to the invention,
[0047] [Fig. 2]: a schematic representation of an elementary signal acquisition sequence for generating black blood images and white blood images used in the method according to the invention,
[0048] [Fig. 3]: a schematic representation of an MRI acquisition phase in black blood and white blood carried out over a plurality of heartbeats, [Fig. 4]: a schematic representation of a heart in three dimensions (3D) illustrating different section planes distributed along the major axis of the heart and images generated from signals acquired in one of the section planes, [Fig. 5]: a flowchart of an example of a method according to the invention,
[0049] [Fig. 6]: a schematic representation of four images comprising at the top left a white blood image and at the top right a white blood image on which are represented the walls detected during the segmentation step, and at the bottom left a black blood image and the representation of the walls transferred to the black blood image,
[0050] [Fig. 7]: at the top, the bottom left image of figure 6 on which sectors have been represented, at the bottom left a bull's-eye type representation of the lesion size and at the bottom right a bull's-eye type representation of a lesion percentage of transmurality.
[0051] Description of invention
[0052] The invention relates to the field of cardiac imaging by magnetic resonance or MRI, late gadolinium enhancement in black blood and white blood.
[0053] The invention relates to a method for characterizing cardiac lesions, and more precisely of at least one cardiac muscle, for example the myocardium.
[0054] Cardiac injury means damage to a muscle of the myocardium.
[0055] Cardiac injuries can be divided into acute injuries resulting from acute myocardial injury, such as acute myocardial infarction, and chronic injuries characteristic of chronic cardiac pathologies. These injuries are cardiac injuries, for example, of the myocardium or papillary muscles. These injuries include myocardial fibrosis, which frequently develops in the context of hypertrophic or dilated cardiomyopathies, but which also represent a frequent sequela of inflammatory heart disease or myocardial infarction.
[0056] The lesions also include myocardial necrosis, i.e. the volumes of myocytes whose cell membrane has been destroyed and the volumes of extracellular and collagen matrices constituting the fibrous scars, in the chronic phase of the infarction.
[0057] Imaging system
[0058] Figure 1 schematically represents an exemplary embodiment of a system S according to the invention. The system comprises the hardware and software means for implementing the method according to the invention. Advantageously, this system S comprises a set of measuring equipment A comprising a magnetic resonance imaging (MRI) device B as well as an electrocardiograph referenced ECR in Figure 1.
[0059] The system S also comprises a processing device C comprising a processing unit TC and a human-machine interface INT. This processing device may be part of the imaging device B or be external to this device, the system is then a device. Alternatively, the system has a distributed architecture.
[0060] In a manner known per se, the MRI imaging device B comprises a static magnetic field generator GEN_B, a gradient generator GEN_GRAD and a radiofrequency (RF) device D_RF.
[0061] The static magnetic field generator GEN_B comprises a main polarization magnet intended to generate, along a longitudinal axis z, a static magnetic field of substantially uniform polarization in a polarization zone (generally a tunnel) intended to comprise the area of the patient to be imaged, this area to be imaged comprising the heart.
[0062] The patient is a mammal. The mammal is, but is not limited to, a human.
[0063] The gradient generator GEN_GRAD comprises three gradient coils (or solenoids) arranged and configured to vary the intensity of the magnetic field in the polarization zone along the respective orthogonal axes x, y and z fixed with respect to the polarization zone. The choice of the intensities circulating in these coils makes it possible to select, from several possible ones, a slice, having a given thickness and a cutting plane on which the slice is centered, in which the magnetization of the area to be imaged of the patient received in the polarization zone will be measured.
[0064] The radiofrequency device D_RF comprises coils or solenoids and is capable of generating MRI acquisition sequences comprising preparatory sequences for the magnetization of the area to be imaged and sequences for reading RF signals from the area to be imaged.
[0065] Each of the preparatory and reading sequences comprises at least one radiofrequency pulse of predetermined and adjustable frequency, shape, duration, phase, amplitude. The preparatory sequence is configured to excite, i.e. to modify the direction of magnetization of the tissues in the area to be imaged.
[0066] The reading sequence is configured to measure the magnetization of the area to be imaged resulting from the preparatory module.
[0067] The ECR electrocardiograph is intended to acquire an electrocardiogram of the patient
[0068] The processing unit TC is configured to generate commands to the MRI device B, in particular to the RF device D_RF and the gradient generator GEN_GRAD, so that the MRI device generates the predefined acquisition sequences of signals from predefined volumes or sections of the area to be imaged.
[0069] The TC processing unit is also configured to generate images of the area to be imaged from the measured signals, from reconstruction techniques known to those skilled in the art, and to process these images as we will see in more detail in the remainder of the description.
[0070] Acquisition sequence
[0071] Figure 2 represents an example of an elementary acquisition sequence SE1 of an MRI acquisition sequence of RF signals allowing the generation of images of the heart as well as an electrocardiogram (ECG) E measured by the electrocardiograph ECR during the elementary sequence SE1.
[0072] The acquisition sequence comprises a series of elementary acquisition sequences SE1 such as that shown in Figure 2.
[0073] The lower part of figure 2 represents the variation of the longitudinal magnetization Mz of the tissues of the area to be imaged as a function of time t during this elementary sequence SE1.
[0074] The elementary acquisition sequence SE1 includes a so-called black blood acquisition ACQ1 followed by a so-called white blood acquisition ACQ2 which will be described later. The black blood acquisition ACQ1 makes it possible to acquire the signals of the area to be imaged, making it possible to generate an elementary black blood image IM1 of the area to be imaged. The white blood acquisition ACQ2 makes it possible to acquire the signals of the area to be imaged, making it possible to generate an elementary white blood image IM2 of the area to be imaged. These acquisition steps ACQ1, ACQ2 each include a preparatory module PREP1, PREP2 and a reading module LE1, LE2.
[0075] In the present patent application, by module is meant a step comprising a radiofrequency pulse or a series of radiofrequency pulses.
[0076] It should be noted that throughout the duration of the elementary acquisition sequence SE1 and preferably throughout the duration of the MRI acquisition sequence, the static magnetic field generator GEN_B is controlled by the processing unit TC so that it generates a fixed static magnetic field along the z axis.
[0077] The gradient generator GEN_GRAD is controlled for the processing unit TC so that the radiofrequency device D_RF acquires signals coming from a predefined slice having a predefined thickness during the elementary acquisition sequence SE1.
[0078] The acquisition sequence is a late gadolinium enhancement acquisition sequence implemented following the injection of a Gadolinium-based contrast agent intravenously into the patient, 10 to 15 minutes before the implementation of the acquisition sequences in order to obtain images with maximum contrast between the lesions and healthy tissues and blood. In the heart, the contrast is rapidly eliminated from the healthy myocardium, poor in interstitial tissue, but accumulates for a prolonged period in the myocardial lesions. Gadolinium has an extracellular distribution, that is to say it does not cross the membranes of the cardiomyocytes.
[0079] Gadolinium has the effect of shortening the T1 relaxation time of the tissues where it accumulates. The relaxation of the magnetization of lesions following a magnetization reversal pulse is thus faster than that of healthy blood and myocardium.
[0080] Black blood acquisition
[0081] First, we seek to generate elementary images in black blood IM1. In an image of this type, the intensity of the pixels corresponding to blood and healthy muscle is zero (black pixels) or substantially zero. In order to generate such an elementary image in black blood IM1, the RF device D_RF implements an acquisition step in black blood ACQ1 in inversion-recovery. This black blood acquisition step ACQ1 includes a longitudinal inversion pulse noted 180° in Figure 2, which switches the longitudinal magnetization of the tissues of the imaged area in the opposite direction, that is to say which reverses the longitudinal magnetization of these tissues. In Figure 2, we see that the magnetization of the area to be imaged changes from Mz to -Mz under the effect of the inversion pulse. Due to longitudinal relaxation, the longitudinal magnetization of the different tissues present in the area to be imaged increases to return to its initial value, passing through the zero value.Naturally, the relaxation kinetics of different tissues are different.
[0082] As is known per se, the ACQ1 black blood acquisition also includes a PREP1 preparatory module implemented after the 180° longitudinal inversion pulse, for example, an adiabatic T1-rho (Tip) module of duration noted TSL (acronym for the Anglo-Saxon expression "Time of Spin Lock") or a T2-weighted module, or of the MTC type (acronym for the Anglo-Saxon expression "Magnetization Transfer Contrast") or a combination of two of these modules or of these three modules.
[0083] The preparatory module PREP1 is configured so that the longitudinal magnetization of blood A(Blood) and that of healthy myocardium A(Musc) cancel each other out at the same instant te.
[0084] At this same instant te, the longitudinal magnetization of the A(Cica) lesions is clearly greater than zero. By acquiring the signals from the area to be imaged at this instant te, we obtain an image with a very high contrast between the pixels or voxels corresponding to the blood and healthy myocardium, which are black, and the pixels or voxels corresponding to the lesions, which are generally white.
[0085] The first acquisition step ACQ1 in inversion-recovery then comprises a reading sequence LE1 comprising a 90° pulse applied at time te and a reading gradient to read the transverse magnetization of the area to be imaged. The inversion time Tl is the duration separating the 180° pulse of the reading sequence LE1 from the elementary sequence ACQ1. In order to obtain the best contrast between the myocardial lesions and the blood as well as between the myocardial lesions and the healthy myocardium, the reading sequence LE1 is advantageously started at time te where the longitudinal magnetizations of the blood and the myocardium cancel each other out in order to generate the image with the best contrast.
[0086] In the example of Figure 2, the LE1 reading module of the black blood acquisition is temporally spaced from the PREP1 preparatory module of the black blood acquisition. Alternatively, the LE1 reading module begins as soon as the PREP1 preparatory module ends. The same applies to the relative temporal positioning between the PREP2 preparatory module of the white blood acquisition and the LE2 reading module of the white blood acquisition.
[0087] In the example of Figure 2, the inversion pulse IMP1 is generated before the preparatory module PREP1. Alternatively, the preparatory module PREP1 is generated before the inversion pulse IMP1.
[0088] White blood acquisition
[0089] The elementary white blood image IM2 of the area to be imaged is generated from signals acquired by implementing the white blood acquisition step ACQ2 comprising a preparatory module PREP2 followed by a reading module LE2.
[0090] Advantageously, the preparatory module PREP2 is identical to the preparatory module PREP1 of the black blood acquisition step ACQ1, but the invention also applies when these modules are distinct.
[0091] The PREP2 preparatory module is, for example, an adiabatic sequence in T1 rho.
[0092] Alternatively, the PREP2 module includes at least one preparatory sequence taken from a T2-weighted module and an MTC-type preparatory module (acronym for the Anglo-Saxon expression “Magnetization Transfer Contrast”) or a combination of two of these modules or of these three modules.
[0093] The white blood acquisition step ACQ2 then includes a reading module LE2 comprising a reading gradient to read the transverse magnetization of the area to be imaged. This reading module LE2 can be carried out in gradient echo or spin echo, just like the reading module LE1 of the black blood acquisition step LE1. The reading modules LE1 and LE2 can be identical or different. The duration D2 separating the reading module LE2 is defined so that the longitudinal magnetization of the blood A(Blood) is greater than that of the Myocardium A(MUSC) which leads to generating an image in which the pixels or voxels of the blood are white, that is to say with a high luminance, and in which the pixels of the myocardial tissues are a little less luminous than those of the blood as can be deduced from the curves represented in figure 2.These images allow for perfect visualization of the cardiac anatomy, allowing the myocardium to be delineated on this image, which is not possible on a dark blood image.
[0094] We understand that by using the two images IM1 and IM2 it is possible to detect this lesion and also to characterize it, for example to locate it precisely in relation to the myocardium and to size it in relation to the myocardium.
[0095] Synchronization of acquisition steps with cardiac cycles
[0096] Preferably, the processing unit TC is configured to synchronize the acquisition sequence SE with the electrocardiogram E.
[0097] For this purpose, the TC processing unit uses the electrocardiogram E to generate commands to trigger the acquisition sequences for the RF device, the gradient generator and possibly the main magnetic field generator.
[0098] Advantageously, the acquisition sequence SE comprises, as visible in figure 3, a plurality of elementary acquisition sequences SEi, with i = 1 to N, where N is greater than 1 where i is the index of the elementary sequence, the acquisition steps ACQ1, ACQ2 of which are identical. i= 1 in figure 2.
[0099] Each elementary acquisition sequence SEi is advantageously implemented during two consecutive cardiac cycles, preferably during two consecutive interbeats C1, C2 referenced in Figure 2 constituting a pair of interbeats CBi referenced in Figure 1. An interest is to minimize the acquisition time and therefore to minimize the movements of the heart between the different acquisitions and the spatial shifts between the images IM1 and IM2. In the rest of the text, we call beat, a QRS complex, and an interbeat, a phase of a cardiac cycle located between two consecutive beats.
[0100] Advantageously, the consecutive elementary acquisition sequences SEi are implemented during consecutive CBi interbeat pairs.
[0101] Each SEi elementary acquisition sequence includes:
[0102] - During the first C1 interbeat of the CBi interbeat pair, the black blood acquisition step ACQ1;
[0103] - During the second C2 interbeat of the CBi interbeat pair, the white blood acquisition step ACQ2.
[0104] One interest is to minimize the acquisition time and therefore to minimize the movements of the heart between the different acquisitions and the spatial shifts between the IM 1 and IM2 images acquired during the different SEi elementary sequences.
[0105] Advantageously, as shown in Figure 2, the acquisition sequence SE and the electrocardiogram E are synchronized so that the reading modules LE1, LE2 are implemented during the same phase of respective cardiac cycles C1, C2.
[0106] Advantageously, this phase is an interbeat.
[0107] Advantageously, this phase is diastole.
[0108] Advantageously, the acquisition sequence SE and the electrocardiogram E are synchronized so that the reading modules LE1, LE2 of the black blood and white blood acquisition steps ACQ1, ACQ2 are implemented at the same times of these respective cardiac cycles C1, C2.
[0109] These instants are defined in relation to the same time reference of the cardiac cycles C1, C2. The time reference is, for example; the maximum of the QRS complex.
[0110] These instants are separated by the same duration D2' from the maximum of the R wave in the example of figure 2.
[0111] The synchronization of the LE1, LE2 reading modules of the black blood and white blood acquisition sequences ACQ1, ACQ2 and, as we will see later, of different reading modules of white blood acquisition steps on the one hand and of the different reading modules of black blood acquisition steps on the other hand, makes it possible to generate images of the heart at times when the heart occupies the same position in a fixed reference frame relative to the main magnet, which makes it possible to superimpose the images obtained without any registration being necessary or by carrying out a simple registration.
[0112] The invention also applies when the order of the acquisition steps is different. For example, it is possible to implement several black blood acquisition steps ACQ1 during consecutive interbeats and then several white blood acquisition steps ACQ2 during consecutive interbeats and vice versa.
[0113] It is also possible to implement at least one ACQ1 black blood acquisition step and at least one ACQ2 white blood acquisition step during the same interbeat.
[0114] Alternatively, at least one ACQ2 white blood acquisition step is spaced from a temporally closest ACQ1 black blood acquisition step.
[0115] Acquisition of cuts
[0116] Advantageously, the TC processing unit is configured to generate commands to the MRI device to acquire signals from respective slices distributed along a predefined axis of the heart.
[0117] The axis is advantageously the major axis of the heart. The sections obtained are then so-called minor axis sections. One advantage is that it allows excellent visualization of the two ventricles. However, the invention also applies to the case where the sections are distributed along another axis of the heart, for example an axis in 2 cavities (long vertical axis) or 4 cavities (long horizontal axis) of the heart. Each section has a thickness defined along the axis and is centered on a predefined cutting plane perpendicular to the axis. By section, is meant in the present application, a slice or layer perpendicular to the axis g and having a predefined thickness along the axis.
[0118] Advantageously, the cuts are contiguous along the axis.
[0119] This is achieved by the commands generated by the choice of commands generated to the gradient generator GEN_GRAD by synchronizing the commands to the gradient generator GEN_GRAD and to the RF device D_RF.
[0120] Advantageously, signals are acquired from adjacent or partially overlapping slices. This allows the heart to be imaged completely.
[0121] Advantageously, the gradient generator GEN_GRAD is controlled so that several two-dimensional images of each slice can be generated from the signals acquired during the SE acquisition sequence.
[0122] Figure 4 represents a three-dimensional (3D) view of a heart comprising a plurality of section planes noted PCk distributed along the major axis g, with k = 1 to K, K being an integer greater than 1. The section planes are distributed from the apex AP to the base BA of the heart CO. Consequently, the sections are so-called “minor axis sections”.
[0123] Only the images from the section centered on the cutting plane PCk are shown in Figure 4.
[0124] Preferably, several elementary images in black blood IM1 k(j) and / or several elementary images in white blood IM2k(j) are generated with j = 1 to J, J being an integer greater than or equal to 2 for at least one cutting plane PCk, for example for each cutting plane PCk. This makes the analysis of the images obtained more robust.
[0125] Alternatively, the system is configured to acquire signals from a volume, for example from the entire heart so as to enable the generation of three-dimensional images.
[0126] Advantageously, the SE acquisition sequence is implemented while the patient is holding his breath. One advantage is that it produces perfectly registered images, which makes it possible to limit, simplify, or eliminate the need for image registration.
[0127] Alternatively, the SE acquisition sequence is implemented in free breathing. Free breathing acquisition has temporal advantages. Indeed, breath-hold acquisition must be rapid, which leads to the need to reduce the acquisition time from a few seconds to a few minutes and often involves having to reduce the area to be imaged, for example by limiting it to a 3D portion. However, since the SE acquisition sequence is synchronized with the ECG so that the reading sequences are implemented at the same time marker of different cardiac cycles, breath-hold acquisition leads to generating a limited number of images.
[0128] Image generation
[0129] The processing unit TC is configured to generate GEN, using reconstruction techniques known to those skilled in the art, images of the area to be imaged.
[0130] For example, we can use the GRAPPA algorithm or the SENSE algorithm (and its iterative version).
[0131] The generation step includes a step of generating two-dimensional (2D) or three-dimensional (3D) elementary images of the area to be imaged from the signals acquired during the SE acquisition sequence.
[0132] In the 2D case, for each black blood acquisition step ACQ1, a black blood image IM1 is advantageously generated from the signals acquired during the black blood acquisition step ACQ1 and, for each white blood acquisition step ACQ2, a white blood image IM2 from the signals acquired during the white blood acquisition step ACQ2.
[0133] The elementary images IM1, IM2 are advantageously generated in gray level. Each image comprises a set of unitary elements of pixel or voxel type, each characterized by an intensity I capable of taking a set of N values (N being a finite integer greater than 1) corresponding to N gray levels ranging from 0 to N-1. For example, this value can take 256 values between 0 and 255, but N is not limited to 256. This value can advantageously take 4096 values between 0 and 4095.
[0134] The TC processing unit is also configured to use the elementary images obtained to characterize lesions of the heart, for example of the myocardium as we will see in more detail later in the text.
[0135] The elementary images generated by the TC processing unit can be intended to be displayed on a screen of the human-machine interface INT.
[0136] Registration Advantageously, the method does not require an image registration step.
[0137] Alternatively, the GEN image generation step comprises the registration of elementary black blood images with each other and / or the registration of elementary white blood images with each other and / or the registration of elementary black blood and white blood images with each other. This makes it possible, in particular when the patient is breathing freely during the SE acquisition sequence, to limit the effects of breathing on the position of the heart and therefore to avoid spatial shifts induced by breathing on the images and likely to affect the precision and reliability of the analyses of these images or of the combination of these images. Indeed, the rhythm of breathing is a priori different from the heart rate, but even if correlations exist between these two rhythms, it is possible for breathing to accelerate while the heartbeat remains stable or vice versa.
[0138] Advantageously, the method comprises the registration of elementary black blood images of the same section.
[0139] Advantageously, the registration is carried out using a non-rigid image registration algorithm.
[0140] Advantageously, the method comprises the registration of elementary white blood images from the same section.
[0141] Advantageously, the registration is carried out using a non-rigid image registration algorithm.
[0142] Advantageously, the method comprises the registration of elementary images in black blood IM1 and in white blood IM2 with each other.
[0143] Advantageously, the method comprises the registration of elementary white blood images and elementary black blood images of the same section.
[0144] Advantageously, this registration is carried out using a non-rigid image registration algorithm.
[0145] Advantageously, these algorithms are identical. It is possible to choose a different algorithm for processing elementary images in black blood and white blood, but it is preferable to choose the same algorithm for ease of implementation. Registration significantly improves the quality, particularly the contrast, of an image resulting from a plurality of elementary images of the same section. Furthermore, it helps reduce artifacts related to breathing.
[0146] According to a first example, at least one of the non-rigid algorithms is an algorithm based on the method of mutual information between images based on statistical relations. The function to be optimized can be implemented by a statistical similarity criterion. An advantage of this method is that the matching between homologous attributes of images of the same section is independent of their geometric position. Furthermore, this method is particularly effective for registering elementary images presenting different contrasts, such as images of black blood and white blood.
[0147] According to a second example compatible with the first example, at least one of the non-rigid algorithms is based on a transformation model is implemented. The transformation model makes it possible to determine functions making it possible to minimize the difference between two images. The difference can be translated by a geometric error to be minimized. Different approaches can be used such as those based on the extraction from each of the images of geometric primitives or shape descriptors such as salient points, shape singularities or contours. A parametric or non-parametric approach can be used.
[0148] As an example of optimizing a transformation model or a similarity criterion, the least squares method can be used.
[0149] Other optimization methods can be implemented such as gradient descent. However, this latter method applies more particularly to image intensities and is not optimal in the context of the invention since the aim is to optimize the sharpness and contrast of the merged image. Nevertheless, the invention includes this embodiment.
[0150] Registration can be performed by choosing a reference image and determining a transformation function for the other images of the same slice relative to this image. Each image is then registered by optimizing a transformation to obtain the reference image according to a geometric criterion from the image considered. When acquiring three-dimensional images, it is possible to acquire several three-dimensional images of the heart, which can be registered if necessary.
[0151] Combination of images
[0152] When a plurality of elementary images of the same section are generated, it is possible to carry out operations aimed at combining, that is to say merging these images in order to produce a single combined image per section.
[0153] Advantageously, the step of generating the images GEN comprises, for at least one section of index k, for example for each section, the combination of white blood images of the section IM2k(j), for example for j = 1 to J so as to obtain a combined image ISBk in white blood of the section.
[0154] Advantageously, the method comprises, for at least one section, for example for each section, the combination of black blood images IM1k(j), for example for j = 1 to J of the section of index k so as to obtain a combined black blood image ISNk of the section.
[0155] This helps reduce noise and increase the signal-to-noise ratio.
[0156] Image combination can be done before, during or after GEN generation of images.
[0157] In one example, the combination is averaging. Averaging is, for example, performed in image space or in Fourier space (i.e., the frequency domain, before image reconstruction). These solutions are computationally inexpensive and fast.
[0158] Averaging has the advantage of preserving image detail, as it increases the signal-to-noise ratio (SNR). This technique smooths out noise to reduce residual image artifacts. In addition, averaging improves the bit depth of the digital image beyond what is possible with a single image.
[0159] One advantage of the averaging step of images taken from the same slice is to reduce the maximum deviation. The noise amplitude decreases as the square root of the number of images used, i.e. with only 4 images, the noise amplitude can be reduced by a factor of two. Using an example of a 2-minute free-breathing acquisition, it is possible to collect 4 to 5 images per slice plane, which provides good noise reduction performance.
[0160] In an exemplary embodiment, the combination of images may alternatively be implemented by motion-compensated iterative reconstruction. In other words, this type of combination is implemented during the reconstruction of the images. Compensated MRI reconstruction techniques are notably described in the following articles: Odille F, et al., “Generalized reconstruction by inversion of coupled systems (GRICS) applied to free-breathing MRI” Magnetic Resonance in Medicine, 2008; and “3D whole-heart isotropic sub-millimeter resolution coronary magnetic resonance angiography with non-rigid motion-compensated PROST”, Bustin A, et al, Journal of Cardiovascular Magnetic Resonance, 2020.
[0161] Advantageously, the elementary images of one part black blood and the other part white blood are respectively combined so as to produce a combined black blood image ISNk and a combined white blood image ISBk per section.
[0162] When acquiring three-dimensional images, it is possible to acquire several three-dimensional images of the heart, which can be combined, for example averaged, to obtain a single three-dimensional image of the heart.
[0163] Characterization of lesions
[0164] As seen previously, during the SE acquisition sequence, signals are acquired for the generation of elementary black blood images IM1 and elementary white blood images IM2 and these elementary images IM1, IM2 are generated from the acquired signals.
[0165] According to the invention, these elementary images IM1, IM2 are generated from signals acquired by implementing an acquisition sequence. This acquisition sequence comprises ACQ2 white blood acquisition steps. Each ACQ2 white blood acquisition step is distinct from an inversion-recovery sequence.
[0166] In other words, this sequence is devoid of a pulse of inversion of the longitudinal magnetization of the area to be imaged. Therefore, unlike PSIR imaging during white blood acquisition, the longitudinal magnetization of the myocardium is not canceled, which makes it possible to obtain images with a stronger contrast between the lesions and the blood and therefore to promote diagnosis and image processing.
[0167] Advantageously, the white blood acquisition is configured so that when the LE2 reading module is implemented, the respective longitudinal magnetizations of the healthy myocardium, the blood and the lesions are positive and the longitudinal magnetization of the lesions is between the magnetization of the healthy myocardium and that of the blood. This is achieved by the configuration of the PREP2 preparatory module and that of the LE2 reading module and by the relative temporal positioning between these two modules.
[0168] As visible in Figure 5, the lesion characterization process includes the following steps:
[0169] - SEG segmentation, by computer, of at least one ISB white blood image so as to generate positioning data of a first L1 wall delimiting the myocardium,
[0170] - the CAR lesion characterization, by computer, of a cardiac lesion using at least one ISN black blood image and positioning data of the first L1 wall taken from the data calculated during the SEG segmentation step.
[0171] These steps are implemented by the TC processing unit which uses for this purpose white blood ISBk and black blood ISNk images generated by the method previously described.
[0172] Each white blood image ISB, respectively black blood ISN is an elementary image IM1 k(j), IM2kO) or a combined image in white blood ISBk, respectively in black blood ISNk.
[0173] In the rest of the text, we consider, as in the example of figure 5, that each white blood image ISB is a combined white blood image ISBk and that each black blood image ISN is a combined black blood image ISNk.
[0174] The invention makes it possible to characterize, in an automatic, reproducible, reliable and precise manner, a cardiac lesion, and more precisely cardiac muscles, in particular myocardial lesions. Indeed, the segmentation of ISBk white blood images generated from signals measured during the ACQ2 white blood acquisition steps distinct from inversion-recovery sequences makes it possible to position the walls delimiting the myocardium in an automatic, robust, reliable and precise manner, because these images present a significant contrast between the myocardium and the blood. ISNk black blood images do not allow obtaining such good results due to the absence of contrast between the healthy myocardium and the blood.Lesion characterization, which uses, in addition to the positioning data from segmentation, an ISNk dark blood image, allows good results to be obtained that could not be obtained on its own with the ISBk white blood image containing little or no information on cardiac lesions.
[0175] Segmentation
[0176] According to one example, the SEG segmentation is implemented using at least one white blood image ISBk so as to generate positioning data of a first wall L1 and a second wall L2 delimiting the myocardium M and surrounding and delimiting a chamber of the heart, the first wall L1 surrounding the second wall L2.
[0177] The positioning data relating to a wall corresponds, for example, to the identification of the pixels constituting the wall.
[0178] The result of this segmentation is visible in figure 6 schematically representing at the top left a white blood image of a section of the ISBk heart and at the top right the white blood image of the section on which the first wall L1 and the second wall L2 obtained during the segmentation step are represented in thick black lines.
[0179] The generated images are, for example, in grayscale. The white areas in Figure 6 represent areas that are lighter than the dotted areas, which represent areas that are lighter than the grid areas, which represent areas that are lighter than the bricks.
[0180] In the example of Figure 6, the heart cavity is the left ventricle and the SEG segmentation is implemented so as to delimit the L1, L2 walls of the part of the myocardium surrounding and delimiting the left ventricle.
[0181] It is noted that in the present description the invention is described in the case where the cavity of the heart is the left ventricle, but the invention is applicable to any cavity of the heart, such as the right ventricle and the atria which are also surrounded and delimited by the myocardium and subject to cardiac lesions.
[0182] The second wall L2 is the wall delimiting the myocardium and the left ventricle LV. The first wall L1 surrounding the second wall L2 is the external wall, i.e. facing the outside of the left ventricle LV, of the part of the myocardium surrounding the left ventricle LV. This is the epicardium.
[0183] The second wall L2 is the wall of the myocardium delimiting the left ventricle. This is the endocardium.
[0184] In the images in Figure 6, which are sections of the heart, these L1 and L2 walls form closed curves in that they completely surround the left ventricle LV in short-axis sections.
[0185] It is easy to understand that in 3D these walls form surfaces.
[0186] Alternatively, SEG segmentation is implemented to generate positioning data of only one of these two walls, for example the outer wall of the myocardium.
[0187] Segmentation is performed by implementing a learning function or algorithm, for example an artificial neural network, to segment a white blood image so as to delineate at least one wall of the myocardium surrounding and delimiting a cavity of the heart.
[0188] In a non-limiting example, the learning function is a neural network.
[0189] The artificial neural network used for segmentation is advantageously a convolutional neural network.
[0190] The convolutional neural network is, for example, of the U-Net type or of the transformer type also called self-attentive model, for example, of the type commonly called swin transformer.
[0191] The neural network, or more generally the learning function, is implemented on two-dimensional (2D) images and / or three-dimensional (3D) images. In other words, it is trained to perform the desired segmentation by receiving 2D and / or 3D images as input.
[0192] Advantageously, the learning function is trained, prior to the implementation of the method according to the invention, from white blood images of the heart, generated from signals acquired during respective white blood acquisition steps distinct from inversion recovery sequences, and labeled by specialists, i.e. segmented by specialists, so that the trained learning function receiving input data comprising a white blood image of the heart, is capable of segmenting so as to delimit at least one wall of the myocardium surrounding and delimiting a cavity of the heart.
[0193] The learning function is, for example, configured to deliver, from a white blood input image generated from signals acquired during a white blood acquisition step distinct from an inversion recovery sequence, an output image in which the pixels or voxels corresponding to the walls or contours L1 and L2 are colorized in a predetermined intensity or color or in respective predetermined colors.
[0194] Spread
[0195] The method may comprise a step of propagating the walls detected during the SEG segmentation step, on at least one black blood image. In other words, the method may comprise a REP reporting step, i.e. propagation, comprising, the identification, on an ISNk black blood image, of the pixels or voxels corresponding to the L1 and L2 walls identified during the SEG segmentation.
[0196] In Figure 6, a black blood image ISNk of the heart section is schematically represented at the bottom left and the black blood image at the bottom right on which the L1 and L2 walls detected during the SEG segmentation step are represented in thick black lines.
[0197] The identification, on the black blood image ISNk, of the pixels or voxels corresponding to the first wall L1 and respectively to the second wall L2 is determined from the positions of the pixels or voxels corresponding to these walls on the white blood image ISBk.
[0198] These pixels or voxels may have the same respective positions on the white blood image and on the black blood image when these images are considered to be spatially aligned and because these images have the same size and resolution. A predetermined or calculated spatial shift may alternatively be applied to these pixels or voxels when it is estimated that a spatial shift exists between these images.
[0199] The reporting may include annotation or colorization of pixels or voxels corresponding to the L1 and L2 walls. Advantageously, the characterization includes segmentation for each ISBk white blood image so as to generate respective positioning data obtained from the respective ISBk white blood images.
[0200] Advantageously, the characterization comprises the transfer to each ISNk black blood image of the pixels or voxels corresponding to the L1 and L2 walls identified during the SEG segmentation, from one of the ISBk white blood images. The pixels or voxels transferred to the different black blood images or combined black blood images are advantageously identified from respective white blood images.
[0201] Advantageously, the positioning data used for the transfer to an ISNk black blood image are generated from an ISBk white blood image generated from signals measured during the same elementary acquisition sequence.
[0202] Thus, the positioning data generated from a combined white blood image ISBk of order k is advantageously transferred to a combined black blood image ISNk of order k.
[0203] Lesion characterization step
[0204] The CAR lesion characterization step consists of characterizing the heart from the point of view of lesions using one or more ISNk black blood image(s) and positioning data of at least one wall, for example the second L2 wall, obtained from one or more ISBk white blood images.
[0205] This step advantageously allows the generation of data characterizing the heart from the point of view of lesions.
[0206] This step is implemented by the CT processing unit.
[0207] The CAR characterization step may comprise a DE lesion detection step and / or a CAE lesion characterization step. Advantageously, when a lesion is detected, the CAE lesion characterization step is implemented. In other words, the CAE lesion characterization step may be implemented only on condition that a lesion is detected during the DE detection step.
[0208] Alternatively, the DE detection step is implemented after the CAE lesion characterization step or after one of the steps of this CAE effective lesion characterization step.
[0209] Alternatively, the CAE lesion characterization step is devoid of a DE detection step.
[0210] The detection step will be described later.
[0211] The CAE lesion characterization step advantageously comprises a SC lesion segmentation step of at least one ISNk black blood image so as to generate positioning data of at least one cardiac lesion possibly present in the figure, the SC lesion segmentation using positioning data of the first wall L1 and possibly those of the second wall L2, generated during the SEG segmentation step.
[0212] The CAE lesion characterization step possibly includes the following steps:
[0213] - CTA calculation of CIC lesion size from the positioning data of the first wall L1 and possibly the second wall L2 from the SEG segmentation step, and / or
[0214] - CTT calculation of at least one degree of transmurality TR of the CIC lesion from the first wall L1 and the second wall L2 resulting from the SEG segmentation step.
[0215] These calculations are performed using a set of at least one black blood image.
[0216] Lesion size refers to data representative of the dimensions of the lesion, such as a volume or surface area, for example, or a number of pixels or voxels.
[0217] Lesion segmentation
[0218] SC lesion segmentation uses one or more ISNk black blood image(s) and positioning data of the first wall L1 and possibly those of the second wall L2 from SEG segmentation.
[0219] These positioning data may be positioning data generated during the SEG segmentation step or positioning data from the REP reporting step. Alternatively, the SG lesion segmentation step includes the reporting step.
[0220] This step allows cardiac lesions to be localized, i.e., cardiac lesion location data to be generated.
[0221] These lesion location data include, for example, the identification or positions of pixels or voxels corresponding to lesions.
[0222] The SC lesion segmentation step is advantageously implemented by thresholding.
[0223] It advantageously comprises the identification of pixels or voxels having an intensity greater than or equal to a predetermined intensity threshold only in a predetermined area of at least one black blood image ISNk delimited by the first wall L1 and / or the second wall L2. Indeed, as can be deduced from Figure 2, the lesions have, on the black blood images, a high intensity compared to the healthy myocardium and to the blood.
[0224] This area is determined from the positioning data of the first wall L1 and possibly those of the second wall L2 from the SEG segmentation.
[0225] This is, for example, the area of a black blood image ISNk delimited by the pixels or voxels of the first wall L1 and / or the pixels or voxels of the second wall L2 reported on the black blood image ISNk.
[0226] Advantageously, the area of the black blood image is the area surrounded and delimited by the first wall L1.
[0227] In other words, the lesion segmentation step SC comprises the search for pixels or voxels of intensity greater than or equal to a predetermined intensity threshold only in the area delimited and surrounded by the first wall L1 on one or more black blood image(s) ISNk. In other words, these pixels or voxels are taken only from among the pixels or voxels of an area of the black blood image(s) surrounded and delimited by the first wall L1. This makes it possible to avoid the erroneous detection of lesions beyond the epicardium, by avoiding confusion between lesions and fat surrounding the epicardium and represented, on the black blood images, by high intensity pixels.
[0228] Alternatively, zone Z is the area of the black blood image(s) ISNk delimited by the first wall L1 and by the second wall L2.
[0229] In other words, SC lesion segmentation includes searching for pixels with an intensity greater than or equal to a predetermined intensity threshold only in the area delimited by the two walls L1 and L2 of one or more ISNk black blood images. This variant has the advantage of identifying the pixels or voxels of myocardial lesions only. Indeed, it happens that patients have papillary muscle necrosis (located in the area delimited by the L2 wall). In these patients, the muscles are white on the black blood image, which can lead to errors in lesion characterization when segmenting the lesions in the entire area delimited by L1.
[0230] Alternatively and / or additionally, SC lesion segmentation includes searching for pixels with an intensity greater than or equal to a predetermined intensity threshold only in the area surrounded by the L2 wall. This step makes it possible to identify pixels or voxels of the papillary muscles only.
[0231] Alternatively, the segmentation is implemented using a neural network, for example, a convolutional neural network trained to segment cardiac lesions in an area bounded by the L1 and / or L2 walls when receiving as input the positioning data of the corresponding wall(s) and the black blood image, or using at least one active contour segmentation algorithm, i.e., a segmentation algorithm using an active contour model.
[0232] The DE detection step comprises detecting the absence or presence of lesions using an ISNk black blood image and positioning data of at least one wall, for example, the second wall L2. It outputs an indication of the presence or absence of cardiac lesions.
[0233] The DE detection step can be performed by thresholding or by using a neural network like the segmentation step. This step can consist of determining whether a number of contiguous pixels or voxels greater than a predetermined threshold have an intensity greater than a predetermined threshold in the area delimited by the L1 wall and / or the L2 wall whose positioning is defined during the SEG segmentation step of the myocardium. The presence of cardiac lesions is detected if this condition is verified and the absence of cardiac lesions is detected if this condition is not verified.
[0234] The neural network is, for example, a convolutional neural network. The neural network is, for example, trained to detect the presence or absence of cardiac lesions in an area delimited by the L1 and / or L2 walls when it receives as input the positioning data of the corresponding wall(s) and the black blood image.
[0235] Advantageously, when no lesion is detected, that is to say when the absence of lesion is detected during the DE step.
[0236] If no lesion is detected, the next step is advantageously the GENR generation step.
[0237] In Figure 7, the ISNk black blood image is represented, on which the L1 and L2 limits identified during segmentation and reported, i.e. propagated, on the ISNk black blood image are represented in thick lines, as well as the pixels identified as being pixels of the lesion.
[0238] Calculation of lesion size
[0239] CAR characterization advantageously includes a CTA calculation step of lesion size.
[0240] This CTA calculation step comprises the determination of at least one elementary data representative of the size of at least one cardiac lesion, for example of the myocardium, using location data of the location data of the first and / or second walls L1, L2 which are for example directly the positioning data resulting from the SEG segmentation of the myocardium or data resulting from these data, for example, data resulting from the transfer step or positioning data of the lesion obtained during the SC lesion segmentation step.
[0241] An elementary data representative of a lesion size can be a percentage of a surface of the myocardium occupied by a lesion on a SEC sector of an ISNk black blood image or a volume or a mass of the lesion in this SEC sector starting from the I axis parallel to the p axis and passing substantially through the center of the cardiac cavity on the ISNk black blood image and delimited by two rays R starting from the I axis as visible on the ISNk black blood image.
[0242] The percentage of the myocardial area occupied by the lesion in the SEC sector can be calculated from the ratio between the number of pixels corresponding to the lesion in this SEC sector and the number of pixels corresponding to the myocardium in this SEC sector.
[0243] The number of pixels corresponding to the lesion in this SEC sector can be calculated from the location data obtained during the lesion segmentation step or can be calculated directly, during the CTA calculation step, for example by selecting, by thresholding, the number of pixels having an intensity greater than a predetermined threshold in the portion of the SEC sector delimited by the walls L1 and L2 or by the wall L1. The CTA step can comprise the calculation of data representative of the lesion size in an SEC sector from several elementary data representative of the calculated lesion size, in this SEC sector, for several black blood images ISNk distributed along the axis p.
[0244] For example, we calculate a combination or an average of elementary data.
[0245] The lesion volume on a SEC sector can be calculated from the ratio between the number of pixels corresponding to the lesion on this sector and the number of pixels corresponding to the myocardium on this sector, from the thickness of the section corresponding to an ISNk black blood image, when the image is two-dimensional.
[0246] The size and / or volume are advantageously also calculated from the predetermined resolution of the images.
[0247] It should be noted that the density of the myocardium is 1.06 g / ml. We therefore consider that the mass of a lesion is approximately equal to the volume of the latter, which makes it possible to evaluate the mass of the lesion.
[0248] The CTA calculation step may, for example, comprise dividing the black blood image ISNk into a first predefined number, equal to 12 in the non-limiting example of Figure 1, predefined of SEC sectors of the same angle crl fcopening angle pointing towards axis I and calculating the percentage of myocardial surfaces occupied by the lesion on the different SEC sectors. The first number of sectors and the opening angle al k may vary depending on the cutting plane PCk. For example, the closer the cutting plane PCk is to the apex along the major axis, the more the number of sectors decreases and the opening angle al k increase.
[0249] This step can be implemented for different black blood images ISNk of different sections centered on respective cutting planes PCk with k = 1 to K. The method advantageously comprises a generation step GENR, by computer, for example by the processing unit, of a set of at least one representation of lesion characterization data and a display step AFFD of at least one representation of the set of at least one representation on a screen of the human-machine interface.
[0250] The generation step comprises, for example, the generation of data representative of the result of the DE detection step, i.e. the absence or presence of a lesion, and the display step comprises the display of this data.
[0251] The set of at least one representation advantageously comprises a first REPT representation of the data representative of the lesion size calculated during the CTA calculation step.
[0252] For example, as seen in Figure 7, we can generate a bull's eye type representation of the percentages or data representing the percentages of the myocardial surfaces occupied by the lesion in different sectors of black blood images ISNk taken according to the respective cutting planes PCk.
[0253] Bull's eye imaging is defined by the American Heart Association (AHA) and described in the following article: "Standardized Myocardial Segmentation and Nomenclature for Tomographic Imaging of the Heart: A Statement for Healthcare Professionals From the Cardiac Imaging Committee of the Council on Clinical Cardiology of the American Heart Association.", Manuel D. Cerqueira et al, Circulation, 2002; 105:539-42.
[0254] The bull's-eye representation comprises a plurality of concentric circles CE separated two by two by crowns CO. Each crown CO is assigned to a slice or a set of contiguous slices, knowing that the closer the crown CO corresponds to a slice or a set of slices to the apex, the closer it is to the center of the circles. Each crown CO is divided into portions of PSE sectors in which are displayed, as in the example of figure 7, the percentages of the surface of the myocardium occupied by a lesion and calculated for the respective sectors of the black blood image ISNk of the corresponding slice or combinations, for example averages, of the percentages calculated from the percentages of the surface of the myocardium occupied by a lesion calculated for the sectors of the black blood images of the set of corresponding slices.
[0255] Alternatively and / or additionally, the pixel intensity of the different portions of the crowns depends on the calculated percentage. The lower this percentage, the higher the intensity of the corresponding crown.
[0256] For example, in Figure 7, the display is shown in the form of a known bull's-eye type representation of the respective averages of the percentages of the size of the lesion calculated in the respective sectors defined on three sets of contiguous black blood images distributed along the p axis associated with the three respective crowns corresponding respectively to a section of the apex (inner crown), to the mid-ventricle (middle crown) and to the basal zone (outer crowns).
[0257] Portions of sectors associated with a percentage greater than 80% are represented by dotted lines and those associated with a percentage less than or equal to 80% are represented in white.
[0258] When generating a 3D image of the heart, it is advantageous to divide the image into several layers along the p axis and calculate the same data as from 2D images from these different layers.
[0259] Transmu rality
[0260] The CAR characterization step advantageously includes a step of calculating data representative of a percentage of transmurality of a lesion. By percentage of transmurality, we mean the percentage of a thickness of the myocardium occupied by a lesion.
[0261] This CTT calculation step includes the determination of at least one data representative of the percentage of transmurality of at least one lesion of the myocardium using location data of a lesion and location data of the first and / or second walls L1, L2 resulting from the segmentation step.
[0262] This data can be a percentage of the thickness of the myocardium occupied by a lesion on a sector of the black blood image ISNk starting from axis I
[0263] The percentage of the myocardial thickness occupied by the lesion in the sector can be calculated from the ratio between a number of pixels corresponding to the thickness of the lesion in this sector and the number of pixels corresponding to the thickness of the myocardium in this sector. The number of pixels corresponding to the thickness of the lesion can be a number obtained from the results of the SC lesion segmentation step or be calculated, for example by thresholding, during the CTT calculation step from the positioning data of L1 and possibly L2 from the SEG segmentation step.
[0264] The number of pixels corresponding to the thickness of the lesion on a sector can be an average or a maximum of numbers of pixels, corresponding to the thickness of the lesion, calculated according to different radii of the sector.
[0265] The number of pixels corresponding to the myocardial thickness in a sector can be an average or a maximum of numbers of pixels, corresponding to the myocardial thickness, calculated according to different radii of the sector. These numbers are calculated from positioning data of the L1 and L2 walls.
[0266] The CTT calculation step may, for example, comprise dividing the black blood image ISNk into a second predefined number of sectors of the same angle a2 k opening pointing towards the center of the cardiac cavity and the calculation of the percentage of the myocardial surfaces occupied by the lesion in the different sectors.
[0267] The second number of sectors and therefore the opening angle a2 kmay vary depending on the cutting plane PCk. For example, the closer the cutting plane PCk is to the apex, the more the number of sectors decreases and the opening angle a2 k increase.
[0268] Advantageously, the second number is greater than the first number. The CTT step may comprise the calculation of data representative of the transmurality in a sector from several elementary data representative of the transmurality calculated in this sector for several black blood images ISNk distributed along the p axis.
[0269] For example, we calculate a combination or an average of elementary data.
[0270] This step can be implemented for different ISNk black blood images of different sections centered on respective PCk section planes.
[0271] The GENR step advantageously comprises the generation of a REPTR representation of data representative of a percentage of transmurality. The AFFD display step advantageously comprises the display of this representation.
[0272] For example, a bull's-eye representation of combinations, e.g., averages, of percentages of lesion transmurality in sectors of contiguous ISNk black blood image sets taken along the respective PCk section planes can be generated.
[0273] The pixel intensity of this image advantageously, but not necessarily, represents the percentage of transmurality.
[0274] For example, in Figure 7, the display is shown as a bull's-eye REPTR representation of the averages of percentages of transmurality of the lesion calculated in the sectors defined on several sets of contiguous black blood images taken according to respective section planes distributed along the p axis.
[0275] As before, the bull's-eye representation includes a plurality of sector portions whose intensity corresponds to the combination of the percentage of transmurality calculated for this sector portion.
[0276] The lower this percentage, the higher the intensity of the corresponding corona. Alternatively and / or in addition, the percentages are displayed in the sector portions.
[0277] Advantages The proposed solution makes it possible to obtain images with sufficient resolution and contrast to detect and characterize lesions precisely and in a reliable and reproducible manner.
[0278] Furthermore, by separating two important pieces of information, namely the anatomy of the heart and the lesions, on two separate images, namely respectively the white blood images and the black blood images, it allows for the implementation of an automatic lesion characterization process. This automation allows for a significant saving in time and reproducibility compared to prior art solutions.
[0279] The black blood and white blood acquisition sequence of the method according to the invention requires a relatively short acquisition time, particularly when acquiring signals to generate 2D images that involve little computation. This advantageously makes it possible to implement the acquisition sequence in breath-hold breathing and to limit the movements of the heart between the images and therefore the corrections to be made, which makes it possible to limit the computational resources and the implementation of the method in real time. This also makes it possible to limit the artifacts altering the readability of the images. These artifacts accentuate the difficulty of reconstructing clear and precise images in order to locate and detect the lesion. Furthermore, long MRI acquisitions are uncomfortable for the patient. A duration of 10 to 20 min is considered a very long duration and it is difficult for the patient to remain within the MRI without moving.
[0280] Furthermore, in the case of the generation of 2D images by the method according to the invention, artifacts of an image extracted from a section plane of the 3D image are avoided, which are likely to lead to cases in which it is impossible to discriminate the presence of a potential lesion from the presence of blood located near the muscle. Indeed, in certain cases, the lesion is so close to the blood, it is called subendocardial, that it is difficult to know, on images presenting artifacts, whether it is a lesion, blood or an artifact of the image.
[0281] The method according to the invention makes it possible to base a clinical decision with little risk of diagnostic error on the presence or absence of a lesion.
[0282] Hardware From a hardware point of view, the TC processing unit can be seen as a calculator interacting with computer programs.
[0283] The TC processing unit comprises at least one computer, for example, a microcomputer, a computer network, an electronic component, a tablet, a smartphone or a personal digital assistant (PDA).
[0284] The processing and control unit TC comprises, for example, a computer, comprising a set of at least one processor, and possibly a memory operationally coupled to the computer.
[0285] The memory includes, for example, a computer-readable medium. The computer-readable medium is a tangible device readable by a reader of the processing unit, capable of storing electronic instructions and of being coupled to the communication system or communication unit.
[0286] In other words, the computer-readable medium is a tangible medium. In other words, it is not a transient signal in itself, such as radio waves or other freely propagating electromagnetic waves, such as light pulses or electronic signals. Such a computer-readable storage medium is, for example, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any combination thereof.
[0287] For example, the readable medium is an optical disc, a magneto-optical disc, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a random access memory (RAM), a magnetic card or an optical card.
[0288] The readable medium may include an operating system and load the programs according to the invention. It includes registers adapted to record parameter variables created and modified during the execution of the aforementioned programs. A computer program comprising software instructions is then stored on the readable medium. Alternatively, the program instructions come from an external source and downloaded via a network. This is particularly the case for applications.
[0289] The processing and control unit comprises a computer, i.e. at least one electronic data processing circuit designed to manipulate and / or transform data represented by electronic or physical quantities in registers of the evaluation system and / or memories into other similar data corresponding to physical data in the memories of registers or other types of display devices, transmission devices or storage devices.
[0290] The CT processing unit comprises, for example, memories, for storing data, for example the black blood and white blood images, operatively coupled to the data processing circuit and a reader adapted to read a computer-readable medium.
[0291] The steps of the method according to the invention are, for example, carried out by causing the processing circuits of the processing unit CT to read predetermined programs recorded on hardware such as memories so that their data processing circuits perform calculations, control communications and read and / or write data in memories.
[0292] The characterization is, for example, performed on a processing device, for example a single computer, or on a system distributed among several computers (in particular via the use of cloud computing).
[0293] The processing unit CT comprises at least one computer comprising at least elements listed below: a set of one or more processors (for example at least one central processing unit (CPU) and / or at least one graphics processing unit (GPU) and / or at least one microcontroller and / or at least one digital signal processor (DSP)) ASIC capable of interpreting instructions in the form of a computer program and / or a hardware assembly such as an application-specific integrated circuit (ASIC), an in-field programmable gate array (FPGA), a programmable logic device (PLD) of programmable logic arrays (PLA), a system on chip (SOC), and / or an electronic card in which steps of the method according to the invention are implemented in hardware elements.The invention relates to a computer program product comprising the computer-readable medium containing instructions which, when executed by the processing circuit, cause the system S to implement the steps of the method according to the invention.
[0294] The program product may include the computer-readable recording medium.
[0295] The invention also relates to a computer-readable medium on which the computer program is recorded.
[0296] Alternatively, the program instructions are obtained from an external source and downloaded via a network. This is particularly the case for applications. In this case, the computer program product comprises a computer-readable data carrier on which the program instructions are stored or a data carrier signal on which the program instructions are encoded.
[0297] The form of the program instructions is, for example, a source code form, a computer-executable form, or any intermediate form between a source code and a computer-executable form, such as the form resulting from the conversion of the source code via an interpreter, an assembler, a compiler, a linker, or a locator. Alternatively, the program instructions are microcode, firmware instructions, state definition data, integrated circuit configuration data (e.g., VHDL), or object code. The program instructions are written in any combination of one or more programming languages, for example, an object-oriented programming language (C++, JAVA, Python), a procedural programming language (e.g., C language).
[0298] The communication unit comprises at least one communication device enabling communication between the elements of the system and possibly between at least one element of the system and a device external to the system. The communication systems may establish a physical link between elements of the system and / or between an element of the system and a device external to the system and / or a remote communication link (wireless) between elements of the system and / or between an element of the system and a device external to the system. The communication device may comprise any hardware, firmware and / or software suitable for communicating information between elements of the device to which the communication device belongs, for example via a data bus, or to an element external to the device.In order to enable data communication between different devices to which, where applicable, communication devices belong, these devices include firmware and / or software hardware enabling a wired or wireless communication link to be established between them, for example Wi-Fi, Bluetooth, cellular or Ethernet.
[0299] The INT user interface allows a user to enter data or commands so as to be able to interact with the programs according to the invention.
[0300] The INT user interface includes, for example, an INTS interface and output and an INTE input interface.
[0301] The input interface includes, for example, a keyboard or a pointing interface, such as a mouse, a light pen, a touchpad, a remote control, a voice recognition device, a haptic device.
[0302] The output interface INTS is designed to return information to a user, in a sensory or electrical manner, such as, for example, visually or audibly. The output interface comprises, for example, a display. The display step AFFD may be a step of returning information by a means other than a display.
[0303] The INTS output interface can be the INTE input device, for example, in the case of a touchscreen tablet.
Claims
CLAIMS 1. Method for lesion characterization of the heart using images of an area to be imaged comprising the heart (CO) of a patient, the heart comprising a myocardium delimiting a cavity of the heart, the images comprising: - a black blood image (BBI) generated from signals acquired during a black blood magnetic resonance acquisition (ACQ1) by late gadolinium enhancement, - a white blood image (WBI) generated from signals acquired during a late gadolinium enhanced white blood magnetic resonance acquisition, the white blood acquisition (WBA2) being distinct from an inversion recovery sequence, the method comprising: - segmentation (SEG), by computer, of the white blood image (WBI) so as to generate positioning data of a set of at least one wall delimiting the myocardium, - lesion characterization (CAR) of the heart, by computer, from the black blood image (ISN) and positioning data, of at least one wall (L1, L2) of the set of at least one wall delimiting the myocardium, taken from the positioning data of the set of at least one wall delimiting the myocardium.
2. Method according to the preceding claim, in which the segmentation (SEG) uses a learning function to segment the white blood image (ISB) so as to obtain the positioning data.
3. Method according to the preceding claim, in which the learning function is a convolutional neural network.
4. Method according to any one of claims 2 to 3, in which the learning function is trained from a set of training images of the area to be imaged generated from signals acquired during respective acquisition steps by resonance. magnetic in white blood by late gadolinium enhancement distinct from inversion recovery sequences.
5. Method according to any one of the preceding claims, in which the assembly of at least one wall comprises a first wall (L1) delimiting and surrounding the myocardium.
6. Method according to claim 5, in which the characterization (CAR) comprises a lesion segmentation (SC) to locate a lesion of the myocardium on the black blood image (ISN) using data from positioning data of the first wall (L1).
7. Method according to claim 6, in which the lesion segmentation (SC) comprises the selection of the pixels of the black blood image (ISN) having an intensity greater than a predetermined threshold, the pixels being taken only from among the pixels of the black blood image (ISN) surrounded by the first wall (L1).
8. Method according to any one of claims 5 to 7, in which the assembly of at least one wall comprises a second wall (L2) delimiting the myocardium and surrounded by the first wall (L1).
9. Method according to claim 8, in which the characterization (CAR) comprises a calculation (CTT) of data representative of a percentage of transmurality of the lesion (CIC) from data originating from the positioning data of the first wall (L1) and the second wall (L2).
10. Method according to any one of claims 8 to 9, in which the characterization comprises a calculation (CTA) of data representative of a lesion size (CIC) from data originating from the positioning data of the first wall (L1) and the second wall (L2).
11. Method according to any one of the preceding claims, comprising displaying, on a screen, a representation of data calculated during the characterization step (CAR).
12. Method according to any one of the preceding claims, comprising the following steps: o acquisition by black blood magnetic resonance (ACQ1) by late gadolinium enhancement, o generation of the black blood image (ISN) from the signals acquired during acquisition by black blood magnetic resonance (ACQ1) by late gadolinium enhancement, o acquisition by white blood magnetic resonance (ACQ2) by late gadolinium enhancement, o generation of the white blood image (ISB) from the signals acquired during acquisition by black blood magnetic resonance (ACQ2) by late gadolinium enhancement.
13. A method according to any preceding claim, wherein the black blood image and the white blood image are two-dimensional.
14. System comprising the hardware and software elements for implementing the method according to any one of the preceding claims, the system comprising a processing unit configured to implement the segmentation step and the lesion characterization step.
15. A computer program product comprising instructions which cause the system according to claim 14 to execute the steps of the method according to any one of claims 1 to 13.
16. Computer-readable medium on which the computer program according to claim 15 is recorded.