Method of reconstructing an image from an image, called an input image, produced by a portable device designed to generate a main magnetic field.

Abstract

Reconstruction method for determining an image, called a reconstructed image, said method comprising the following steps: a step of learning to reconstruct distortion correction from learning data, and an inference step (Ei) comprising a determination of said reconstructed image reconstruction by the conjugate phase method; the learning step comprising the training of a variational network having: Figure to be published: figure 1

Description

Title of the invention: Method for reconstructing an image from an image, called an input image, produced by a portable device designed to generate a main magnetic field. Technical field

[0001] The present invention relates to the field of magnetic resonance imaging. More particularly, the present invention relates to a magnetic resonance imaging device, and in particular to a magnetic resonance imaging device having a radiofrequency assembly provided with a transmitting / receiving radiofrequency coil.

[0002] The present invention is particularly of interest when it comes to considering a portable magnetic resonance imaging device. State of the prior art

[0003] Magnetic resonance imaging (MRI) is now widely used to non-invasively image the interior of bodies, particularly human bodies. In particular, magnetic resonance imaging makes it possible to probe the hydrogen nuclei, and particularly their nuclear spin, of water molecules that partly form the body under examination.

[0004] In this regard, an MRI device is provided with a magnet intended to impose a static magnetic field on the body (called the "main magnetic field"), under the effect of which, the nuclear spins associated with the hydrogen nuclei contained in the water molecules forming part of this body become polarized.

[0005] In particular, the magnetic moments associated with these spins are preferentially aligned along an axis, called the z axis, determined by the orientation of the main magnetic field so as to create a magnetization of the body.

[0006] An MRI device also includes gradient coils configured to produce small amplitude, spatially varying magnetic fields when a current is applied thereto. More particularly, the gradient coils are configured to produce a magnetic field component that is aligned parallel to the main magnetic field, and that varies linearly in amplitude with position along one of the x, y, or z axes (the x, y, and z axes being pairwise perpendicular).

[0007] Thus, the combined effects of the magnetic fields imposed by the gradient coils make it possible to spatially code each of the positions of the body intended to be probed.

[0008] An MRI device also includes at least one radiofrequency (RF) coil. intended to act as an RF transmitter-receiver. In particular, the at least one radiofrequency coil is configured to emit pulses of RF energy of a frequency equal to or close to the resonance frequency of the spins of the hydrogen nuclei and which is at least partly absorbed by these nuclei.

[0009] Once the RF emission is interrupted, the nuclear spins relax to return to their initial energy state and in turn emit an RF signal that can be collected by at least one RF coil. This RF signal is then processed using a computer and reconstruction algorithms to obtain an image of the body.

[0010] The main magnetic field, generally between 1.5 Tesla and 3 Tesla, makes it possible to achieve relatively reasonable signal to noise ratios (SNR) and consequently to form images of the human body of sufficient quality and over durations of the order of a minute or more.

[0011] However, there are circumstances in which it is not possible to implement a main magnetic field of such intensity. Portable MRI devices are an example. These generally comprise a permanent magnet or electromagnets of limited capacity, and cannot impose a main magnetic field of an intensity greater than 60 mT, or even greater than 200 mT, without penalizing the mass or size of the MRI device in question.

[0012] This limitation in terms of main magnetic field intensity directly affects the performance of the MRI device. In particular, the images obtained with such an MRI device are likely to have a quality that is significantly degraded by an unfavorable signal-to-noise ratio. This unfavorable signal-to-noise ratio reflects, in part, a significant reduction in the magnetization present in the tissues.

[0013] In the ideal case, the precession of the nucleus is driven by a static magnetic field (called B0 field) which is homogeneous. Spatial coding process model

[0014] Considering a 2D Spin-Echo sequence as an example, suppose the z-direction is defined as the slice selection direction. The x- and y-directions can then be defined as the frequency (readout) and phase encoding directions respectively. Any 3D object under is first truncated into a predefined number of slices along the z-direction. On each 2D slice, the process of encoding the object's tomographic information for a perfect MRI system could be modeled as a discrete Fourier transform process.

[0015] Without loss of generality, the image can be represented by a scalar-valued function x(r), the spatial coding process then being formulated as follows:

[0016] y(k(t) ) ( 1)

[0017] where k(t) is a position vector in K space, while it is the varying signal in the time read by the receiver coil during the reading step. The integral domain û is equal to the entire field of view (FOV) of the scanner.

[0018] In a real MRI system, it is not possible to obtain a perfectly homogeneous BQ field and ideally linear gradient fields. While these inhomogeneities can sometimes be neglected when the main magnetic field has a relatively high intensity, this is not possible in the context of low or ultra-low field MRI scanners.

[0019] Thus, an additional phase shift term must be added to the previous coding model to cover the inhomogeneity of the BQ field and the nonlinearity of the gradient fields. The corrected spatial coding process can then be formulated as follows:

[0020] y(k(t) ) = # (2)

[0021] where &B(f) is the magnetic field deviation in units of Hz quantifying both the level of inhomogeneity of the BQ field and the nonlinearity of the gradient fields. Discretization

[0022] Current computing units have limited hardware resources that do not allow infinitesimal resolution for images obtained by MRI. Mathematically, this means that the continuous function x(r) mentioned above must be transformed into its discrete counterpart x(r-)-

[0023] This discretization is generally carried out by a pixelation process.

[0024] Thus, the integrals of equations (1) and (2) are converted into summations:

[0025] y (kj) = x(r,)?Jkx # (3)

[0026] y^kj) — (r,))6# (4)

[0027] Discretization also applies to data in K space, where ^k(t^) become y(kj} but still vary over time.

[0028] By writing these discrete equations (3) and (4) in matrix form with a coding matrix Ê, y a vector from the space K and x the image vector, the equation can be written:

[0029] y = Ex # (5)

[0030] where the coding matrix E is defined differently with and without phase shift term:

[0031] E^e^# (6)

[0032] Ey = ( ,-Q f, # ( 7 )

[0033] The presence of the phase shift term makes the encoding matrix in equation (7) "ill-conditioned". Thus, finding a reconstructed image becomes an "ill-posed" discrete linear inverse problem.

[0034] Classical reconstruction method for correcting distortions

[0035] When the deviation of the magnetic field is large, the direct reconstruction based on the direct Fourier transform DFT (for English discrete Fourier transform) presents crucial geometric distortions and a decrease in the signal-to-noise ratio SNR. These problems are partially solved by classical distortion correction reconstruction methods.

[0036] The phase shift term in equation (2) is essential to perform a reconstruction with corrected or attenuated distortion. Therefore, the deviation of the magnetic field AB(r) must always be a known data. It is possible to obtain this deviation term by measuring the BQ field and the gradient fields. When a measurement is not accessible, the BQ field mapping technique is another choice to control and quantify the deviation.

[0037] Reconstruction by the conjugate phase method

[0038] Once the magnetic field AB(r) is known, it is possible to carry out a conjugated phase reconstruction method CPR (for conjugated phase reconstruction) by inverting the spatial coding model: [°039] = # (8)

[0040] where $( r ) is an approximation of x(r) since the inverse of equation (8) is not exact. In matrix form after discretization, we observed that this inverse operator is the conjugate transpose of the encoding matrix E:

[0041] x = EH.y # (9)

[0042] in which the coding matrix E follows the definition of equation (7). Model-based reconstruction

[0043] Unlike the direct inversion method of the CPR method, the model-based method approaches by formulating the reconstruction as an optimization problem by minimizing the least squared error:

[0044] x = min| || E^-y || # (10)

[0045] In practice, measured data in K-space are always tainted with noise. To avoid overfitting to the noisy data composed within y when solving equation (10) with an iterative algorithm, it is necessary to stop the iteration early. This has been proven to be equivalent to a truncated or selective singular value decomposition (SVD).

[0046] Instead of early stopping, we more often extend the optimization by an additional regularization term R(x) to avoid overfitting and stabilize the iterative solution. This regularized problem is formulated as follows:

[0047] $ = min|^ || Ex-y || + #(11)

[0048] where 2 represents the weighting coefficient of the regularization term. The first term 4 || £ y - y || 2 quantifies the fidelity of the measured data of the K space. The second term measures the regularity of the solution. The minimum of equation (11) depends on the trade-off between data fidelity and regularization controlled by the weighting coefficient 2.

[0049] Conventionally, the regularization term is constructed empirically "by hand". The most common solution is total variation regularization which applies a first-order difference matrix T to the solution x to calculate the values ​​of the jumps between each pair of neighboring pixels.

[0050] = |T^|C

[0051] where the operator || || p is the Ip norm of a vector. When p is different from 2, the problem must be solved by the Bregman method or iteratively reweighted least squares (IRLS) method.

[0052] The reader may advantageously refer to the article Goldstein T, Osher S (2009) The split Bregman method for L1-regularizedproblems. SIAM J Imaging Sci 2(2):323-343 for the Bregman method.

[0053] Although the model-based method mentioned above gives relatively good reconstruction results, there are several drawbacks to overcome. The computational complexity is high: to solve the optimization problem defined in equations (11) and (12) with the Zj norm via the IRLS method, 2 iteration layers with the inner layer solving a least squares problem with a wide and complete linear operator, and the outer layer solving the weighted linear least squares problem. These two loop layers make the solution exceptionally expensive.

[0054] In traditional methods, the regularization term and its weighting coefficient are developed and selected manually. They are therefore not always optimal. Furthermore, when the content of an image obtained by an MRI device changes, for example from the brain to the knee, or when the noise level and characteristics change due to varying circumstances, the regularization terms and their relative weighting must be adapted.

[0055] Finally, the resolution by these methods does not allow parallelization of the calculations.

[0056] An aim of the invention is to overcome all or part of the aforementioned drawbacks. Statement of the invention

[0057] One idea that underlies the invention is to address these problems by implementing machine learning models related to artificial neural networks.

[0058] For this purpose, according to a first aspect of the invention, a reconstruction method is proposed for determining an image, called a reconstructed image, from an image, noted y, called input.

[0059] The input image y is in Fourier space, said input image being produced by a portable device intended to generate a main magnetic field, preferably less than 1 Te sla.

[0060] The method being implemented by a computing unit.

[0061] The method comprises the following steps: • a distortion correction reconstruction learning step from learning data, • an inference step (Ei) comprising a determination of said reconstructed image reconstruction by the conjugate phase method,

[0062] The training data presents a plurality of pairs of images xj, yj, the image xj being a reference image and yj being the Fourier transform of the image xj.

[0063] When the device is perfect, yj = FFT(xj).

[0064] The learning step involves training a residual network having: • a predetermined number of iterations n, • each iteration presenting: • a direct forward propagation branch, • a data consistency control branch with the encoding model, • a regularization bench. • a recurrence equation.

[0065] The recurrence equation can be written:

[0066] j = Xn _ XnET • (E • xn - yn) - K^Kn • un) • where E is a coding matrix verifying y=Ex • where Kn■ a) is a regularization term comes in the form of expert field models that are based on a predefined number of 2D convolution kernels and activation functions to determine the parameters 2, Kn,

[0067] The determination of said reconstructed image is carried out by the conjugate phase method:

[0068] = # (8)

[0069] where $ = Eh.j

[0070] Learning can be self-supervised (for English self-supervisedp supervised), or unsupervised (for English unsupervised).

[0071] According to a second aspect of the invention, a module is proposed comprising a calculation unit configured to implement a method according to the first aspect of the invention.

[0072] According to a third aspect of the invention, there is provided a portable resonance imaging device according to the second aspect of the invention. Brief description of the figures

[0073] Other characteristics and advantages of the invention will appear during the reading of the detailed description which follows for the understanding of which one will refer to the appended drawings in which: • [Fig.l] illustrates a variational network implemented in a method according to the invention, • [Fig.2] illustrates steps of the embodiment of the method according to the invention, • [Fig.3] illustrates an embodiment of a device according to the invention. Description of embodiments

[0074] The embodiments described below being in no way limiting, it will be possible in particular to consider variants of the invention comprising only a selection of the characteristics described, subsequently isolated from the other characteristics described, if this selection of characteristics is sufficient to confer a technical advantage or to differentiate the invention compared to the state of the prior art. This selection comprises at least one characteristic, preferably functional without structural details, or with only a part of the structural details if this part only is sufficient to confer a technical advantage or to differentiate the invention compared to the state of the prior art.

[0075] In the figures, an element appearing in several figures retains the same reference.

[0076] [Fig. 3] is a representation of an MRI device 1 suitable for implementing the imaging method according to the present invention.

[0077] The MRI device 1 comprises in particular a magnet 2 configured to impose a main magnetic field Bo. The magnet 2 may for example comprise a permanent magnet. The magnet 2 may in particular extend along an elongation axis z.

[0078] More particularly, the magnet 2 defines a housing 3 opening through a first opening 4 and a second opening 5 opposite one another along the elongation axis z.

[0079] In this regard, the magnet 2 is arranged to allow the insertion of a body, and more particularly a human body, into the housing 3 through the first opening 4 along the elongation axis z.

[0080] The magnet 2 can be configured to impose a main magnetic field Bo oriented along an axis perpendicular to the elongation axis z, in a zone, called the analysis zone, of the housing 3.

[0081] In this regard, the magnet 2 may comprise an assembly of elementary magnets, and in particular arranged in a series of Halbach rings. Patent EP3368914B1 gives an example of this. However, the invention is not limited to the sole configuration described in this patent.

[0082] By way of example, the magnet 2 is configured to impose a main magnetic field with an amplitude of less than 0.1 Tesla, advantageously less than 0.065 Tesla, even more advantageously less than or equal to 0.05 Tesla.

[0083] The MRI device 1 also comprises a set of gradient coils 6. The gradient coils 6 are notably configured to produce small amplitude magnetic fields varying in space when a current is applied to them.

[0084] More particularly, the gradient coils 6 are designed to produce a magnetic field component that is aligned parallel to the main magnetic field, and that varies linearly in amplitude with position along one of the x, y or z axes (the x, y and z axes forming an orthogonal coordinate system).

[0085] Thus, the combined effects of the magnetic fields imposed by the gradient coils 6 make it possible to spatially code the signals originating from a body present in the housing 3 and intended to be probed. The spatial encoding is manifested in particular by a variation in the resonance energy of the nuclear spins of the hydrogen nuclei included in the body intended to be probed and present in the analysis zone. In other words, the nuclear spins of the hydrogen nuclei are subjected to a magnetic field which differs from one position to another.

[0086] The MRI device 1 further comprises a radiofrequency coil 8 (hereinafter “RF coil”). The RF coil 8 is in particular arranged in the housing 3 and delimits an examination volume of the MRI device 1 and in which a body is intended to be housed.

[0087] Finally, the MRI device 1 also comprises means for controlling said MRI device 1. These control means may in particular comprise a computer 13 interfaced, via interfacing means 11, with the various elements forming the MRI device 1.

[0088] The MRI device 1 thus described can be implemented for carrying out the method of forming an MRI image of a body placed in the examination volume.

[0089] According to the terms of the present invention, a body image may be two-dimensional or three-dimensional.

[0090] A reconstruction method is now described for determining an image called a reconstructed image, from an image, called an input image, y in Fourier space, said input image being produced by a portable device, such as the MRI device 1, designed to generate a main magnetic field, the method being implemented by a computing unit. A module M is described at the same time comprising such a computing unit as well as a portable MRI 1 magnetic resonance imaging device.

[0091] The method comprises a learning step, preferably of the supervised type, of distortion correction reconstruction. According to one variant, the learning can be self-supervised. According to another variant, the learning can be unsupervised. Data collection

[0092] The learning process requires having a set of sufficient size.

[0093] Furthermore, each data point must contain a correct MRI image pair and its data in K-space. The image pair comprises one image in physical space, for example a tomographic image of a brain or a knee, and another image that is in K-space. A correct image is one that is free of artifacts or distortions, and almost without noise.

[0094] However, the K-space data should have characteristics similar to those of raw data acquired in practice with a portable magnetic resonance imaging device.

[0095] No MRI image database meets the above-mentioned conditions. The training data set is actually generated by passing high-field MRI images (1.5T or 3.0 T) through a numerical simulation tool comprising mainly 3 steps: • downsampling: reducing the resolution of the original high-resolution MRI image to a resolution corresponding to a portable magnetic resonance imaging device scanning protocol; • a signal simulation: calculate the K space with the magnetic field deviations from the results of the B0 mapping of the portable imaging device; • noise addition: add additive Gaussian noise at an SNR level consistent with our scanner results. Variational network

[0096] A variational network (VN) is a deep learning approach built by rolling out the iterative method that solves the regularized inverse problem in an artificial neural network with an architecture similar to a recurrent neural network (RNN) and a residual neural network (ResNet). It allows incorporating prior knowledge about MRI images by learning the regularization filter kernel, gradient descent weight and step size, and other parameters from the data.

[0097] As shown in [Fig.l], a variational network is composed of a predefined number of cells / stages representing the iteration stages, and within each cell, the image data of stage n flows into the next stage n + 1 via 3 branches, as indicated by these 3 arrows: • a direct feed-forward branch; • a data consistency check branch with the encoding model; and • a regularization bench.

[0098] The regularization term comes in the form of expert field models that are based on a predefined number of 2D convolution kernels and activation functions. After these two groups of variables, the step sizes of each cell / step complete the parameters of the variational network model.

[0099] The recurrence equation reads: [0i00] = Xn. - y„) -

[0101] where Knet Àn represent the convolution kernel of the variational network and the step size for step n, respectively. Kn and Àn are variables of the variational network that are determined during the training phases. Thus, the variational network will determine the optimal regularization value by removing any empirical regularization for each step n. Each step is represented by a cell with its own convolution kernel and step size.

[0102] The process of training a variational network aims to find the values ​​of the above-mentioned parameter groups by minimizing a loss function. 3 groups of parameters mentioned previously that minimize a loss function. We can define different loss functions like other machine learning models in computer vision, such as the mean square error (MSE) between images and data, mean square error (MSE) between the model output and the reference. However, since MRI images are complex-valued, it is possible to use the mean square error of complex images or their magnitude, depending on whether MRI is a machine learning model or not.

[0103] Finally, popular deep learning optimization algorithms have been used to accomplish the learning process, such as stochastic gradient descent or Adam.

[0104] The learning rate must be carefully tuned to ensure convergence. The learning rate is a hyperparameter to be tuned during training, which also depends on the optimization method used. In general, when it is small, it is more stable but convergence is slower, which means that a larger number of learning epochs is required. For example, it is possible to set the rate to le-5.

[0105] The module M according to the invention can be implemented in the form of an electronic module comprising a memory in which is stored a computer program product comprising instructions intended to be executed by the calculation unit UC or by the engine control unit ECU which then replaces the calculation unit UC.

[0106] Finally, the method according to the invention and the corresponding module can be implemented with sensors other than magnetic, provided that the sensor is sensitive to the passage of target reference elements.

[0107] More generally, the variational network (VN) can be replaced by any method of the unrolled iteration type for reconstruction based on deep learning (for English unrolled deep learning based iterative reconstruction).

[0108] In the general framework of such a method, • the number of iterations n is always predefined; • each iteration comprising >= 2 branches: • a control branch (bc) of data consistency with the encoding model; • a regularization branch but can be in another form for example U-net instead of expert fields comprising 2D convolution kernels and activation functions; • a direct branch (bd) may be present, but not necessarily.

[0109] In addition, the various features, forms, variations and embodiments of the invention may be combined with each other in various combinations to the extent that they are not incompatible or mutually exclusive.

Claims

Claims

1. Method (P) of reconstruction for determining an image, called reconstructed image, from an image, called input, y in Fourier space, said input image being produced by a portable device intended to generate a main magnetic field, the method being implemented by a computing unit, said method comprising the following steps: • a learning step (Ea) of distortion correction reconstruction from learning data, and • an inference step (Ei) comprising a determination of said reconstructed image by the conjugate phase method, the training data having a plurality of pairs of images xj, yj, the image xj being a reference image and yj being the Fourier transform of the image xj, the training step comprising the training of a variational network (VN) having: • a predetermined number of iterations n (il, i2 ... in), • each iteration presenting: • a branch (bd) with direct forward propagation, • a control branch (bc) of data consistency with the encoding model, • a regularization branch (br). • a recurrence equation that can be written:

2.

3. x^^ x n -\Ex n -y^ - K^Kn-u^ where E is a coding matrix verifying y=Ex, where the regularization term is in the form of expert field models that are based on a predefined number of 2D convolution kernels and activation functions. Module (M) comprising a calculation unit configured to implement a method according to the preceding claim. Portable magnetic resonance imaging device (1) comprising a module according to the preceding claim.

Images