Rapid magnetic resonance image reconstruction method based on potential variable diffusion model

Abstract

The invention discloses a rapid magnetic resonance image reconstruction method based on a potential variable diffusion model, and belongs to the technical field of medical image processing research. The method comprises the following steps: 1) acquiring an image data set: performing equal-proportion scaling processing and data enhancement processing on the data set to obtain a training data set and a verification data set which are consistent in image size and sufficient in quantity; 2) constructing a diffusion model network: constructing a potential k-space diffusion model network structure, training by using a training data set, and verifying a training intermediate result by using a verification data set to obtain a trained diffusion model network; and 3) magnetic resonance image reconstruction: inputting under-sampled k space data, performing magnetic resonance image reconstruction by using the trained diffusion model network, and outputting a reconstruction result image. According to the method, the calculation amount and the calculation time required by diffusion model reconstruction can be effectively reduced, the structure details of the image can be reserved, clear image edges and textures are reserved, and the quality of the reconstructed image is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of medical image processing research, and specifically relates to a fast magnetic resonance image reconstruction method based on a latent variable diffusion model. Background Art

[0002] Magnetic resonance imaging (MRI), as one of the most important contemporary medical assistance means, has become an indispensable imaging technology for non-invasively obtaining diagnostic information clinically because it can provide fine soft tissue contrast and high-precision spatial resolution. However, as an imaging technology based on nuclear magnetic resonance, its imaging process is affected by various factors, including physical properties, signal acquisition time, scan parameter settings, and physiological factors. This makes its scanning often require collecting a large amount of signal data to construct an image, and this process involves a series of complex physical processes, including the generation of magnetic field gradients, the emission and reception of pulse sequences, signal processing, etc., and each signal acquisition requires a certain amount of time. The long acquisition time will increase the discomfort of patients, and at the same time, image artifacts are caused by factors such as the patient's breathing and heartbeat, which will lead to misdiagnosis. These factors together have led to the major bottleneck problem of slow magnetic resonance imaging speed, which not only affects the imaging quality but also is not conducive to its clinical application. To sum up, magnetic resonance imaging can provide fine medical diagnostic information. If high-quality reconstruction of scanned images can be achieved while significantly shortening the scanning time, it will help to promote the clinical application of MRI technology. In the digital age, fast magnetic resonance image reconstruction, as a branch of medical image processing, has always been a challenging and attractive problem, with great research value and social significance.

[0003] Fast magnetic resonance image reconstruction is a very intuitive image reconstruction problem. Simply put, it aims to accelerate imaging by collecting a small amount of data. However, the lack of data will cause problems such as imaging artifacts. At this time, reconstruction algorithms are needed to obtain the final target image. There are three major categories of early fast magnetic resonance imaging techniques: One is to improve the performance of magnetic resonance imaging hardware. For example, increasing the main magnetic field strength and gradient switching speed of the magnetic resonance scanner. However, this technique is too costly and prone to image blurring during imaging. In addition, the high-speed switching magnetic field will generate eddy current fields, resulting in the generation of image artifacts and having a certain nerve electrical stimulation on human muscles. The second is to use parallel imaging algorithms, using the sensitivities of multiple receive coils to provide additional encoding information for reconstructing magnetic resonance images, allowing successful reconstruction of undamaged images from sparsely sampled image data. However, this technique is limited by various factors such as the accurate measurement of coil sensitivity distribution, sampling multiples, and the number of fitting blocks. Moreover, when the signal-to-noise ratio is very low or the acceleration acquisition factor is relatively large, the performance of these algorithms drops significantly. The third is the compressed sensing method. During the image reconstruction process, the prior information in the form of regularization provides constraint conditions for optimization, thus better solving the image reconstruction problem. This technique utilizes the sparsity of images under certain mathematical transformations and the incoherence between data acquisition and sparse transformation to accurately reconstruct images from undersampled K-space data. However, the significant reduction in the amount of data collected is prone to loss of details and image artifacts during reconstruction.

[0004] Traditional magnetic resonance imaging reconstruction techniques have made significant progress in the reconstruction field by introducing prior information of images. However, these methods often only explore the prior information of the reconstructed images and rarely involve reference images. However, with the further improvement of MRI acceleration, these traditional methods often suffer from loss of details and image artifacts. Driven by the success of deep learning in computer vision and natural image processing, fast magnetic resonance imaging reconstruction methods based on deep learning have received great attention. Different from traditional reconstruction methods, deep learning implicitly learns prior information from a large amount of magnetic resonance raw data scanned by different people through training prior models. Due to the high non-linear characteristics of the data-driven prior extraction strategy, some deep learning methods are superior to traditional methods. Research data from many domestic and foreign teams show that deep learning methods not only have great potential in terms of performance and computational efficiency, but also improve the imaging quality while reducing the reconstruction time. Due to the pursuit of imaging quality and rate, the network structures of deep learning algorithms are becoming more and more complex. Although deep learning has shown promising results in the MRI field, they use quantization metrics as loss functions during the training process. However, in actual scenarios, the distribution of MRI images is often complex and difficult to describe. Summary of the Invention

[0005] The object of the present invention is to propose a fast magnetic resonance image reconstruction method based on a latent variable diffusion model for practical needs, encoding the original k-space data into a low-dimensional latent space, generating prior knowledge through diffusion therein, combining a full-frequency structure reconstruction model and a high-frequency detail refinement model, and through pre-training of the encoder and decoder and latent k-space diffusion training, realizing fast and high-quality MRI reconstruction, which can not only effectively reduce the computational amount and computational time required for diffusion model reconstruction, but also retain the structural details of the image, retain clear image edges and textures, and improve the quality of the reconstructed image.

[0006] To achieve the above object, the present invention adopts the following technical solutions.

[0007] A fast magnetic resonance image reconstruction method based on a latent variable diffusion model, comprising the following steps: Step S1, obtaining an image data set; The image data set is obtained based on the SIAT data set and the fastMRI data set. The SIAT data set and the fastMRI data set are subjected to proportional scaling processing and data augmentation processing to obtain an image data set with consistent image size and sufficient quantity, and the image data set is further divided into a training data set and a validation data set; Step S2, constructing a diffusion model network; Construct a latent k-space diffusion model network capable of capturing and representing features and structures in the k-space, use the training data set to train the constructed latent k-space diffusion model network, use the validation data set to verify the intermediate results of the training of the latent k-space diffusion model network, and obtain a trained latent k-space diffusion model network after verifying the fitting of the latent k-space diffusion model network; Step S3, magnetic resonance image reconstruction; Input the undersampled k-space data, use the trained latent k-space diffusion model network for magnetic resonance image reconstruction, and output the reconstructed result image.

[0008] Specifically, in step S1, the SIAT data set and the fastMRI data set are subjected to proportional scaling processing and data augmentation processing, and the processing process is as follows: Merge 500 12-coil MRI images in the SIAT data set into single-coil images, and then enhance them to 4000 single-coil images; randomly select 92 individuals from the fastMRI data set, merge each slice of each individual into single-coil data, obtain a total of 1424 T1-weighted single-coil images, and then enhance them to 8000 single-coil images; uniformly crop the image sizes of the obtained 12000 single-coil images to 256×256 to obtain an image data set with consistent image size and sufficient quantity.

[0009] Further, in step S1, the image dataset is further divided into a training dataset and a validation dataset, and the ratio of the training dataset to the validation dataset is 9:1.

[0010] Specifically, in step S2, a potential k-space diffusion model network structure that can effectively capture and represent features and structures in the k-space is constructed. This potential k-space diffusion model network structure includes a frequency information generation model, a high-frequency detail refinement model, and an encoder-decoder network: The frequency information generation model is used to reconstruct the entire image structure from the undersampled potential k-space data, and the high-frequency detail refinement model is used to recover the high-frequency details lost during the reconstruction of the image structure by the frequency information generation model; In the encoder-decoder network, the encoder is stacked with residual blocks and linear layers to compress the k-space data into a low-dimensional potential k-space. The decoder combines dynamic Transformer blocks with a U-shaped structure. The dynamic Transformer blocks include multi-head transposed attention and a gated feed-forward network, and use the potential k-space as a dynamic modulation parameter to retain the details of the restored image.

[0011] Further, the training process of the potential k-space diffusion model network in step S2 is as follows: Step S21: Train the overall parameters of the potential k-space diffusion model network using the three channels of the RGB image, and input the training dataset into the potential k-space diffusion model network; Step S22: Train the encoder-decoder of the frequency information generation model and the high-frequency detail refinement model simultaneously; For the encoder of the frequency information generation model , first multiply the high-quality k-space data with the low-quality k-space data and modulate the value range of the entire k-space data through a weight matrix so that the encoder can more accurately extract features from the k-space data. Then, connect the weighted high-quality k-space data and the weighted low-quality k-space data and perform downsampling using the PixelUnshuffle operation to obtain the input of the encoder . The encoder of the frequency information generation model encodes the input into a potential k-space representation. The expression for the entire training process is as follows: ; In the above formula, is the potential k-space representation; and Weighted high-quality k-space data and weighted low-quality k-space data after multiplying the encoder input by weights, respectively; For the encoder of the high-frequency detail refinement model , first obtain and using the same weight strategy, and then multiply them by the high-frequency information extraction operator to obtain and , ensuring that the encoder pays more attention to the high-frequency details of the k-space data. Subsequently, and are concatenated and downsampled to obtain the input of the encoder . The encoder of the high-frequency detail refinement model encodes the input into a high-frequency latent k-space representation. The expression for the entire training process is as follows: ; In the above formula, is the high-frequency latent k-space representation; and are respectively and multiplied by the high-frequency information extraction operator to obtain the weighted high-frequency k-space data; Train the decoders and of the frequency information generation model and the high-frequency detail refinement model, and respectively restore and to k-space data and . The formula is expressed as: ; ; Step S23: Train the frequency information generation model and the high-frequency detail refinement model; For the frequency information generation model, first input the weighted k-space data and into the pre-trained encoder . Then the encoder encodes the input into an initial latent k-space representation . Subsequently, the forward DDPM converts the initial latent k-space representation into Gaussian noise through iteration . This process is described by the mathematical formula: ; In the above formula, represents the process of converting through iteration Convert the starting latent k-space representation into Gaussian noise ; is Gaussian distributed; , , are hyperparameters for controlling the noise variance; I is the identity matrix; For the high-frequency detail refinement model, use the encoder trained in step S22 to capture the high-frequency latent representation , and then, the forward DDPM will diffuse the starting high-frequency latent k-space representation into Gaussian noise , and this process is described by the mathematical formula: ; In the above formula, represents diffusing the starting high-frequency latent k-space representation into Gaussian noise through iteration T; The objective functions for training the frequency information generation model and the high-frequency detail refinement model are respectively expressed as: ; ; In the above formula, is the expectation over all variables, where is the noise sampled from the standard Gaussian distribution, is the high-frequency noise sampled from the standard Gaussian distribution, I is the identity matrix, t is the diffusion time step; and are respectively the latent k-space representation at time step t and the high-frequency latent k-space representation at time step t ; and are respectively the full-frequency data latent k-space representation and the high-frequency data latent k-space representation; and are the parameterized diffusion models.

[0012] Furthermore, the training loss functions of the encoder-decoder corresponding to the frequency information generation model and the high-frequency detail refinement model are respectively expressed as: ; ; In the above formula, and are respectively the weighted k-space images of the frequency information generation model and the high-frequency detail refinement model; and respectively represent the high-quality k-space data recovered by the encoders of two models from the latent k-space; represents the norm .

[0013] Specifically, the reconstruction process of the magnetic resonance image in step S3 is as follows: Step S31: Input the undersampled k-space data. The encoder encodes the k-space data therein into a latent k-space representation, and the frequency information generation model reconstructs the entire image structure from the latent k-space. The reconstruction process is expressed as: ; In the above formula, is the latent k-space representation at time step t -1; is the latent k-space representation at time step t ; , , is a hyperparameter for controlling the noise variance; Step S32: The high-frequency detail refinement model restores the high-frequency details lost during the image structure reconstruction process in step S31. The restoration process is expressed as: ; In the above formula, is the high-frequency latent k-space representation at time step t -1; Step S33: Introduce a data consistency operator to align the data reconstructed by the frequency information generation model and the high-frequency detail refinement model with the original measurement results. The expression of the data consistency operator is: ; ; In the above formula, ifj represents the position where the target sample data is collected; and respectively represent the index sets for collecting k-space samples and high-frequency collecting k-space samples; and represent the values of the k-space data generated by the frequency information generation model and the high-frequency detail refinement model at , j represents a position identifier in the k-space; represents the value of the k-space data generated by the frequency information generation model at position j; represents the k-space data generated by the frequency information generation model; represents the value of the k-space data generated by the high-frequency detail refinement model at position j; represents the k-space data generated by the high-frequency detail refinement model; represents the value at position j of the data generated by the frequency information generation model for the undersampled k-space ; represents the data generated by the frequency information generation model for the undersampled k-space ; represents the value at position j of the data generated by the high-frequency detail refinement model for the undersampled k-space ; represents the data generated by the high-frequency detail refinement model for the undersampled k-space ; corresponds to the undersampled k-space; represents the weight coefficient for balancing the influence of k-space measurement noise on reconstruction; Step S34, after data consistency processing, combine the outputs of the frequency information generation model and the high-frequency detail refinement model through a weighting strategy, and the mathematical expression of the weighting strategy is: ; By removing the weight , convert the combined weighted data into k-space data ; Then obtain the multi-coil image by applying the inverse Fourier transform, denoted as , and combine the multi-coil images through the sum of squares to obtain the final reconstruction result .

[0014] Compared with the prior art, the present invention has the following beneficial effects: 1. The method of the present invention provides a potential k-space domain diffusion model and introduces a potential space diffusion strategy that combines frequency information generation and high-frequency refinement, enabling the model to operate in the potential k-space domain rather than the original k-space domain, significantly reducing the computational complexity and shortening the required reconstruction time.

[0015] 2. The method of the present invention constructs a frequency information generation model and a high-frequency detail refinement model by using a potential space diffusion strategy that combines frequency information generation and high-frequency refinement. The two models can effectively learn and utilize global and local information, which helps to improve the quality and accuracy of reconstruction.

[0016] 3. The method of the present invention strictly verifies and evaluates the reconstruction model on three datasets, and the experimental results prove its excellent reconstruction performance, demonstrating its potential as a robust and effective solution for MRI reconstruction. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1It is the flowchart of a fast magnetic resonance image reconstruction method based on a latent variable diffusion model of the present invention; Figure 2 It is the network model diagram of the latent k-space diffusion model of the present invention; Figure 3 It is the process diagram of test data image reconstruction; Figure 4 It is the diagram of test image reconstruction result. Specific implementation manner

[0018] For the convenience of those of ordinary skill in the art to understand and implement the present invention, the following will detail each step of the method proposed by the present invention. It should be understood that these embodiments are only used to illustrate the present invention and not to limit the scope of the present invention. In addition, it should be understood that after reading the content taught by the present invention, those skilled in the art can make various changes or modifications to the present invention, and these equivalent forms also fall within the scope defined by the appended claims of this application.

[0019] Embodiment As Figure 1 shown, the present invention discloses a fast magnetic resonance image reconstruction method based on a latent variable diffusion model, including the following steps: Step S1, obtain an image data set; The image data set is obtained based on the SIAT data set and the fastMRI data set. The SIAT data set and the fastMRI data set are subjected to equal-proportion scaling processing and data augmentation processing to obtain an image data set with consistent image size and sufficient quantity, and the image data set is further divided into a training data set and a validation data set; Step S2, construct a diffusion model network; Construct a latent k-space diffusion model network capable of capturing and representing features and structures in k-space, use the training data set to train the constructed latent k-space diffusion model network, use the validation data set to verify the intermediate results of the training of the latent k-space diffusion model network, and obtain a trained latent k-space diffusion model network after verifying the fitting of the latent k-space diffusion model network; Step S3, magnetic resonance image reconstruction; Input the undersampled k-space data, use the trained latent k-space diffusion model network for magnetic resonance image reconstruction, and output the reconstructed result image.

[0020] Specifically, in step S1, the SIAT data set and the fastMRI data set are subjected to equal-proportion scaling processing and data augmentation processing, and the processing process is as follows: Merge 500 12-coil MRI images in the SIAT dataset into single-coil images, and then enhance them to 4000 single-coil images; randomly select 92 individuals from the fastMRI dataset, merge each slice of each individual into single-coil data to obtain a total of 1424 T1-weighted single-coil images, and then enhance them to 8000 single-coil images; uniformly crop the image sizes of the obtained 12000 single-coil images to 256×256 to obtain an image dataset with consistent image sizes and sufficient quantities.

[0021] Furthermore, in step S1, the image dataset is further divided into a training dataset and a validation dataset, and the ratio of the training dataset to the validation dataset is 9:1.

[0022] As Figure 2 shown, Figure 2 in (a) is the encoder and decoder network structure, Figure 2 in (b) is the latent k-space diffusion model network structure. In step S2, a latent k-space diffusion model network structure that can effectively capture and represent features and structures in the k-space is constructed. This latent k-space diffusion model network structure includes a frequency information generation model, a high-frequency detail refinement model, and an encoder-decoder network: The frequency information generation model is used to reconstruct the entire image structure from undersampled latent k-space data, and the high-frequency detail refinement model is used to recover the high-frequency details lost during the reconstruction of the image structure by the frequency information generation model; In the encoder-decoder network, the encoder is stacked by residual blocks and linear layers to compress k-space data into a low-dimensional latent k-space, and the decoder combines dynamic Transformer blocks with a U-shaped structure. The dynamic Transformer blocks include multi-head transposed attention and a gated feed-forward network, and use the latent k-space as a dynamic modulation parameter to retain the details of the restored image.

[0023] Furthermore, the training process of the latent k-space diffusion model network in step S2 is as follows: Step S21: Train the overall parameters of the latent k-space diffusion model network using the three channels of RGB images, and input the training dataset into the latent k-space diffusion model network; Step S22: Train the encoder-decoder of the frequency information generation model and the high-frequency detail refinement model simultaneously; For the encoder of the frequency information generation model , first multiply the high-quality k-space data with the low-quality k-space data through the weight matrix To modulate the value range of the entire k-space data, enabling the encoder to more accurately extract features from the k-space data, and then the weighted high-quality k-space data and the weighted low-quality k-space data are concatenated and downsampled using the PixelUnshuffle operation to obtain the input of the encoder of the frequency information generation model. The encoder encodes the input into a latent k-space representation. The expression for the entire training process is as follows: ; In the above formula, is the latent k-space representation; and are the weighted high-quality k-space data and weighted low-quality k-space data respectively after multiplying the encoder input by the weights; For the encoder of the high-frequency detail refinement model, first use the same weight strategy to obtain and , and then multiply them by the high-frequency information extraction operator to obtain and , ensuring that the encoder pays more attention to the high-frequency details of the k-space data. Subsequently and are concatenated and downsampled to obtain the input of the encoder of the high-frequency detail refinement model. The encoder encodes the input into a high-frequency latent k-space representation. The expression for the entire training process is as follows: ; In the above formula, is the high-frequency latent k-space representation; and are respectively and multiplied by the high-frequency information extraction operator to obtain the weighted high-frequency k-space data; The decoders and of the frequency information generation model and the high-frequency detail refinement model are trained and respectively restore and to k-space data ; ; Step S23: Train the frequency information generation model and the high-frequency detail refinement model; For the frequency information generation model, first, the weighted k-space data and are input into the pre-trained encoder . Then, the encoder encodes the input into the initial latent k-space representation . Subsequently, the forward DDPM converts the initial latent k-space representation into Gaussian noise through iteration . This process is described by the mathematical formula: ; In the above formula, represents converting the initial latent k-space representation into Gaussian noise through iteration ; is a Gaussian distribution; , , are hyperparameters for controlling the noise variance; I is the identity matrix; For the high-frequency detail refinement model, the encoder trained in step S22 is used to capture the high-frequency latent representation . After that, the forward DDPM diffuses the initial high-frequency latent k-space representation into Gaussian noise . This process is described by the mathematical formula: ; In the above formula, represents diffusing the initial high-frequency latent k-space representation into Gaussian noise through iteration T; The objective functions for training the frequency information generation model and the high-frequency detail refinement model are respectively expressed as: ; ; In the above formula, is the expectation over all variables, where is the noise sampled from the standard Gaussian distribution, is the high-frequency noise sampled from the standard Gaussian distribution, I is the identity matrix, t is the diffusion time step; and are respectively the latent k-space representation at time step t and the high-frequency latent k-space representation at time step t ; and are the latent k-space representations of the full-frequency data and the high-frequency data, respectively; and is a parameterized diffusion model.

[0024] Furthermore, the training loss functions of the encoder-decoder corresponding to the frequency information generation model and the high-frequency detail refinement model are respectively expressed as: ; ; In the above formula, and are the weighted k-space images of the frequency information generation model and the high-frequency detail refinement model, respectively; and respectively represent the high-quality k-space data recovered by the encoders of the two models from the latent k-space; represents the norm .

[0025] Specifically, as Figure 3 shown, the reconstruction process of the magnetic resonance image in step S3 is as follows: Step S31: Input the undersampled k-space data. The encoder encodes the k-space data therein into a latent k-space representation. The frequency information generation model reconstructs the entire image structure from the latent k-space. The reconstruction process is expressed as: ; In the above formula, is the latent k-space representation at time step t -1; is the latent k-space representation at time step t ; , , are hyperparameters for controlling the noise variance; Step S32: Recover the high-frequency details lost during the image structure reconstruction process in step S31 through the high-frequency detail refinement model. The recovery process is expressed as: ; In the above formula, is the high-frequency latent k-space representation at time step t -1; Step S33: Introduce a data consistency operator to align the data reconstructed by the frequency information generation model and the high-frequency detail refinement model with the original measurement results. The expression of the data consistency operator is: ; ; In the above formula, ifj represents the position for collecting target sample data; and respectively represent the index sets for collecting k-space samples and high-frequency collected k-space samples; and represent the values of the k-space data generated by the frequency information generation model and the high-frequency detail refinement model at ; j represents the position in the k-space for identification; represents the value of the k-space data generated by the frequency information generation model at position j; represents the k-space data generated by the frequency information generation model; represents the value of the k-space data generated by the high-frequency detail refinement model at position j; represents the k-space data generated by the high-frequency detail refinement model; represents the value of the data generated by the frequency information generation model for the undersampled k-space at position j; represents the data generated by the frequency information generation model for the undersampled k-space ; represents the value of the data generated by the high-frequency detail refinement model for the undersampled k-space at position j; represents the data generated by the high-frequency detail refinement model for the undersampled k-space ; corresponds to the undersampled k-space; represents the weight coefficient for balancing the influence of k-space measurement noise on reconstruction; Step S34, after data consistency processing, combine the outputs of the frequency information generation model and the high-frequency detail refinement model through a weighting strategy, and the mathematical expression of the weighting strategy is: ; By removing the weight , convert the combined weighted data into k-space data ; then obtain the multi-coil image by applying the inverse Fourier transform, denoted as , and combine the multi-coil images through the sum of squares to obtain the final reconstruction result .

[0026] The following gives a specific embodiment of using the method proposed by the present invention for image reconstruction to further illustrate the technical effects of the method of the present invention.

[0027] The experimental configuration is as follows: In this embodiment, the method proposed by the present invention is implemented using a single NVIDIA RTX3090 GPU in PyTorch. For the decoder, a 5-level encoder-decoder structure is adopted in this embodiment. The number of Transformer blocks from level 1 to level 5 is set to [1, 1, 1, 1, 9], and note that the number of heads is set to [1, 2, 4, 8, 16]. For the latent k-space diffusion model network, the channel dimension is 64, and the predefined hyperparameters increase linearly from 0.1 to 0.99. During the training process, the batch size is set to 4 in this embodiment, and the Adam optimizer is used for network training, where , . During the reconstruction process, the total number of iterative steps is 4, and the batch size input to the model is dynamically determined by the coils of the multi-coil MRI data.

[0028] To demonstrate the clinical feasibility of the reconstruction effect, in this embodiment, the ability of the present invention to retain the lesion area in the image is systematically evaluated by comparing with traditional reconstruction methods. In this embodiment, the method of the present invention is compared with two deep learning algorithms, the traditional E2E-Varnet and MoDL. As Figure 4 shown, the intuitive images of the reconstruction results of different methods are presented. The image reconstruction process uses random undersampling factors R = 3, 4 and Poisson undersampling factors R = 4, 6. It can be seen from Figure 4 that the method of the present invention has a very large advantage in removing image artifacts. There is still a lot of noise retained in the reconstruction result of the E2E-Varnet algorithm. Although the MoDL algorithm suppresses noise and artifacts to a certain extent, the reconstructed image is too smooth and loses too much texture detail. By comparing the three, it can be clearly concluded that the method of the present invention not only effectively suppresses artifacts but also preserves obvious texture details, and is more capable of effectively retaining the lesion area of the reconstructed image compared with traditional reconstruction methods, achieving high-quality MRI reconstruction.

[0029] The above is only a preferred embodiment of the present invention, and it is not a limitation of the present invention in other forms. Any person skilled in the art may use the disclosed technical content to make changes or modifications into equivalent embodiments with equivalent changes. However, any simple modification, equivalent change and modification made to the above embodiments based on the technical essence of the present invention without departing from the technical solution content of the present invention still belong to the protection scope of the technical solution of the present invention.

Claims

1. A fast magnetic resonance image reconstruction method based on a latent variable diffusion model, characterized in that: The following steps are involved: Step S1, obtaining an image data set; The image dataset is obtained based on the SIAT dataset and the fastMRI dataset. The SIAT dataset and the fastMRI dataset are scaled and data enhanced to obtain an image dataset with consistent image size and sufficient quantity. The image dataset is further divided into a training dataset and a validation dataset. Step S2, constructing a diffusion model network; A latent k-space diffusion model network capable of capturing and representing features and structures in k-space is constructed, a training data set is used to train the constructed latent k-space diffusion model network, a verification data set is used to verify the intermediate results of the latent k-space diffusion model network training, and a trained latent k-space diffusion model network is obtained after verifying the fitting of the latent k-space diffusion model network; Step S3, magnetic resonance image reconstruction; The undersampled k-space data is input, and the trained potential k-space diffusion model network is used to reconstruct the magnetic resonance image, and the reconstructed result image is output.

2. A fast magnetic resonance image reconstruction method based on a latent variable diffusion model according to claim 1, characterized in that: In step S1, the SIAT dataset and the fastMRI dataset are scaled and enhanced in proportion, and the processing process is as follows: The 500 12-coil MRI images in the SIAT dataset were merged into single-coil images and then enhanced to 4000 single-coil images. 92 individuals were randomly selected from the fastMRI dataset, and each slice of each individual was merged into single-coil data to obtain a total of 1424 T1-weighted single-coil images, which were then enhanced to 8000 single-coil images. The image sizes of the 12000 single-coil images were uniformly cropped to 256×256 to obtain an image dataset with consistent image size and sufficient quantity.

3. The method for rapid magnetic resonance image reconstruction based on latent variable diffusion model according to claim 1, characterized in that: In step S1, the image data set is further divided into a training data set and a verification data set, and the ratio of the training data set to the verification data set is 9:

1.

4. The method for rapid magnetic resonance image reconstruction based on latent variable diffusion model according to claim 1, characterized in that: Step S2 constructs a potential k-space diffusion model network structure that can effectively capture and represent features and structures in k-space. The potential k-space diffusion model network structure includes a frequency information generation model, a high-frequency detail refinement model, and an encoder-decoder network: The frequency information generation model is used to reconstruct the entire image structure from the undersampled potential k-space data, and the high-frequency detail refinement model is used to restore the high-frequency details lost in the process of reconstructing the image structure by the frequency information generation model; In the encoder-decoder network, the encoder is stacked with residual blocks and linear layers to compress k-space data into a low-dimensional latent k-space, and the decoder combines a dynamic Transformer block with a U-shaped structure. The dynamic Transformer block includes a multi-head transposed attention and a gated feedforward network, and uses the latent k-space as a dynamic modulation parameter to retain the details of the restored image.

5. The method for rapid magnetic resonance image reconstruction based on latent variable diffusion model according to claim 4, characterized in that: The training process of the potential k-space diffusion model network in step S2 is as follows: Step S21, using three channels of RGB images to train the overall parameters of the latent k-space diffusion model network, and inputting a training data set into the latent k-space diffusion model network; Step S22, simultaneously training the encoder-decoder of the frequency information generation model and the high-frequency detail refinement model; Encoder for frequency information generation model First, high-quality k-space data With low quality k-space data Multiply by the weight matrix To modulate the value range of the entire k-space data, the encoder can more accurately extract features from the k-space data, and then use the weighted high-quality k-space data and weighted low-quality k-space data Concatenate and downsample using the PixelUnshuffle operation to obtain the encoder Input, encoder of the frequency information generation model Encoding the input into a latent k-space representation, the entire training process is expressed as follows: ； In the above formula, is the potential k-space representation; and The weighted high-quality k-space data and the weighted low-quality k-space data are respectively obtained by multiplying the encoder input by the weight; Encoder for high frequency detail refinement model , first use the same weight strategy to obtain and , and then multiply them by the high-frequency information extraction operator get and , ensuring that the encoder focuses more on the high-frequency details of the k-space data, and then and are concatenated and downsampled to obtain the encoder Input, encoder of high-frequency detail refinement model The input is encoded into a high-frequency latent k-space representation. The expression of the entire training process is as follows: ； In the above formula, is the high-frequency latent k-space representation; and They are and Multiply by the high frequency information extraction operator The obtained weighted high-frequency k-space data; Train the decoder of the frequency information generation model and the high-frequency detail refinement model and , respectively and Restore to k-space data and , the formula is: ； ； Step S23, training a frequency information generation model and a high frequency detail refinement model; To generate a frequency information model, firstly transform the weighted k-space data and Input to the pre-trained encoder Then the encoder Encode this input into a starting latent k-space representation , and then the forward DDPM iterates The starting potential k-space is represented as Converted to Gaussian noise , this process is described by mathematical formula: ； In the above formula, Indicates that through iteration The starting potential k-space is represented as Converted to Gaussian noise ; is a Gaussian distribution; , , is a hyperparameter to control the noise variance; I is the identity matrix; For the high-frequency detail refinement model, use the encoder trained in step S22 To capture high-frequency latent representations , after which the forward DDPM will start with the high-frequency latent k-space representation Diffusion as Gaussian noise , this process is described by mathematical formula: ； In the above formula, It means that the starting high-frequency potential k-space is represented by iterating T Diffusion as Gaussian noise ; The objective functions of training the frequency information generation model and the high-frequency detail refinement model are expressed as: ； ； In the above formula, is the expectation of all variables, where is the noise sampled from a standard Gaussian distribution, is high frequency noise sampled from a standard Gaussian distribution, I is the identity matrix, t is the diffusion time step; and The time steps are t The potential k-space representation and time step when t High-frequency latent k-space representation when ; and They are the latent k-space representation of full-frequency data and the latent k-space representation of high-frequency data respectively; and It is a parameterized diffusion model.

6. The method for rapid magnetic resonance image reconstruction based on latent variable diffusion model according to claim 5, characterized in that: The training loss functions of the encoder-decoder corresponding to the frequency information generation model and the high-frequency detail refinement model are expressed as: ； ； In the above formula, and They are weighted k-space images of the frequency information generation model and the high-frequency detail refinement model respectively; and Respectively represent the high-quality k-space data recovered from the latent k-space by the encoders of the two models; Representation norm .

7. The method for rapid magnetic resonance image reconstruction based on latent variable diffusion model according to claim 5, characterized in that: The reconstruction process of the magnetic resonance image in step S3 is as follows: Step S31: input undersampled k-space data, the encoder encodes the k-space data into a latent k-space representation, and the frequency information generation model reconstructs the entire image structure from the latent k-space. The reconstruction process is expressed as: ； In the above formula, The time step is t Latent k-space representation at -1; The time step is t The potential k-space representation when ; , , is a hyperparameter to control the noise variance; Step S32: restore the high-frequency details lost in the image structure reconstruction process of step S31 through the high-frequency detail refinement model. The restoration process is expressed as: ； In the above formula, The time step is t High-frequency latent k-space representation at -1; Step S33: introduce a data consistency operator to align the data reconstructed by the frequency information generation model and the high-frequency detail refinement model with the original measurement results. The expression of the data consistency operator is: ； ； In the above formula, ifj Indicates the location where the target sample data is collected; and They represent the index sets for collecting k-space samples and collecting k-space samples at high frequency respectively; and The k-space data generated by the frequency information generation model and the high-frequency detail refinement model are The value at j Represents the position in k-space. represents the value of the k-space data generated by the frequency information generation model at position j; represents the k-space data generated by the frequency information generation model; represents the value of the k-space data generated by the high-frequency detail refinement model at position j; represents the k-space data generated by the high-frequency detail refinement model; Representation frequency information generation model for undersampled k-space The value of the generated data at position j; Representation frequency information generation model for undersampled k-space Generated data; Represents the high-frequency detail refinement model for undersampled k-space The value of the generated data at position j; Represents the high-frequency detail refinement model for undersampled k-space Generated data; corresponds to undersampled k-space; Represents the weight coefficient for balancing the effect of k-space measurement noise on reconstruction; Step S34: After data consistency processing, the outputs of the frequency information generation model and the high-frequency detail refinement model are combined through a weighted strategy, and the mathematical expression of the weighted strategy is: ； By removing the weight , the combined weighted data Convert to k-space data ; Then, the multi-coil image is obtained by applying the inverse Fourier transform, denoted as , the multi-coil images are combined by square sum to obtain the final reconstruction result .

Images