A multi-domain perception contrast-enhanced computed tomography image synthesis method, system and electronic device

By using a multi-domain perception contrast-enhanced computed tomography image synthesis method, utilizing a 3D autoencoder and a denoising diffusion probability model, the challenges of image synthesis in traditional CECT technology are solved, radiation-free high-quality image generation is achieved, and accurate diagnosis of acute pancreatitis is supported.

CN119648552BActive Publication Date: 2025-09-23UNIV OF SCI & TECH BEIJING
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411818001.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-11
Publication Date
2025-09-23
Estimated Expiration
2044-12-11

AI Technical Summary

Technical Problem

Traditional CECT scanning technology has problems with contrast agent side effects, radiation exposure and high cost, and existing NCCT image synthesis methods have challenges in image quality and feature simulation.

Method used

A multi-domain-aware contrast-enhanced computed tomography (CECT) image synthesis method is adopted. Through a 3D autoencoder and a denoising diffusion probability model, combined with multi-domain-aware regularization technology, high-quality CECT images are generated from NCCT images, including data preprocessing, image compression and reconstruction, denoising diffusion generation, and multi-domain-aware regularization.

Benefits of technology

It achieves high-quality image synthesis without the need for iodine contrast agents, reduces radiation exposure and medical costs, improves diagnostic accuracy and efficiency, and significantly enhances image detail expression and texture consistency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119648552B_ABST
    Figure CN119648552B_ABST
Patent Text Reader

Abstract

The present invention provides a multi-domain perception contrast-enhanced computed tomography image synthesis method, system and electronic device. By adopting a 3D autoencoder and a denoising diffusion probability model, it successfully achieves efficient synthesis from non-contrast enhanced to high-quality contrast-enhanced images, optimizes the calculation process and improves image quality. The introduction of multi-domain perception regularization significantly improves the detail expression and texture consistency of the synthesized image by performing fine-grained enhancement of the image in different frequency bands. In addition, the present invention automates the image synthesis process through a deep learning framework, reduces manual operations, shortens processing time, and provides a fast, accurate and reliable technical solution for the field of medical image processing. These technological innovations provide a new path for the generation of CECT images and promote the development of medical imaging technology.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of medical imaging technology, and in particular to a multi-domain perception contrast-enhanced computed tomography (CECT) image synthesis method, system and electronic equipment for acute pancreatitis assessment. Background Art

[0002] Acute pancreatitis is a severe inflammatory disease characterized by edema, hemorrhage, and necrosis of pancreatic tissue. The disease can rapidly worsen, leading to multi-organ dysfunction and a high mortality rate. Therefore, early and accurate diagnosis is crucial for effective treatment.

[0003] Traditional diagnostic methods rely on contrast-enhanced computed tomography (CECT), an imaging technique that can provide high-resolution images of the pancreas and its surrounding structures. CECT uses an iodine-containing contrast agent to enhance the contrast of the image, thereby more clearly showing the vascular and tissue structures of the pancreas. However, this technology has some limitations: (1) Side effects of contrast agents: The use of iodine contrast agents may cause allergic reactions or other side effects and is not suitable for some patients (such as those with kidney disease or those who are allergic to iodine). (2) Radiation exposure: CECT scans involve higher radiation doses, posing a potential risk to the patient's health. (3) Cost and accessibility: CECT equipment is expensive and not easily available in some areas or medical institutions.

[0004] To overcome these limitations, researchers have been exploring methods to synthesize CECT images using non-contrast enhanced computed tomography (NCCT) images. This approach aims to generate CECT-like images from NCCT images using software algorithms, thereby avoiding the use of contrast agents and reducing radiation exposure. Existing image synthesis methods, including those based on generative adversarial networks (GANs) and diffusion models, have made some progress in the field of image synthesis, but there are still some challenges, such as unstable training, insufficient image quality, and the inability to accurately simulate the specific features of CECT images. Summary of the Invention

[0005] The purpose of this invention is to provide an improved CECT image synthesis method that can reduce the need for invasive examinations for patients while providing high-quality imaging results to support accurate diagnosis of acute pancreatitis. By using advanced image processing techniques and machine learning algorithms, the aim is to improve the accuracy and efficiency of diagnosis while reducing patient health risks and medical costs.

[0006] To solve the above technical problems, according to one aspect of the present invention, the present invention provides the following technical solutions:

[0007] A multi-domain perception contrast-enhanced computed tomography image synthesis method comprises the following steps:

[0008] S1. Obtain a pancreatitis medical image dataset through medical image data acquisition and preprocessing, and divide it into a training set, a validation set, and a test set;

[0009] S2. Compress and reconstruct the image using a 3D autoencoder to obtain a latent representation;

[0010] S3. construct a denoising diffusion probability model to generate the distribution of the latent representation;

[0011] S4, optimizing specific targets by encoding conditional codes to generate synthetic images with high consistency with actual CECT images;

[0012] S5. Design multi-domain perception regularization to ensure the consistency of the generated synthetic images in different frequency spaces.

[0013] As a preferred embodiment of the multi-domain perception contrast-enhanced computed tomography image synthesis method of the present invention, step S1 specifically includes the following steps:

[0014] S101. Collect pancreatic NCCT-CECT paired data, consisting of 220 pairs of CT images acquired using a Siemens Definition AS 40 scanner, using a voltage of 120 kV and a current of 303 mA. The voxel spacing of each NCCT and CECT image is 0.78 × 0.78 × 5 mm. 3 , the image matrix size is 512 × 512, containing 19 to 81 slices;

[0015] S102, randomly dividing the paired CT images into a training set, a validation set, and a test set, wherein the training set accounts for 80% and is used for model learning; the validation set accounts for 10% and is used for monitoring and optimizing the model; and the test set accounts for 10% and is used for evaluating model performance;

[0016] S103. Standardize the dataset, adjust its size to 128×128×16, and normalize it to the range of [0,255] to reduce data storage pressure and improve data practicality.

[0017] As a preferred embodiment of the multi-domain perception contrast-enhanced computed tomography image synthesis method of the present invention, step S2 specifically includes the following steps:

[0018] S201, constructing a three-dimensional autoencoder to encode the voxel space of the CECT image into a latent representation;

[0019] S202, CECT image x i Through the encoder q Φ (z|x i ) is compressed into a latent variable, and the latent representation z is obtained by sampling;

[0020] S203, using decoder p θ (z|x i ) reconstruct the latent representation z to generate a reconstructed CECT image and optimize the latent representation through reconstruction consistency learning to make it close to the data distribution;

[0021] S204. Introduce a patch-based inverse normalization mechanism to enhance the recognition of details of the pancreatitis area and improve the local contours and textures of the generated image.

[0022] As a preferred solution of the multi-domain perception contrast-enhanced computed tomography image synthesis method of the present invention, the implementation method of step S204 is:

[0023]

[0024] Among them, q Φ represents the encoder, p θ Describes the decoder, represents the discriminator, and represent the real image and the reconstructed image respectively;

[0025] As a preferred embodiment of the multi-domain perception contrast-enhanced computed tomography image synthesis method of the present invention, step S3 specifically includes the following steps:

[0026] S301, constructing a denoising diffusion probability model, converting the original data into noisy data by gradually introducing Gaussian noise, and achieving denoising by predicting the noise distribution;

[0027] S302, the denoising diffusion probability model gradually adds Gaussian noise to the original data by establishing a Markov chain to learn the distribution of the noise;

[0028] S303, encode the NCCT image into conditional embedding through the conditional extractor, and use q Φ The generated latent representation and the noise prediction network p θ Conduct joint optimization;

[0029] S304 , reconstructing a high-quality CECT image through an inverse diffusion process, and decoding the inferred latent representation into an image output.

[0030] As a preferred embodiment of the multi-domain perceptual contrast enhanced computed tomography image synthesis method of the present invention, wherein: in step S3, the optimal paradigm of the denoising diffusion probability model is for:

[0031]

[0032] Among them, x t represents the data sample after adding noise at time step t, ∈ represents the actual Gaussian noise added, ∈ θ (x t ,t) represents the prediction result of the model for the noise at time step t, and t and ∈ are random samples.

[0033] As a preferred embodiment of the multi-domain perception contrast-enhanced computed tomography image synthesis method of the present invention, step S4 specifically includes the following steps:

[0034] S401, by inheriting the encoder q from the encoder Φ , obtain the potential condition code for condition generation and reduce redundant calculation;

[0035] S402, pass the potential conditional code zc as input to the 3D U-Net backbone network to guide the noise prediction model ∈ θ Perform denoising generation;

[0036] S403. During the condition extraction process, avoid additional training of the DDPM model to improve generation efficiency.

[0037] As a preferred solution of the multi-domain perception contrast-enhanced computed tomography image synthesis method of the present invention, the implementation method of step S403 is:

[0038]

[0039] where ∈ represents Gaussian noise sampled from the standard normal distribution N(0,1), ∈ θ (z t ,t,z c ) represents the model’s prediction of the noise at time step t, z t is the representation of data x at time step t, z c is from the conditional distribution q φ (z|x i ) represents the potential representation of multi-domain images.

[0040] As a preferred embodiment of the multi-domain perception contrast-enhanced computed tomography image synthesis method of the present invention, step S5 specifically includes the following steps:

[0041] S501, mapping the synthesized image to different frequency spaces by using a preset mask to enhance the consistency of the generated image in each frequency domain;

[0042] S502. Optimize the generated image through multi-domain perception regularization and combining the spatial information of the two domains to ensure a balance between local details and global features of the reconstructed image.

[0043] S503. A balance is maintained between consistency and multi-domain awareness through a dynamic trade-off factor λ, thereby achieving high-quality generation and detail optimization of the synthesized image.

[0044] As a preferred solution of the multi-domain perception contrast-enhanced computed tomography image synthesis method of the present invention, the implementation method of step S501 is:

[0045]

[0046] in, Represents the conditional probability distribution p θ (x i All reconstructed images sampled from |z) The expected value of and They represent the real image and the reconstructed image respectively, the subscript h represents the image that has passed through a high-pass filter, and the subscript l represents the image that has passed through a low-pass filter.

[0047] As a preferred embodiment of the multi-domain perceptual contrast-enhanced computed tomography image synthesis method of the present invention, the complete optimization objective Q in step S503 satisfies:

[0048]

[0049] in, represents the overall optimization objective, including reconstruction loss and multi-domain aware regularization loss; Reconstruction loss measures the difference between the model's reconstructed image and the original image; λ represents the trade-off coefficient, which controls the balance between the reconstruction loss and the multi-domain-aware regularization loss, and its value is 1.5.

[0050] As a preferred embodiment of the multi-domain perceptual contrast-enhanced computed tomography image synthesis method described in the present invention, step S3 further includes a conditional extractor for encoding non-contrast-enhanced computed tomography (NCCT) images into conditional embeddings to guide DDPM to generate specific CECT images.

[0051] To solve the above technical problems, according to another aspect of the present invention, the present invention provides the following technical solutions:

[0052] A multi-domain perception contrast-enhanced computed tomography image synthesis system, comprising:

[0053] The data acquisition and preprocessing module acquires the pancreatitis medical image dataset through medical image data acquisition and preprocessing, and divides it into training set, validation set and test set;

[0054] The image compression and reconstruction module uses a 3D autoencoder to compress and reconstruct the image to obtain a latent representation;

[0055] a denoising diffusion generation module, which constructs a denoising diffusion probability model to generate the distribution of the latent representation;

[0056] The conditional generation module optimizes specific targets by encoding conditional codes to generate synthetic images with high consistency with actual CECT images;

[0057] Multi-domain perception regularization module,designs multi-domain perception regularization to ensure the consistency of the,generated synthetic images in different frequency spaces.

[0058] To solve the above technical problems, according to another aspect of the present invention, the present invention provides the following technical solutions:

[0059] An electronic device comprises: a processor, a memory, an internal bus, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the multi-domain perception contrast-enhanced computed tomography image synthesis method.

[0060] A readable storage medium stores a program or instruction, which, when executed by a processor, implements the multi-domain perception contrast-enhanced computed tomography image synthesis method.

[0061] The beneficial effects of the present invention are as follows:

[0062] The present invention proposes a multi-domain perception contrast-enhanced computed tomography image synthesis method, system and electronic device. By adopting a 3D autoencoder and a denoising diffusion probability model, it successfully achieves efficient synthesis from non-contrast enhanced to high-quality contrast-enhanced images, optimizes the calculation process and improves image quality. The introduction of multi-domain perception regularization significantly improves the detail expression and texture consistency of the synthesized image by performing fine-grained enhancement of the image in different frequency bands. In addition, the present invention automates the image synthesis process through a deep learning framework, reduces manual operations, shortens processing time, and provides a fast, accurate and reliable technical solution for the field of medical image processing. These technological innovations provide a new path for the generation of CECT images and promote the development of medical imaging technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying any creative work.

[0064] Figure 1 is a flowchart of the steps of a multi-domain perceptual contrast-enhanced computed tomography image synthesis method;

[0065] Figure 2 This is a schematic diagram of the framework structure of the multi-domain perception contrast enhancement computed tomography image synthesis method;

[0066] Figure 3 This is a block diagram of the multi-domain perception contrast-enhanced computed tomography image synthesis system;

[0067] Figure 4 It is a structural block diagram of an electronic device according to an embodiment of the present application.

[0068] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0069] The following will be a clear and complete description of the technical solutions in the embodiments. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of the present invention.

[0070] The present invention proposes a multi-domain perception contrast-enhanced computed tomography (CECT) image synthesis method, which can solve the patient health risk problem caused by the use of iodine contrast agents in traditional CECT scans. Specifically, through this multi-domain perception CECT image synthesis method, it is possible to synthesize images that are highly consistent with actual CECT images from non-contrast-enhanced computed tomography (NCCT) images, achieving the purpose of disease diagnosis without the use of iodine contrast agents, while reducing the radiation dose received by patients. In addition, this method significantly improves the efficiency and accuracy of image synthesis through an automated image processing process, providing an innovative technical support for medical imaging diagnosis.

[0071] like Figure 1 As shown, one embodiment of the present invention provides a multi-domain perception contrast-enhanced computed tomography image synthesis method, comprising the following steps:

[0072] S1. Through medical image data acquisition and preprocessing, a pancreatitis medical image dataset is obtained and divided into a training set, a validation set, and a test set.

[0073] This step involves the acquisition and preprocessing of medical image data and the partitioning of data sets. An optional method for preprocessing medical image data, acquiring image data, and partitioning data sets may include the following steps:

[0074] S101. Collect pancreatic NCCT-CECT paired data, consisting of 220 pairs of CT images acquired using a Siemens Definition AS 40 scanner, using a voltage of 120 kV and a current of 303 mA. The voxel spacing of each NCCT and CECT image is 0.78 × 0.78 × 5 mm. 3 , the image matrix size is 512 × 512, containing 19 to 81 slices;

[0075] S102, randomly dividing the paired CT images into a training set, a validation set, and a test set, wherein the training set accounts for 80% and is used for model learning; the validation set accounts for 10% and is used for monitoring and optimizing the model; and the test set accounts for 10% and is used for evaluating model performance;

[0076] S103. Standardize the dataset, adjust its size to 128×128×16, and normalize it to the range of [0,255] to reduce data storage pressure and improve data practicality.

[0077] S2. Compress and reconstruct the image using a 3D autoencoder to obtain a latent representation;

[0078] An alternative framework could be Figure 2 As shown, in the first training stage, an autoencoder constraint establishes a latent representation of an image. Multi-domain perception captures the consistency of different frequency spaces. Subsequently, DDPM learns the distribution of the later representation. We inherit the encoder of the autoencoder as a conditional extractor, which is considered appropriate. We then introduce multi-domain fusion in the conditional embedding to obtain sufficient expressions. During inference, DDPM generates a specific synthetic CECT image by sampling and conditional codes generated by the autoencoder decoder and reconstructing it into the image space. It includes the following steps:

[0079] S201, constructing a three-dimensional autoencoder to encode the voxel space of the CECT image into a latent representation;

[0080] S202, CECT image x i Through the encoder q Φ(z|x i ) is compressed into a latent variable, and the latent representation z is obtained by sampling;

[0081] S203, using decoder p θ (z|x i ) reconstruct the latent representation z to generate a reconstructed CECT image and optimize the latent representation through reconstruction consistency learning to make it close to the data distribution;

[0082] S204: Introduce a patch-based inverse normalization mechanism to enhance the recognition of details of the pancreatitis area and improve the local contour and texture of the generated image. The implementation method of step S204 is as follows:

[0083]

[0084] Among them, q Φ represents the encoder, p θ Describes the decoder, represents the discriminator, and represent the real image and the reconstructed image respectively;

[0085] S3. constructing a denoising diffusion probability model (DDPM) to generate the distribution of the latent representation;

[0086] The step S3 specifically includes the following steps:

[0087] S301, constructing a denoising diffusion probability model, converting the original data into noisy data by gradually introducing Gaussian noise, and achieving denoising by predicting the noise distribution;

[0088] S302, the denoising diffusion probability model gradually adds Gaussian noise to the original data by establishing a Markov chain to learn the distribution of the noise;

[0089] S303, encode the NCCT image into conditional embedding through the conditional extractor, and use q Φ The generated latent representation and the noise prediction network p θ Conduct joint optimization;

[0090] S304 , reconstructing a high-quality CECT image through an inverse diffusion process, and decoding the inferred latent representation into an image output.

[0091] In step S3, the optimal paradigm of the denoising diffusion probability model for:

[0092]

[0093] Among them, x trepresents the data sample after adding noise at time step t, ∈ represents the actual Gaussian noise added, ∈ θ (x t ,t) represents the prediction result of the model for the noise at time step t, and t and ∈ are random samples.

[0094] The step S3 further includes a conditional extractor for encoding the non-contrast enhanced computed tomography (NCCT) image into a conditional embedding to guide the DDPM to generate a specific CECT image.

[0095] S4, optimizing specific targets by encoding conditional codes to generate synthetic images with high consistency with actual CECT images;

[0096] The step S4 specifically includes the following steps:

[0097] S401, by inheriting the encoder q from the encoder Φ , obtain the potential condition code for condition generation and reduce redundant calculation;

[0098] S402, pass the potential conditional code zc as input to the 3D U-Net backbone network to guide the noise prediction model ∈ θ Perform denoising generation;

[0099] S403: During the condition extraction process, additional training of the DDPM model is avoided to improve generation efficiency. The implementation method of step S403 is as follows:

[0100]

[0101] where ∈ represents Gaussian noise sampled from the standard normal distribution N(0,1), ∈ θ (z t ,t,z c ) represents the model’s prediction of the noise at time step t, z t is the representation of data x at time step t, z c is from the conditional distribution q φ (z|x i ) represents the potential representation of multi-domain images.

[0102] S5. Design multi-domain-aware regularization to ensure the consistency of the generated synthetic images in different frequency spaces.

[0103] The step S5 specifically includes the following steps:

[0104] S501: Mapping the synthesized image to different frequency spaces by using a preset mask to enhance the consistency of the generated image in each frequency domain. The implementation method is as follows:

[0105]

[0106] in, Represents the conditional probability distribution p θ (x i All reconstructed images sampled from |z) The expected value of and They represent the real image and the reconstructed image respectively, the subscript h represents the image that has passed through a high-pass filter, and the subscript l represents the image that has passed through a low-pass filter.

[0107] S502. Optimize the generated image through multi-domain perception regularization and combining the spatial information of the two domains to ensure a balance between local details and global features of the reconstructed image.

[0108] S503. A balance is maintained between consistency and multi-domain awareness through a dynamic trade-off factor λ, thereby achieving high-quality generation and detail optimization of the synthesized image.

[0109] As a preferred embodiment of the multi-domain perceptual contrast-enhanced computed tomography image synthesis method of the present invention, wherein:

[0110] As a preferred embodiment of the multi-domain perceptual contrast-enhanced computed tomography image synthesis method of the present invention, the complete optimization objective Q in step S503 satisfies:

[0111]

[0112] in, represents the overall optimization objective, including reconstruction loss and multi-domain aware regularization loss; Reconstruction loss measures the difference between the model's reconstructed image and the original image; λ represents the trade-off coefficient, which controls the balance between the reconstruction loss and the multi-domain-aware regularization loss, and its value is 1.5.

[0113] like Figure 3 As shown, another embodiment of the present invention provides a multi-domain perception contrast-enhanced computed tomography (CECT) image synthesis system, comprising:

[0114] The data acquisition and preprocessing module acquires the pancreatitis medical image dataset through medical image data acquisition and preprocessing, and divides it into training set, validation set and test set;

[0115] The image compression and reconstruction module uses a 3D autoencoder to compress and reconstruct the image to obtain a latent representation;

[0116] a denoising diffusion generation module, which constructs a denoising diffusion probability model to generate the distribution of the latent representation;

[0117] The conditional generation module optimizes specific targets by encoding conditional codes to generate synthetic images with high consistency with actual CECT images;

[0118] Multi-domain perception regularization module,designs multi-domain perception regularization to ensure the consistency of the,generated synthetic images in different frequency spaces.

[0119] Optionally, the data acquisition and preprocessing module includes:

[0120] In the data acquisition submodule, the system collects paired NCCT (non-contrast-enhanced CT) and CECT (contrast-enhanced CT) image data from multiple clinical data sources. This data is acquired using a standard CT scanner, such as the Siemens Definition AS 40 scanner. CT scanning parameters are set to 120 kV and 303 mA to ensure scan quality.

[0121] In the data preprocessing submodule, the system standardizes the image data, resizes it to 128×128×16, and normalizes the pixel values ​​to the range of [0,255] so that subsequent model training can be processed uniformly.

[0122] The data partitioning submodule divides the collected data set into a training set (80%), a validation set (10%), and a test set (10%) according to a certain ratio to ensure the reliability and generalization ability of the model.

[0123] Optionally, the image compression and reconstruction module includes:

[0124] Encoding submodule: By constructing a 3D autoencoder, the high-dimensional spatial information of the CECT image is encoded into a low-dimensional latent representation. The encoding process extracts global and local features of the image, reduces redundant data, and compresses image information.

[0125] Reconstruction submodule: The latent representation is reconstructed through the decoder to generate a reconstructed image that is highly similar to the original CECT image. This process ensures the quality of the reconstructed image by learning the feature distribution of the CECT image.

[0126] Optimization submodule: To improve reconstruction accuracy, the system adopts a consistency learning mechanism. By optimizing the potential representation to match the real data distribution and introducing a patch-based inverse regularization mechanism, the system enhances the recognition of pancreatic regional details and ensures that the reconstructed image has high consistency in both details and global information.

[0127] Optionally, the denoising diffusion generation module includes:

[0128] Noise introduction submodule: During the training process of the diffusion model, Gaussian noise is gradually introduced into the original image to convert it into noisy data at different stages.

[0129] Noise prediction submodule: Using the Markov chain model, the system gradually predicts the noise distribution at different stages and learns how to denoise at each step, gradually approaching a clean image.

[0130] Conditional Encoding Submodule: Through the conditional extractor, the NCCT image is encoded into a conditional embedding and combined with the latent variables in the diffusion process to guide the system to generate CECT images with specific medical characteristics. This process generates latent representations through joint optimization, ensuring that the synthesized image reflects the real image characteristics in both global structure and details.

[0131] Optionally, the condition generation module includes:

[0132] Conditional coding submodule: This submodule generates a latent conditional code (zc) by inheriting the encoder part from the encoder, which is used to guide the subsequent generation process and reduce redundant calculations.

[0133] Noise removal submodule: Based on the latent conditional code, the noise in the image is gradually removed through the 3D U-Net network structure to generate clean and high-quality CECT images.

[0134] Efficiency Optimization Submodule: To improve generation efficiency, the system avoids additional training of the DDPM model, accelerating the image generation process by reducing redundant computations. This approach improves the overall model's operational efficiency, enabling rapid generation of high-quality images in clinical applications.

[0135] Optionally, the multi-domain-aware regularization module includes:

[0136] Frequency Domain Mapping Submodule: This module maps the generated CECT images to different frequency spaces using a preset mask to enhance their multi-domain information perception capabilities. This mapping process ensures that the image maintains consistency in both high-frequency and low-frequency information.

[0137] Detail optimization submodule: Combining the spatial information of the dual domains, it optimizes the details of the generated image to ensure its balance between local structure and global features, and improve the clarity and contrast of the image.

[0138] Trade-off control submodule: This module uses a dynamic trade-off factor λ to regulate the balance between consistency and multi-domain awareness to achieve optimal fusion of information from different domains, thereby achieving ideal results in terms of details and overall perception. Ultimately, by optimizing the objective function Q, the system can generate high-quality synthetic images. The optimization objective Q satisfies:

[0139]

[0140] in, represents the overall optimization objective, including reconstruction loss and multi-domain aware regularization loss; Reconstruction loss measures the difference between the model's reconstructed image and the original image; λ represents the trade-off coefficient, which controls the balance between the reconstruction loss and the multi-domain-aware regularization loss, and its value is 1.5.

[0141] The present invention provides a multi-domain-aware contrast-enhanced computed tomography image synthesis method with significant technical innovation and practicality. By adopting a 3D autoencoder and a denoising diffusion probability model (DDPM), the method effectively achieves the automated synthesis of non-contrast-enhanced to high-quality contrast-enhanced images. Multi-domain-aware regularization technology enhances image detail and texture consistency across different frequency bands, significantly improving the quality of the synthesized image. In addition, the present invention optimizes computational efficiency, reduces manual intervention and processing time, and provides a fast and accurate technical solution for medical image processing, with important clinical application value.

[0142] The medical image synthesis system in the embodiment of the present invention may be a device, or may be a chip, an integrated circuit, etc. The medical image synthesis system may be an Android, iOS or other operating system, which is not specifically limited in the embodiment of the present application.

[0143] like Figure 4 As shown, another embodiment of the present invention provides an electronic device, the structural block diagram of which is as follows Figure 4 As shown, it includes a processor, a memory, an internal bus, and a program or instruction stored in the memory and capable of running on the processor. When the program or instruction is executed by the processor, the various processes of the above-mentioned image synthesis method embodiment are implemented. In addition, it may also include other required hardware such as a network interface, etc.

[0144] An embodiment of the present application further provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned medical synthesis method embodiment is implemented.

[0145] The electronic device may be a computer chip or physical implementation, or a product with a certain function. A typical implementation device is a computer, such as a personal computer, smartphone, tablet computer, wearable device, or any combination of devices. The processor is a processor of the electronic device, and the readable storage medium includes a computer-readable storage medium, such as a computer read-only memory, random access memory, or optical disk.

[0146] The above description is only a preferred embodiment of the present invention and does not limit the patent scope of the present invention. All equivalent structural transformations made by using the contents of the present invention specification under the inventive concept of the present invention, or direct / indirect application in other related technical fields are included in the patent protection scope of the present invention.

Claims

1. A method for synthesizing multi-domain perceptual contrast-enhanced computed tomography images, characterized in that: The steps include: S1. Obtain a pancreatitis medical image dataset through medical image data acquisition and preprocessing, and divide it into a training set, a validation set, and a test set; S2. Compress and reconstruct the image using a 3D autoencoder to obtain a latent representation; S3: Construct a denoising diffusion probability model to generate the distribution of the potential representation; the step S3 specifically includes the following steps: S301, constructing a denoising diffusion probability model, converting the original data into noisy data by gradually introducing Gaussian noise, and achieving denoising by predicting the noise distribution; S302, the denoising diffusion probability model gradually adds Gaussian noise to the original data by establishing a Markov chain to learn the distribution of the noise; S303, encode the NCCT image into conditional embedding through the conditional extractor, using Generated latent representation and decoder Conduct joint optimization; S304, reconstructing a high-quality CECT image through an inverse diffusion process and decoding the inferred latent representation into an image output; S4, optimizing specific targets by encoding conditional codes to generate synthetic images with high consistency with actual CECT images; S5. Design multi-domain perception regularization to ensure the consistency of the generated synthetic image in different frequency spaces. The step S5 specifically includes the following steps: S501, mapping the synthesized image to different frequency spaces by using a preset mask to enhance the consistency of the generated image in each frequency domain; S502. Optimize the generated image through multi-domain perception regularization and combining the spatial information of the two domains to ensure a balance between local details and global features of the reconstructed image. S503. A balance is maintained between consistency and multi-domain awareness through a dynamic trade-off factor λ, thereby achieving high-quality generation and detail optimization of the synthesized image.

2. The multi-domain perceptual contrast-enhanced computed tomography image synthesis method according to claim 1, characterized in that: The step S1 specifically includes the following steps: S101, collect pancreatic NCCT-CECT paired data; S102, randomly dividing the paired data into a training set, a validation set, and a test set; S103: Standardize the data set.

3. The multi-domain perceptual contrast-enhanced computed tomography image synthesis method according to claim 1, characterized in that: The step S2 specifically includes the following steps: S201, constructing a three-dimensional autoencoder to encode the voxel space of the CECT image into a latent representation; S202, CECT image Through the encoder (z| ) is compressed into a latent variable, and the latent representation z is obtained by sampling; S203, use decoder (z| ) reconstruct the latent representation z to generate a reconstructed CECT image and optimize the latent representation through reconstruction consistency learning to make it close to the data distribution; S204. Introduce a patch-based inverse normalization mechanism to enhance the recognition of details of the pancreatitis area and improve the local contours and textures of the generated image.

4. The multi-domain perceptual contrast-enhanced computed tomography image synthesis method according to claim 1, characterized in that: The step S4 specifically includes the following steps: S401, by inheriting the encoder from the encoder , obtain the potential condition code for condition generation and reduce redundant calculation; S402, passing the potential conditional code zc as input to the 3D U-Net backbone network to guide the denoising diffusion probability model to perform denoising generation; S403. During the condition extraction process, avoid additional training of the DDPM model to improve generation efficiency.

5. The multi-domain perceptual contrast-enhanced computed tomography image synthesis method according to claim 1, characterized in that: Said step S3 further includes a conditional extractor for encoding the non-contrast enhanced computed tomography image into a conditional embedding to guide the DDPM to generate a specific CECT image.

6. A multi-domain perception contrast-enhanced computed tomography image synthesis system, used to implement the multi-domain perception contrast-enhanced computed tomography image synthesis method according to any one of claims 1 to 5, characterized in that: include: The data acquisition and preprocessing module acquires the pancreatitis medical image dataset through medical image data acquisition and preprocessing, and divides it into training set, validation set and test set; The image compression and reconstruction module uses a 3D autoencoder to compress and reconstruct the image to obtain a latent representation; a denoising diffusion generation module, which constructs a denoising diffusion probability model to generate the distribution of the latent representation; The conditional generation module optimizes specific targets by encoding conditional codes to generate synthetic images with high consistency with actual CECT images; Multi-domain perception regularization module,designs multi-domain perception regularization to ensure the consistency of the,generated synthetic images in different frequency spaces.

7. An electronic device, characterized in that: include: A processor, a memory, an internal bus, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the multi-domain perception contrast-enhanced computed tomography image synthesis method according to any one of claims 1 to 5.

8. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, which, when executed by a processor, implements the multi-domain perception contrast-enhanced computed tomography image synthesis method described in any one of claims 1 to 5.

Citation Information

Patent Citations

  • Enhanced CT image reconstruction method

    CN113222852A

  • Image processing method and device and electronic equipment

    CN114565650A