Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Generative Adversarial Network for Synthesizing Medical Images

A medical image and network technology, applied in the medical image field of computer vision, can solve problems such as limiting the development of deep learning and scarcity of high-quality data sets, and achieve the effects of alleviating mode collapse, improving training efficiency, and balancing the learning rate.

Active Publication Date: 2022-07-15
SOUTHWEST JIAOTONG UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the other hand, due to the protection of patient privacy, public high-quality data sets in the medical field are very scarce, which limits the development of deep learning in the medical field.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Generative Adversarial Network for Synthesizing Medical Images
  • A Generative Adversarial Network for Synthesizing Medical Images
  • A Generative Adversarial Network for Synthesizing Medical Images

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0061] Step 1: Download the medical image dataset, and extract a total of 1556 PD images according to the label document. For the images that do not meet the resolution, the cubic interpolation method is used for upsampling, and then 1556 images are saved in npy format.

[0062] Step 2: Construct a progressive network. Initially, only low-resolution image generation can be learned. As the training progresses, the number of layers of the network is continuously deepened, and then higher-resolution image generation is learned. Finally, GANs are continuously updated to enable Learn the generation of 512*512 resolution medical images.

[0063] In the convolution process of the experiment, the use of convolution plus sampling replaces the more commonly used deconvolution in the generated image. The purpose of using convolution plus sampling is to avoid the checkerboard when the size of the convolution kernel is not divisible by the step size. Effect (checkboard), especially when w...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a generative confrontation network for synthesizing medical images. The topology of the generator is: with 8 levels, the level of the level is the logarithm of the base 2 of the resolution of the image learned at that level; the resolution of the image learned by the lower level level is doubled and the transition to the high level level learning is smooth The resolution of the image; the feature map of the convolutional block is the feature map with self-attention. The topology of the discriminator is opposite to that of the generator. The resolution of the image learned by the high-level layer is half-smoothly transitioned to the resolution of the image learned by the low-level layer; the lowest level of the discriminator also includes batch standard deviation; the generator and the discriminator Use the loss function of WGAN‑GP; initialize the weights using a standard normal distribution, and scale the weights at runtime. Compared with GAN networks that generate large resolutions such as LapGAN and StackGAN, most of the iterations in the training process of the present invention are completed at low resolutions, which greatly speeds up the generation speed on the premise of ensuring the quality of the synthesized images.

Description

technical field [0001] The invention relates to the medical image field of computer vision, in particular to a generative confrontation network for synthesizing medical images. Background technique [0002] With the improvement of computing power and the sharp increase in the amount of data in various industries, artificial intelligence has achieved rapid development. In 2014, Hinton's doctoral student lan Goodfellow proposed the GAN network (Generative Adversarial Networks), and then the improvement of GAN was in full swing in academia, and there is still a lot of room for development. [0003] With the continuous research on GAN, various fields try to combine GAN with the work in the field. Since 2017, the application of GAN in the field of medical images has risen sharply, in which image synthesis, denoising, reconstruction, segmentation, detection and classification have become the main directions of GAN in the field of medical images. Supervised deep learning is the c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T3/40G06T5/50G06K9/62G06V10/774
CPCG06T3/4023G06T3/4053G06T5/50G06T2207/20221G06F18/214
Inventor 张晓博张哲浩
Owner SOUTHWEST JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products