Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Generative adversarial network for synthesizing medical images

A medical image and network technology, applied in the medical image field of computer vision, can solve problems such as limiting the development of deep learning and scarcity of high-quality data sets, and achieve the effects of alleviating mode collapse, improving training efficiency, and balancing the learning rate.

Active Publication Date: 2021-06-22
SOUTHWEST JIAOTONG UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the other hand, due to the protection of patient privacy, public high-quality data sets in the medical field are very scarce, which limits the development of deep learning in the medical field.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Generative adversarial network for synthesizing medical images
  • Generative adversarial network for synthesizing medical images
  • Generative adversarial network for synthesizing medical images

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0062] Step 1: Download the medical image dataset, and extract a total of 1556 PD images according to the label documents. For images that do not meet the resolution, the cubic interpolation method is used for upsampling, and then 1556 images are saved in npy format.

[0063] Step 2: Construct a progressive network. Initially, only low-resolution image generation can be learned. As the training progresses, the number of layers of the network is continuously deepened, and then to learn higher-resolution image generation. Finally, GANs are continuously updated to be able to Learned the generation of 512*512 resolution medical images.

[0064] In the convolution process of the experiment, convolution plus sampling is used to replace the more commonly used deconvolution in generating images. The purpose of using convolution plus sampling is to avoid the checkerboard when the convolution kernel size cannot be divisible by the step size. Effect (checkboard), especially when we grad...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a generative adversarial network for synthesizing medical images. The topological structure of the generator is that the generator has eight levels, and the levels of the levels are logarithms, with 2 as the bottom, of the resolution of images learned by the levels; the resolution of the image of the low-level hierarchical learning is doubled and smoothly transited to the resolution of the image of the high-level hierarchical learning; the feature map of the convolution block is a feature map with self-attention. The topological structure of the discriminator is opposite to that of the generator, and the resolution of the image of high-level hierarchical learning is converted into the resolution of the image of low-level hierarchical learning in a half-smooth transition manner; the lowest level of the discriminator further comprises a batch standard deviation; the generator and the discriminator use a loss function of the WGAN-GP; the weight is initialized by using standard normal distribution, and the weight is scaled in an operation stage. Compared with a large-resolution GAN network generated by a LapGAN, a StackGAN and the like, most iteration in the training process is completed at a low resolution, and the generation speed is greatly increased on the premise that the quality of the synthesized picture is guaranteed.

Description

technical field [0001] The invention relates to the field of medical images of computer vision, in particular to a generative confrontation network for synthesizing medical images. Background technique [0002] With the improvement of computing power and the rapid increase of data volume in various industries, artificial intelligence has achieved rapid development. In 2014, Hinton's doctoral student, Lan Goodfellow, proposed the GAN network (Generative Adversarial Networks Generative Adversarial Networks), and then the improvement of GAN has been studied in full swing in the academic community, and there is still a lot of room for development. [0003] With the continuous research on GAN, various fields try to combine GAN with work in the field. Since 2017, the application of GAN in the field of medical images has risen sharply, among which image synthesis, denoising, reconstruction, segmentation, detection and classification have become the main directions of GAN in the fi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06T5/50G06K9/62
CPCG06T3/4023G06T3/4053G06T5/50G06T2207/20221G06F18/214
Inventor 张晓博张哲浩
Owner SOUTHWEST JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products