Image generation method based on a conditional capsule generative adversarial network

An image generation and network technology, applied in the field of image processing, can solve the problems of reducing the scale of network parameters and not considering the important spatial levels of simple and complex objects.

Active Publication Date: 2019-04-05
JINAN UNIVERSITY
View PDF4 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Traditional GAN ​​usually uses a convolutional neural network to build an adversarial structure. This structure not only completes the detection of important features in image pixels through techniques such as sparse weights, parameter sharing, and pooling, but also greatly reduces network pa

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image generation method based on a conditional capsule generative adversarial network
  • Image generation method based on a conditional capsule generative adversarial network
  • Image generation method based on a conditional capsule generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0057] as attached figure 1 As shown, this embodiment discloses an image generation method based on conditional capsule generative adversarial networks. In this example, the MNIST handwriting data set will be used as experimental data, and the generation goal is to generate handwritten digits. Among them, the generative confrontation network includes a generator and a discriminator. Generator part: The generator receives random noise and conditional vectors as input data, and outputs the generated image; then discriminator part: The discriminator receives generated images, real images (MINST dataset images) and conditional vectors as input data, and outputs generated The similarity between the image and the real image; by training this model structure, the model parameters of the generator are finally retained, and the handwritten digits can be generated by using the model parameters of the generator. The method for generating includes the following steps:

[0058] The exper...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image generation method based on a conditional capsule generative adversarial network. The image generation method comprises the following steps: collecting image data and preprocessing an image; Extracting a condition vector; Acquiring random noise; Designing a neural network as a generator to map the random noise and the condition vector into a generated picture; Designing another neural network as a discriminator to receive the generated picture, the real picture and the condition vector to obtain a loss value; When the adversarial network is trained, adjusting the weight of the generator network according to the loss value minimization objective function; And after the training is completed, adjusting the weight of the generator network to be optimal, abandoning the discriminator at the moment, and reserving the generator model as the optimal neural network of the generated image. The discriminator structure is designed by using the capsule neural network, the network can effectively avoid the gradient disappearance problem in combination with the advantages of the existing WGAN and CGAN, and meanwhile, the generated sample is high in quality and hascertain advantages compared with an algorithm in the prior art.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to an image generation method based on a conditional capsule generation confrontation network. Background technique [0002] The generative modeling method based on the differentiable generator network is currently the most popular research field, but due to the complexity of the real sample distribution, there are many problems in the stability and generation efficiency of the GAN generative model. Therefore, the industry urgently needs generation algorithms that can provide stable and high-quality samples. [0003] GAN theory is based on a game-theoretic scenario where the generator network learns to transform from some simple input distribution (usually the standard multivariate normal or uniform distribution) to a distribution in image space by competing with an opponent—that is, more and more The more realistic samples; as an adversary, the discriminator network tries...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T11/60G06N3/04
CPCG06T11/60G06N3/045
Inventor 孔锐黄钢
Owner JINAN UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products