Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

CycleGAN-based image training network structure ArcGAN and method

A technology of network structure and network architecture, applied in the field of deep learning and image processing, can solve problems such as poor application of deep network structure, style migration of color architectural drawings, inability to achieve stylization, etc., to achieve excellent visual effects, The effect of rich and flexible colors and improved feature utilization

Inactive Publication Date: 2019-09-10
TIANJIN UNIV
View PDF1 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0020] The purpose of the present invention is to overcome the deficiencies in the prior art, and provide a network structure ArcGAN and method based on CycleGAN image training. The style migration of buildings faces three problems: the existing tools for generating building drawings cannot achieve style The limited available training set and the existing deep network structure cannot be well applied to the data set of the present invention to produce ideal results
The invention can solve the problem of style migration from line architectural drawings to colored architectural drawings of different styles

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • CycleGAN-based image training network structure ArcGAN and method
  • CycleGAN-based image training network structure ArcGAN and method
  • CycleGAN-based image training network structure ArcGAN and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The present invention will be described in further detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0042] The CycleGAN network architecture consists of two convolutional neural networks (CNNs), a generator G that is trained to produce outputs that fool the discriminator. The other is the discriminator D, which classifies whether an image is from a real object or a synthetic image. In order to adapt to the particularity of the building model, the network structure ArcGAN of the present invention is mainly composed of a generator and a double discriminator, and the double discriminator includes a rough discriminator (CD) and a fine discriminator (FD). For details, see figure 1 .

[0043] 1. About the generator

[0044] The generator is mainly responsible for generating a picture ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a CycleGAN-based image training network structure ArcGAN and a method, the network structure ArcGAN is composed of a generator and double discriminators, and the double discriminators comprise a rough discriminator and a fine discriminator, wherein the encoder comprises an input layer and three down-sampling convolution layers, and each down-sampling convolution layer is connected with two flat convolution layers with the same structure as the input layer; a converter comprises five dense convolution blocks without pooling layers, each dense convolution block comprisesfive dense convolution layers with bottleneck layers, and a compression layer is arranged between the blocks, wherein the decoder comprises three upsampling deconvolution layers and an output layer, and each upsampling deconvolution layer is connected with two flat convolution layers with the same structure as the input layer; and each layer of downsampling in the encoder and the upsampling in thedecoder corresponding to the layer of downsampling are in replicated connection. A rough discriminator is used for processing high-level visual information and consists of six down-sampling layers and an output layer; the calculation loss of the fine discriminator is combined with the calculation loss of the rough discriminator, and the fine discriminator and the rough discriminator jointly complete confrontation consistency training.

Description

technical field [0001] The present invention mainly relates to deep learning and image processing field, relate in particular to a kind of network structure ArcGAN based on the picture training of CycleGAN and the method for line building automatic coloring. Background technique [0002] Since the mid-1990s, there has been a large body of research exploring how to automatically transform images into synthetic artwork with a particular style. Pioneering work by Gatys et al. demonstrates the power of convolutional neural networks (CNNs) to create artistic imagery by separating and recombining image content and style [2] . The process of using CNN to render content images with different styles is called Neural Style Transfer (NST). Since then, NST has become a hot topic in academia and industry, it is receiving more and more attention, and various methods to improve or extend the original NST algorithm have been proposed. [0003] Deep Neural Networks are the most used, most...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/08G06N3/04
CPCG06N3/082G06N3/044G06N3/045
Inventor 蒋涵陶文源孙倩
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products