Instance level image translation technology based on deep attention generative adversarial network

An instance-level, image-based technology, applied in the field of image translation, can solve problems such as the inability to learn instance-level correspondence

Inactive Publication Date: 2018-09-07
SHENZHEN WEITESHI TECH
View PDF2 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problems that existing methods cannot learn instance-level correspondence, the purpose of the present invention is to provide an instance-level image translation technology based on deep attention generative adversarial networks. First, a deep attention encoder, a generator and two The discriminator builds a deep attention generative adv...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Instance level image translation technology based on deep attention generative adversarial network
  • Instance level image translation technology based on deep attention generative adversarial network
  • Instance level image translation technology based on deep attention generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present invention will be further described in detail below in conjunction with the drawings and specific embodiments.

[0039] figure 1 It is a system structure diagram of an instance-level image translation technology based on deep attention generative adversarial network of the present invention. It mainly includes network modules, instance-level image translation, set-level image translation and complete objective functions.

[0040] Wherein, the network module, deep attention generation confrontation network includes four network modules: deep attention encoder, generator, discriminator D1 and discriminator D2.

[0041] Among them, the instance-level image translation uses a consistency loss function:

[0042]

[0043] Alternatively, a symmetric loss function is used:

[0044]

[0045] The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention puts forward an instance level image translation technology based on a deep attention generative adversarial network. The main content of the technology comprises a network module, an instance level image translation, collection level image translation and an integral target function. The technology comprises the following steps that: firstly, using a deep attention coder, a generator and two descriminators to construct the deep attention generative adversarial network; then, according to a given input image, adopting a positioning function to predict the position of the attention area and calculate an attention mask; then, utilizing the generator to receive a structured expression from a latent space, and generating a translation sample; and finally, using the descriminatorsto discriminate the translated sample from a real image. The invention puts forward the instance level image translation technology based on the deep attention generative adversarial network, can besimultaneously applied to instance level and collection level constraints, solves a great quantity of practical tasks and can obtain an effect of better performance.

Description

technical field [0001] The present invention relates to the field of image translation, in particular to an instance-level image translation technology based on deep attention generative confrontation network. Background technique [0002] Image translation is an application of machine translation. Users can convert text information, color information, icon information, etc. contained in an image into any form of expression. The rapid development of mobile electronic devices makes image translation technology widely used in all aspects of people's lives. For example, this technology can be used to translate the characters of other countries into the characters of one's own country, which is conducive to the transmission of information and cultural exchanges. For another example, image translation technology can be used to translate advertisements describing the nature of products that users see in shopping malls into intuitive pictures, and it can also automatically search ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/32G06K9/62G06N3/08
CPCG06N3/088G06V10/25G06F18/2155
Inventor 夏春秋
Owner SHENZHEN WEITESHI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products