Unlock instant, AI-driven research and patent intelligence for your innovation.

Non-paired image generation method and system, server and storage medium

An image generation and image technology, applied in the image field, can solve the problem of poor interference suppression ability of false images, etc., and achieve the effect of enhancing differentiation and improving suppression ability

Inactive Publication Date: 2019-08-27
SHANGHAI JILIAN NETWORK TECH CO LTD
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a non-paired image generation method, system, server, and storage medium to solve the technical problem of poor ability to suppress false image interference in the process of generating images using existing non-paired image generation methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Non-paired image generation method and system, server and storage medium
  • Non-paired image generation method and system, server and storage medium
  • Non-paired image generation method and system, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] figure 1 It is a flow chart of a non-paired image generation method provided by Embodiment 1 of the present invention. This embodiment is applicable to situations where images need to be generated quickly and accurately. The method can be executed by a non-paired image generation system, which can be configured on a server superior.

[0026] Such as figure 1 As shown, the non-paired image generation method provided in the embodiment of the present invention may include:

[0027] S101. Acquire an original image, and perform instance segmentation on the original image to obtain an instance segmentation image.

[0028] Among them, the original picture is the image to be input to the image generation model. For the obtained original image, the Mask R-CNN (Mask Region-based Convolutional Neural Network) method can be used for instance segmentation. What needs to be explained here is that the instance segmentation of the original image can also use any instance segmentatio...

Embodiment 2

[0042] figure 2 It is a schematic flowchart of a method for training an image generation model provided by Embodiment 2 of the present invention. This embodiment is optimized on the basis of the above embodiments, adding an improved composition and training process of the generative confrontation network. Such as figure 2 As shown, the image generation model training method provided in the embodiment of the present invention may include:

[0043] S201. Perform instance segmentation on the training sample image to obtain an instance segmentation image based on the training sample.

[0044] S202. Fusion the training sample image and the obtained instance segmentation image.

[0045] When training the image generation model, perform instance segmentation operation and image fusion processing on the input training sample image in advance according to S201-S202 respectively, to obtain the fused training sample, wherein, the instance segmentation image based on the training sam...

Embodiment 3

[0064] image 3 It is a schematic structural diagram of an unpaired image generation system provided by Embodiment 3 of the present invention. Such as image 3 As shown, the system includes:

[0065] An instance segmentation module 301, configured to acquire an original image, and perform instance segmentation on the original image to obtain an instance segmentation image;

[0066] An instance information fusion module 302, configured to perform image fusion on the original image and the instance segmentation image;

[0067] The image generation module 303 is used to input the fused image data as an input value into the image generation model based on the improved generative confrontation network training, and obtain the target image according to the output of the image generation model, and the improved generation Adversarial networks are generative adversarial networks incorporating instance-dependent loss functions.

[0068] In the embodiment of the present invention, t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a non-paired image generation method and system, a server and a storage medium, and the method comprises the steps: obtaining an original image, carrying outthe instance segmentation of the original image, and obtaining an instance segmented image; carrying out image fusion on the original image and the instance segmentation image; and inputting the fusedimage data as an input value into an image generation model trained on the basis of an improved generative adversarial network, and obtaining a target image according to the output of the image generation model, the improved generative adversarial network being a generative adversarial network fused with an instance-related loss function. According to the embodiment of the invention, instance supervision information is introduced to supervise the image generation process; and an instance related loss function is introduced into the generative adversarial network, so that the distinction of aninstance / non-instance region image generation process is enhanced during model training, and it is ensured that the trained image generation model can effectively improve the inhibition capability onnon-instance region false image interference.

Description

technical field [0001] The embodiments of the present invention relate to the field of image technology, and in particular, to a method, system, server, and storage medium for generating an unpaired image. Background technique [0002] With the proposal, development and application of Generative Adversarial Networks (GAN), the technology in the field of automatic image generation has developed rapidly in recent years, many methods represented by pix2pix, CycleGAN, DualGAN, DiscoGAN, etc. A better image generation effect. From the perspective of pairing constraints of training samples, GAN-based image generation methods can be generally divided into paired GAN image generation methods (such as pix2pix, etc.) and non-paired GAN image generation methods (such as CycleGAN, DualGAN, DiscoGAN, etc.). [0003] Among these methods, the paired GAN image generation method can obtain better image generation results because it can introduce supervisory information to guide the generati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T7/10
CPCG06T7/10G06T2207/20221G06T2207/20084G06T2207/20081G06T5/00
Inventor 王晓平董慧智姜育刚
Owner SHANGHAI JILIAN NETWORK TECH CO LTD