Text and contour-based man-made controllable image synthesis method

A technology of image synthesis and outline, applied in the direction of neural learning methods, editing/combining graphics or text, biological neural network models, etc., can solve the problem that the results cannot better meet human expectations, the color and size of specific information cannot be controlled, and the lack of Issues such as the overall layout of the image, to achieve the effect of promoting the machine to be more intelligent, improving the degree of human controllability, and promoting development

Active Publication Date: 2021-12-14
SOUTHWEAT UNIV OF SCI & TECH
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, if the category label "bird" is artificially input, the image synthesis technology based on the category label can synthesize an image of a bird, but the specific information of the bird (such as the color and size of the bird) is beyond human control
The method of inputting natural language description contains more information, so it can play a better role in human control, but this method lacks the constraints of the overall layout of the image, so that the synthetic results cannot better meet human expectations.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text and contour-based man-made controllable image synthesis method
  • Text and contour-based man-made controllable image synthesis method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to make the purpose, technical solution and advantages of the present invention clearer, the present invention will be further elaborated below in conjunction with the accompanying drawings.

[0020] In this example, see figure 1 and figure 2 As shown, the present invention proposes a kind of artificially controllable image synthesis method based on text and contour, comprising steps:

[0021] Custom synthesis: draw the basic outline and input the basic text information, encode the basic outline and basic text information to obtain their respective feature vectors, combine the basic outline and basic text information together to synthesize the corresponding image;

[0022] Optimization correction: Input the optimized text information, encode the synthesized image and optimized text information to obtain the corresponding feature vector, and then combine the synthesized image and the feature vector of optimized text information to synthesize the optimized imag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a text and contour-based man-made controllable image synthesis method, which comprises the following steps of: customized synthesis: drawing a basic contour and inputting basic text information, and encoding the basic contour and the basic text information to obtain respective feature vectors, combining the feature vectors of the basic contour and the basic text information together to synthesize a corresponding image; and optimization correction: inputting optimized text information, coding the synthesized image and the optimized text information to obtain corresponding feature vectors, and then combining the feature vectors of the synthesized image and the optimized text information together to synthesize and obtain an optimized image. According to the method, the controllability of image synthesis can be improved, and a high-quality image result can be synthesized under the condition of completely conforming to human subjective willingness.

Description

technical field [0001] The invention belongs to the technical field of image synthesis, in particular to an artificially controllable image synthesis method based on text and outlines. Background technique [0002] Controllable image synthesis is one of the most important technical problems of artificial intelligence in the field of computer vision. Compared with text and voice information, images contain richer content, which makes it difficult for machines to complete high-quality image synthesis. The rapid development of artificial intelligence in recent years has made a major breakthrough in image synthesis technology. At present, machines have been able to synthesize subjectively more realistic complex images (such as human faces, album covers, room layouts, etc.). With the advent of the era of artificial intelligence, machines have been given more missions, the most critical of which is to enable machines to understand human subjective thoughts more accurately so as t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T11/60G06N3/04G06N3/08
CPCG06T11/60G06N3/08G06N3/044G06N3/045Y02T10/40
Inventor 俞文心张志强甘泽军龚梦石文茄汁龚俊
Owner SOUTHWEAT UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products