Image attribute editing method based on structured scene and text description

Abstract

The invention discloses an image attribute editing method based on a structured scene and text description, and provides an implementation scheme of first structuring a picture and then editing the picture for the first time, the picture modification efficiency and accuracy can be effectively improved through understanding and decoupling of a picture scene, and a semantic irrelevant part is prevented from being excessively modified. According to the method, a multi-scale feature fusion mechanism more suitable for the task is adopted on a network structure, and return segmentation loss, hierarchical semantic matching perception, adversarial loss of an image quality discriminator, image consistency loss and image-text similarity loss are combined on a loss function, so that the final sum performance of the whole method is ensured; the problems that an existing image attribute editing method is unstable in operation, difficult to expand and large in resource overhead are solved.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to the design of an image attribute editing method based on structured scenes and text descriptions. Background technique [0002] With the development of deep neural networks, technologies such as image classification, image segmentation, and image object detection have been relatively mature and widely used. However, due to the high quality and high resolution requirements of image generation related technologies, there are often problems such as long model training time, high overhead, and unstable training, and have not been widely applied. [0003] Among them, the text-guided image editing task is a task with strong functionality and broad application prospects. It uses the text description given by the user to edit the input image, keeps the overall style unchanged, and effectively performs semantic-related attributes. modification to generate the corresp...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to address the above-mentioned deficiencies in the prior art, and propose a method for editing image attributes based on structured scenes and text descriptions, and adopt a network structure, fusion module and loss function that are more in line with the task to solve the existing problems. In image attribute editing methods, the problems of complex and redundant network structure, long training time and excessive modification of semantically irrelevant parts

Images