A data construction method for stylized visual text image generation

Abstract

The application discloses a data construction method for style visual text image generation, comprising data acquisition; image preprocessing; inputting the visual text image into a multimodal large model to generate a text description; inputting the visual text image into a text recognition system and an image segmentation model to generate a text segmentation mask; inputting the text description and the visual text image into a visual semantic similarity model to verify semantic consistency; inputting the visual text image and the text segmentation mask into the multimodal large model to evaluate coverage accuracy; combining the text description, the text segmentation mask and the visual text image into a triple data; through constructing triple structure data containing a stylized text description, a visual text image and a pure text content image, the model effectively learns the corresponding relationship between the font style and the text content, and the data quality in the style visual text image generation task is improved.

Images