Vision generation method and device based on semantic association modeling, equipment and medium

By constructing a dialogue data set guided by interactive requirements and a low-rank adaptation matrix fine-tuning pre-trained language model, the method of generating visual content solves the consistency and personalized adaptation problems of visual content generation in the prior art, and realizes efficient personalized visual content generation in the fields of financial technology, medical health and poster design.

CN120542428APending Publication Date: 2025-08-26SHENZHEN PINGAN COMM TECH CO LTD
0 Cites 27 Cited by

Patent Information

Application Number
CN202510620689.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-05-14
Publication Date
2025-08-26

AI Technical Summary

Technical Problem

The existing visual content generation methods are difficult to meet the structured semantic expression, personalized style control and spatial layout optimization, and cannot accurately understand user input and generate consistent visual content. Especially in the fields of financial technology, medical health and poster design, there are problems such as loose content generation, misalignment of elements, and style fragmentation.

Method used

Construct an interactive requirements-guided dialogue dataset, generate perturbation training samples through semantic perturbation operations, fine-tune the pre-trained language model for low-rank adaptation matrix, extract element semantic features and determine association weights, generate layout optimization functions in combination with spatial distribution constraints, and iteratively generate target visual content.

Benefits of technology

It realizes structured response and spatial mapping to user semantic needs, improves the expression consistency and personalized adaptability of visual content generation, and is suitable for business scenarios such as financial technology, medical health and poster design.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to the technical field of voice semantics, can be applied to business scenes of financial science and technology, medical health, poster design and the like, and discloses a visual sense generation method and device based on semantic association modeling, equipment and a medium. Generating a demand text containing theme and style parameters; semantic features in the demand text are extracted, semantic association weights are constructed, and element layout coordinates are optimized in combination with spatial distribution constraints; and encoding the layout information into a control matrix, fusing the control matrix with the initial noise, adjusting a noise reduction process through an encoding and decoding network, and generating target visual content highly matched with the semantic meaning of the user instruction. According to the method, the layout optimization function is constructed, the diffusion model is guided to focus the semantic salient region in space, language model output and the visual generation process are closely combined, structured response and space mapping of user semantic requirements are achieved, and the expression consistency and personalized adaptation capacity of visual content generation are improved.
Need to check novelty before this filing date? Find Prior Art