The invention relates to the technical field of voice
semantics, can be applied to business scenes of financial science and technology,
medical health, poster design and the like, and discloses a visual sense generation method and device based on
semantic association modeling, equipment and a medium. Generating a demand text containing theme and style parameters; semantic features in the demand text are extracted,
semantic association weights are constructed, and element
layout coordinates are optimized in combination with
spatial distribution constraints; and encoding the
layout information into a control matrix, fusing the control matrix with the initial
noise, adjusting a
noise reduction process through an encoding and decoding network, and generating target visual content highly matched with the semantic meaning of the user instruction. According to the method, the
layout optimization function is constructed, the
diffusion model is guided to focus the semantic salient region in space,
language model output and the visual
generation process are closely combined, structured response and
space mapping of user semantic requirements are achieved, and the expression consistency and personalized
adaptation capacity of visual
content generation are improved.