场景文字处理方法、装置、设备及产品

By using a multimodal signal feature encoding and a diffusion model superposition reference position encoding mechanism, the problem of inaccurate text spatial layout and style control in existing technologies is solved, achieving high-quality scene text processing, eliminating ghosting artifacts, and ensuring background consistency.

CN122156390BActive Publication Date: 2026-07-17PEKING UNIV SHENZHEN GRADUATE SCHOOL

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
PEKING UNIV SHENZHEN GRADUATE SCHOOL
Filing Date
2026-05-07
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing scene text editing technologies struggle to achieve precise joint control over text spatial layout and visual typography style. Furthermore, scene text replacement tasks often result in ghosting artifacts or damage to background textures, making it difficult to obtain high-quality processing results.

Method used

By acquiring multimodal control signals, feature encoding is performed using a preset variational autoencoder and a visual language model. Combined with the superposition reference position encoding mechanism and the region adaptive suppression mechanism in the preset diffusion model, decoupled control and efficient fusion processing of text spatial layout and style are achieved.

Benefits of technology

It achieves high-quality, natural scene text processing results, eliminates ghosting artifacts, ensures the consistency of background texture, and completes complex text editing tasks in one go.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122156390B_ABST
    Figure CN122156390B_ABST
Patent Text Reader

Abstract

本申请公开了一种场景文字处理方法、装置、设备及产品,涉及数据处理技术领域。所述方法包括:获取待编辑文字图像的多模态控制信号,多模态控制信号包括源图像、擦除掩码图、结构引导图、风格参考图与目标编辑指令;基于预设变分自编码器与视觉语言模型,对多模态控制信号进行特征编码,得到对应的混合潜在特征;基于预设扩散模型,对混合潜在特征进行融合处理,生成编辑后的目标文字图像,其中,预设扩散模型包括若干个串联的扩散模型模块,扩散模型模块包括叠加参考位置编码机制和区域自适应抑制机制。本申请通过上述方案实现解耦待编辑文字图像的空间布局控制与风格控制,可以一次性输出高质量、自然的场景文字处理结果。
Need to check novelty before this filing date? Find Prior Art