一种图像上色模型构建方法、图像上色方法、设备及介质

By constructing a grid latent feature and binary mask combined with a color prior prediction module and an alignment loss function, the problems of inaccurate region localization, missing semantic coverage, and color misalignment in text-guided image coloring are solved, and high-fidelity, semantically consistent color image generation is achieved.

CN121999090BActive Publication Date: 2026-07-17NANJING UNIV OF POSTS & TELECOMM
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
NANJING UNIV OF POSTS & TELECOMM
Filing Date
2026-04-09
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies for text-guided image coloring suffer from problems such as inaccurate region positioning, missing semantic coverage, and color overflow and misalignment, making it difficult to generate high-fidelity and semantically consistent color images.

Method used

An image colorization method based on a diffusion model is adopted. By constructing grid latent features and binary masks, combined with a color prior prediction module and a color-object alignment loss function, it achieves accurate pixel-level localization and complete semantic coverage, and eliminates color misalignment interference.

Benefits of technology

It significantly improves the color fidelity and semantic consistency of generated color images, reduces training costs, achieves color completion and enrichment from the full-view perspective, and enhances the practicality of the model.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121999090B_ABST
    Figure CN121999090B_ABST
Patent Text Reader

Abstract

本发明公开了一种图像上色模型构建方法、图像上色方法、设备及介质,方法包括:基于参考灰度图像、目标彩色图像及文本描述生成对应类别描述;构建基础图像生成模型,并以参考灰度图像数据和目标彩色图像数据编码构建网格潜特征与二进制掩码;提取颜色先验表示,结合二进制掩码注入网格潜特征的参考区域,对目标上色区域进行掩码前向加噪及预测,计算基础去噪损失函数;在去噪过程中提取文本描述颜色词汇与对象词汇的交叉注意力图,并通过颜色‑对象对齐损失函数约束权重分布;最终联合优化模型参数,组合得到图像上色模型。本发明能实现精准的像素级区域定位、自动丰富并补全全图语义颜色覆盖,且在训练推理过程中显式消除颜色对象错位干扰。
Need to check novelty before this filing date? Find Prior Art