感知多重特征的双分支网络实现针对真实世界文本图像的超分辨率的方法

By constructing a dual-branch network that perceives multiple features and integrates visual and textual features, the problem of insufficient feature extraction in real-world text image super-resolution is solved, achieving more efficient text recognition results.

CN116703725BActive Publication Date: 2026-07-17EAST CHINA UNIV OF SCI & TECH

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
EAST CHINA UNIV OF SCI & TECH
Filing Date
2023-06-01
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing text image super-resolution methods struggle to fully extract important features when processing low-resolution text images in the real world, resulting in low recognition rates. Furthermore, conventional methods fail to effectively simulate complex degradation scenarios in the real world.

Method used

A dual-branch network for perceiving multiple features is constructed, including a super-resolution branch and a text recognition branch. Visual and text features are fused through an image-image fusion module, a frequency-spatial perception module, and a text-image fusion module. Features are learned in the frequency and time domains, and training is performed using image reconstruction loss and text recognition loss.

Benefits of technology

It improves the super-resolution reconstruction effect of real-world text images, enhances the perception ability of visual features and text sequence knowledge, and improves the accuracy of text recognition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116703725B_ABST
    Figure CN116703725B_ABST
Patent Text Reader

Abstract

本发明涉及一种感知多重特征的双分支网络实现针对真实世界文本图像的超分辨率重建的方法,其中,该方法包括:采集真实世界文本图像超分辨率的数据集,并对其进行相应的预处理操作;构建超分辨率分支将输入的低分辨率图像重建为清晰的超分辨率图像;构建文本识别分支从低分辨率图像中提取视觉特征和文本特征构建图像‑图像融合模块,进行图像特征进行融合,加强视觉特征;构建频率‑空间感知模块,利用频域分支和时域分支,分别提取频域信息和时域信息;构建文本‑图像融合模块,将文本特征与图形特征进行融合处理;采用图像重建损失和文本识别损失训练、优化双分支网络。本发明相较于基线模型和现有的前沿方法,具有更好的超分辨率重建的效果。
Need to check novelty before this filing date? Find Prior Art