A lightweight endoscope image restoration method based on teacher-student network knowledge distillation

By constructing a three-stage teacher network and a lightweight student network, and combining a window Transformer and U-Net hybrid model with a supervised attention module, the problems of large number of parameters and high computational complexity in endoscopic image restoration models are solved, and efficient processing of endoscopic image restoration for various degradation types is achieved.

CN122415360APending Publication Date: 2026-07-17SUZHOU ENTROPTONG INTELLIGENT TECHNOLOGY CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
SUZHOU ENTROPTONG INTELLIGENT TECHNOLOGY CO LTD
Filing Date
2026-04-03
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing endoscopic image restoration models have a large number of parameters and high computational complexity, making it difficult to meet real-time processing requirements and to handle multiple degradation types simultaneously.

Method used

We employ a knowledge distillation approach based on teacher-student networks to construct a three-stage teacher network and a lightweight student network. By combining a window Transformer and U-Net hybrid model, we design a supervised attention module and a multi-stage knowledge distillation strategy to achieve efficient image restoration through knowledge transfer.

Benefits of technology

It reduces the number of network parameters for students by approximately 66%, and the processing time for a single image is reduced from 1.267 seconds to 1.004 seconds. It can simultaneously handle various degradation types such as motion blur, Gaussian blur, low-light noise, and salt-and-pepper noise, and has strong adaptability and robustness.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122415360A_ABST
    Figure CN122415360A_ABST
Patent Text Reader

Abstract

本发明公开了一种基于师生网络知识蒸馏的轻量级内窥镜图像复原方法,包括下列步骤:1构建三阶段教师网络,先采用窗口Transformer与U‑Net混合模型捕获图像,再采用通道级Transformer捕获全局通道信息;2构建轻量级学生网络;采用U‑Net架构结合通道注意力机制,跨阶段特征融合模块实现特征有效传递;3监督注意力模块集成于网络的每个阶段生成残差图像和注意力图;4多阶段知识蒸馏策略将教师网络的知识迁移至学生网络;5模型训练与优化,模型训练采用Adam优化器和余弦退火调度策略;6轻量化推理部署,仅使用学生网络进行推理。应用本发明网络结构轻量化,能满足高质量的复原效果及实时处理需求。
Need to check novelty before this filing date? Find Prior Art