基于特征重组的图像识别模型的训练方法及装置、图像识别方法、设备、介质及产品

By training with feature recombination and knowledge distillation, the feature distribution of the student model is adjusted to approximate that of the teacher model. This solves the problem of inaccurate image recognition caused by the difference in feature distribution at different granularities between the teacher and student models, and improves the overall and detailed feature recognition performance of image recognition.

CN122416218APending Publication Date: 2026-07-17INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
INST OF AUTOMATION CHINESE ACAD OF SCI
Filing Date
2026-06-17
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Due to the difference in feature distribution between the teacher model and the student model at different granularities, the final trained student model is unable to achieve more accurate image recognition, especially when the image features are complex, making it difficult to accurately identify both the overall features and the detailed features of the image at the same time.

Method used

By analyzing the intermediate feature distributions of the teacher and student models, the feature distribution of the student model is adjusted to approximate that of the teacher model. Feature recombination methods, including feature decomposition and weighted recombination, are used, combined with knowledge distillation training, to optimize the feature distribution of the student model.

Benefits of technology

This improved the student model's ability to recognize both overall and detailed features of images, making the final trained student model closer to the teacher model's image recognition capabilities and achieving more accurate image recognition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122416218A_ABST
    Figure CN122416218A_ABST
Patent Text Reader

Abstract

本公开涉及深度学习和计算机视觉技术领域,提供一种基于特征重组的图像识别模型的训练方法及装置、图像识别方法、设备、介质及产品,该训练方法包括:将训练样本图像分别输入到学生模型和教师模型中,得到第一中间特征和第二中间特征;确定第一中间特征中整体特征与细节特征的第一分布以及第二中间特征中整体特征与细节特征的第二分布;通过将第一分布朝向第二分布调整,对第一中间特征进行重组,得到重组特征;通过比较第二中间特征和重组特征,得到重组特征损失;基于重组特征损失,对学生模型进行训练,得到经训练的学生模型。本公开可以解决难以实现更准确的图像识别的问题,提升图像的整体特征和细节特征的识别效果,更准确识别图像。
Need to check novelty before this filing date? Find Prior Art