Target encoder training method and device, computer equipment and storage medium

CN119027965APending Publication Date: 2024-11-26INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411114044.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-14
Publication Date
2024-11-26

Smart Images

  • Figure CN119027965A_ABST
    Figure CN119027965A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of artificial intelligence, and discloses a target encoder training method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining a preprocessed training sample which comprises text content, a target box position corresponding to the text content, and the type of the text content; based on the text content, the target frame position corresponding to the text content and the category of the text content, adding position coding information for the preprocessed training sample to obtain a target training sample; inputting the target training sample into a preset encoder to obtain a first feature value; inputting the preprocessed training sample into a preset picture encoder to obtain a second feature value; determining a first loss function between the first feature value and the second feature value based on the first feature value and the second feature value; and based on the first loss function, performing parameter tuning on a preset picture encoder to obtain a pre-trained picture encoder. According to the method, the time consumption for carrying out text understanding by a large visual language model is reduced.
Need to check novelty before this filing date? Find Prior Art