Target encoder training method and device, computer equipment and storage medium
CN119027965APending Publication Date: 2024-11-26INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF 0 Cites 0 Cited by
Patent Information
- Application Number
- CN202411114044.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-14
- Publication Date
- 2024-11-26
Smart Images

Figure CN119027965A_ABST
Abstract
The invention relates to the technical field of artificial intelligence, and discloses a target encoder training method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining a preprocessed training sample which comprises text content, a target box position corresponding to the text content, and the type of the text content; based on the text content, the target frame position corresponding to the text content and the category of the text content, adding position coding information for the preprocessed training sample to obtain a target training sample; inputting the target training sample into a preset encoder to obtain a first feature value; inputting the preprocessed training sample into a preset picture encoder to obtain a second feature value; determining a first loss function between the first feature value and the second feature value based on the first feature value and the second feature value; and based on the first loss function, performing parameter tuning on a preset picture encoder to obtain a pre-trained picture encoder. According to the method, the time consumption for carrying out text understanding by a large visual language model is reduced.
Need to check novelty before this filing date? Find Prior Art
