The invention discloses a visual
language model two-stage unsupervised
adaptation method,
system and device and a medium, which are corresponding schemes, in the scheme, a high-quality auxiliary
data set is constructed through adaptive retrieval,
cost effectiveness and universality are achieved, and an efficient and reliable new normal form is provided for cross-
domain knowledge migration; moreover, a complex
adaptation task is decomposed into two stages of optimization processes, distribution of auxiliary data is controlled to be close to pre-training or
target distribution through adjustable data
distribution control parameters, and the single-step
adaptation difficulty is remarkably reduced; meanwhile, during category filtering, samples of a specific category are screened from a large-scale image-text
data set by utilizing weak supervision signals, matching frequency statistics and prediction information entropy contained in image-text pair data, and
noise category samples are prevented from being introduced; in addition, based on two-stage training, the model can be helped to gradually adapt to target tasks and target data distribution, the adaptive performance is improved, and higher classification accuracy can be obtained.