The invention discloses a
remote sensing question answering system based on a comparison-generation type pre-training model, which comprises the following steps of: firstly, collecting
remote sensing images of tasks such as classification, semantic segmentation, target detection, image-
text retrieval and image
text generation as
original data, and uniformly converting the
original data into an image-text pair form; the category area proportion is calculated through segmentation
processing, a target category and position information thereof are detected, and zero
sample classification is performed through a CLIP model. Thirdly, inputting multi-source information into a multi-
modal large
language model, generating text description of an image according to a question, and completing construction of a
remote sensing global visual question and answer
data set; and meanwhile, based on the
annotation box,
cutting the picture and sending the picture into a multi-
modal large
language model to obtain a remote sensing local visual question and answer
data set. Then, pre-training the comparison-generation type model from a coarse stage to a fine stage, so that the comparison-generation type model has global-local level remote sensing knowledge and visual question and answer ability; and finally, realizing question and answer interaction with the user by constructing a user-friendly
system interface.