The invention relates to a method and equipment for constructing a minority language image-text
data set for internet data and a medium, and the method comprises the steps: obtaining an
HTML webpage file, extracting a multi-
modal document containing minority language image-text data from the
HTML webpage file, and screening out image-text related pairs according to replaceable texts corresponding to images in the multi-
modal document; inputting a pure picture which does not contain a replaceable text in the multi-
modal document, the text information after the picture is removed and a self-defined cue word into a first multi-modal
large model, generating corresponding picture description information and image-text question and answer information, forming an image-text description pair by the pure picture and the picture description information, and displaying the image-text description pair in the first multi-modal
large model; forming a visual question-answer pair by the pure picture and the image-text question-answer information; inputting the multi-modal document, the image-text related pair, the image-text description pair and the visual question-answer pair into a second multi-modal
large model, and outputting an image scene
label; and combining the information to obtain a small language image-text
data set. Compared with the prior art, the method has the advantages that high-quality, diversified and standardized small language image-text
data set construction can be realized.