The invention discloses a multi-
modal sample
data synthesis and labeling integration method and device, equipment and a storage medium, and relates to the technical field of
information extraction. The method comprises the following steps: firstly, grouping a collected sample
data set, calculating a reasoning confidence average value, a standard deviation and a multi-
modal large model false detection rate of each group of first sample data, and determining a target group according to the reasoning confidence average value and the standard deviation; and generating a target sample feature part in combination with the grouping condition of the target group and the grouping
noise, and combining the feature part and the first actual
label part into target sample data after
model prediction and rechecking. Meanwhile, according to the target grouping demand number, the target sample
generation number and the conversion coefficient, the supplementary collection number is determined, a supplementary collection
data set is obtained, and after merging, image and context features of incremental samples are extracted and coded and fused. And finally, inputting the fusion code into the model, and optimizing the model by directly using the loss value or the corrected loss value according to whether the fusion code is a collection type, thereby effectively filling the weak region of the sample and improving the performance of the model.