This invention belongs to the field of
multimedia analysis technology and discloses a multimodal media tampering detection method,
system, device, and medium based on multi-view contrastive learning. The method includes: acquiring a training dataset, which includes training image-training text pairs and corresponding tampering category labels; introducing a cross-
encoder based on a visual-
language model, setting several
multilayer perceptron head structures, and designing three contrastive
learning methods:
noise enhancement, prototype-based, and multi-
label tampering classification, to obtain an initial multi-view contrastive learning framework; training the initial multi-view contrastive learning framework based on the training dataset to obtain a trained multi-view contrastive learning framework; and performing a tampering detection task on the image-text pair data to be detected based on the trained multi-view contrastive learning framework. The technical solution of this invention can improve the accuracy and robustness of multi-
label classification.