The invention relates to a multi-
modal rumor detection method and
system fusing multi-
granularity features, and the method comprises the steps: collecting
multimedia posts in
social media, extracting texts, images and comments in the posts, and labeling authenticity labels of the posts, thereby constructing a training
data set; a multi-
modal rumor detection model fused with multi-
granularity features is constructed, the multi-
modal rumor detection model extracts the multi-
granularity features in posts, image-text features are deeply fused, resolution of image-text
ambiguity is achieved through image-text similarity weights, comment information is fully mined, comments are utilized from different angles, and the image-text
ambiguity resolution is achieved. Finally, similar information of the same category of
social media posts is captured through comparative learning; using the training
data set to
train a multi-modal rumor detection model; and inputting texts, images and comments of undetected
multimedia posts into the trained multi-modal rumor detection model to obtain authenticity labels of the
multimedia posts. The method and the
system are beneficial to improving the rumor detection accuracy and reliability.