The invention discloses a cloud platform auditing method based on multi-
modal data processing, and relates to the technical field of cloud platform auditing. Independent features of text, image, audio, video and
log data are extracted, each piece of
modal information can be subjected to refined analysis in a corresponding feature space, and in a cross-
modal feature fusion stage, a multi-modal
feature fusion model is obtained. The correlation between different
modal data is calculated by using a cross-modal consistency comparison network CMCN, and feature alignment is optimized through an attention mechanism, so that multi-modal information can be mutually verified, and misjudgment and missed judgment caused by independent auditing are reduced; in the auditing decision-making link, an auditing model based on
deep learning is constructed, and end-to-end illegal content judgment is realized in combination with
anomaly detection and a self-adaptive
risk control threshold value, so that the intelligent level of an auditing
system is improved; in addition, the suspicious areas of the image and the video are visually marked, and an auditing conclusion is generated by utilizing a
natural language to generate an NLG model, so that the auditing result is more transparent.