This application discloses a method and
system for consolidating evidence of network fraud through multimodal
semantic consistency verification, comprising: collecting and modally identifying multimodal electronic evidence and generating
original data fingerprints; extracting
semantic information from each
modal of evidence across five dimensions: time, amount, identity, behavior description, and geographical location; constructing a cross-
modal evidence
semantic association graph with a heterogeneous graph structure including evidence nodes, element nodes, and relational edges, and establishing attribution edges and cross-
modal association edges based on element categories using differentiated
semantic similarity calculation methods; generating initial feature vectors for each node, inputting the
semantic association graph into a graph
attention network model for consistency
inference, performing consistency, contradiction, and uncertainty classification on cross-modal association edges, and obtaining a
global consistency score; and performing differentiated on-chain consolidation operations based on the
score to generate consolidation certificates. This invention can automatically discover semantic contradictions between different modalities of evidence, improving the quality of electronic evidence consolidation.