The invention discloses a fraud phone recognition method and
system based on multi-
modal data fusion. The method comprises the following steps: acquiring multi-
modal data of a plurality of fraud numbers from historical fraud data; constructing a multi-
modal fraud
data graph, taking each piece of multi-
modal data of the fraud number as a node, and constructing a connection edge between the nodes according to an association relationship between every two pieces of multi-
modal data; constructing and finely adjusting a large
language model; multi-
modal data of a to-be-recognized fraud number is obtained, a plurality of nodes are selected from the multi-modal fraud
data graph, then the multi-modal data of the to-be-recognized fraud number and the multi-modal data of the selected nodes form cue words, the cue words are input into the large
language model, and whether the obtained to-be-recognized fraud number relates to fraud or not and reason analysis for judging that the to-be-recognized fraud number is fraud are output. The invention relates to the field of communication, can improve the fraud recognition accuracy and
system adaptability through deep fusion and calculation of multi-mode data such as call audio, short message text and call
ticket data, and provides powerful
technical support for fighting against novel telecommunication network fraud.