The invention discloses a multi-
modal data fusion financial
service information processing method and
system, and the method comprises the steps: S1, collecting enterprise text data and enterprise table data, and carrying out the preprocessing, and obtaining cleaned text data and cleaned table data; s2, calculating an enhanced text embedding vector, extracting a
semantic representation feature vector, decoding a text triple set, and generating a text
semantic vector; s3, calculating a standardized field set and a row-level entity
primary key, outputting an exception risk vector, and then calculating a table exception mark and a table
semantic vector; s4, calculating an entity alignment gate, and calculating an entity alignment
feature vector; calculating an entity matching degree
score, and finally calculating a cross-
modal conflict mark; and S5, calculating a cross-
modal fusion vector through the multi-layer
perceptron, and then calculating a knowledge representation vector. According to the method, the problem of low entity alignment precision caused by
data structure difference, field semantic conflict and insufficient entity recognition precision of a traditional method can be solved.