The invention discloses a multi-
modal deep learning traceability method and
system fusing magnetoencephalogram and
electroencephalography, and relates to the technical field of
artificial intelligence and neuroimage.Real magnetoencephalogram signals and
electroencephalography signals are preprocessed and then input into a
traceability model, the probability of occurrence of a source in a corresponding area is predicted, and the
traceability of the source in the corresponding area is obtained by combining an imported source partition
distance matrix. A final traceability result is obtained; the training process of the traceability model is as follows: constructing a
generative adversarial network, and generating a multi-
modal neural electrophysiological
data set; inputting the multi-
modal neural electrophysiological
data set into a residual network of a double-
branch structure, and performing stage hierarchical extraction and decoupling on magnetoencephalogram signals and electroencephalogram signals respectively; extracting features in different stages by using a multi-scale
convolution module, fusing the extracted features, inputting the fused features into a classifier, defining a
loss function, and updating trainable parameters of the traceability model; the traceability method improves the accuracy and generalization ability of traceability positioning.