The invention discloses an
emotion recognition method based on multi-
modal signal fusion, and relates to the technical field of
emotion recognition, and the method comprises the steps: obtaining an electroencephalogram
signal and a
peripheral physiological
signal to form a multi-
modal signal, and carrying out the preprocessing of down-sampling, baseline correction and band-pass filtering on the multi-
modal signal; based on the preprocessed signal, extracting a difference entropy feature and a power spectrum density feature; mapping the extracted features into a standardized space grid to generate a feature
tensor with a uniform structure; performing
adaptive weighting on the mapped feature
tensor by using a
frequency band fusion attention mechanism, and generating a
frequency band weight through global average
pooling and a full connection layer; inputting the weighted features into a full connection layer of the parameterized hypermatrix, and performing feature compression and modeling through
matrix decomposition and reconstruction; a multi-
task learning framework is adopted, classification results of emotion
titer and awakening degree are output at the same
time based on compressed features, and multi-task
collaboration is optimized through a shared feature layer and a dynamic
loss weight.