The application discloses an
emotion recognition method based on online cross-
modal knowledge
distillation, comprising the following steps: acquiring electroencephalogram and electrocardiogram original signals and windowing and
cutting; constructing electroencephalogram and electrocardiogram student models, extracting intermediate features from each
modal data segment through an
encoder, and obtaining non-normalized prediction output through a classifier; constructing a teacher probability distribution through a joint
encoder fusion; introducing adaptive contrast loss to align the cross-
modal intermediate features, introducing
distillation loss to constrain the
prediction probability distribution of each modal to align with the teacher probability distribution; synchronously optimizing new student
model parameters through online collaborative training; and performing actual
inference prediction based on the student model after training. The application combines double modal signals to make up for the defects of single modal information, excavates the complementarity of
modes, realizes dynamic generation of teacher supervision signals and real-time collaborative learning of
modes through online
distillation, does not increase test calculation overhead, effectively improves the recognition accuracy, model robustness and generalization ability, and has good application prospect.