The invention discloses an emotion feature auxiliary personality recognition method and
system based on multi-
task learning. According to the method, a dual-
branch network comprising an emotion
branch and a personality
branch is constructed by loading and preprocessing multi-
modal features, emotion tags and personality tags of an MDPE
data set; the emotion branch adopts a Transform
encoder to model sequence features and outputs an emotion prediction result; the personality branch adopts a multi-layer
perceptron to extract personality embedded representation; further, constructing an emotion feature auxiliary module, performing attention weighted
pooling on an emotion prediction result to obtain an emotion abstract representation, splicing the emotion abstract representation with a personality embedded representation, and then realizing
information fusion through cross attention and a selectable gating mechanism; and finally, obtaining a personality prediction result through residual connection and layer normalization. A joint
loss function is designed to coordinate double-task joint training, the model
training effect is guaranteed through an optimization
algorithm, a learning rate attenuation strategy and an early stop mechanism, and
information sharing and collaborative optimization of
emotion recognition and personality recognition are achieved.