The invention discloses a cross-
modal emotion interaction
system based on dynamic self-evolution anthropomorphic calculation. According to the
system, the functions of cross-
modal perception, self-evolution learning and full-scene emotional interaction are realized through
collaborative design of an innovative
algorithm architecture and hardware and by taking a
robot as a carrier. According to the
algorithm, a multi-
modal fusion
perception system is constructed, an emotion
feature vector is generated through a self-attention module, and accurate
emotion recognition is realized based on Transform. The self-evolution mechanism adopts
federated learning and abnormal optimization dual drive, continuous iteration and rapid
adaptation of the model are achieved, and
data security is guaranteed. The low-time-
delay interactive execution system realizes anthropomorphic actions through
kinematics solution,
trajectory planning and a
control algorithm, and combines a dynamic interactive
library and
reinforcement learning optimization
strategy selection. Hardware adopts a polylactide
topological optimization skeleton, has 17
degrees of freedom, and integrates a
microphone array, a visual module and the like. The
robot can be widely applied to the fields of pension services and the like, and
emotion recognition precision, self-evolution ability and interaction naturalness are improved.