The invention relates to a multi-
modal digital employee reception
system and method based on edge calculation, and relates to the technical field of
artificial intelligence, and the
system comprises a multi-
modal data collection module, an edge calculation module, a data fusion and decision module, a trigger activation module, an
emotion recognition module, an interaction response module and a behavior prediction module. The method comprises the following steps: acquiring voice, image and action information of a user through a high-resolution camera, a
microphone array and an
infrared sensor; locally
processing data by using an edge calculation module, and extracting voice, vision and thermal imaging features; a
Transformer model is dynamically optimized through Test Time Training (TTT), multi-
modal data are dynamically fused in combination with a multi-head attention mechanism, a comprehensive decision vector is generated, the
system can accurately judge the emotional state of a user, user behaviors are predicted based on a fused Token sequence and historical records, personalized services are actively provided, and by dynamically adjusting a trigger threshold value and a
weight distribution mechanism, the emotion state of the user can be accurately judged. The false triggering rate and the missed triggering rate are reduced, and the stability and the robustness of the system are enhanced.