The invention provides an intelligent interaction
system and method based on a multi-stage cognitive mode, and the
system comprises a multi-
modal data collection module which is used for collecting user interaction data through a multi-
modal sensor, and the data comprise language input, non-language behaviors, interface operation data, expressions,
eye movement tracks and the like; and the cognitive feature analysis module is used for calling a
deep learning model to perform
feature extraction on the interaction data. According to the method, language, behavior, interaction,
physiology and other data are fused through the multi-
modal sensor, the cognitive driving vector is generated by using the
deep learning model, the real-time cognitive state of the user is effectively captured, then the probability distribution of the cognitive stage is constructed in combination with Bayesian reasoning, the problems that in the prior art, only the
cognitive level can be statically judged, and real-time updating is difficult are solved, and the user experience is improved. The accuracy and timeliness of
user state perception are remarkably improved, and dynamic accurate recognition and continuous modeling in the cognitive stage are achieved.