The invention discloses a
cognitive impairment risk intelligent matching intervention
system based on multi-
modal data, and belongs to the technical field of
cognitive impairment, and the
cognitive impairment risk intelligent matching intervention
system specifically comprises the following steps: collecting a tactile interaction sequence and a face video
data stream when a user executes a cognitive intervention task, and constructing an original multi-
modal data set; extracting tactile operation track features and reconstructing a
heart rate variability sequence, and generating a synchronous multi-mode
feature set; identifying a difference interval of state fluctuation and extracting behavior and physiological features in the interval to form an instant physical and
mental load parameter set; in combination with an interaction efficiency index in the task execution
record, generating a joint state
feature vector, and outputting a personalized
adaptation instruction through a pre-trained sub-state-parameter
association model; and constructing an adaptive strategy model by using the multi-
modal features and an adaptive instruction to realize
millisecond-level dynamic adjustment from the real-time multi-modal features to task parameters. According to the method, real-
time perception and accurate matching of the cognitive emotion load of the user are realized, and the individuation degree and instantaneity of intervention are improved.