The invention relates to the technical field of
artificial intelligence and psychology crossing, in particular to a digital sand table multi-
modal data analysis method based on an intelligent chat
robot, which comprises the following steps: constructing a knowledge enhanced large
language model architecture; the three types of
training data sets are subjected to
synonym replacement, scene generalization and verbal skill
rewriting strategy data enhancement; executing four-stage model training; synchronously collecting sand tool operation,
facial expression, behavior and voice response data based on a large
language model, synchronously integrating a multi-
modal data set according to a
timestamp, and training a psychological analysis model; and based on
interpretability analysis of a psychoanalysis model
screening result, extracting a model attention weight and a feature importance
score, performing attribution analysis on sand table image, audio and video data, and generating a text analysis report. According to the method, subjective psychological motivation is deeply mined through dynamic interaction, deep fusion analysis of multi-
modal data is realized, an interpretable analysis report is provided, and the method is suitable for depression
risk screening of large-scale
crowds.