This invention relates to the field of
mental health diagnosis and treatment technology. The invention provides a method and device for
mental health monitoring and auxiliary diagnosis based on multimodal recognition. The method includes: a
data processing unit receiving and preprocessing
multimodal data from
eye movement,
electroencephalography (EEG), facial recognition, speech, scales, and text; constructing a comprehensive
feature set reflecting attentional state, physiological
arousal, emotional expression, and subjective risk by extracting quantifiable features from the
multimodal data; concatenating the comprehensive
feature set into an input vector, inputting it into a local multi-
disease MLP, outputting five risk probabilities, and performing structured scale security calibration; calculating independent scores for each channel based on the multimodal features, and performing weighted fusion with the MLP output, combining risk thresholds and self-harm intention escalation rules to generate a
risk level; and generating an auxiliary assessment report through a multi-agent collaborative review mechanism. This approach improves the accuracy,
interpretability, and
traceability of
mental health auxiliary assessment results.