The invention discloses a psychological state pre-screening
system and method based on multi-
modal data. The psychological state pre-screening
system comprises a
data acquisition module, a data preprocessing module, a psychological state analysis module, a psychological state evaluation and screening module and a feedback and early warning module. The
system collects multi-
modal data such as facial expressions, voices, texts, physiological signals and the like, and performs psychological state analysis by using a
deep learning algorithm. The psychological state
score is calculated through a multi-
modal data fusion
algorithm, and feedback or early warning is provided, so that the user or related mechanisms can perform further intervention. According to the method, the accuracy and the real-time performance of psychological state screening can be improved, and the problem of misjudgment of a single
data source is avoided. The system can be integrated to a
smart phone, a smart bracelet, a computer and other equipment, realizes low-cost and non-perceptual
mental health monitoring, is suitable for personal health management, enterprise employee mental monitoring,
psychological counseling auxiliary diagnosis and school psychological screening, and is beneficial to early discovery and intervention of
mental health problems.