The application provides a
mental health risk early warning and intervention
system based on multi-
modal emotion calculation, belongs to the field of
mental health analysis, and comprises a multi-
modal fusion module, a risk prediction module and a strategy recommendation module.The multi-
modal fusion module is used for acquiring multi-
modal data, restraining and fusing the multi-
modal data, and generating fused emotion features.The risk prediction module is used for calculating
mental health risk probability and emotion state through a double-stage cumulative risk prediction
algorithm according to the fused emotion features, and performing mental
health risk early warning based on the emotion state.The strategy recommendation module is used for extracting emotion trajectory features based on the fused emotion features and the mental
health risk probability, performing intervention strategy recommendation, and obtaining an intervention strategy for the current mental
health risk.The multi-modal fusion module, the risk prediction module and the strategy recommendation module simultaneously process video, audio, text and physiological four kinds of
modal data, accurately model the nonlinear cumulative process of the mental health risk, and improve the risk early warning and intervention ability.