The invention discloses a Parkinson's
disease assessment method and
system based on face video multi-
modal physiological
feature fusion, and relates to multiple technical fields of
computer vision, physiological
signal processing and the like, and the method comprises the following steps: S1, based on a continuous face video
stream, extracting rPPG signals; then
heart rate variability key parameters are calculated, and
heart rate variability characteristics are obtained; s2, analyzing the dynamic change of an eye
fixation point in the face
video based on IPAST, extracting key
eye movement behavior parameters, and obtaining
eye movement behavior characteristics through a
convolution gating loop unit; and S3, inputting the
heart rate variability characteristics and the
eye movement behavior characteristics into a multi-
modal fusion
network structure, and outputting a continuous risk
score or an illness state
label for assisting a doctor in early Parkinson
risk assessment. According to the method, multiple physiological signals acquired through videos are deeply integrated, a multi-
modal feature collaborative analysis framework is constructed, the subjective limitation of traditional scale evaluation is broken through, and the one-sidedness defect of single biomarker detection is overcome.