The invention discloses a multi-
modal electrocardiosignal and arrhythmia
recognition system and method. The
system comprises a
signal acquisition module, a preprocessing module, a space-
time alignment module, a
feature extraction module, a self-adaptive fusion module, a multi-
modal fusion module, a classification
risk assessment module and a visual report module. The recognition method comprises the following steps: S1, synchronously acquiring an electrocardiosignal and a heart sound
signal, and preprocessing the electrocardiosignal and the heart sound
signal; s2, establishing a time corresponding relation between the electrical activity and the mechanical activity; s3, calculating a mechanical shrinkage efficiency index; s4, evaluating the quality of the electrocardiosignal and the heart sound signal in real time, and dynamically adjusting contribution weights of the electrocardiosignal and the heart sound signal in a fusion process according to the quality; s5, adopting a multi-head attention mechanism to generate a joint
feature vector for classification; s6, inputting the joint
feature vector into a classification
network model, and outputting an arrhythmia type and a quantitative
risk level at the same time by the classification
network model; and S7, generating a visual atlas and a structured diagnosis report.