The invention belongs to the technical field of
rehabilitation assessment, and provides a cerebral apoplexy
rehabilitation assessment method and
system based on multi-mode electroencephalogram and myoelectricity fusion. According to the method, 59-channel electroencephalogram signals and 14-channel electromyographic signals are preprocessed,
mutual information between channels is calculated to construct a correlation matrix, spatial-temporal features are extracted in combination with a
convolutional neural network (CNN) and a Transform self-attention mechanism, and
rehabilitation level classification is achieved. According to the method, coherence between electroencephalogram / myoelectricity channels is quantified by adopting
mutual information, and 59 * 59 and 14 * 14 dimensional feature matrixes are constructed; a CNN-Transform
hybrid model is designed to optimize
feature fusion, and the classification precision is improved; gradient weighted
class activation mapping (Grad-
CAM) is introduced to analyze
feature saliency, and correlation between an electroencephalogram channel and a focus is revealed; and developing a visual
evaluation system, and displaying the multi-
modal data and the historical trend in real time. The
system stores
patient information and evaluation results through a MySQL
database, and supports doctor-patient online interaction. Compared with traditional scale evaluation, the method has the advantages that the evaluation objectivity is improved by using multi-
modal objective data, the model credibility is enhanced by combining
interpretability analysis, and
technical support is provided for formulating a personalized rehabilitation scheme.