The invention discloses a
scoliosis evaluation system and device based on multi-
modal information fusion, and belongs to the field of spine health. A
back pressure electromyographic
signal acquisition module acquires stress electromyographic information of a
back muscle group; the thermal imaging module obtains a thermal imaging information graph of a
human body; the
plantar pressure acquisition module acquires
plantar pressure information; the multi-mode data fusion module inputs the stress myoelectricity information, the thermal imaging information graph and the
plantar pressure information into the
encoder layer, a cross attention mechanism is adopted in the
feature matching layer to fuse features from different modules, a classifier model is used for
scoliosis evaluation, and classification is conducted according to the
scoliosis degree. According to the application, the collaborative mechanism of the stress myoelectricity information, the thermal imaging information graph and the plantar pressure information of the back during scoliosis is utilized, multi-
modal data fusion is performed on the stress myoelectricity information, the thermal imaging information graph and the plantar pressure information of the back, full-automatic evaluation is realized through a multi-
modal data fusion model, the evaluation accuracy is high, and no
radiation is generated.