The invention discloses a
gesture recognition system and method based on multi-channel mixing of EMG, FMG and IMU. The
system comprises a multi-channel
signal acquisition module, a
signal conditioning and synchronous acquisition circuit, a data preprocessing module, a deep neural network fusion recognition module and an output interface module. By integrating a surface electromyogram, a
muscle force diagram and an
inertial measurement unit, synchronous acquisition of multi-
modal physiological signals of the
forearm of a
human body is realized; a double-flow
convolution-
time sequence attention fusion network (DCTANet) is adopted for
feature extraction and classification
decision making, and neuromuscular activity,
muscle mechanical response and limb movement information are effectively fused. The accuracy, robustness and real-time performance of
gesture recognition are improved, and the method is suitable for the fields of intelligent prostheses, wearable interaction,
rehabilitation training and the like. The
system is compact in structure, supports embedded deployment, and has a good practical prospect.