The application discloses an
arrhythmia detection method based on cross-
modal data enhancement. In view of the problems of serious imbalance of class distribution of existing ECG data sets and limited effect of multi-
modal feature fusion, the method comprises the following steps: db6
wavelet denoising and
heartbeat segmentation are performed on the original electrocardiogram
signal, and categories are merged according to the AAMI standard; a one-dimensional
heartbeat time sequence signal is converted into a two-dimensional polyline waveform image with a pixel size of 224*224, and a
metadata CSV file containing
signal indexes, image paths and category labels is constructed; signal data and images are sequentially
matched sample by sample, and a multi-
modal paired data set is constructed; an intra-class multi-modal reorganization (ICMR) enhancement strategy is proposed, signal and image are independently and randomly sampled from the same category
sample pool under the constraint of maintaining category consistency, and are re-paired, and the imbalance problem of categories is relieved through
differential amplification rate; a double-flow multi-modal fusion classification network composed of a one-dimensional CNN-bidirectional LSTM signal
encoder, a ResNet18 image
encoder, a gating fusion module and a classification head is constructed, and two-way features of signal and image are adaptively integrated; cross-entropy
loss function and Adam optimizer are used for end-to-end training and evaluation. The application effectively improves the recognition performance of the
minority class arrhythmia.