The invention discloses a heart sound, electrocardio and echocardiogram multi-
modal data
phase synchronization method, which belongs to the technical field of medical
image processing, and comprises the following steps: A1, obtaining an original echocardiogram video and independently recorded heart sound audio
data information; a2, preprocessing the acquired data and performing sample automatic construction; a3, a double-path
neural network architecture is constructed, electrocardiogram waveform extraction is carried out, and a digital electrocardiogram
signal sequence is obtained; a4, periodic feature points of the heart sound and the electrocardio are recognized based on the digital electrocardio signals; and A5, aligning the
asynchronous data based on
linear phase resampling. According to the method, the video frames, the electric signals and the heart sound signals under different sampling rates are forcibly mapped into the unified phase coordinate
system through a linear interpolation
algorithm, absolute synchronization of the video frames, the electric signals and the heart sound signals in cardiac pulsation physiological logic is finally achieved, and the influence of individual
heart rate differences on data alignment is eliminated.