Heart sound, electrocardio and echocardiogram multi-modal data phase synchronization method

By employing dual-path neural networks and linear phase resampling technology, the robustness and synchronization issues of ECG waveform extraction in echocardiography were resolved, achieving high-precision synchronization of heart sounds, ECG, and echocardiography. This lowered the equipment configuration threshold and improved the accuracy and convenience of multimodal diagnosis.

CN121622100AActive Publication Date: 2026-03-10SICHUAN PROVINCIAL HOSPITAL FOR WOMEN & CHILDREN
8 Cites 2 Cited by

Patent Information

Application Number
CN202610162387.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-02-05
Publication Date
2026-03-10
Estimated Expiration
2046-02-05

AI Technical Summary

Technical Problem

Existing technologies for extracting ECG waveforms from echocardiograms suffer from problems such as sensitivity to color thresholds, poor anti-interference ability, lack of time-series consistency modeling, difficulty in handling waveform breaks and occlusions, and difficulty in synchronizing asynchronous data, resulting in low data robustness and affecting the performance of multimodal assisted diagnosis.

Method used

A dual-path neural network architecture is adopted, which combines HSV color filtering and sliding window algorithm. The ECG waveform is extracted and repaired through confidence judgment and time-series dependency module. Phase synchronization is achieved by using the autocorrelation of ECG signal and heart sound anchor point to realize linear phase resampling alignment.

Benefits of technology

It improves the robustness and completeness of ECG waveform extraction, achieves high-precision synchronization of heart sounds, ECG and echocardiography, lowers the equipment configuration threshold, and enhances the accuracy and convenience of multimodal diagnosis.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a heart sound, electrocardio and echocardiogram multi-modal data phase synchronization method, which belongs to the technical field of medical image processing, and comprises the following steps: A1, obtaining an original echocardiogram video and independently recorded heart sound audio data information; a2, preprocessing the acquired data and performing sample automatic construction; a3, a double-path neural network architecture is constructed, electrocardiogram waveform extraction is carried out, and a digital electrocardiogram signal sequence is obtained; a4, periodic feature points of the heart sound and the electrocardio are recognized based on the digital electrocardio signals; and A5, aligning the asynchronous data based on linear phase resampling. According to the method, the video frames, the electric signals and the heart sound signals under different sampling rates are forcibly mapped into the unified phase coordinate system through a linear interpolation algorithm, absolute synchronization of the video frames, the electric signals and the heart sound signals in cardiac pulsation physiological logic is finally achieved, and the influence of individual heart rate differences on data alignment is eliminated.
Need to check novelty before this filing date? Find Prior Art