The invention discloses a multi-
modal deep learning-driven multi-dimensional ultrasonic image intelligent
processing system, relates to the technical field of
image processing, and is used for solving the problem of poor multi-
modal ultrasonic fusion analysis. According to the method, B-mode,
color Doppler, elastic and radio-frequency images are acquired, a unified structured
tensor is constructed,
time synchronization and space registration of multi-mode images are realized, a cross attention mechanism is introduced to align and fuse
modal features, the feature expression ability is enhanced, and a
time sequence modeling method and a graph structure modeling method are combined, so that the
time synchronization and space registration of the multi-mode images is realized. According to the method, dynamic features and spatial topological relations of tissues evolved along with time are extracted, joint spatial-temporal feature representation is formed, at the output end, the
system supports multi-task paths such as region segmentation, structure classification and functional parameter extraction, clinical diversified analysis requirements are met, the overall architecture is an end-to-end
deep learning process, and the
system is a multi-task system. The method has high
automation and cross-modal
adaptive capacity, and the ultrasonic
image analysis efficiency and accuracy are improved.