The application discloses a kind of for
left auricle plugging operation navigation multi-
modal image automatic registration method, comprising the following steps: collecting structural
heart disease intervention
surgery patient preoperative CTA image and intraoperative
CBCT image;Using U-Net
deep learning framework, the heart region in CTA image and
CBCT image is segmented and extracted, and the extracted image region is carried out data enhancement and size normalization etc.Pretreatment operation;With the network of depth
convolution and visual
Transformer fusion, the heart region image of CTA and CBCT is calculated Affine
transformation matrix, so that the CTA image and
CBCT image realize 3D affine registration;The image after registration is filled to the
cutting region of the CBCT image, and the intraoperative CBCT image containing heart anatomical structure information is generated.The method of the application can realize the automatic, fast and accurate
spatial registration of preoperative CTA image and intraoperative CBCT image, and the
fusion image view generated by registration provides comprehensive reference for the heart three-dimensional anatomical structure and real-time instrument position, effectively assists instrument positioning, path planning and size selection, and provides a new intelligent tool for
left auricle plugging operation navigation.