Multi-modal image registration method based on synthetic ultrasonic image

Abstract

The invention provides a multi-modal image registration method based on a synthetic ultrasonic image. The method comprises the following steps: according to a magnetic resonance image and a real ultrasonic image, constructing a generative adversarial network comprising a generator and a discriminator, generating a simulated synthetic ultrasonic image, registering the simulated synthetic ultrasonicimage and a real ultrasonic image to obtain registration parameters, and applying the registration parameters to a magnetic resonance image to complete registration and fusion of the final magnetic resonance image and the final ultrasonic image. According to the method, the ultrasonic image can be synthesized from the magnetic resonance image in real time, and the requirement of a real-time imageguide operation is met; the synthesized simulated ultrasonic image is closer to a real ultrasonic image, the image quality is higher, and important detail information is better stored; when the magnetic resonance image contains the tumor, the simulated ultrasonic image can still be accurately synthesized; the final registration technology does not need a complex registration algorithm, and a goodregistration effect can be achieved only through a traditional simple registration algorithm.

Description

technical field [0001] The invention relates to the field of multi-modal image registration, in particular to a multi-modal image registration method based on synthetic ultrasonic images. Background technique [0002] Both ultrasound images and magnetic resonance images are currently widely used in the diagnosis of various medical cases, for example, to detect infarcts and tumors in the head, to detect acute and chronic changes in the liver, and to navigate various clinical procedures. Real-time imaging of the liver is essential for detection of lesions or clinical treatment. Scanning imaging with an ultrasound probe can meet the requirements of real-time imaging, and ultrasound imaging is non-invasive and causes less harm to the human body. However, compared with magnetic resonance images, ultrasound images have lower imaging quality, and magnetic resonance images can provide more anatomical details to better assist diagnosis and treatment. However, magnetic resonance imag...

AI Technical Summary

Problems solved by technology

However, simulating ultrasound images takes a lot of time, so this method cannot be used in real-time surgical navigation systems, and cannot accurately simulate the information of tumor regions, and missing tumors will lead to unstable image registration before and after resection.

The registration and fusion technology based on ultrasound simulation has become a research hotspot and has achieved certain results, but there are still some defects in the following aspects: it takes a lot of time to simulate a three-dimensional magnetic resonance image into a three-dimensional ultrasound image, and it does not Applicable to real-time image-guided surgical navigation system; when the magnetic resonance image contains a tumor, it cannot correctly simulate the ultrasound image of the tumor in the corresponding position

Images