3D/2D medical image registration method based on deep reinforcement learning

Abstract

The invention discloses a 3D / 2D medical image registration method based on deep reinforcement learning, and the method comprises the steps: obtaining 2D and 3D medical images, and carrying out the preprocessing of the 2D and 3D medical images, and obtaining a reference image and a floating image with multiple resolutions; then, establishing a deep reinforcement learning network; carrying out specific direction projection on a pre-operative to-be-registered 3D image to obtain DRR images with different transformation parameters, calculating the similarity measure of each DRR image and a 2D reference image, finally selecting the DRR image with the highest similarity measure value, and finally carrying out image registration on the selected DRR image by utilizing a deep reinforcement learningnetwork.

Description

technical field [0001] The invention belongs to the technical field of image registration, and more specifically relates to a 3D / 2D medical image registration method based on deep reinforcement learning. Background technique [0002] Image-guided surgery in clinical operations usually requires obtaining 3D images of human body lesions before the operation to help doctors understand the patient's condition and formulate surgical planning. The key to surgery is to accurately establish the spatial position relationship between the preoperative 3D image and the intraoperative 2D image, that is, to register the preoperative 3D image and the intraoperative 2D image. [0003] Current registration methods can be divided into grayscale-based methods, feature-based methods, and deep learning-based methods. The feature-based registration method can be divided into external feature-based and internal feature-based. Based on external features, medical imaging is performed after implanti...

AI Technical Summary

Problems solved by technology

In general, feature-based registration ignores a large amount of image information, resulting in low registration accuracy and requiring human intervention

The grayscale-based registration algorithm uses the similarity measure to quantify the similarity between the 2D image generated by projection and the intraoperative 2D image, and uses the optimization algorithm to iteratively search for the optimal similarity measure value to represent the best registration state of the image. , which is the optimal spatial transformation parameter, the use of more grayscale information means more processing data, complex calculation, longer registration time, and poor real-time performance

Shun Miao proposed to use a deep regression network to directly predict 2D / 3D registration transformation parameters, but the preprocessing steps are complex, the network structure is lengthy, a large amount of data is required, and the end-to-end direct prediction of transformation parameters is not conducive to ensuring registration accuracy

Images