Ultrasonic endoscope and CT three-dimensional image real-time conversion method and system

Abstract

The invention relates to an ultrasonic endoscope and CT three-dimensional image real-time conversion method and system. The method comprises the following steps of obtaining an ultrasonic endoscope two-dimensional image, and marking a zero scale in the two-dimensional image; obtaining a CT three-dimensional reconstructed image, and marking zero scale in the CT three-dimensional reconstruction image; matching the zero scale of the ultrasonic endoscope two-dimensional image with the zero scale of the CT three-dimensional reconstructed image, and establishing a conversion model of the zero scaleof the ultrasonic endoscope two-dimensional image and the zero scale of the CT three-dimensional reconstructed image; converting the zero scale of the ultrasonic endoscope two-dimensional image into the CT three-dimensional reconstructed image through the conversion model, and converting the ultrasonic endoscope two-dimensional image into the CT three-dimensional reconstructed image through a mapping relation between the two-dimensional image and the three-dimensional image to generate a real-time CT three-dimensional image of the ultrasonic endoscope. Through deep learning, a two-dimensionalultrasonic endoscope image and a CT three-dimensional reconstruction technology are combined, and real-time imaging and navigation are carried out by applying a CT three-dimensional structure when a mediastinum ultrasonic endoscope is carried out.

Description

Technical field [0001] The invention relates to a method and system for real-time conversion of ultrasound endoscopy and CT three-dimensional images, and belongs to the technical field of medical equipment. Background technique [0002] With the emergence and application of ultrasound endoscopy, it has become a reality to directly observe the lesions in the digestive tract wall and maximize the closeness to the esophageal wall to visually observe the esophageal extraluminal structure. Since the ultrasound endoscope mostly uses the imaging structure of the squint endoscope and the side view endoscope, its operation difficulty and image recognition are greater than that of the ordinary endoscope. For lesions outside the digestive tract, it is not only necessary to grasp the anatomical structure of the external organs and the adjacency of each anatomical structure, but also to trace the shape of blood vessels and the shape of the anatomical structure of the organs, in order to find ...

AI Technical Summary

Problems solved by technology

At present, the three-dimensional reconstruction of endoscopic ultrasonography images cannot be realized clinically.

[0005] At present, the clinical diagnosis of mediastinal lesions relies on chest CT and endoscopic ultrasonography. After three-dimensional reconstruction of chest CT, the adjacent relationship between the lesion and the surrounding organs can be clearly observed, showing an absolute advantage in anatomical location, but it cannot provide instant images. The key is that biopsy cannot be obtained. pathological diagnosis

Endoscopic ultrasonography can obtain images of lesions intuitively and instantly, but ultrasonic images can only show the structure on a certain level, and the images are variable during the operation of endoscopic ultrasonography. Therefore, it is currently difficult to accurately and clearly collect the location of lesions and 3D images of the surrounding anatomy

Images