Surgical navigation method and system based on augmented reality assistance

Abstract

The invention discloses a surgical navigation method and system based on augmented reality assistance. The method comprises the following steps: (1) performing three-dimensional CT scanning on a patient; (2) performing segmentation and three-dimensional reconstruction on the bile duct to obtain a three-dimensional model of the bile duct, importing the three-dimensional model into a storage unit in a computer, extracting a center line of the three-dimensional model of the bile duct through a data processing unit, and recording three-dimensional coordinate information of each point on the center line; (3) selecting a characteristic marker with a proper size; (4) deploying an augmented reality aided navigation system; (5) displaying the virtual bile duct model by identifying the feature marker; and (6) performing perspective imaging on the patient by using X-rays, acquiring two-dimensional coordinates of a tip in each frame of image through a surgical instrument tip detection algorithm in the data processing unit, matching the tip coordinates with three-dimensional bile duct center line point set coordinates according to a 2D-3D registration algorithm, deducing optimal probability matching mapping, and determining the optimal probability matching mapping according to the optimal probability matching mapping. The specific position of the tip of the surgical instrument in the three-dimensional bile duct model is judged, and coordinates are recorded.

Description

technical field [0001] The invention relates to the technical field of medical image processing, in particular to an augmented reality-assisted surgical navigation method and augmented reality-assisted surgical navigation system, which are mainly used to accurately guide a surgical operator to complete intubation. Background technique [0002] Endoscopic Retrograde Cholangiopancreatography (ERCP) is an endoscopic minimally invasive treatment method with the highest technical difficulty, the highest risk of complications and the most benefit for patients with biliary and pancreatic diseases in the field of digestive endoscopy. However, the bile duct structure varies from person to person, and presents a bifurcated tree-like structure with complex three-dimensional information. ERCP relies more on subjective imagination and clinical experience in the surgical operation guided by two-dimensional X-ray images, especially for beginner ERCP. However, repeated attempts at intubatio...

AI Technical Summary

Problems solved by technology

Due to the limitations of X-ray imaging principles, traditional X-ray image guidance can only provide two-dimensional structural information for the operator, lacking three-dimensional information. In the complex structure of the biliary tract, the operator can only make multiple attempts through preoperative image analysis and subjective experience. Insertion, low efficiency; and multiple insertions are likely to cause other complications

Traditional navigation methods, such as optical navigation or magnetic navigation, need to track the tip of surgical instruments through optical markers or magnetic sensors. When necessary, they need to enter the human body during interventional operations. The design of medical disinfection and ethical issues is more complicated.

In addition, doctors need to wear augmented reality glasses (such as HoloLens), which increases the burden on doctors and limits the field of vision

Images