A multi-level interactive visualization method for surgical navigation

Abstract

The invention discloses a multi-level interactive visualization method for surgical navigation. The steps of the method of the present invention are as follows: firstly obtain multi-modal two-dimensional image data output by medical imaging equipment, preprocess the multi-modal two-dimensional image data to obtain tissue and organ images; then perform three-dimensional Reconstruction, obtain the 3D model files of tissues, organs and lesion locations and transmit them to the client; the client parses the 3D model files to obtain the contour model; selects the region of interest in the 3D model and renders it clearly, defines the high-risk tissue model and stains it, Finally, through the AR module, the outline model and the rendered 3D model are superimposed on the corresponding position of the patient in the real world, and auxiliary information is displayed on the mobile terminal. The method of the invention can help the doctor to track and display the tissues and organs around the lesion in layers according to the operation path in real time during the operation, so as to relieve the pressure of the doctor and improve the success rate of the operation.

Description

technical field [0001] The invention relates to the technical fields of medical image processing, artificial intelligence, and medical image visualization, in particular to a multi-level interactive visualization method for surgical navigation. Background technique [0002] With the development of computer graphics technology, people's demand for 3D information is increasing day by day, 3D visualization technology is also developing rapidly, and its application in the field of medical imaging is becoming more and more extensive. In recent years, 3D visualization platforms for the medical field have emerged in an endless stream. However, due to various reasons such as transmission speed, file size, and rendering effect, the existing visualization platform has many defects, especially in the mobile terminal, such as insufficient computing power and slow rendering on the mobile terminal, which lead to great limitations in application scenarios. sex. And most of them only prov...

AI Technical Summary

Problems solved by technology

However, due to various reasons such as transmission speed, file size, and rendering effect, the existing visualization platform has many defects, especially in the mobile terminal, such as insufficient computing power and slow rendering on the mobile terminal, which lead to great limitations in application scenarios. sex

And most of them only provide preoperative image viewing or preoperative surgical planning, and cannot provide help during the operation

The emerging augmented reality (AR) technology makes it possible to present preoperative planning information to doctors in real time during the operation, but the current visualization platform for AR surgery is not perfect

During the operation, the existing medical imaging visualization platform can rarely provide auxiliary presentation of the lesion site. The doctor can only rely on the inference of the tumor location after the preoperative image analysis during the operation, which is more about the doctor's own experience. And technology

Images