MR-based 3D visualized auxiliary diagnosis and treatment system

A technology of mixed reality and diagnosis and treatment system, applied in the field of image recognition and medical image processing, it can solve the problems of corresponding human body structure and anatomy parts that cannot be displayed in 3D, and achieve the effect of real-time interaction and remote operation participation and low cost

Inactive Publication Date: 2018-12-18
HEILONGJIANG TUOMENG TECH CO LTD
View PDF6 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide an auxiliary diagnosis and treatment system based on mixed reality three-dimensional visualization, so as to solve the problem that doctors cannot match the human body structure displayed in 3D with the real anatomical part of the patient during the operation, and then perform precise surgery

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • MR-based 3D visualized auxiliary diagnosis and treatment system
  • MR-based 3D visualized auxiliary diagnosis and treatment system
  • MR-based 3D visualized auxiliary diagnosis and treatment system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] This embodiment takes the auxiliary diagnosis and treatment of aortic disease as an example to illustrate the application effect of mixed reality technology in the auxiliary diagnosis and treatment of aortic disease.

[0060] refer to figure 1 , The present invention's 3D visual aided diagnosis and treatment system based on mixed reality technology includes a data preprocessing unit, a 3D reconstruction unit, a model uploading unit, and an auxiliary medical unit.

[0061] The data preprocessing unit is used to receive the aortic image provided by the hospital.

[0062] The 3D reconstruction unit includes a reconstruction module and a manual processing module. The reconstruction process is through the pipeline reconstruction method in vtk. However, due to the different source data, it may cause a lot of noise in the reconstruction, and there will be honeycomb defects on the generated target organ model or sharp spikes, there will be discrete fragments or clumps around t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an MR(mixed reality)-based 3D visualized auxiliary diagnosis and treatment system that comprises a data preprocessing unit for receiving a medical image provided by a hospitalon a cloud platform, and converting the medical image into a commonly used Dicom format for subsequent digitization processing; a 3D reconstruction unit for volume rendering the medical image by using a reconstruction technology in a vtk environment, generating an available STL format, then manually processing a 3D model to improve the model; a model uploading unit for converting the format of the model to generate a file format available for a MR system and uploading a file; and an auxiliary medical treatment unit for covering the human body with the 3D model by a MR device through a visualoverlay technology during an operation to help a doctor perform the operation. The application of the auxiliary diagnosis and treatment system in the medical field solves the problem that the doctor cannot perform the accurate operation by enabling the 3D displayed human body structure to correspond to the actual anatomical parts of a patient during the operation.

Description

technical field [0001] The invention belongs to the fields of image recognition and medical image processing, and relates to an auxiliary diagnosis and treatment system based on mixed reality three-dimensional visualization. Background technique [0002] Mixed reality refers to a new visual environment created by merging the real and virtual worlds, where physical and digital objects coexist and interact in real time. The realization of mixed reality needs to be in an environment that can interact with all things in the real world. If everything is virtual, it is virtual reality. If the displayed virtual information can only be simply superimposed on real things, it is augmented reality. . Combining the advantages of both is the ultimate goal of mixed reality. [0003] With the continuous development of science and technology, intelligent medical technology is also constantly improving. In the past, doctors were unable to match the 3D displayed human body structure with t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G16H50/20G16H80/00G06T19/00
CPCG06T19/006G16H50/20G16H80/00
Inventor 邱兆文张健
Owner HEILONGJIANG TUOMENG TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products