Soft tissue adaptive deformation method based on mixed reality and 3DGAN

A mixed reality and soft tissue technology, applied in the medical field, can solve problems such as soft tissue 3D model self-adaptation, achieve the effect of reducing the burden of surgery, improving safety and success rate, and clearing the situation

Pending Publication Date: 2022-02-25
SHENZHEN UNIV
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In order to solve the problems in the prior art, the present invention provides a soft tissue adaptive deformation method and system based on mixed reality and 3DGAN to solve the problem of soft tissue three-dimensional model self-adaptation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Soft tissue adaptive deformation method based on mixed reality and 3DGAN
  • Soft tissue adaptive deformation method based on mixed reality and 3DGAN
  • Soft tissue adaptive deformation method based on mixed reality and 3DGAN

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments.

[0057] like figure 1 As shown, the adaptive deformation method of the present invention comprises the following steps:

[0058] At the beginning, judge whether to train the nested 3DGAN (into confrontation network) network model, if yes, perform the adaptive deformation step, if not, perform the nested 3DGAN network model training step A, including the following steps:

[0059] A1: Obtain a training set of soft tissue deformation, the training set includes multiple sets of different body membrane models;

[0060] A2: Use the training set to train the generator network and the discriminator network of the local mapping network until the Nash equilibrium is reached;

[0061] A3: Train the generator network and discriminator network of the global detection network until the Nash equilibrium is reached;

[0062] A4: The training is complete, en...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a soft tissue adaptive deformation method and system based on mixed reality and 3DGAN, and belongs to the technical field of medical treatment. The method comprises the following steps: collecting a preoperative global three-dimensional model, and converting the preoperative global three-dimensional model into point cloud data; collecting local image depth map data of a patient in an operation in real time, and converting the local image depth map data into point cloud data; the obtained point cloud data are sent to a nested 3DGAN network model, and local deformation is mapped to global deformation; and converting the obtained deformed point cloud global data into a three-dimensional model. The invention further provides a system which is used for realizing the soft tissue adaptive deformation method based on the mixed reality and the 3DGAN. The method has the advantages that in the operation process, according to the local image of the patient, human body soft tissue deformation in the operation can be matched with the pre-operation virtual three-dimensional model, and the three-dimensional model after soft tissue deformation in the body of the patient is generated in real time.

Description

technical field [0001] The invention relates to a medical technology, in particular to a soft tissue adaptive deformation method based on mixed reality and 3DGAN. Background technique [0002] During traditional surgery, doctors need to combine their professional knowledge with preoperative CT or MR scans to conceive a three-dimensional model of the patient's body during surgery. The intraoperative navigation system is a relatively novel surgical assistance method. It matches the patient's body 3D model with the intraoperative anatomical structure through the registration method, and then the virtual 3D model overlaps with the real patient and is displayed to the doctor through the corresponding imaging equipment. , so that the doctor can clearly understand the anatomical position of the patient during the operation, improve the safety and success rate of the operation, and effectively reduce the surgical burden of the doctor. [0003] The existing intraoperative navigation...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T19/00G06N3/04G06N3/08G16H30/20
CPCG06T17/00G06T19/006G06N3/08G16H30/20G06N3/045
Inventor 夏羽刘安然
Owner SHENZHEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap