Auxiliary surgery system and method for automatic coincidence and matching of 3D model and surgical patient

A surgical system and automatic coincidence technology, applied in the field of auxiliary surgical systems, can solve problems such as low efficiency

Active Publication Date: 2020-06-12
无锡蓝软智能医疗科技有限公司
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention solves the problem that the doctor's line of sight switches back and forth between the actual surgical site and the display in the existing surgical process, and the problem of low efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Auxiliary surgery system and method for automatic coincidence and matching of 3D model and surgical patient
  • Auxiliary surgery system and method for automatic coincidence and matching of 3D model and surgical patient
  • Auxiliary surgery system and method for automatic coincidence and matching of 3D model and surgical patient

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach 1

[0113] Augmented reality assisted surgery system, including:

[0114] The 3D model file loading module is used to load the 3D model file (the 3D model file synthesized by the multi-layer scanning photos) established by CT, MRI and other (multi-layer scanning) equipment;

[0115] The 3D model file presentation module presents the 3D model through AR technology based on the AR glasses; it may be that the doctor wears the AR glasses, and the AR glasses initially present the 3D model at 0.2m in front of the human eye by default; the glasses also have a camera;

[0116] The gear selection module is used to provide the mode selection of automatic coincidence matching and manual coincidence matching between the 3D model and the surgical patient; and the neutral gear selection gear, model position shift gear, model rotation gear, and model size adjustment under the mode of manual coincidence matching file, component selection file, transparency adjustment file, model color adjustment ...

specific Embodiment approach 2

[0139] The automatic matching and overlapping module described in this embodiment performs the process of automatically overlapping and matching the 3D model and the surgical patient, including the following steps:

[0140] For the situation of the thoracic cavity, that is, set two nipple markers on the surgical patient, and draw a black straight line to draw the midline of the sternum:

[0141] Black straight line positioning:

[0142]a1. Continuously read the two-dimensional pictures in the video captured by the AR glasses camera, and cycle each pixel in a spiral form from the middle point of the two-dimensional picture until the first black pixel is found (the color density error can be determined according to the actual situation. Select, in this embodiment, the color density error can be judged as black within 20%, denoted as point A,

[0143] b1. Based on the found point A, record the coordinates of point A into the stack array, and then use point A as the center of the...

specific Embodiment approach 3

[0151] The automatic matching and overlapping module described in this embodiment performs the process of automatically overlapping and matching the 3D model and the surgical patient, including the following steps:

[0152] For the situation of the abdominal cavity, that is, to set a navel mark point on the surgical patient, and draw a black straight line to draw the midline of the sternum:

[0153] Black straight line positioning:

[0154] a2. Continuously read the two-dimensional pictures in the video captured by the AR glasses camera, and cycle each pixel in a spiral form from the middle point of the two-dimensional picture until the first black pixel is found (the color density error can be determined according to the actual situation. Select, in this embodiment, the color density error can be judged as black within 20%, denoted as point A,

[0155] b2. Based on the found point A, record the coordinates of point A into the stack array, and then use point A as the center o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An augmented reality assisted surgery system and a method for automatically overlapping and matching a 3D model with a surgical patient relate to an assisted surgery system and method. In order to solve the problem that the doctor's line of sight switches back and forth between the actual surgical site and the display in the existing surgical process, and the problem of low efficiency. The system of the present invention includes: a 3D model file loading module for loading a 3D model file, a 3D model file presentation module for presenting a 3D model through AR technology based on AR glasses, an automatic coincidence matching and manual matching for providing a 3D model and an operation patient. A gear selection module for mode selection of coincidence matching, an automatic matching and coincidence module for automatic coincidence and matching of the 3D model and the surgical patient, and a manual matching and coincidence module for manual coincidence and matching of the 3D model and the surgical patient. The invention is suitable for auxiliary implementation of operations.

Description

technical field [0001] The invention relates to an auxiliary operation system and method. Background technique [0002] At present, doctors need to conduct CT, MRI and other (multi-layer scanning) examinations through patients before surgical treatment, and generate 3D model files of corresponding parts, and display them on a two-dimensional display; Understand and familiarize yourself with the 3D model files of the site, and formulate the corresponding surgical plan (including the sequence of surgery). In the actual operation process, the camera needs to image the surgical site, and then the doctor takes a look at the surgical site or the 3D model file presented on the monitor, and then focuses his sight and attention on the actual surgical site, according to the doctor's understanding of the 3D model The memory of the file performs surgery on the lesion or the diseased part. In view of this situation, the doctor's line of sight not only needs to switch back and forth bet...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): A61B34/10A61B34/20G06K9/00G06T19/00
CPCG06T19/006A61B34/10A61B34/20A61B2034/105G06V40/28G06V20/20
Inventor 谢锋
Owner 无锡蓝软智能医疗科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products