Remote operation guiding device based on Holols and operation method

A technology of remote surgery and operation method, applied in the field of mixed reality, can solve the problem that the surgical guidance process is not intuitive enough, achieve the effect of reducing transfer time and treatment time, improving the medical environment, and increasing the success rate

Pending Publication Date: 2020-03-27
CHONGQING UNIV OF POSTS & TELECOMM
View PDF15 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this method greatly facilitates the remote guidance of experts, there is still the problem of 2D annotation display, which makes the surgical guidance process not intuitive enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote operation guiding device based on Holols and operation method
  • Remote operation guiding device based on Holols and operation method
  • Remote operation guiding device based on Holols and operation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The technical solutions in the embodiments of the present invention will be described clearly and in detail below with reference to the drawings in the embodiments of the present invention. The described embodiments are only some of the embodiments of the invention.

[0044] The technical scheme that the present invention solves the problems of the technologies described above is:

[0045] Such as figure 1 As shown, the remote operation guidance system based on hololens of the present invention includes a three-dimensional reconstruction unit of the lesion, a physical modeling unit, a virtual operation unit and an intraoperative guidance unit, wherein:

[0046] The three-dimensional reconstruction unit A1 of the lesion and the geometric model reconstruction module A11 of the lesion carry out three-dimensional geometric three-dimensional reconstruction of the CT or MRI image of the lesion through the medical image processing software, and transmit it to the physical model...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a remote operation guiding device based on Holols and an operation method, and relates to the field of mixed reality (MR). The device comprises a pair of holens mixed reality glasses, a force feedback operation device and a terminal device. The method comprises the steps that a local holens carries out three-dimensional reconstruction on a CT or MRI image of a human body focus part to obtain a 3D virtual model, and sends the 3D virtual model to the terminal device; and a remote expert performs virtual surgery operation through the force feedback equipment at the terminal, sends the 3D virtual model and the surgery operation to the local holens mixed reality glasses, and performs registration display at the focus part of the patient. According to the invention, the mixed reality, the force feedback technology and the remote medical treatment are combined, so the medical personnel on site can clearly and visually see the operation of the remote expert on the operation, the operation guiding of the remote expert is facilitated, and the remote operation guiding efficiency and accuracy are improved.

Description

technical field [0001] The invention belongs to the field of mixed reality, and in particular relates to a hololens-based remote operation guidance device and an operation method. Background technique [0002] Telemedicine is one of the ways to solve the problem of scarcity and uneven distribution of superior medical resources. In foreign countries, telemedicine was carried out earlier. In 2006, NASA carried out remote diagnostic guidance based on ultrasound images for astronauts on the International Space Station. The remote surgical guidance under wearable high-definition video broadcast was also earlier. In 2013, the United States The University of Alabama at Birmingham used Google Glass to perform remote virtual surgery. At present, the surgical guidance system based on high-definition video has been widely used in China, but most remote surgical guidance systems are based on 2D screens for viewing and instruction operations, making the remote guidance of experts rough,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G16H40/67G06T19/00G06T17/00
CPCG16H40/67G06T19/006G06T17/00
Inventor 李红波王敏吴渝
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products