Unlock instant, AI-driven research and patent intelligence for your innovation.

Augmented reality surgical image generating method and device, apparatus and storage medium

An augmented reality and image technology, applied in the field of image processing, can solve the problems of low operation efficiency and safety, and the inability of doctors to provide perspective angles, so as to achieve the effect of improving efficiency and safety

Pending Publication Date: 2018-12-18
SHENZHEN UNIV
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a method, device, device and storage medium for generating augmented reality surgical images, aiming to solve the problem that in the prior art, when surgical operations are guided by surgical images, the doctor's line of sight needs to be between the display screen and the patient. Reciprocating movement also cannot provide doctors with a perspective view, resulting in low efficiency and safety of surgery

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmented reality surgical image generating method and device, apparatus and storage medium
  • Augmented reality surgical image generating method and device, apparatus and storage medium
  • Augmented reality surgical image generating method and device, apparatus and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] figure 1 The implementation process of the method for generating augmented reality surgical images provided by Embodiment 1 of the present invention is shown. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

[0026] In step S101, the scene image of the operation scene is collected by the camera, and the scene image is registered.

[0027] The embodiment of the present invention is applicable to an image processing platform or system, and the scene image of the surgical scene is collected by a camera preset in the surgical scene, and the scene image is registered to realize the registration of the external scene image of the operation. Preferably, when the scene images are registered, the scene images are registered through a preset marker point positioning method (such as an image registration algorithm based on marker points), so as to effectively improve the registration e...

Embodiment 2

[0040] figure 2 The structure of the device for generating augmented reality surgical images provided by Embodiment 2 of the present invention is shown. For the convenience of description, only the parts related to the embodiment of the present invention are shown, including:

[0041] The external image registration unit 21 is configured to collect scene images of the operation scene through the camera, and perform registration on the scene images.

[0042]In the embodiment of the present invention, the scene images of the surgical scene are collected by a camera pre-set in the surgical scene, and the scene images are registered, so as to realize the registration of the external scene images of the operation. Preferably, when the scene images are registered, the scene images are registered through a preset marker point positioning method, so as to effectively improve the registration effect of the scene images.

[0043] The endoscope image acquisition unit 22 is configured t...

Embodiment 3

[0062] Figure 4 The structure of the image processing device provided by the third embodiment of the present invention is shown, and for the convenience of description, only the parts related to the embodiment of the present invention are shown.

[0063] The device 4 of the embodiment of the present invention includes a processor 40 , a memory 41 and a computer program 42 stored in the memory 41 and operable on the processor 40 . When the processor 40 executes the computer program 42, the steps in the above-mentioned method embodiments are realized, for example figure 1 Steps S101 to S104 are shown. Alternatively, when the processor 40 executes the computer program 42, the functions of the units in the above-mentioned device embodiments are realized, for example figure 2 Function of units 21 to 24 shown.

[0064] In the embodiment of the present invention, the scene image of the operation scene is collected by the camera, the scene image is registered, and the endoscopic ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention is applied to the technical field of image processing and provides an augmented reality surgical image generating method and device, an apparatus and a storage medium. The method comprises: collecting images of a surgical scene by a camera; registering the scene image, and obtaining the endoscopic position in the surgical scene by the camera, and acquiring the endoscopic image acquired by the endoscope; depending on the position of the endoscope, performing registration of the endoscopic image and the pre-constructed three-dimensional CT image, generating a registration image ofthe endoscopic image and a three-dimensional CT image, and displaying and outputting the registered image and a registered scene image by an augmented reality display device to obtain the corresponding augmented reality surgical image. The method can guide the doctor through the augmented reality surgical image, so that the doctor can simultaneously observe the internal and external scenes of theoperation through the augmented reality surgical image, and can provide a perspective angle for the doctor, thereby improving the efficiency and safety of the operation.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a method, device, equipment and storage medium for generating an augmented reality surgical image. Background technique [0002] Traditional surgery must cut through many layers of healthy tissue to reach the target tissue, causing severe damage to healthy tissue. In order to reduce costs while de-traumating the patient, traditional surgical procedures are being replaced by minimally invasive procedures, such as image-guided surgery systems, which aim to enhance and complement the The doctor's ability to understand the spatial structure of bones. [0003] In image-guided surgery, physicians can reduce trauma and improve accuracy and safety during surgical procedures by utilizing medical imaging technology. However, there are some problems with existing image-guided surgery systems. Firstly, the doctor has to look away from the patient to the display, which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00
CPCG06T19/006G06T2210/41
Inventor 石大明
Owner SHENZHEN UNIV