Operation guiding system and method based on optical enhancement reality technology

A technology of surgical navigation and reality technology, which is applied in the field of surgical navigation system based on optical augmented reality technology, can solve the problems of requiring manual alignment and having great influence on accuracy, and achieves increased accuracy, high precision, and solves the problem of automatic calibration. Effect

Inactive Publication Date: 2010-12-08
FUDAN UNIV
View PDF0 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Tuceryan describes a calibration method for optical HMDs - the Single Point Active Alignment Method (SPAAM) [4] , achieve

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Operation guiding system and method based on optical enhancement reality technology
  • Operation guiding system and method based on optical enhancement reality technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] Such as figure 1 As shown, the surgical navigation system based on optical augmented reality technology of the present invention includes: an external calibration board with a number of color calibration points on the board, which is convenient for automatic identification of the computer in the calibration process; HMD is an optical see-through helmet display. Among them, the light dot matrix is ​​generated on the display screen; the camera is used to align the HMD display screen to shoot the computer-generated light dot matrix and the color calibration points on the calibration board seen through the display screen, and output image data; the computer, It mainly includes: a tracking module, used to receive the information of six degrees of freedom output by the space locator, and convert it into a data format recognizable by the program, and receive the digital image data output by the camera; a calibration module, used to identify the digital photos taken The two-dim...

Embodiment 2

[0035] The surgical navigation method based on optical augmented reality technology requires preoperative registration and calibration. The working diagram of the system is as follows: figure 2shown. The entire registration and calibration process is as follows: firstly, a pre-prepared calibration board is placed in the scene to be worked, with several color calibration points on it. The computer draws the dot matrix of known coordinates and displays it on the HMD display through video cable transmission. Fix the camera in front of the HMD display, and shoot the color calibration points and the light dot matrix on the HMD display through the display. The collected digital images are sent to the computer, and after noise reduction processing, the images are scanned line by line, and the target calibration points are found according to the pre-set colors, and the light dot matrix is ​​recognized at the same time. The three-dimensional world coordinates of the color calibrati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of medical equipment, relating to an operation guiding system and method based on an optical enhancement reality technology. The method comprises the steps of: displaying optical lattice generated by a computer on a display screen of an optical helmet display; shooting a calibration plate and the optical lattice through the display screen by a camera; recognizing the optical lattice and colour calibration points in the shot digital image and acquiring two-dimension coordinates of the optical lattice and colour calibration points by the computer; calculating mapping of the three-dimensional space of the calibration points to the two-dimensional space of an imaging surface of the optical helmet display to complete the calibration; and drawing corresponding virtual information according to the required mapping, and displaying the information on the display screen of the optical helmet display to realize the enhancement of operation scene. The invention can well support the application of the enhancement reality technology to the operation guiding system.

Description

technical field [0001] The invention belongs to the field of medical devices, and in particular relates to a surgical navigation system and method based on optical augmented reality technology. Background technique [0002] Traditional surgical navigation, also known as image-guided surgery (IGS: Image guided surgery), is based on medical image information such as CT and MRI. By reconstructing an accurate three-dimensional human body model and using a high-precision positioning system to track the position information of patients and surgical instruments, During the operation, real-time computer simulation is used to monitor the operation process. Surgical navigation can assist doctors to formulate preoperative plans, reduce surgical trauma areas, protect important tissue structures, improve surgical quality, and reduce accident rates, which has very positive clinical significance. [0003] Although the application of IGS has brought great convenience to surgery, the surgeo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): A61B19/00A61B34/20
Inventor 宋志坚王满宁姚德民李文生杜文健
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products