Application method of hybrid reality-based auxiliary diagnosis and treatment system in neurosurgery

A mixed reality and neurosurgery technology, applied in the field of image recognition and medical image processing, can solve the problems of normal tissue trauma and low accuracy, and achieve the effect of reducing surgical risks, reducing doctor-patient disputes, good business prospects and value

Inactive Publication Date: 2019-01-04
HEILONGJIANG TUOMENG TECH CO LTD
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide an application method of an auxiliary diagnosis and treatment system based on mixed reality in neurosurgery, so as to solve the problems of low accuracy and easy trauma to normal tissues in neurosurgery

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Application method of hybrid reality-based auxiliary diagnosis and treatment system in neurosurgery
  • Application method of hybrid reality-based auxiliary diagnosis and treatment system in neurosurgery
  • Application method of hybrid reality-based auxiliary diagnosis and treatment system in neurosurgery

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] A method for extracting facial image feature point data comprises:

[0052] Step 1. Use 90 feature points to locate the face. The feature points are distributed as follows: 18 points mark the mouth, 14 points mark the jaw, 12 points mark the eyes, 6 points mark the eyebrows, and 4 points mark the cheeks and gills 10 dots mark the nose, 4 dots mark the nape of the neck, 10 dots mark the ears, and 12 dots mark the hair. Such as figure 1 shown.

[0053] Step 2: Establish a Cartesian coordinate system, draw up any origin, record the coordinate information of feature points, and construct point cloud data. The point cloud data is a coordinate array with 90 rows and 3 columns, and the distribution of the 3 columns corresponds to the x, y, and z coordinate values, and each row represents a different feature point.

[0054] Step 3: Convert the point cloud data into a QR code for storage, which is convenient for mixed reality devices to scan and identify.

Embodiment 2

[0056] A feature point positioning method based on mixed reality, comprising:

[0057] Step 1. The doctor wears the mixed reality device, scans the QR code with the patient's characteristics, and obtains the characteristic point cloud model. The process is as follows: image 3 shown.

[0058] Step 2: Name the patient feature point cloud as p, and the model point cloud as q. The center of gravity of the point cloud is calculated by the following formula:

[0059]

[0060]

[0061] Use the obtained point cloud center of gravity to construct the covariance matrix:

[0062]

[0063] Step 3. Next, enter the ICP algorithm for model registration. The function of ICP is to match two data sets with different numbers. Then the application of ICP needs to use the covariance matrix to construct a 4×4 symmetric matrix:

[0064]

[0065] Among them, the largest eigenvector through this symmetric matrix can be used to calculate the rotation parameters, and then find the R and T ...

Embodiment 3

[0069] This embodiment illustrates the technical solution of the present invention for the process of providing navigation assistance for brain tumor patients.

[0070] Step 1. To mark the brain tumor on the model, and then upload the picture to the mixed reality device.

[0071] Step two, such as Figure 6 As shown, the doctor operates the pointer, that is, the direction of the line of sight of the mixed reality glasses, and the system detects the center of the mark, and determines the position of the opening through two points and one line.

[0072] Step 3. The size of the opening is tangent to the direction of the opening. The extension line between the tangent and the tangent position of the marked tumor will intersect with the brain boundary. The distance between the intersections is the distance to be compensated; in order to prevent opening errors, the system calculates the actual opening distance through compensation calculations , the compensation distance is 1mm, su...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an application method of hybrid reality-based auxiliary diagnosis and treatment system in neurosurgery, which comprises three parts including facial feature point extraction,model and facial feature registration in a mixed reality device, and surgery-assisted navigation. A medical image position technology, a registration technology and a feature recognition technology are integrated together, and a set of three-dimensional visualization-assisted diagnosis and treatment system base on hologram is completed by combining a hybrid reality device, and that system is applied to neurosurgery. The system can effectively complete the preoperative planning and the completion of the operation to provide a reliable guarantee for the completion of the operation, reduce the risk of surgery, reduce doctor-patient disputes, has a good commercial prospects and value.

Description

technical field [0001] The invention belongs to the fields of image recognition and medical image processing, and relates to an application method of an auxiliary diagnosis and treatment system based on mixed reality in neurosurgery. Background technique [0002] Mixed reality refers to a new visual environment created by merging the real and virtual worlds, where physical and digital objects coexist and interact in real time. The realization of mixed reality needs to be in an environment that can interact with all things in the real world. If everything is virtual, it is virtual reality. If the displayed virtual information can only be simply superimposed on real things, it is augmented reality. . Combining the advantages of both is the ultimate goal of mixed reality. [0003] Medical image navigation system for neurosurgery is a field that develops very rapidly in recent years. In developed countries, this type of navigation technology has been widely used clinically. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): A61B34/20
CPCA61B34/20A61B2034/2065
Inventor 邱兆文张健张相彤梁洪生
Owner HEILONGJIANG TUOMENG TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap