Method and system for virtual surgery training based on mixed reality

Abstract

The invention relates to a method and a system for virtual surgery training based on mixed reality. The method establishes a digital three-dimensional model including a bony structure and a soft tissue according to whole body volume data of a real human body, so that the model data is accurate and can clearly reflect bones, muscles, blood vessels, and nerves and other information of a human body.Combined with a mixed reality head display, dynamic teaching, dynamic presentation, real-time communication and multi-site consultation and other functions can be realized. Coordinates of the digitized three-dimensional model are converted into a world coordinate system established with an operation platform as standard, and the coordinates are matched to an operation platform plane to achieve effect that a virtual object is naturally placed on the plane, thereby creating a realistic surgical atmosphere. According to relative positional relationship between surgical instruments and tissues inthe three-dimensional model, corresponding force feedback is applied to a hand, so that an operator can truly feel operation intensity, and experience hand tactile responses when the surgical instrument contacts different tissues and organs, so as to improve surgical training trueness.

Description

technical field [0001] The invention relates to the interdisciplinary technical field of biomedicine and information technology, in particular to a virtual surgery training method and system based on mixed reality. Background technique [0002] Biomedical Engineering (BME for short) is a marginal subject combining science, engineering and medicine, and is the product of the infiltration of various engineering disciplines into biomedicine. It uses the principles and methods of modern natural science and engineering technology to study the structure, function and relationship of the human body at multiple levels from the perspective of engineering, reveal its life phenomena, and provide new technologies for disease prevention and treatment. A comprehensive, high-tech discipline of means. The traditional surgical teaching method is to use simulated rubber figures for teaching, demonstration and playback of surgical videos, explanation of physical organ specimens, teaching of h...

AI Technical Summary

Problems solved by technology

[0003] 1. Model people are used for teaching. Model people are generally made of resin or latex materials, which are easy to age and need to be replaced after being used many times. The price of model people is relatively high, and frequent replacement of teaching aids greatly increases the cost of teaching

[0004] 2. In the teaching of human anatomy structure, watching video or autopsy teaching in the laboratory cannot make students learn the anatomical structure very intuitively and easily, and a lot of training costs are generated, such as textbook fees, autopsy fees, Internship fees, etc.

[0005] 3. The form of expert operation observation prevents medical workers from fully immersing themselves in the actual scene, and understands and learns various surgical operations through multiple senses such as audio-visual and tactile. For young doctors, it is impossible to personally operate and operate with experts. Timely comparison and discovery of one's own mistakes and deficiencies will undoubtedly waste a lot of cost and time in training young medical staff and fail to obtain good training results

If inexperienced medical students or interns are allowed to perform the operation, the risk of the operation will be greatly increased, and the safety of the patient's life will not be guaranteed, which will increase the hospital's subsequent expenditure costs and negative social impact due to the failure of the operation.

[0007] 5. Animal live anatomy teaching, on the one hand, live animals are very expensive and involve sensitive issues such as animal protection. On the other hand, due to the differences between animals and human bodies, it is very important for improving surgical proficiency during surgical training. limited

[0010] However, in the current virtual surgery training systems or methods, most of the training targets are designed by related software, which is not very authentic, and most of the training is in the form of tutorial training, which is relatively strong in theory, and is far from practical. There is still a big gap in clinical operation

Images