Head and neck tumor operation simulation training system based on UE5 engine

Abstract

The invention provides a head and neck tumor operation simulation training system based on a UE5 engine. The system comprises a rendering system, a display system, an interaction system, a control system, a physical simulation system, an operation process simulation system and a data recording and feedback system. According to the method, a more vivid 3D model and scene are created by utilizing the UE5 engine, a more real visual effect is provided, meanwhile, the physical simulation function of the UE5 engine can simulate interaction between the surgical instrument and the tissue, a more vivid tactile feedback effect is provided, the reality sense and effectiveness of simulation are greatly improved, and the method is suitable for popularization and application. According to the system, a safe and low-cost training platform is provided for medical workers through a highly-vivid 3D graph and a real operation process, and a user can perform simulation training of a half-tongue resection operation without depending on a real patient. Meanwhile, due to the fidelity and interactivity of the simulation system, the surgical skills of the user can be effectively improved.

Description

Technical Field

[0001] The present invention relates to the technical field of mixed reality, and in particular to a head and neck tumor surgery simulation system developed using the UE5 (Unreal Engine 5) engine, which is displayed through MR glasses. Background Art

[0002] Head and neck tumor surgery is a very complex operation that requires doctors to have superb surgical skills and rich experience. In traditional surgical training, doctors can usually only accumulate experience through actual surgery or animal experiments, which is not only costly but also has certain ethical issues. With the development of computer technology, surgical simulation systems have gradually become an effective training method.

[0003] Traditional simulation systems are usually based on simple 2D images or simplified 3D models, lacking realistic visual and physical effects, and unable to provide a realistic surgical experience. Despite the continuous advancement of 3D graphics technology in recent years, traditional simulation systems still cannot achieve realistic effects, especially in the simulation of tissue structure and surgical procedures. With the development of virtual reality (VR) and computer graphics, surgical training methods using computer simulation have become possible. However, existing simulation systems still need to be improved in terms of realism, interactivity, and accuracy of surgical procedures.

[0004] In recent years, the rise of mixed reality (MR) technology has provided new possibilities for surgical simulation. MR technology can combine the virtual world with the real world to provide users with an immersive experience. Through MR glasses, users can be more deeply immersed in the simulation environment and gain a more realistic surgical experience. However, the existing MR simulation system still has some problems in the application of head and neck tumor surgery.

[0005] First, the realism of the model is insufficient. Existing simulation systems usually use simplified 3D models to simulate tissue structures, lacking real textures, colors, and details. This makes the simulation system unable to provide realistic visual effects and reduces the realism of the simulation.

[0006] Secondly, the interaction methods are limited. In existing simulation systems, users can usually only simulate the surgical process through simple operations, lacking simulation of the delicate operations in actual surgery. This makes it impossible for users to fully experience the operation feeling in actual surgery, reducing the effectiveness of the simulation.

[0007] In addition, the existing technology lacks accurate simulation of the surgical process. In existing simulation systems, the surgical process is usually simplified or ignored, and it is impossible to provide a complete simulation of the surgical process. This makes it impossible for users to understand and master the key steps and techniques in actual surgery, reducing the guiding role of the simulation.

[0008] In summary, the existing head and neck tumor surgery simulation system still has deficiencies in terms of realism, interactivity, and accuracy of surgical procedures. The existence of these problems limits the effectiveness and application scope of the simulation system. Therefore, it is necessary to develop a head and neck tumor surgery simulation training system that can meet all the following requirements:

[0009] (1) Real-time and responsiveness: Surgical simulation needs to provide a high degree of real-time and responsiveness in a real-time environment to ensure that the simulation can respond quickly to user operations.

[0010] (2) Fine graphics and rendering quality: Surgical simulation requires high graphics precision and realism, which may require a powerful graphics rendering engine to achieve.

[0011] (3) Realistic physical simulation: Surgical simulation may require realistic physical simulation, including tissue deformation and cutting, which requires the support of a highly accurate physics engine.

[0012] (4) Interactivity and user interface design: Surgical simulation requires the design of an intuitive and easy-to-use user interface to support doctors in performing simulation operations and ensure the accuracy and efficiency of the operations.

[0013] (5) Data processing and visualization: Surgical simulation usually requires a large amount of medical image data for processing and visualization, which requires efficient data processing and visualization technology. Summary of the invention

[0014] In order to overcome the above technical defects, the purpose of the present invention is to provide a head and neck tumor surgery simulation training system based on UE5 engine, which includes:

[0015] A rendering system, wherein the rendering system is used to render a virtual 3D tissue model and a virtual 3D scene generated by a UE5 engine;

[0016] A display system, which is MR glasses, used to display the 3D tissue model and 3D scene as well as the simulation status of head and neck tumor surgery in real time;

[0017] An interactive system, the interactive system is used to obtain surgical operations input by one or more users, and is also used to display the user's operation data and operation feedback results using the data visualization tool of the UE5 engine;

[0018] A control system, the control system is used to process user input and drive the operation of the physical simulation system and the surgical process simulation system; it is also used to use the UE5 engine's script system to achieve accurate simulation of the surgical process and update the simulation state in real time according to the user's operation; it is also used to transmit the user's operation data to the data recording and feedback system in real time;

[0019] A physical simulation system, wherein the physical simulation system is used to realize virtual physical interaction simulation between virtual surgical instruments and virtual 3D tissues by using the Niagara particle system and physics engine of the UE5 engine;

[0020] A surgical process simulation system, which is used to use the animation system and behavior tree system of the UE5 engine to realize various surgical actions and process control of the actual surgical process;

[0021] The data recording and feedback system is used to record the user's operation data in real time, analyze the operation quality through AI algorithms, and provide operation feedback and suggestions.

[0022] Furthermore, the rendering system utilizes the graphics rendering capabilities of UE5 and combines the Lumen lighting system to generate a virtual 3D scene; the rendering system optimizes rendering through one or more methods of LOD technology, real-time rendering technology, material and texture optimization, avoiding excessive details, pipeline optimization, adaptive refresh rate, reducing anti-aliasing level, avoiding transition rendering, hardware acceleration, and user-defined settings to construct a virtual 3D tissue model.

[0023] Furthermore, the virtual physical interaction simulation includes simulation of physical properties of surgical instruments and simulation of tissue characteristics.

[0024] Furthermore, the interactive system realizes natural interaction between the user and the virtual environment through head tracking and hand motion capture.

[0025] Furthermore, the AI ​​algorithm includes one or more of a supervised learning algorithm, an unsupervised learning algorithm, a reinforcement learning algorithm, a deep learning algorithm, a genetic algorithm, a natural language processing algorithm, a recommendation algorithm, and a chatbot algorithm.

[0026] Furthermore, the head and neck tumor surgery includes one or more of maxillofacial surgery, laryngeal cancer resection surgery, tongue cancer resection surgery, cervical lymph node dissection surgery, and neck tumor resection surgery.

[0027] Compared with the prior art, the above technical solution has the following beneficial effects:

[0028] The present invention provides a simulation system for hemiglossectomy surgery based on the UE5 engine. By using the UE5 engine, we can create more realistic 3D models and scenes, provide more realistic visual effects, and at the same time, the physical simulation function of the UE5 engine can simulate the interaction between surgical instruments and tissues, and provide more realistic tactile feedback effects, which will greatly improve the realism and effectiveness of the simulation. The system provides a safe and low-cost training platform for medical workers through highly realistic 3D graphics and real surgical procedures. By using the simulation system of the present invention, users can perform simulation training for hemiglossectomy surgery without relying on real patients. This not only reduces the training cost, but also avoids ethical issues. At the same time, due to the realism and interactivity of the simulation system, the user's surgical skills can be effectively improved. In addition, the simulation system can also be used for teaching and demonstration of surgery, which helps to promote correct surgical techniques and operation methods. The technical solution of the present application is applicable to head and neck tumor surgery, for example: (1) Maxillofacial surgery: used to treat tumors of the maxillofacial bones, including the jaw, cheek bones, etc. (2) Laryngeal cancer resection surgery: surgery for laryngeal tumors, which may involve the resection and reconstruction of the larynx. (3) Tongue cancer resection: Surgery for tongue tumors, which can be partial or complete tongue resection. (4) Neck lymph node dissection: Surgery for neck lymph nodes, usually used to examine and remove lymph nodes that may be affected by tumors. (5) Neck tumor resection: Surgery for tumors in other parts of the neck, which may involve the removal of soft tissue, blood vessels, etc. The specific type of surgery may depend on the patient's specific condition, the nature, location and spread of the tumor, and the doctor's treatment plan.

[0029] The invention provides a surgical simulation system with higher fidelity, stronger interactivity and more accurate surgical process by combining with UE5 engine. Compared with the prior art, the invention has the following advantages:

[0030] 1. Use the UE5 engine to create highly realistic 3D models: Through the powerful graphics rendering capabilities of the UE5 engine, we are able to create tissue models (such as a half-tongue tissue model) with realistic textures, colors, and details. Users can get more realistic visual effects in the simulation system, which helps to improve the realism of the simulation and the user's immersion. For example: (1) Advanced graphics and rendering: The advanced graphics technology of the UE5 engine can provide high-quality rendering effects and enhance the visual realism of surgical simulation. (2) Real-time lighting and shadows: The real-time lighting and shadow technology of the UE5 engine can improve the visual effects of surgical simulation and increase realism. (3) Niagara particle system: The Niagara particle system of UE5 can be used to simulate biophysical processes such as blood flow and tissue cutting.

[0031] 2. Introducing precise interaction methods: With the input device support of the UE5 engine, we can achieve more sophisticated operation control. Users can use MR glasses and handles and other devices to simulate surgical operations such as cutting and suturing to get a more realistic sense of operation. This improved interaction method not only improves the effectiveness of the simulation, but also helps users better master the operation skills in actual surgery. The UE5 engine's support for virtual reality technology may make surgical simulations more interactive and immersive.

[0032] 3. Accurate simulation of surgical procedures: Through the UE5 engine's scripting system and physics engine, we can accurately simulate each link in the surgical procedure. From preoperative preparation to surgical implementation to postoperative recovery, the entire process can be accurately reproduced in the simulation system. This precise simulation helps users better understand and master the key steps and techniques in actual surgery and improve the effectiveness of surgical training.

[0033] 4. User feedback and data recording: By recording the user's operation data in real time and analyzing it with AI algorithms, we can provide more accurate operation feedback and suggestions. At the same time, using UE5's data visualization tools, we display the operation data in the form of charts and other forms to achieve data visualization, which can better process and analyze medical image data and facilitate users to conduct self-evaluation and improvement. This feedback mechanism helps to improve users' learning effects and skills in simulation training.

[0034] 5. Reduce costs and risks: Through the hemiglossectomy surgery simulation system, medical workers can conduct simulation training before the actual surgery, which helps to reduce the risks and costs of the actual surgery. At the same time, through simulation training, medical workers can better familiarize themselves with the surgical process and skills, and improve the success rate of the surgery.

[0035] 6. Environmental sustainability: Compared with animal experiments or actual human surgery, using the hemiglossectomy surgery simulation system for training can reduce harm to animals and humans, and is more in line with the concepts of environmental protection and sustainable development. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 This is a structural framework diagram of the head and neck tumor surgery simulation training system based on the UE5 engine of this application.

[0037] Figure 2 Example screenshot of the user interface for the physics simulation system.

[0038] Figure 3 The surgical process simulation system controls the various surgical actions and processes of the actual surgical process through the behavior tree system.

[0039] Figure 4The surgical process simulation system controls the various surgical actions and processes of the actual surgical process through the animation system. DETAILED DESCRIPTION

[0040] The advantages of the present invention are further described below in conjunction with the accompanying drawings and specific embodiments. Those skilled in the art should understand that the following specific description is illustrative rather than restrictive, and should not be used to limit the scope of protection of the present invention.

[0041] This embodiment provides a simulation training system for hemiglossectomy based on the UE5 engine. Figure 1 As shown, the system includes: a rendering system, a display system, an interactive system, a control system, a physical simulation system, a surgical process simulation system, and a data recording and feedback system.

[0042] The rendering system is used to generate virtual 3D tissue models and virtual 3D scenes using UE5 engine rendering. The rendering system uses UE5's graphics rendering capabilities and combines the Lumen lighting system to generate virtual 3D scenes; the rendering system optimizes rendering through one or more of the following methods: LOD technology, real-time rendering technology, material and texture optimization, avoiding excessive details, pipeline optimization, adaptive refresh rate, reducing anti-aliasing levels, avoiding over-rendering, hardware acceleration, and user-defined settings, to construct a virtual 3D tissue model.

[0043] The display system is MR glasses, which are used to display 3D tissue models and 3D scenes in real time as well as the simulation status of head and neck tumor surgery;

[0044] The interactive system is used to obtain surgical operations input by one or more users, and is also used to display the user's operation data and operation feedback results using the UE5 engine's data visualization tools; the interactive system achieves natural interaction between the user and the virtual environment through head tracking and hand motion capture.

[0045] The control system is used to process user input and drive the operation of the physical simulation system and the surgical process simulation system; it is also used to use the UE5 engine's script system to achieve accurate simulation of the surgical process and update the simulation state in real time according to the user's operation; it is also used to transmit the user's operation data to the data recording and feedback system in real time;

[0046] like Figure 2 As shown, the physical simulation system is used to utilize the Niagara particle system and physics engine of the UE5 engine to implement virtual physical interaction simulation between virtual surgical instruments and virtual 3D tissues, for example, simulation of the physical properties of surgical instruments and simulation of tissue characteristics.

[0047] like Figure 3 and Figure 4As shown, the surgical process simulation system is used to use the animation system and behavior tree system of the UE5 engine to realize various surgical actions and process control of the actual surgical process;

[0048] The data recording and feedback system is used to record the user's operation data in real time, analyze the operation quality through AI algorithms, and provide operation feedback and suggestions. AI algorithms include one or more of supervised learning algorithms, unsupervised learning algorithms, reinforcement learning algorithms, deep learning algorithms, genetic algorithms, natural language processing algorithms, recommendation algorithms, and chatbot algorithms.

[0049] The process of using the above-mentioned UE5 engine-based simulation training system for hemiglossectomy surgery to perform simulation training for hemiglossectomy surgery is as follows:

[0050] Step S1: Preparation

[0051] 1. Obtain CT images: Computed tomography is used to obtain detailed CT images of the patient's head and neck in order to accurately identify the location of the tumor and surrounding structures.

[0052] 2. Tumor extent determination: Using image processing and analysis tools, doctors identify and demarcate the edges of the tumor to ensure that the area involved during surgery is clear.

[0053] 3. Determination of the scope of surgical resection: Based on the extent of the tumor and surrounding anatomical structures, the doctor makes manual judgment to determine the scope of surgical resection to maximize tumor removal while preserving important structures.

[0054] 4. Surface unfolding: CT images are unfolded to better understand and visualize the head and neck structures, providing a more intuitive operating interface for surgical simulation.

[0055] Step S2: Perform simulation training using a simulation training system and following the actual process of hemiglossectomy surgery

[0056] 1. Fixed point: In the simulated environment displayed by the MR glasses, the doctor can select the specific fixed point for surgical resection to simulate the operation on a specific location in the actual operation.

[0057] MR glasses (mixed reality glasses) are usually composed of multiple structures, each with a specific function. The following are some of the structures that may be included and their basic functions: (1) Display module: Structure: A small display or projection system integrated into the glasses. Function: Provide users with the ability to see virtual content in front of their eyes, allowing the real world to merge with virtual information. (2) Lens system: Structure: A lens component used to adjust the optical focal length and focus. Function: Enable users to clearly see the virtual projection while maintaining appropriate focus with the real world. (3) Sensor module: Structure: Includes various sensors such as gyroscopes, accelerometers, magnetometers, etc. Function: Provides glasses with real-time tracking of user head movements in order to adjust the position and direction of the virtual projection. (4) Computing module: Structure: A small computing device integrated into the glasses, such as a processor, memory, etc. Function: Processes and runs mixed reality applications to ensure real-time and responsiveness. (5) Power module: Structure: Includes batteries and charging circuits. Function: Provides power to the various components of the glasses to ensure the normal operation of the device. (6) Perception module: Structure: May include cameras and other sensors. Function: Enables the glasses to perceive and understand the real world around them, and supports interaction between virtual and real things. (7) Sound system: Structure: Speakers or bone conduction technology integrated into the glasses. Function: Provides audio feedback, allowing users to hear the sounds in virtual content or augmented reality. (8) User interface elements: Structure: Interactive interfaces such as buttons and touchpads. Function: Provides a means for users to interact with the glasses, such as adjusting settings, selecting applications, etc. (9) Frame and head-mounted system: Structure: Includes the frame and head-mounted parts of the glasses. Function: Provides a comfortable wearing experience and ensures that the glasses are firmly fixed on the user's head. These structures work together to enable MR glasses to achieve a mixed reality experience, combining virtual information with the real world to provide a richer and more immersive user experience. MR glasses from different manufacturers and models may have some differences, but generally include similar basic structures and functions.

[0058] 2. Connection: Through simulated interaction, doctors can draw a virtual surgical path to simulate the process of removing tissue in an actual hemiglossectomy surgery while ensuring minimal interference with surrounding critical structures.

[0059] 3. Resection simulation: Use virtual tools to simulate cutting and resection, simulating the actual operation process in surgery to ensure the accuracy and safety of surgical resection.

[0060] Preferably, during the simulation training, rendering optimization is performed using the following two technologies: 1. Real-time rendering: During the simulation, real-time rendering technology is used to ensure that the doctor's feedback on the surgical scene is fast and smooth, thereby improving the realism of the simulation. Rendering optimization in mixed reality (MR) glasses is key because it directly affects the smoothness and realism of the user experience. The following are some common methods for rendering optimization: (1) Level of detail (LOD): Use level of detail technology to ensure that the rendered objects have a lower polygon count and texture resolution when they are far away from the user. This helps to reduce the burden on the graphics processing unit (GPU). (2) Real-time rendering technology: Use real-time rendering technology to ensure that the rendered content can be updated in a real-time environment. This includes real-time lighting, real-time shadows, and other real-time special effects to improve the user's perception of virtual and real interaction. (3) Material and texture optimization: Use appropriate material and texture compression technology to reduce texture file size and memory usage. Optimize the use of materials and avoid unnecessary high-resolution textures. (4) Avoid excessive details: Avoid designs with excessive details due to the limited resolution of MR glasses. Unnecessary small details may be difficult to recognize in the glasses and increase the rendering burden. (5) Pipeline optimization: Optimize the graphics rendering pipeline to ensure that rendering is performed only when needed. Use GPU sleep and wake-up technology to reduce unnecessary energy consumption. (6) Adaptive refresh rate: Adaptive refresh rate technology is used according to the requirements of the scene. Reduce the refresh rate in more static scenes to save power, and provide a smoother experience when a higher refresh rate is required. (7) Reduce anti-aliasing level: Reduce the anti-aliasing level to reduce the computational burden of the GPU. On MR glasses, some slight edge jaggedness may not be overly noticed by users. (8) Avoid over-rendering: Avoid unnecessary rendering outside the user's field of view. Reduce rendering of invisible areas through technologies such as spatial culling and frustum clipping. (9) Hardware acceleration: Make full use of hardware acceleration features, such as GPU hardware acceleration, dedicated hardware renderer, etc., to improve graphics rendering performance. (10) User-adjustable settings: Provide user-adjustable graphics setting options, allowing users to adjust according to their device performance and preferences. These rendering optimization methods can improve the performance and efficiency of MR glasses while maintaining the user experience. Specific optimization strategies may vary depending on the application scenario and specific hardware platform. 2. Visual optimization: By adjusting lighting, materials and other visual effects, the visual presentation of the virtual scene is optimized, allowing doctors to observe and understand the details of the surgical simulation process more clearly.

[0061] Step S3: 3D visualization of surgical simulation results and evaluation and feedback

[0062] 1.3D visualization: After the surgical simulation is completed, 3D visualization results are generated to provide a more comprehensive surgical simulation effect, helping doctors better understand and prepare for actual surgery.

[0063] 2. Result evaluation and feedback: After the surgical simulation is completed, the data recording and feedback system is used to record the user's operation data in real time, analyze the operation quality through AI algorithms, and provide operation feedback and suggestions, such as the accuracy of surgical resection and the impact on surrounding structures.

[0064] AI algorithms refer to specific computational methods and procedures used in the field of artificial intelligence (AI) to solve problems, perform tasks, or achieve learning. These algorithms simulate human intelligent behavior or complete specific tasks by learning, reasoning, and making decisions on data. AI algorithms are widely used in image recognition, natural language processing, machine learning, deep learning, and other fields. The following are some common types of AI algorithms: (1) Supervised learning algorithms: In supervised learning, algorithms learn by using labeled training data so that they can classify or predict new data. Common supervised learning algorithms include support vector machines (SVMs), decision trees, random forests, and neural networks. (2) Unsupervised learning algorithms: Unsupervised learning algorithms discover patterns and structures in unlabeled data. Clustering and dimensionality reduction are the two main tasks of unsupervised learning. Typical algorithms include K-means clustering, principal component analysis (PCA), and self-organizing maps (SOM). (3) Reinforcement learning algorithms: Reinforcement learning is a learning paradigm in which an intelligent agent learns optimal behavior strategies by interacting with the environment. Common reinforcement learning algorithms include Q-learning, deep Q networks (DQNs) in deep reinforcement learning (DRL), and policy gradient methods. (4) Deep learning algorithms: Deep learning is a branch of machine learning that mainly involves deep neural networks. Convolutional neural networks (CNNs), recurrent neural networks (RNNs), and transformers are commonly used algorithms in deep learning. (5) Genetic algorithms: Genetic algorithms are an optimization algorithm that searches for the optimal solution to a problem by simulating natural selection and genetic mechanisms. This type of algorithm is widely used in optimization problems. (6) Natural language processing algorithms: Algorithms used to process and understand natural language text, including tasks such as text classification, named entity recognition, and machine translation. Common algorithms include recurrent neural networks (RNNs), long short-term memory networks (LSTMs), and transformers. (7) Recommendation algorithms: Algorithms used to predict products or content that users may like. Collaborative filtering, content filtering, and recommendation algorithms in deep learning are all common technologies in recommendation systems. (8) Chatbot algorithms: Algorithms used to implement dialogue systems, including natural language processing, dialogue generation, and intent recognition. Recurrent neural networks (RNNs) and transformers are widely used in this field. The choice of AI algorithm depends on the problem to be solved, the available data, and the nature of the problem. In different application scenarios, engineers and researchers will choose appropriate algorithms to achieve the desired goals.

[0065] It is worth noting that the above-mentioned simulation training process of hemiglossectomy covers the key steps of hemiglossectomy, and the specific implementation may differ slightly in details due to the simulation platform and technology used.

[0066] It should be noted that the embodiments of the present invention have better practicability and do not impose any form of limitation on the present invention. Any technician familiar with the field may use the technical content disclosed above to change or modify it into an equivalent effective embodiment. However, any modification or equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention without departing from the content of the technical solution of the present invention are still within the scope of the technical solution of the present invention.

Claims

1. A head and neck tumor surgery simulation training system based on UE5 engine, It is characterized in that include: A rendering system, wherein the rendering system is used to render a virtual 3D tissue model and a virtual 3D scene generated by a UE5 engine; A display system, which is MR glasses, used to display the 3D tissue model and 3D scene as well as the simulation status of head and neck tumor surgery in real time; An interactive system, the interactive system is used to obtain surgical operations input by one or more users, and is also used to display the user's operation data and operation feedback results using the data visualization tool of the UE5 engine; A control system, the control system is used to process user input and drive the operation of the physical simulation system and the surgical process simulation system; it is also used to use the UE5 engine's script system to achieve accurate simulation of the surgical process and update the simulation state in real time according to the user's operation; it is also used to transmit the user's operation data to the data recording and feedback system in real time; A physical simulation system, wherein the physical simulation system is used to realize virtual physical interaction simulation between virtual surgical instruments and virtual 3D tissues by using the Niagara particle system and physics engine of the UE5 engine; A surgical process simulation system, which is used to use the animation system and behavior tree system of the UE5 engine to realize various surgical actions and process control of the actual surgical process; The data recording and feedback system is used to record the user's operation data in real time, analyze the operation quality through AI algorithms, and provide operation feedback and suggestions.

2. The head and neck tumor surgery simulation training system based on UE5 engine as claimed in claim 1, It is characterized in that The rendering system utilizes the graphics rendering capabilities of UE5 and combines the Lumen lighting system to generate a virtual 3D scene; the rendering system optimizes rendering through one or more methods of LOD technology, real-time rendering technology, material and texture optimization, avoiding excessive details, pipeline optimization, adaptive refresh rate, reducing anti-aliasing level, avoiding transition rendering, hardware acceleration, and user-defined settings to construct a virtual 3D tissue model.

3. The head and neck tumor surgery simulation training system based on UE5 engine as claimed in claim 1, It is characterized in that The virtual physical interaction simulation includes the simulation of the physical properties of the surgical instrument and the simulation of the tissue characteristics.

4. The head and neck tumor surgery simulation training system based on UE5 engine as claimed in claim 1, It is characterized in that The interactive system realizes natural interaction between the user and the virtual environment through head tracking and hand motion capture.

5. The head and neck tumor surgery simulation training system based on UE5 engine as claimed in claim 1, It is characterized in that The AI ​​algorithm includes one or more of a supervised learning algorithm, an unsupervised learning algorithm, a reinforcement learning algorithm, a deep learning algorithm, a genetic algorithm, a natural language processing algorithm, a recommendation algorithm, and a chatbot algorithm.

6. The head and neck tumor surgery simulation training system based on UE5 engine according to any one of claims 1 to 5, It is characterized in that The head and neck tumor surgery includes one or more of maxillofacial surgery, laryngeal cancer resection surgery, tongue cancer resection surgery, cervical lymph node dissection surgery, and neck tumor resection surgery.

Images