A simulation system based on plastic surgery

By improving multi-level model construction and simulation technology, combining virtual reality and GPU acceleration, the limitations of existing plastic surgery simulation systems in fine modeling and mechanical response are solved, and high-precision and authentic surgical process simulation are achieved, improving the simulation of the surgical process. The interaction and accuracy of the surgery.

CN119170287BActive Publication Date: 2025-02-25JILIN UNIVERSITY
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411667872.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-11-21
Publication Date
2025-02-25
Estimated Expiration
2044-11-21

AI Technical Summary

Technical Problem

The existing plastic surgery simulation system has limitations in fine modeling, mechanical response, fluid simulation and real-time feedback, making it difficult to truly restore the human anatomy and surgical environment.

Method used

By improving multi-level model construction, soft tissue mechanics simulation and fluid simulation, combined with virtual reality technology and GPU acceleration, high-precision object model construction, intelligent feature analysis, preoperative solution design, mechanical simulation, blood and smoke simulation, and real-time visualization are achieved. with feedback and postoperative evaluation.

Benefits of technology

It improves the authenticity and interactivity of the surgical process, provides high-precision anatomical simulation and mechanical response, and enhances the doctor's operating experience and the accuracy of plastic surgery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119170287B_ABST
    Figure CN119170287B_ABST
Patent Text Reader

Abstract

The present invention discloses a simulation system based on plastic surgery, and relates to the field of surgical simulation technology. The system includes: an object model construction module, an intelligent feature analysis module, a preoperative scheme design module, a mechanical simulation module, a blood and smoke simulation module, a real-time visualization and feedback module, and a postoperative evaluation module. The present invention realizes accurate modeling of multi-level anatomical structures such as bones, muscles, fat, skin, and blood vessels through the parameter construction unit and the image construction unit in the object model construction module; through the improved smooth particle fluid dynamics algorithm, combined with GPU parallel computing, accurate dynamic simulation of blood flow and smoke diffusion in plastic surgery is realized, the authenticity of the surgical environment is improved, and the physical effects of blood and smoke can be realistically presented during the simulation process, providing doctors with a closer to real operation experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of surgical simulation, and in particular to a simulation system based on plastic surgery. Background Art

[0002] The current plastic surgery simulation system has certain limitations in terms of fine modeling, mechanical response, fluid simulation and real-time feedback. The existing system's hierarchical modeling of the human anatomical structure is often rough, and it is difficult to distinguish the layers of bones, muscles, fat, etc., resulting in a lack of real layering in the surgical simulation. For the simulation of the mechanical behavior of soft tissue, the traditional finite element method has deficiencies in real-time and accuracy, especially under dynamic cutting and large deformation, it is difficult to effectively reproduce the real mechanical response of the tissue. During the operation of plastic surgery, the flowing blood and the smoke generated by equipment such as lasers and electric knives are all fluids, and the movement laws of fluids are relatively complex. Existing simulation methods usually do not simulate blood and smoke, and fail to restore the complex surgical environment based on fluid dynamics, reducing the immersion of the simulation. In addition, the existing system lacks tactile feedback and real-time performance, and cannot provide doctors with real surgical touch and detailed observation support, affecting the interactivity and accuracy of the simulation experience. Summary of the invention

[0003] In view of the above shortcomings, the present invention proposes a simulation system based on plastic surgery, which achieves highly realistic surgical process simulation by improving multi-level model construction, soft tissue mechanics simulation and fluid simulation, thereby enhancing the interactivity and accuracy of the system.

[0004] The simulation system based on plastic surgery includes the following modules:

[0005] The object model building module is used to build a detailed model of the plastic surgery object, the plastic surgery object model includes a bone layer, a muscle layer, a fat layer, a skin layer, a blood vessel distribution and other soft tissue distribution; the object model building module includes a parameter building unit and an image building unit;

[0006] An intelligent feature analysis module is used to determine the specific plastic surgery site and surgery type by analyzing multi-source data; the intelligent feature analysis module includes a data acquisition unit, a classification analysis unit and a user confirmation unit;

[0007] The preoperative plan design module is used to design a reasonable plan for plastic surgery to meet the needs of different types of plastic surgery; the preoperative plan design module includes a standard plan matching unit, a plan fine-tuning unit, and a custom plan unit;

[0008] The mechanical simulation module is used to simulate the mechanical properties of soft tissues involved in plastic surgery to ensure that the mechanical behavior of plastic surgery is accurately reflected in the virtual environment; the mechanical simulation module includes a mechanical property construction unit, a mechanical response simulation unit and a parameter adjustment unit;

[0009] The blood and smoke simulation module is used to simulate the blood flow and smoke effects produced during plastic surgery to improve the authenticity of the simulation; this module includes a blood simulation unit, a smoke simulation unit, and a GPU acceleration unit;

[0010] A real-time visualization and feedback module is used to achieve real-time display and interaction of plastic surgery effects through virtual reality technology; the real-time visualization and feedback module includes a VR display unit, an interactive feedback unit, and a progress recording unit;

[0011] The postoperative evaluation module is used to analyze the simulated surgical process and evaluate the final plastic surgery effect; the postoperative evaluation module includes an operation data acquisition unit, a plastic surgery effect evaluation unit and an error feedback unit.

[0012] As a preferred technical solution of the present invention, the parameter construction unit and the image construction unit of the object model construction module respectively improve the construction efficiency and accuracy of the model by the following methods:

[0013] The parameter construction unit generates a plastic surgery object model based on the preset template and the parameters input by the user, which is suitable for simple surgery or training;

[0014] The user inputs body parameters, which include gender, height, weight, and body fat percentage, and matches the standard complete object model under the body type in the model template database; the user inputs description parameters, matches the required plastic surgery part in the standard complete object model, maps the object feature parameters to the required plastic surgery part, and generates a plastic surgery object model with a multi-layer structure through model mapping;

[0015] The image construction unit acquires detailed three-dimensional anatomical image data through magnetic resonance imaging and constructs a plastic surgery object model that meets the set accuracy, which is suitable for complex surgeries or actual operation scenarios;

[0016] Use image recognition algorithms to segment bones, muscles, fat, skin, blood vessels and soft tissues, automatically identify and model image data in layers, and achieve fine 3D reconstruction to ensure a high-precision model suitable for complex surgeries.

[0017] Use parameter construction in simple surgical scenarios and image construction in complex or critical surgical scenarios to select data sources in order to balance accuracy and cost.

[0018] As a preferred technical solution of the present invention, the data acquisition unit is used to integrate the patient's self-report information, the doctor's evaluation information and the characteristic data of the plastic surgery object model to provide basic data for characteristic analysis;

[0019] The classification analysis unit is used to perform multi-feature analysis on the collected patient self-report information, physician evaluation information, and feature data of the plastic surgery object model in combination with the feature classification model, map the feature data to specific needs in the plastic surgery, and output effective plastic surgery parts and surgery types so as to make the best choice in the user confirmation unit; the effectiveness of the plastic surgery parts and surgery types is evaluated by the accuracy of the output results of the feature classification model, and the accuracy is compared with the set effective threshold. If the result is greater than the effective threshold, it is judged to be effective; the feature classification model is constructed based on a support vector machine and is obtained through standard training with a large amount of historical data;

[0020] The user confirmation unit is used to confirm the output result of the classification and analysis unit. If the classification and analysis unit has no valid output result, the user selects the required plastic surgery site and surgery type.

[0021] As a preferred technical solution of the present invention, the standard solution matching unit: selects the most suitable solution from a preset standard solution library as a basis according to the plastic surgery part and type;

[0022] A scheme fine-tuning unit is used to make personalized adjustments on the basis of the standard scheme according to the characteristic data of the plastic surgery object model to obtain the final plastic surgery simulation scheme to meet the specific needs of the specific object;

[0023] The custom plan unit supports doctors to redesign surgical plans in order to flexibly respond to unique plastic surgery simulation needs.

[0024] As a preferred technical solution of the present invention, the mechanical property modeling unit defines the elasticity, viscosity and stress-strain relationship of each layer of soft tissue according to the actual material properties of the soft tissue, establishes a mechanical model that conforms to the laws of biomechanics, and adds it to the soft tissue corresponding to the plastic surgery object model;

[0025] The mechanical response simulation unit, based on the finite element method, performs high-precision simulation of tissue response under cutting, stretching, etc., and provides real-time feedback on operating force and soft tissue morphological changes. Tissue response includes deformation and rebound.

[0026] The steps to simulate tissue response using the finite element method include:

[0027] Discretization: decompose the soft tissue into many small finite elements, and the deformation of each soft tissue unit is described by node displacement; material property definition: assign appropriate material properties to each finite element based on the biomechanical properties of the soft tissue to accurately simulate the different responses of different tissues under external forces; boundary conditions and load application: calculate the deformation distribution and internal stress state of soft tissue under mechanical action by applying boundary conditions and external loads; by establishing the stress-strain equation of each unit, assemble the equations of each unit of the discrete system into the equation of the overall system, and use the iterative method to solve and calculate the deformation and rebound of the tissue under external force;

[0028] The parameter adjustment unit is used to adjust the parameters in the mechanical response simulation unit and provide a variety of simulation situations.

[0029] As a preferred technical solution of the present invention, the blood simulation unit is used to calculate the Navier-Stokes equation by improving the SPH algorithm to simulate the detailed blood dynamics, including flow velocity, flow direction and viscosity changes;

[0030] Smoke simulation unit, which performs volume modeling and density change simulation of smoke caused by surgical tools based on Marching Cubes algorithm;

[0031] The GPU acceleration unit improves the efficiency of large-scale particle simulations through parallel computing, ensuring the real-time performance of the blood and smoke simulation process.

[0032] As a preferred technical solution of the present invention, the optimization of improving the SPH algorithm includes:

[0033] Time step control optimization is used to balance the calculation accuracy and real-time performance. The time step of the SPH algorithm is optimized to a larger value to reduce the number of sub-time steps of the simulation calculation. The maximum time step is set to , determined by the following formula: ;in is the smooth length, is the expansion wave velocity, is the maximum particle speed, is the maximum external force, is the viscosity coefficient;

[0034] Calculate the kernel function used to measure the interaction between particles , the kernel function influence area is controlled by the smooth length, and the kernel function gradient is used to calculate the pressure and viscosity. The specific kernel function formula is as follows: ;in is the dimension constant, is the scalar distance between the two particles;

[0035] Calculate the pressure between particles using the following formula: ;in represents the pressure between two particles, represents the mass of neighboring particle j, and are the pressures of particles i and j, and are the densities of particles i and j, respectively, Represents the gradient calculation symbol, is the kernel function between particles i and j;

[0036] The formula for calculating the viscosity is as follows: ;in represents the viscous force between two particles, is the dynamic viscosity coefficient, and denote the velocity vectors of particles i and j respectively;

[0037] Using an improved space partitioning method instead of the traditional traversal search method, the computational complexity is reduced from O(N 2 ) is reduced to O(NlogN), the particles are divided into grids, and neighboring particles are found by traversing the surrounding 8 grids to reduce the amount of calculation and memory usage.

[0038] As a preferred technical solution of the present invention, a VR display unit is used to display the real-time plastic surgery effects at each stage before, during and after the operation through multi-angle view switching and VR environment;

[0039] An interactive feedback unit, which is used to provide real-time feedback of touch and pressure sensations to the user's hands during operation through a tactile feedback device, thereby enhancing the authenticity of the operation;

[0040] The progress recording unit is used to automatically record surgical process data, including operation sequence, duration, force parameters, etc., to provide support for subsequent review and improvement.

[0041] As a preferred technical solution of the present invention, an operation data acquisition unit is used to record and store operation data during the simulated surgery, including cutting depth, force and angle parameters, so as to analyze the operation quality;

[0042] A plastic surgery effect evaluation unit is used to automatically evaluate the plastic surgery simulation results through morphological indicators and generate plastic surgery scores. The morphological indicators include symmetry, smoothness, and deviation;

[0043] The error feedback unit is used to generate an operation error report based on the evaluation results, provide detailed improvement suggestions, and store user operation data for training and optimizing shaping operations.

[0044] As a preferred technical solution of the present invention, the plastic surgery simulation method performed by the simulation system comprises the following steps:

[0045] Constructing an object model: through the object model construction module, select parameter construction or image construction to generate a multi-layer model of the plastic surgery object, the model includes a bone layer, a muscle layer, a fat layer, a skin layer, blood vessel distribution and other soft tissue distribution;

[0046] Intelligent feature analysis: The intelligent feature analysis module is used to obtain patient self-report information, physician evaluation information and object model feature data, and the object model is analyzed in combination with the classification algorithm to identify the characteristic parts and types that need plastic surgery, output the analysis results, and the user confirms whether to perform the surgery;

[0047] Preoperative plan design: Based on the analysis results, the preoperative plan design module selects a matching standard surgical plan and makes fine adjustments, or redesigns the plastic surgery plan when there is no matching plan;

[0048] Mechanical simulation: Use the mechanical simulation module to simulate the mechanical properties of soft tissue during plastic surgery and simulate the deformation response of soft tissue under external force;

[0049] Blood and smoke simulation: Through the blood and smoke simulation module, the blood flow in plastic surgery is simulated based on the improved smooth particle fluid dynamics method, and the smoke effect that may be produced during surgery is simulated based on the Marching Cubes algorithm;

[0050] Real-time visualization and feedback: Using the real-time visualization and feedback module, the real-time effects of plastic surgery are displayed through virtual reality technology, and force and tactile feedback are provided to achieve an interactive experience with real surgery;

[0051] Postoperative evaluation: The postoperative evaluation module collects the operation data during the simulated surgery, evaluates the plastic surgery effect of the object model, generates an error analysis report and puts forward improvement suggestions.

[0052] The present invention has the following advantages:

[0053] The present invention realizes the accurate modeling of multi-level anatomical structures such as bones, muscles, fat, skin, and blood vessels through the parameter construction unit and the image construction unit in the object model construction module; the model provides a high-precision anatomical basis for subsequent simulation operations, can truly restore the anatomical characteristics of the human body, and provide a reliable simulation basis for plastic surgery program design and training; through the improved smooth particle fluid dynamics algorithm and combined with GPU parallel computing, accurate dynamic simulation of blood flow and smoke diffusion in plastic surgery is achieved, the authenticity of the surgical environment is improved, and the physical effects of blood and smoke can be realistically presented during the simulation process, providing doctors with a more realistic operating experience.

[0054] The intelligent feature analysis module and preoperative plan design module provided by the present invention can automatically identify surgical feature locations and types through multi-source data analysis, and match the optimal plan from the standard plan library, or perform personalized fine-tuning according to the characteristics of the object; this not only simplifies the plan design process, but also improves the accuracy and practicality of the plan, and provides efficient support for plastic surgeries of different complexities; through the improved finite element method, the mechanical simulation module of the present invention can accurately simulate the deformation and rebound of soft tissue under cutting, stretching and other operations in a virtual surgical environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Figure 1 This is a schematic diagram of the structure of a plastic surgery-based simulation system used in an embodiment of the present invention. DETAILED DESCRIPTION

[0056] In order to enable persons skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0057] Example 1, a simulation system based on plastic surgery, see Figure 1 As shown, it includes the following modules:

[0058] The object model building module is used to build a detailed model of the plastic surgery object. The plastic surgery object model includes the bone layer, muscle layer, fat layer, skin layer, blood vessel distribution and other soft tissue distribution, providing a high-precision basis for subsequent simulation operations; this module includes a parameter building unit and an image building unit;

[0059] The parameter construction unit and image construction unit of the object model construction module improve the model construction efficiency and accuracy through the following methods:

[0060] The parameter construction unit generates a plastic surgery object model based on the preset template and the parameters input by the user, which is suitable for simple surgery or training;

[0061] The user inputs body parameters (including gender, height, weight, and body fat percentage) to match the standard complete object model of the body type in the model template database; the user inputs description parameters to match the required plastic surgery parts in the standard complete object model, and maps the object feature parameters to the required plastic surgery parts, and generates a plastic surgery object model with a multi-layer structure through model mapping;

[0062] The image construction unit acquires detailed three-dimensional anatomical image data through magnetic resonance imaging (MRI) and constructs a plastic surgery object model that meets the set accuracy, which is suitable for complex surgeries or actual operation scenarios;

[0063] Use image recognition algorithms to segment bones, muscles, fat, skin, blood vessels and other soft tissues, automatically identify and model image data in layers, and achieve fine 3D reconstruction to ensure a high-precision model suitable for complex surgeries;

[0064] Use parameter construction in simple surgical scenarios and image construction in complex or critical surgical scenarios to select data sources in order to balance accuracy and cost.

[0065] Intelligent feature analysis module, used to determine the specific plastic surgery site and surgery type by analyzing multi-source data; this module includes a data acquisition unit, a classification analysis unit and a user confirmation unit;

[0066] A data collection unit is used to integrate patient self-report information, doctor evaluation information and feature data of the plastic surgery object model to provide basic data for feature analysis;

[0067] The classification analysis unit is used to perform multi-feature analysis on the collected patient self-report information, physician evaluation information, and feature data of the plastic surgery object model in combination with the feature classification model, map the feature data to specific needs in the plastic surgery, and output effective plastic surgery parts and surgery types so as to make the best choice in the user confirmation unit; the effectiveness of the plastic surgery parts and surgery types is evaluated by the accuracy of the output results of the feature classification model, and the accuracy is compared with the set effective threshold. If the result is greater than the effective threshold, it is judged to be effective; the feature classification model is constructed based on a support vector machine and is obtained through standard training with a large amount of historical data;

[0068] The user confirmation unit is used to confirm the output result of the classification and analysis unit. If the classification and analysis unit has no valid output result, the user selects the required plastic surgery site and surgery type.

[0069] Preoperative plan design module, used to design a reasonable plan for plastic surgery to meet the needs of different types of plastic surgery; this module includes a standard plan matching unit, a plan fine-tuning unit, and a custom plan unit;

[0070] Standard solution matching unit: According to the plastic surgery part and type, the most suitable solution is selected from the preset standard solution library as the basis;

[0071] A scheme fine-tuning unit is used to make personalized adjustments on the basis of the standard scheme according to the characteristic data of the plastic surgery object model to obtain the final plastic surgery simulation scheme to meet the specific needs of the specific object;

[0072] The custom plan unit supports doctors to redesign surgical plans in order to flexibly respond to unique plastic surgery simulation needs.

[0073] Mechanical simulation module, used to simulate the mechanical properties of soft tissues involved in plastic surgery to ensure that the mechanical behavior of plastic surgery is accurately reflected in the virtual environment; this module includes a mechanical property construction unit, a mechanical response simulation unit and a parameter adjustment unit;

[0074] The mechanical property modeling unit defines the elasticity, viscosity and stress-strain relationship of each layer of soft tissue according to the actual material properties of the soft tissue, establishes a mechanical model that conforms to the laws of biomechanics, and adds it to the soft tissue corresponding to the plastic surgery object model;

[0075] The mechanical response simulation unit, based on the finite element method (FEM), performs high-precision simulation of tissue response (including deformation and rebound) under cutting, stretching, etc., and provides real-time feedback on operating force and soft tissue morphology changes;

[0076] The steps to simulate tissue response using the finite element method include:

[0077] Discretization: decompose the soft tissue into many small finite elements, and the deformation of each soft tissue unit is described by node displacement; material property definition: assign appropriate material properties to each finite element based on the biomechanical properties of the soft tissue to accurately simulate the different responses of different tissues under external forces; boundary conditions and load application: calculate the deformation distribution and internal stress state of soft tissue under mechanical action by applying boundary conditions and external loads; by establishing the stress-strain equation of each unit, assemble the equations of each unit of the discrete system into the equation of the overall system, and use the iterative method to solve and calculate the deformation and rebound of the tissue under external force;

[0078] The parameter adjustment unit is used to adjust the parameters in the mechanical response simulation unit and provide a variety of simulation situations.

[0079] The blood and smoke simulation module is used to simulate the blood flow and smoke effects produced during plastic surgery to improve the authenticity of the simulation; this module includes a blood simulation unit, a smoke simulation unit, and a GPU acceleration unit;

[0080] The blood simulation unit is used to calculate the Navier-Stokes equations through the improved SPH algorithm to simulate the detailed blood dynamics including flow velocity, flow direction and viscosity changes;

[0081] The smoke simulation unit performs volume modeling and density change simulation of smoke caused by surgical tools (such as electrocautery) based on the Marching Cubes algorithm;

[0082] The GPU acceleration unit improves the efficiency of large-scale particle simulations through parallel computing, ensuring the real-time performance of the blood and smoke simulation process.

[0083] Optimizations to improve the SPH algorithm include:

[0084] Time step control optimization is used to balance the calculation accuracy and real-time performance. The time step of the SPH algorithm is optimized to a larger value to reduce the number of sub-time steps of the simulation calculation. The maximum time step is set to , determined by the following formula: ;in is the smooth length, is the expansion wave velocity, is the maximum particle speed, is the maximum external force, is the viscosity coefficient;

[0085] Calculate the kernel function used to measure the interaction between particles , the kernel function influence area is controlled by the smooth length, and the kernel function gradient is used to calculate the pressure and viscosity. The specific kernel function formula is as follows: ;in is the dimension constant, is the scalar distance between the two particles;

[0086] Calculate the pressure between particles using the following formula: ;in represents the pressure between two particles, represents the mass of neighboring particle j, and are the pressures of particles i and j, and are the densities of particles i and j, respectively, Represents the gradient calculation symbol, is the kernel function between particles i and j;

[0087] The formula for calculating the viscosity is as follows: ;in represents the viscous force between two particles, is the dynamic viscosity coefficient, and denote the velocity vectors of particles i and j respectively;

[0088] Using an improved space partitioning method instead of the traditional traversal search method, the computational complexity is reduced from O(N 2 ) is reduced to O(NlogN), the particles are divided into grids, and neighboring particles are found by traversing the surrounding 8 grids to reduce the amount of calculation and memory usage.

[0089] A real-time visualization and feedback module is used to achieve real-time display and interaction of plastic surgery effects through virtual reality (VR) technology; the module includes a VR display unit, an interactive feedback unit, and a progress recording unit;

[0090] VR display unit, used to display the real-time plastic surgery effects at each stage before, during and after surgery through multi-angle view switching and VR environment;

[0091] An interactive feedback unit, which is used to provide real-time feedback of touch and pressure sensations to the user's hands during operation through a tactile feedback device, thereby enhancing the authenticity of the operation;

[0092] The progress recording unit is used to automatically record surgical process data, including operation sequence, duration, force parameters, etc., to provide support for subsequent review and improvement.

[0093] The postoperative evaluation module is used to analyze the simulated surgical process and evaluate the final plastic surgery effect; the module includes an operation data acquisition unit, a plastic surgery effect evaluation unit and an error feedback unit.

[0094] An operation data acquisition unit, used to record and store the operation data during the simulated surgery, including cutting depth, force and angle parameters, so as to analyze the operation quality;

[0095] Plastic surgery effect evaluation unit, used to automatically evaluate plastic surgery simulation results through morphological indicators (symmetry, smoothness, deviation, etc.) and generate plastic surgery scores;

[0096] The error feedback unit is used to generate operation error reports based on the evaluation results, provide detailed improvement suggestions, and store user operation data for training and optimizing shaping operations.

[0097] Embodiment 2, the plastic surgery simulation method performed by the simulation system comprises the following steps:

[0098] Constructing an object model, through an object model construction module, selecting a parameter construction or an image construction method to generate a multi-layer model of the plastic surgery object, wherein the model includes a bone layer, a muscle layer, a fat layer, a skin layer, a blood vessel distribution, and other soft tissue distributions;

[0099] Intelligent feature analysis: The intelligent feature analysis module is used to obtain patient self-report information, physician evaluation information and object model feature data, and then the object model is analyzed in combination with the classification algorithm to identify the characteristic parts and types that need plastic surgery, output the analysis results, and the user confirms whether to perform the surgery;

[0100] Preoperative plan design: Based on the analysis results, the preoperative plan design module selects a matching standard surgical plan and makes fine adjustments, or redesigns the plastic surgery plan when there is no matching plan;

[0101] Mechanical simulation: Use the mechanical simulation module to simulate the mechanical properties of soft tissue during plastic surgery and simulate the deformation response of soft tissue under external force;

[0102] Blood and smoke simulation: Through the blood and smoke simulation module, the blood flow in plastic surgery is simulated based on the improved smooth particle hydrodynamics (SPH) method, and the smoke effect that may be produced during surgery is simulated based on the Marching Cubes algorithm;

[0103] Real-time visualization and feedback: Using the real-time visualization and feedback module, the real-time effects of plastic surgery are displayed through virtual reality (VR) technology, and force and tactile feedback are provided to achieve an interactive experience with real surgery;

[0104] Postoperative evaluation: The postoperative evaluation module collects the operation data during the simulated surgery, evaluates the plastic surgery effect of the object model, generates an error analysis report and puts forward improvement suggestions.

[0105] Embodiment 3, application of object model construction module;

[0106] Before plastic surgery simulation, the object model building module is used to build the patient's anatomical model. For simple surgical training, the basic body parameters of the patient (such as gender, height, weight, body fat percentage, etc.) can be input through the parameter building unit, and the system automatically matches the template in the database to generate a multi-level object model with layers such as bones, muscles, fat and skin. For complex surgical scenes, the image building unit uses magnetic resonance imaging (MRI) scan data to generate a high-precision three-dimensional model. The image model is processed by the image recognition algorithm to automatically segment the anatomical layers such as bones, muscles, fat, skin, and blood vessels, providing a high-precision foundation for surgical simulation.

[0107] Example 4, application of intelligent feature analysis module and preoperative plan design module;

[0108] The intelligent feature analysis module is used to obtain multi-source data from patients, including the patient's self-report, the doctor's evaluation opinions, and model feature data. After the data acquisition unit integrates this data, the classification analysis unit uses the feature classification algorithm to identify the parts that need plastic surgery (such as facial contours, nose, etc.) and the type of plastic surgery (such as lifting, repair, etc.). When there is no clear result for the surgical features identified by the system, the user confirmation unit allows the doctor to manually confirm or select the feature parts. Next, the preoperative plan design module is used to match the corresponding plastic surgery plan from the standard plan library, and the plan fine-tuning unit allows the doctor to make detailed adjustments based on the patient's specific needs. If there is no matching standard plan, the doctor can design a new plastic surgery plan through the custom plan unit to meet personalized needs.

[0109] Example 5, application of mechanical simulation module;

[0110] During the operation, the mechanical simulation module is used to simulate the mechanical response of soft tissue. The mechanical property modeling unit defines the stress-strain relationship for tissues such as skin and muscle according to the biomechanical properties of soft tissue (such as elastic modulus, viscosity, etc.), and performs real-time simulation of cutting, stretching and other operations through the finite element method (FEM). The mechanical response simulation unit can display the deformation and rebound effect of soft tissue during the cutting process and provide real tactile feedback. Doctors can change the cutting depth and force during the operation through the parameter adjustment unit, observe its different responses to the tissue, and thus improve the accuracy of the surgical operation.

[0111] Example 6, application of blood and smoke simulation module;

[0112] During the simulation, the blood and smoke simulation modules simulate blood flow based on the improved SPH algorithm, and the Navier-Stokes equation is used to calculate the blood flow rate, flow direction and viscosity changes to improve the realism of the simulation. In the electrosurgical cutting simulation, the smoke simulation unit combines the Marching Cubes algorithm to perform volume modeling of smoke diffusion, and uses the GPU acceleration unit to achieve real-time calculations, providing dynamic smoke effects for surgical simulation, making the simulation environment closer to actual surgery.

[0113] Example 7, application of real-time visualization and feedback module;

[0114] During the surgical simulation, the real-time visualization and feedback module uses the VR display unit to provide doctors with multi-angle view switching to display the preoperative, intraoperative and postoperative status of the surgical object. The interactive feedback unit simulates the force and touch during the surgical operation through the tactile feedback device, allowing doctors to obtain an operation experience close to the real operation in the virtual environment. At the same time, the progress recording unit automatically records key data during the operation (such as operation sequence, time and force parameters) to provide data support for subsequent surgical evaluation and optimization.

[0115] Example 8, application of postoperative assessment module;

[0116] After the operation is completed, the postoperative evaluation module automatically collects and stores the operation data, uses the plastic surgery effect evaluation unit to evaluate the morphological indicators such as symmetry and smoothness of the postoperative object model, and generates a scoring report. If there are deficiencies in the operation, the error feedback unit will generate a detailed error analysis report and put forward improvement suggestions to provide objective feedback for the doctor's surgical skills improvement.

[0117] It should be understood that those skilled in the art can make improvements or changes based on the above description, and all such improvements and changes should fall within the scope of protection of the appended claims of the present invention. Parts not described in detail in this specification belong to the prior art known to those skilled in the art.

Claims

1. A simulation system based on plastic surgery, characterized in that: Includes the following modules: The object model building module is used to build a detailed model of the plastic surgery object, the plastic surgery object model includes a bone layer, a muscle layer, a fat layer, a skin layer, a blood vessel distribution and other soft tissue distribution; the object model building module includes a parameter building unit and an image building unit; An intelligent feature analysis module is used to determine the specific plastic surgery site and surgery type by analyzing multi-source data; the intelligent feature analysis module includes a data acquisition unit, a classification analysis unit and a user confirmation unit; The preoperative plan design module is used to design a reasonable plan for plastic surgery to meet the needs of different types of plastic surgery; the preoperative plan design module includes a standard plan matching unit, a plan fine-tuning unit, and a custom plan unit; The mechanical simulation module is used to simulate the mechanical properties of soft tissues involved in plastic surgery to ensure that the mechanical behavior of plastic surgery is accurately reflected in the virtual environment; the mechanical simulation module includes a mechanical property construction unit, a mechanical response simulation unit and a parameter adjustment unit; The blood and smoke simulation module is used to simulate the blood flow and smoke effects produced during plastic surgery to improve the authenticity of the simulation; this module includes a blood simulation unit, a smoke simulation unit, and a GPU acceleration unit; Real-time visualization and feedback module, used to achieve real-time display and interaction of plastic surgery effects through virtual reality technology; The real-time visualization and feedback module includes a VR display unit, an interactive feedback unit, and a progress recording unit; The postoperative evaluation module is used to analyze the simulated surgical process and evaluate the final plastic surgery effect; the postoperative evaluation module includes an operation data acquisition unit, a plastic surgery effect evaluation unit and an error feedback unit; The parameter construction unit and image construction unit of the object model construction module improve the model construction efficiency and accuracy through the following methods: The parameter construction unit generates a plastic surgery object model based on the preset template and the parameters input by the user, which is suitable for simple surgery or training; The user inputs body parameters, which include gender, height, weight, and body fat percentage, and matches the standard complete object model under the body type in the model template database; the user inputs description parameters, matches the required plastic surgery part in the standard complete object model, maps the object feature parameters to the required plastic surgery part, and generates a plastic surgery object model with a multi-layer structure through model mapping; The image construction unit acquires detailed three-dimensional anatomical image data through magnetic resonance imaging and constructs a plastic surgery object model that meets the set accuracy, which is suitable for complex surgeries or actual operation scenarios; Use image recognition algorithms to segment bones, muscles, fat, skin, blood vessels and soft tissues, automatically identify and model image data in layers, and achieve fine 3D reconstruction to ensure a high-precision model suitable for complex surgeries. Use parameter construction in simple surgical scenarios and image construction in complex or critical surgical scenarios to balance accuracy and cost to select data sources; blood simulation unit, used to calculate Navier-Stokes equations through improved SPH algorithm to simulate detailed blood dynamics, including flow velocity, flow direction and viscosity changes; Smoke simulation unit, which performs volume modeling and density change simulation of smoke caused by surgical tools based on Marching Cubes algorithm; GPU acceleration unit, which improves the efficiency of large-scale particle simulation by parallel computing, ensuring the real-time performance of blood and smoke simulation; Optimizations to improve the SPH algorithm include: Time step control optimization is used to balance the calculation accuracy and real-time performance. The time step of the SPH algorithm is optimized to a larger value to reduce the number of sub-time steps of the simulation calculation. Set the maximum time step , determined by the following formula: ; in is the smooth length, is the expansion wave velocity, is the maximum particle speed, is the maximum external force, is the viscosity coefficient; Calculate the kernel function used to measure the interaction between particles , the kernel function influence area is controlled by the smooth length, and the kernel function gradient is used to calculate the pressure and viscosity. The specific kernel function formula is as follows: ; in is the dimension constant, is the scalar distance between the two particles; Calculate the pressure between particles using the following formula: ; in represents the pressure between two particles, represents the mass of neighboring particle j, and are the pressures of particles i and j, and are the densities of particles i and j, respectively, Represents the gradient calculation symbol, is the kernel function between particles i and j; The formula for calculating the viscosity is as follows: ; in represents the viscous force between two particles, is the dynamic viscosity coefficient, and denote the velocity vectors of particles i and j respectively; Using an improved space partitioning method instead of the traditional traversal search method, the computational complexity is reduced from O(N 2 ) is reduced to O(NlogN), the particles are divided into grids, and neighboring particles are found by traversing the surrounding 8 grids to reduce the amount of calculation and memory usage.

2. A plastic surgery simulation system according to claim 1, characterized in that: A data collection unit is used to integrate patient self-report information, doctor evaluation information and feature data of the plastic surgery object model to provide basic data for feature analysis; The classification analysis unit is used to perform multi-feature analysis on the collected patient self-report information, physician evaluation information, and feature data of the plastic surgery object model in combination with the feature classification model, map the feature data to specific needs in the plastic surgery, and output effective plastic surgery parts and surgery types so as to make the best choice in the user confirmation unit; the effectiveness of the plastic surgery parts and surgery types is evaluated by the accuracy of the output results of the feature classification model, and the accuracy is compared with the set effective threshold. If the result is greater than the effective threshold, it is judged to be effective; the feature classification model is constructed based on a support vector machine and is obtained through standard training with a large amount of historical data; The user confirmation unit is used to confirm the output result of the classification and analysis unit. If the classification and analysis unit has no valid output result, the user selects the required plastic surgery site and surgery type.

3. A plastic surgery simulation system according to claim 1, characterized in that: Standard solution matching unit: According to the plastic surgery part and type, the most suitable solution is selected from the preset standard solution library as the basis; A scheme fine-tuning unit is used to make personalized adjustments on the basis of the standard scheme according to the characteristic data of the plastic surgery object model to obtain the final plastic surgery simulation scheme to meet the specific needs of the specific object; The custom plan unit supports doctors to redesign surgical plans in order to flexibly respond to unique plastic surgery simulation needs.

4. A plastic surgery simulation system according to claim 1, characterized in that: The mechanical property modeling unit defines the elasticity, viscosity and stress-strain relationship of each layer of soft tissue according to the actual material properties of the soft tissue, establishes a mechanical model that conforms to the laws of biomechanics, and adds it to the soft tissue corresponding to the plastic surgery object model; The mechanical response simulation unit, based on the finite element method, performs high-precision simulation of tissue response under cutting, stretching, etc., and provides real-time feedback on operating force and soft tissue morphological changes. Tissue response includes deformation and rebound. The steps to simulate tissue response using the finite element method include: Discretization: decompose the soft tissue into many small finite elements, and the deformation of each soft tissue unit is described by node displacement; material property definition: assign appropriate material properties to each finite element based on the biomechanical properties of the soft tissue to accurately simulate the different responses of different tissues under external forces; boundary conditions and load application: calculate the deformation distribution and internal stress state of soft tissue under mechanical action by applying boundary conditions and external loads; by establishing the stress-strain equation of each unit, assemble the equations of each unit of the discrete system into the equation of the overall system, and use the iterative method to solve and calculate the deformation and rebound of the tissue under external force; The parameter adjustment unit is used to adjust the parameters in the mechanical response simulation unit and provide a variety of simulation situations.

5. The plastic surgery simulation system according to claim 1, characterized in that: VR display unit, used to display the real-time plastic surgery effects at each stage before, during and after surgery through multi-angle view switching and VR environment; An interactive feedback unit, which is used to provide real-time feedback of touch and pressure sensations to the user's hands during operation through a tactile feedback device, thereby enhancing the authenticity of the operation; The progress recording unit is used to automatically record surgical process data, including operation sequence, duration, force parameters, etc., to provide support for subsequent review and improvement.

6. The plastic surgery simulation system according to claim 1, characterized in that: An operation data acquisition unit, used to record and store the operation data during the simulated surgery, including cutting depth, force and angle parameters, so as to analyze the operation quality; A plastic surgery effect evaluation unit is used to automatically evaluate the plastic surgery simulation results through morphological indicators and generate plastic surgery scores. The morphological indicators include symmetry, smoothness, and deviation; The error feedback unit is used to generate an operation error report based on the evaluation results, provide detailed improvement suggestions, and store user operation data for training and optimizing shaping operations.

7. A plastic surgery simulation system according to any one of claims 1 to 6, characterized in that: The plastic surgery simulation method performed by the simulation system comprises the following steps: Constructing an object model: through the object model construction module, select parameter construction or image construction to generate a multi-layer model of the plastic surgery object, the model includes a bone layer, a muscle layer, a fat layer, a skin layer, blood vessel distribution and other soft tissue distribution; Intelligent feature analysis: The intelligent feature analysis module is used to obtain patient self-report information, physician evaluation information and object model feature data, and the object model is analyzed in combination with the classification algorithm to identify the characteristic parts and types that need plastic surgery, output the analysis results, and the user confirms whether to perform the surgery; Preoperative plan design: Based on the analysis results, the preoperative plan design module selects a matching standard surgical plan and makes fine adjustments, or redesigns the plastic surgery plan when there is no matching plan; Mechanical simulation: Use the mechanical simulation module to simulate the mechanical properties of soft tissue during plastic surgery and simulate the deformation response of soft tissue under external force; Blood and smoke simulation: Through the blood and smoke simulation module, the blood flow in plastic surgery is simulated based on the improved smooth particle fluid dynamics method, and the smoke effect that may be produced during surgery is simulated based on the Marching Cubes algorithm; Real-time visualization and feedback: Using the real-time visualization and feedback module, the real-time effects of plastic surgery are displayed through virtual reality technology, and force and tactile feedback are provided to achieve an interactive experience with real surgery; Postoperative evaluation: The postoperative evaluation module collects operational data during the simulated surgery, evaluates the plastic surgery effect of the object model, generates an error analysis report and puts forward improvement suggestions.

Citation Information

Patent Citations

  • Virtual operation simulation device and simulation system

    CN114267219A

  • SPH-based blood and aneurysm fluid-solid coupling simulation method

    CN116525119A