A modeling method for cutting and bleeding model in virtual surgery
By setting the maximum withstand threshold of soft tissue and using an improved hybrid depth visual rendering method, the local small deformation and incision feedback force during the cutting process are simulated, solving the problem of realism in cutting and bleeding simulation in virtual surgery and achieving a realistic cutting and bleeding simulation effect.
Patent Information
- Application Number
- CN202210310473.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-28
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-03-28
AI Technical Summary
Existing virtual surgical cutting and bleeding simulation methods typically process data independently, making it difficult to achieve realistic interaction between cutting and bleeding, and the simulation of bleeding location and blood flow is not realistic enough.
By setting a maximum withstand threshold for soft tissue, calculating local small deformations and cutting feedback forces, and combining an improved hybrid depth visual rendering method, the incision and bleeding effects during the cutting process are simulated. The bleeding surface is rendered using local small deformations and cutting feedback forces, combined with the improved hybrid depth visual rendering method.
It achieves realism in cutting and bleeding simulation, improves the simulation effect of cutting and bleeding in virtual surgery, and enhances the realism of the simulation.
Smart Images

Figure CN114693892B_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of virtual surgery in virtual reality, and in particular relates to a modeling method of a cutting bleeding model in virtual surgery. Background Art
[0002] Virtual reality technology (VR) is an interdisciplinary subject that integrates simulation technology, multimedia technology, sensor technology and other technologies. Virtual surgery, as an application of VR, provides a convenient and efficient method for training surgeons. Surgeons can perform repeated surgical operation training in the virtual surgical scene provided by the virtual surgery system to improve the success rate of the surgery.
[0003] In real surgical procedures, cutting is one of the most common surgical operations. A good cutting model is essential for reproducing realistic cutting surgery simulation.
[0004] In the early days, most surgical simulators used the finite element method (FEM) to achieve cutting simulation. Node capture method, vertex copy segmentation algorithm, tetrahedron removal method and tetrahedron subdivision method are the common finite element methods used for cutting simulation in the early days. These methods are easy to implement, but they are very dependent on the mesh, and distorted or low-quality meshes will cause system instability. The emergence of the meshless method (MM) just solves the shortcomings of the finite element method. This method uses a point cloud structure model, which does not require a complex topological structure between points, and there is no direct association between each point element. In addition, all point elements are not constrained by the mesh, making them suitable for discontinuous scenes. Compared with the finite element method, the meshless method has the characteristics of strong adaptability and is suitable for large deformation and cutting simulation.
[0005] During surgery, bleeding is inevitable with cutting. It not only interferes with the surgeon's surgical operation, but also brings the risk of excessive bleeding to the patient. Therefore, bleeding simulation is also an important part of the virtual surgery system, which is extremely important for training surgeons to deal with unexpected bleeding.
[0006] Marching Cubes (MC) is the most common geometric method used to render bleeding. This method is a classic isosurface rendering method. Due to its simple implementation, it is often used to simulate bleeding, especially gushing bleeding. However, if the general cutting operation does not cut large blood vessels such as arteries, the bleeding caused by soft tissue damage is usually located on the surface of the soft tissue and flows slowly. In this case, it is difficult for the MC method to present a sense of depth. The emergence of the mixed depth visual rendering method (MDR) just makes up for the shortcomings of the MC algorithm. This method can well present the depth visual effect of blood flowing on the surface of soft tissue. In addition, the real-time performance of MDR far exceeds that of the MC algorithm.
[0007] Although existing methods have achieved good results in simulating cutting and bleeding, cutting and bleeding usually appear in independent forms. In fact, cutting and bleeding are two interrelated modules, and the fidelity of these two modules affects each other. In addition, the location and blood flow of bleeding are also key factors in simulating realistic bleeding. Summary of the invention
[0008] In view of the shortcomings and difficulties in the prior art, the present invention aims to provide a modeling method for a cutting bleeding model in a virtual surgery. The purpose of the present invention is to improve the authenticity of the cutting bleeding simulation effect.
[0009] The present invention is achieved through the following technical solutions:
[0010] A method for modeling a cutting bleeding model in a virtual surgery comprises the following steps:
[0011] Step 1: Set a maximum tolerance threshold maxforce for the soft tissue.
[0012] Step 2: Generate local small deformation and calculate feedback force according to the position, angle and direction of the virtual scalpel squeezing the soft tissue.
[0013] Step 3: When the force applied by the scalpel on the soft tissue exceeds maxforce, the sliding friction during the cutting process is calculated and the incision is rendered.
[0014] Step 4: According to the cutting situation, the maximum bleeding volume (i.e., the maximum number of particles generated) is reasonably set, and a mathematical function is introduced to calculate the real-time blood flow (the number of particles generated per unit time).
[0015] Step 5: Use the improved hybrid depth visual rendering (IMDR) method to render the blood surface.
[0016] Preferably, the method for generating local small deformation in step 2 includes the following two processes:
[0017] (1) Traverse all point elements and determine whether the point element is within the deformation range. The judgment conditions are as follows:
[0018]
[0019] Where l is the extrusion direction vector of the virtual scalpel, P is the coordinate position of the scalpel tip, T is the coordinate position of the point element, and R is the radius of the deformation range.
[0020] (2) Calculate the displacement of the point element within the deformation range. The calculation formula is as follows:
[0021]
[0022] Where dep is the extrusion depth along the direction of vector l, l x , l y , l z is the component of vector l, and n is a constant parameter that determines the degree of deformation.
[0023] Preferably, the formula for calculating the deformation feedback force in step 2 is:
[0024]
[0025] Where k is the elastic coefficient of Hooke's law.
[0026] Preferably, the formula for calculating the sliding friction force during the cutting process in step 3 is:
[0027]
[0028] Where η is the sliding friction coefficient, v x 、v y 、v z is the component of the cutting movement speed, δ is a non-negative number less than 1.
[0029] Preferably, the function for calculating the real-time blood flow in step 4 is:
[0030]
[0031] Where λ1, λ2, λ3 are constants for controlling blood flow, and t0 is the time when bleeding occurs.
[0032] Preferably, the IMDR method in step 5 specifically comprises the following steps:
[0033] (1) Establish a smooth height field; the establishment process is as follows:
[0034] ① Establish a uniform two-dimensional height field grid for the bleeding area and set an initial height threshold for all grids;
[0035] ② Analyze the forces acting on the particles, including pressure, viscosity, and surface tension, and calculate the position coordinates of the particles;
[0036] ③ According to the coordinates of the particle, determine the grid position of the particle;
[0037] ④ If the height value of the particle exceeds the threshold of the grid where the particle is located, the threshold of the grid is updated with the height value of the particle; otherwise, no update is performed;
[0038] ⑤ Smoothing the thresholds of all grids;
[0039] ⑥ Connect the center points of each grid, and the height of the center point is the height of the grid;
[0040] (2) Repair the boundary grid;
[0041] (3) Calculate the RGB value of blood color; the calculation formula is:
[0042]
[0043] In the formula, (C R ,C G ,C B ) is the RGB value corresponding to the blood color at time t, (C R0 ,C G0 ,C B0 ) is the RGB value corresponding to the blood color at the initial time t=t0, Control C R ,C G ,C B The constants of the rate of change of the three component values, T0 is the temperature of the blood at the initial moment, H is the room temperature, and α is the temperature drop coefficient in Newton's law of cooling;
[0044] (4) Calculate the transparency of blood;
[0045] (5) Calculate the normal vector of the mesh, and then render the triangular facets in combination with the lighting model to finally form the bleeding surface.
[0046] Compared with the prior art, the present invention has the following beneficial effects:
[0047] The present invention provides a modeling method for a cutting bleeding model in a virtual surgery, which obtains a relatively realistic cutting surgery simulation effect by simulating the local small deformation before soft tissue incision and the incision formed after incision, as well as the feedback force of the cutting process; and obtains a relatively realistic bleeding effect by introducing an improved hybrid depth visual rendering method (IMDR). BRIEF DESCRIPTION OF THE DRAWINGS
[0048] Figure 1 The present invention is a flowchart of a method for modeling a cutting and bleeding model in a virtual surgery.
[0049] Figure 2 It is a schematic diagram of establishing orthogonal planes according to the present invention.
[0050] Figure 3 It is a schematic diagram of calculating the normal vector of a two-dimensional height field mesh node according to the present invention.
[0051] Figure 4 This is the 7×7 GS template described in the present invention.
[0052] Figure 5 This is a schematic diagram of the grid center point connection rules described in the present invention.
[0053] Figure 6 This is a schematic diagram of the repair boundary grid described in the present invention.
[0054] Figure 7 This is a local small deformation simulation effect diagram obtained by using the modeling method of a cutting bleeding model in a virtual surgery described in the present invention.
[0055] Figure 8 The figure is a cutting and bleeding simulation effect diagram obtained by using the modeling method of a cutting and bleeding model in a virtual surgery described in the present invention. DETAILED DESCRIPTION
[0056] The present invention is further described in detail below in conjunction with the accompanying drawings so that those skilled in the art can implement the invention with reference to the description.
[0057] like Figure 1 As shown, the present invention provides a modeling method for a cutting and bleeding model in a virtual surgery, which can obtain a realistic cutting and bleeding simulation effect and improve the authenticity of the cutting and bleeding simulation in the virtual surgery. The implementation method specifically includes:
[0058] First, a maximum tolerance threshold maxforce is set for the soft tissue.
[0059] After that, all point elements are traversed to determine whether the point element is within the local extrusion deformation range. The judgment conditions are as follows:
[0060]
[0061] Where l is the extrusion direction vector of the virtual scalpel, P is the coordinate position of the scalpel tip, T is the coordinate position of the point element, and R is the radius of the local extrusion deformation range.
[0062] In this embodiment, the value of R is 2.
[0063] After that, the displacement of the point element within the local extrusion deformation range is calculated using the following formula:
[0064]
[0065] Where dep is the extrusion depth along the direction of vector l, l x , l y , l z is the component of vector l, n is a constant parameter that determines the degree of deformation, and in this embodiment, n is 4.
[0066] After that, the feedback force in the local extrusion deformation process is calculated. The calculation formula of the feedback force is:
[0067]
[0068] Wherein, k is the elastic coefficient of Hooke's law, and in this embodiment, k is taken to be about 0.3.
[0069] Afterwards, when the force applied by the scalpel on the soft tissue exceeds maxforce, the sliding friction force during the cutting process is calculated. The calculation formula is as follows:
[0070]
[0071] Where η is the sliding friction coefficient, v x 、v y 、v z is the component of the cutting movement speed, δ is a non-negative number less than 1.
[0072] In this embodiment, the value of η is about 0.1, and the value of δ is about 0.5.
[0073] After that, the incisions produced by the soft tissue are simulated and generated. The incision generation is divided into the following 5 steps:
[0074] (1) Figure 2 As shown in FIG. 1 , the tip of the virtual surgical knife is simplified into a proxy ball. According to the cutting direction, angle and position of the surgical knife, orthogonal planes α, β and γ are established with the proxy ball as the center.
[0075] (2) Calculate the offset between each point element and the three orthogonal planes respectively. The calculation formula is:
[0076]
[0077]
[0078]
[0079] In the formula, K α , K β , K γ are the offsets of the point element (x, y, z) and the orthogonal planes α, β, and γ respectively; (x tp ,y tp ,z tp ) is the position coordinate of the proxy ball, and a, b, and c are the normal vectors of the orthogonal planes α, β, and γ respectively. x ,a y ,a z ),(b x ,b y ,b z ),(c x ,c y ,c z) are the three components of vectors a, b, c. ||a||,||b||,||c|| are the moduli of vectors a, b, c.
[0080] (3) Construct a suitable cut shape function and cutting influence domain. Then, according to K α , K β , K γ Determine whether the point element is within the cutting influence domain. If so, mark it as a point that needs to be moved. If not, skip it until all point elements are traversed.
[0081] The shape function of the cut is:
[0082]
[0083] Where k1, k2 are constant parameters that control the shape of the cut, and σ is the depth coefficient, which is defined as:
[0084] σ=1+μ1(μ2-z tp )
[0085] Where μ1 and μ2 are parameters that determine the relationship between the depth coefficient and the range of the influence domain.
[0086] Among them, the range of the cutting influence domain is:
[0087]
[0088] In this embodiment, k1 and k2 are taken as 100 / 9 and 25 / 36, and μ1 and μ2 are taken as 1 and 1 / 4.
[0089] (4) Calculate the displacement of each point element that needs to be moved and perform the displacement operation.
[0090] Among them, the calculation formula for the displacement of each point element that needs to be moved is:
[0091]
[0092]
[0093] Where η1, η2, η3 are parameters for controlling displacement. In this embodiment, η1, η2, η3 are taken as 0.06, 0.1, 0.1 respectively. (5) Construct a two-dimensional height field grid to render the cut surface. The specific steps of this method are:
[0094] ① Establish a uniform two-dimensional height field grid for the soft tissue cutting area and set an initial height threshold for all grids;
[0095] ② Traverse all point elements and calculate the grid position of each point according to the position coordinates of the point element;
[0096] ③If the height of the point element exceeds the threshold of the grid where the point is located, the threshold is updated with the height of the point element; otherwise, it is not updated;
[0097] ④ Smooth the height of each grid (generally taking the average of the surrounding 7×7 grids) to reduce the height difference between adjacent grids and improve the smoothness of the cut surface;
[0098] ⑤ Calculate the normal vector of each mesh node (such as Figure 3 ) and normalized to facilitate rendering under the lighting model.
[0099] In step 5, the normal vector at the mesh node (i, j) is:
[0100]
[0101] In the formula, the vector P A , P B , P C , P D The calculation process is as follows:
[0102]
[0103] In the formula, vectors A, B, C, and D represent four vectors pointing to the grid node (i, j), and their calculation process is as follows:
[0104]
[0105] Among them, Pos(i,j) represents the position coordinates of the grid node (i,j).
[0106] In this embodiment, the RGB value of the blood color is selected as (0.8, 0, 0) to render the color of the cutout.
[0107] Afterwards, the maximum bleeding volume (i.e., the maximum number of particles generated) is set according to the cutting situation. In this embodiment, it is set to 3000.
[0108] After that, the real-time blood flow (the number of particles generated per unit time) is calculated and particles are generated at the bleeding site.
[0109] The calculation formula of blood flow is:
[0110]
[0111] Wherein, λ1, λ2, λ3 are constants for controlling blood flow, and t0 is the time of bleeding. In this embodiment, λ1, λ2, λ3 are 100, -0.01, 2 respectively.
[0112] After that, the bleeding surface is rendered using the improved hybrid deep visual rendering (IMDR) method. The IMDR method is specifically divided into the following five steps:
[0113] (1) Establish a smooth height field. The establishment process is as follows:
[0114] ① Establish a uniform two-dimensional height field grid for the bleeding area and set an initial height threshold for all grids;
[0115] ② Analyze the forces acting on the particles (pressure, viscosity, surface tension) and calculate the position coordinates of the particles;
[0116] ③ According to the coordinates of the particle, determine the grid position of the particle;
[0117] ④ If the height value of the particle exceeds the threshold of the grid where the particle is located, the threshold of the grid is updated with the height value of the particle; otherwise, no update is performed;
[0118] ⑤ Smooth the thresholds of all grids. The processing process is as follows:
[0119]
[0120] In the formula, Height i,j is the threshold of grid (i,j), HEIGHT i,j is the height value of the grid (i, j) after smoothing. The 7×7 GS template is as follows Figure 4 As shown;
[0121] ⑥Set the center point of each grid according to Figure 5 The height of the center point is the height of the grid.
[0122] (2) Repair the boundary grid. If the grid appears Figure 6 (a) and 6(c) (the height of the top left corner / bottom right corner vertex of the grid is lower than the height of the soft tissue surface, and the other vertices are higher than the height of the soft tissue surface), then Figure 6 (b) and 6(d) are connected.
[0123] (3) Calculate the RGB value of blood color. The calculation formula is:
[0124]
[0125] In the formula, (C R ,C G ,C B ) is the RGB value corresponding to the blood color at time t, (C R0 ,C G0 ,C B0) is the RGB value corresponding to the blood color at the initial time t=t0, Control C R ,C G ,C B The constants of the rate of change of the three component values, T0 is the temperature of the blood at the initial moment, H is the room temperature, and α is the temperature drop coefficient in Newton's cooling law.
[0126] In this embodiment, take (C R0 ,C G0 ,C B0 ) is (159,10,7), The values of are 60,2,2, T0 is 38.5 degrees Celsius, H is 25 degrees Celsius, t0=0, and the value of α is 0.15.
[0127] (4) Calculate the transparency of blood. The calculation formula is:
[0128]
[0129] Where Alpha i,j Is the grid cell grid i,j The transparency of num i,j For the grid unit grid i,j The number of particles in A constant parameter that controls transparency.
[0130] In this embodiment, The value of is 134.
[0131] (5) Calculate the normal vector of the mesh (the same method as that used to calculate the normal vector when rendering the cutout), and then render the triangular facets in conjunction with the lighting model to ultimately form the bleeding surface.
[0132] A modeling method for a cutting and bleeding model in a virtual surgery provided by the present invention is adopted to achieve a realistic cutting and bleeding simulation effect by integrating the local small deformation before soft tissue incision, the incision formed after incision, the real-time feedback force and bleeding during the cutting process.
[0133] pass Figure 7 It can be seen that the method provided by the present invention achieves a realistic local small deformation simulation effect, which is consistent with the actual cutting and extrusion process. Figure 8 It can be seen that the method provided by the present invention achieves a realistic cutting bleeding simulation, which is consistent with the actual soft tissue cutting bleeding effect.
[0134] Although the embodiments of the present invention have been disclosed as above, they are not limited to the applications listed in the specification and the implementation modes. They can be fully applied to various fields suitable for the present invention. For those familiar with the art, additional modifications can be easily implemented. Therefore, without departing from the general concept defined by the claims and the equivalent scope, the present invention is not limited to the specific details and the illustrations described herein.
Claims
1. A method for modeling a cutting bleeding model in a virtual surgery, characterized in that: The modeling method comprises the following steps: Step 1: Set a maximum tolerance threshold maxforce for the soft tissue; Step 2: Generate a small local deformation and calculate the feedback force according to the position, angle and direction of the virtual scalpel squeezing the soft tissue; Step 3: When the force applied by the scalpel on the soft tissue exceeds maxforce, the sliding friction during the cutting process is calculated and the incision is rendered; Step 4: Set the maximum bleeding volume, i.e. the maximum number of particles generated, according to the cutting situation, and introduce a mathematical function to calculate the real-time blood flow, i.e. the number of particles generated per unit time; Step 5: Using the improved hybrid depth visual rendering method IMDR to render the blood surface; The method for generating local small deformation in step 2 includes the following two processes: (1) Traverse all point elements and determine whether the point element is within the deformation range. The judgment conditions are as follows: Where l is the extrusion direction vector of the virtual scalpel, P is the coordinate position of the scalpel tip, T is the coordinate position of any point element, and R is the radius of the deformation range; (2) Calculate the displacement of the point element within the deformation range. The calculation formula is as follows: Where dep is the extrusion depth along the direction of vector l, l x , l y , l z is the component of vector l, and n is a constant parameter that determines the degree of deformation; The formula for calculating the sliding friction force during the cutting process in step 3 is: Where η is the sliding friction coefficient, v x 、v y 、v z is the component of the cutting movement speed, δ is a non-negative number less than 1, and k is the elastic coefficient of Hooke's law; The function for calculating the real-time blood flow in step 4 is: In the formula, λ1, λ2, λ3 are constant parameters for controlling blood flow, and t0 is the time when bleeding occurs; The IMDR method in step 5 specifically includes the following steps: (1) Establish a smooth height field; the establishment process is as follows: ① Establish a uniform two-dimensional height field grid for the bleeding area and set an initial height threshold for all grids; ② Analyze the forces acting on the particles, including pressure, viscosity, and surface tension, and calculate the position coordinates of the particles; ③ According to the coordinates of the particle, determine the grid position of the particle; ④ If the height value of the particle exceeds the threshold of the grid where the particle is located, the threshold of the grid is updated with the height value of the particle; otherwise, no update is performed; ⑤ Smoothing the thresholds of all grids; ⑥ Connect the center points of each grid, and the height of the center point is the height of the grid; (2) Repair the boundary grid; (3) Calculate the RGB value of blood color; the calculation formula is: In the formula, (C R ,C G ,C B ) is the RGB value corresponding to the blood color at time t, (C R0 ,C G0 ,C B0 ) is the RGB value corresponding to the blood color at the initial time t=t0, Control C R ,C G ,C B The constants of the rate of change of the three component values, T0 is the temperature of the blood at the initial moment, H is the room temperature, and α is the temperature drop coefficient in Newton's law of cooling; (4) Calculate the transparency of blood; (5) Calculate the normal vector of the mesh, and then render the triangular facets in combination with the lighting model to finally form the bleeding surface.
Citation Information
Patent Citations
Virtual cutting algorithm based on silica gel healing model
CN109033641A
Numerical algorithm for solving inverse kinematics of aspheric wrist 6R industrial robot
CN113997288A
Modeling method of bleeding and aspiration interaction model in virtual operation
CN114220547A
Driving simulation apparatus, wide-angle camera video simulation apparatus, and image deforming / compositing apparatus
US20100136507A1
