Method and device for verifying TCP accuracy of TKA surgical robot and storage medium
By resection of the distal part of the femoral model and aligning the femoral and prosthetic model with laser targets and conversion matrix, the problem that cannot fully reflect the impact of saw blade TCP error in the prior art is solved, and high accuracy of TCP accuracy of surgical robots is achieved Sexual verification.
Patent Information
- Application Number
- CN202411033534.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-30
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-07-30
Smart Images

Figure CN119055366A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of medical devices, and in particular to a method, a device and a storage medium for verifying the TCP accuracy of a TKA surgical robot. Background Art
[0002] The TCP (Tool center point) of a surgical robot refers to the position of the end effector carried by the robotic arm under the end flange of the robotic arm itself. It is usually described using a 4x4 rigid body transformation matrix or a translation vector combined with Euler angles. The accuracy of the surgical robot's TCP is a prerequisite for its ability to accurately position the actuator.
[0003] In robot-assisted TKA surgery (total knee replacement surgery), the robot needs to accurately position the saw blade to the five planes of the patient's distal femur. The five cutting planes must be highly matched with the five bone-jointing surfaces of the femoral prosthesis used in the surgical plan to ensure the smooth installation of the prosthesis. The accuracy of the robot saw blade TCP directly affects whether the above process can be achieved, so it is very important to verify the accuracy of TCP before the actual operation.
[0004] There are two common ways to verify the TCP of saw blades:
[0005] 1) Set a groove point on the saw blade that is compatible with the optical probe, and perform hand-eye calibration of the binocular positioning camera and the robotic arm to establish the coordinate system conversion relationship between the two. Then use the optical probe to collect the coordinate value of the saw blade groove point in the camera coordinate system, and compare this value with the coordinate value of the saw blade groove point in the camera coordinate system sent back by the robotic arm. The closer the two are (the smaller the point-to-point distance), the more accurate the robotic arm's own understanding of the saw blade's position, that is, the more accurate the saw blade TCP.
[0006] 2) Perform osteotomy test on the bone model and check the fit between the prosthesis and the cut bone model. The better the fit, the more accurate the TCP.
[0007] The disadvantage of the first method is that the distance error between the two points cannot fully reflect the influence of the saw blade TCP error on the accuracy of positioning the five osteotomy planes, and cannot rule out the situation where the point error is small but the actual osteotomy plane angle deviates greatly.
[0008] The disadvantage of the second method is that the saw blade vibrates at high frequencies during osteotomy, and it is difficult to ensure that the position of the bone model will not shift due to vibration, resulting in the final bone model section not being able to fully reflect the actual positioning accuracy of the robot arm, and thus being unable to assess whether the TCP is accurate. In addition, this method is subject to a large degree of subjective influence in determining adaptability, and cannot give a quantitative value.
[0009] Therefore, there is an urgent need to invent a TCP accuracy verification method that can fully reflect the impact of saw blade TCP error on the accuracy of positioning the five osteotomy planes. Summary of the invention
[0010] The present invention proposes a TKA surgical robot TCP accuracy verification method, device and storage medium, which solves the problem that the TCP accuracy verification method in the prior art cannot fully reflect the influence of the saw blade TCP error on the accuracy of positioning five osteotomy planes.
[0011] The technical solution of the present invention is achieved in this way:
[0012] The first aspect of the present invention provides a method for verifying the accuracy of TCP of a TKA surgical robot, comprising the following steps:
[0013] The distal part of the femoral model was removed;
[0014] Controlling the robotic arm to move the saw blade to each osteotomy plane of the femoral model respectively, and obtaining the position and posture data of each osteotomy plane of the femoral model;
[0015] Obtaining the posture data of each osteotomy plane of the prosthesis model;
[0016] According to the posture data of each osteotomy plane of the femoral model and the prosthesis model, the transformation matrix from the femoral model to the prosthesis model is calculated;
[0017] The femoral model was moved using the transformation matrix to align the femoral model with the prosthesis model, and the accuracy of TCP was determined based on the matching degree between the femoral model and the prosthesis model.
[0018] The present invention can ensure that the saw blade at the end of the robotic arm can be normally positioned to the various osteotomy planes of the femoral model by pre-cutting the distal part of the femoral model, and at the same time can avoid the contact between the saw blade and the femoral model causing the position of the femoral model to shift; by utilizing the matrix conversion relationship between the various osteotomy planes of the femoral model and the various osteotomy planes of the prosthesis model, the femoral model and the prosthesis model are aligned in the same three-dimensional image space, so that the angular influence of the saw blade TCP error on each osteotomy plane can be more accurately judged, and the osteotomy plane offset result can be intuitively visualized.
[0019] Specifically, the method for obtaining the posture data of each osteotomy plane of the femoral model comprises the following steps:
[0020] At least three non-collinear laser target points are set on the osteotomy surface of the saw blade;
[0021] The robot arm is controlled to move the saw blade to the distal osteotomy plane, the anterior malleolus osteotomy plane, the posterior malleolus osteotomy plane, the anterior oblique osteotomy plane and the posterior oblique osteotomy plane of the femoral model respectively;
[0022] A laser tracker is used to obtain the coordinate values of multiple laser target points on each osteotomy plane;
[0023] The least square method is used to fit each osteotomy plane according to the coordinate values, and the normal vector of each osteotomy plane and the coordinate values of the geometric center points of multiple laser target points on the corresponding osteotomy plane are calculated.
[0024] Specifically, the method for obtaining the posture data of each osteotomy plane of the prosthesis model is: importing the prosthesis model into the three-dimensional image space, and directly obtaining the coordinate values of the normal vector and the center point of each osteotomy plane of the prosthesis model in the three-dimensional image space coordinate system.
[0025] Furthermore, before calculating the transformation matrix from the femoral model to the prosthesis model, each osteotomy plane of the femoral model is first drawn in the three-dimensional image space according to the coordinate data obtained by the laser tracker.
[0026] Specifically, the method for calculating the transformation matrix from the femur model to the prosthesis model includes the following steps:
[0027] Take the normal vector of each osteotomy plane of the prosthesis model as the normal vector of the plane, take the center point of each osteotomy plane of the prosthesis model as the center point of the plane, draw 5 square planes with a side length of L, and record this plane set as A;
[0028] Take the normal vector of each osteotomy plane of the femoral model as the normal vector of the plane, take the geometric center point of multiple laser target points on each osteotomy plane of the femoral model as the center point of the plane, draw 5 square planes with a side length of M, and record this plane set as B;
[0029] The center point of each osteotomy plane of the prosthesis model is taken as the target data, and the geometric center point of multiple laser target points on each osteotomy plane of the femoral model is taken as the starting data. The vtk Landmark Transform algorithm is used to calculate the transformation matrix from the starting data to the target data, which is recorded as T1.
[0030] Use the transformation matrix T1 to move the plane set B, and take the vertices of the five square planes in the moved plane set B, which are recorded as point set C;
[0031] Taking the plane set A as the target data and the point set C as the starting data, the vtk Iterative ClosestPoint Transform algorithm is used to calculate the transformation matrix from the starting data to the target data, which is recorded as T2.
[0032] Furthermore, the plane set B is first moved using the transformation matrix T1 to roughly align the femoral model with the prosthesis model, and then the plane set B is further moved using the transformation matrix T2 to accurately align the femoral model with the prosthesis model.
[0033] Furthermore, the side length M of the square plane corresponding to the femoral model is smaller than the side length L of the square plane corresponding to the prosthesis model.
[0034] Specifically, the angle between the normal vectors of the corresponding osteotomy planes of the femoral model and the prosthesis model is calculated according to the dot product result of the normal vectors. The smaller the angle, the higher the TCP accuracy.
[0035] A second aspect of the present invention provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and wherein the processor implements the steps of the above-mentioned verification method when executing the computer program.
[0036] A third aspect of the present invention provides a computer-readable storage medium, wherein the storage medium stores a computer program, and wherein the computer program implements the steps of the above-mentioned verification method when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0038] Figure 1 A schematic diagram of a flow chart of a method for verifying the TCP accuracy of a TKA surgical robot according to the present invention;
[0039] Figure 2 It is a schematic diagram of the distal end of the femur model removed in an embodiment of the present invention;
[0040] Figure 3 Schematic diagram of a plane set A corresponding to the prosthesis model in an embodiment of the present invention;
[0041] Figure 4 Schematic diagram of a plane set B corresponding to the femur model in an embodiment of the present invention;
[0042] Figure 5 It is a schematic diagram of the alignment of the femoral model and the prosthesis model in the three-dimensional image space in an embodiment of the present invention. DETAILED DESCRIPTION
[0043] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0044] Reference Figure 1 The first aspect of the embodiment of the present invention provides a method for verifying the accuracy of TCP of a TKA surgical robot, comprising the following steps:
[0045] Manually resect the distal part of the femoral model (eg Figure 2 The area marked by the dotted box in the middle);
[0046] Controlling the robotic arm to move the saw blade to each osteotomy plane of the femoral model respectively, and obtaining the position and posture data of each osteotomy plane of the femoral model;
[0047] Obtaining the posture data of each osteotomy plane of the prosthesis model;
[0048] According to the posture data of each osteotomy plane of the femoral model and the prosthesis model, the transformation matrix from the femoral model to the prosthesis model is calculated;
[0049] The femoral model was moved using the transformation matrix to align the femoral model with the prosthesis model, and the accuracy of TCP was determined based on the matching degree between the femoral model and the prosthesis model.
[0050] The present invention can ensure that the saw blade at the end of the robotic arm can be normally positioned to the various osteotomy planes of the femoral model by pre-cutting the distal part of the femoral model, and at the same time can avoid the contact between the saw blade and the femoral model causing the position of the femoral model to shift; by utilizing the matrix conversion relationship between the various osteotomy planes of the femoral model and the various osteotomy planes of the prosthesis model, the femoral model and the prosthesis model are aligned in the same three-dimensional image space, so that the angular influence of the saw blade TCP error on each osteotomy plane can be more accurately judged, and the osteotomy plane offset result can be intuitively visualized.
[0051] During the specific implementation process, before manually cutting the femoral model, it is necessary to start the robot system according to the instructions in the manual, and complete the standard pre-osteotomy preparation processes such as robot arm alignment, instrument calibration, bone optical tracking array fixation, and image alignment in sequence.
[0052] Specifically, the method for obtaining the posture data of each osteotomy plane of the femoral model comprises the following steps:
[0053] At least three non-collinear laser target points are set on the osteotomy surface of the saw blade (three laser target points are selected in this embodiment);
[0054] Control the robotic arm to move the saw blade to the distal osteotomy plane of the femoral model;
[0055] A laser tracker was used to obtain the coordinates of the three laser target points on the distal osteotomy plane;
[0056] The distal osteotomy plane is fitted using the least squares method according to the coordinate values, and the normal vector of the distal osteotomy plane is calculated. And the coordinate value p of the geometric center point of the three laser target points (obtained by calculating the weighted average of the coordinate values of the three laser target points) 1 .
[0057] Control the robotic arm to move the saw blade to the anterior malleolus osteotomy plane of the femoral model;
[0058] A laser tracker was used to obtain the coordinates of the three laser target points on the anterior ankle osteotomy plane;
[0059] The least square method is used to fit the anterior malleolus osteotomy plane according to the coordinate values, and the normal vector of the anterior malleolus osteotomy plane is calculated. And the coordinate value p of the geometric center point of the three laser target points (obtained by calculating the weighted average of the coordinate values of the three laser target points) 2 .
[0060] Control the robotic arm to move the saw blade to the posterior malleolus osteotomy plane of the femoral model;
[0061] A laser tracker was used to obtain the coordinates of the three laser target points on the posterior malleolus osteotomy plane;
[0062] The posterior malleolus osteotomy plane was fitted using the least squares method according to the coordinate values, and the normal vector of the posterior malleolus osteotomy plane was calculated. And the coordinate value p of the geometric center point of the three laser target points (obtained by calculating the weighted average of the coordinate values of the three laser target points) 3 .
[0063] Control the robotic arm to move the saw blade to the anterior oblique osteotomy plane of the femoral model;
[0064] A laser tracker was used to obtain the coordinates of the three laser target points on the anterior oblique osteotomy plane;
[0065] The anterior oblique osteotomy plane was fitted using the least squares method according to the coordinate values, and the normal vector of the anterior oblique osteotomy plane was calculated. And the coordinate value p of the geometric center point of the three laser target points (obtained by calculating the weighted average of the coordinate values of the three laser target points) 4 .
[0066] Control the robotic arm to move the saw blade to the posterior oblique osteotomy plane of the femoral model;
[0067] A laser tracker was used to obtain the coordinates of the three laser target points on the posterior oblique osteotomy plane;
[0068] The posterior oblique osteotomy plane was fitted using the least squares method according to the coordinate values, and the normal vector of the posterior oblique osteotomy plane was calculated. And the coordinate value p of the geometric center point of the three laser target points (obtained by calculating the weighted average of the coordinate values of the three laser target points) 5 .
[0069] Specifically, the method for obtaining the posture data of each osteotomy plane of the prosthesis model is as follows: the prosthesis model is imported into the three-dimensional image space (common three-dimensional mapping software can be used), and the normal vectors of the distal osteotomy plane, the anterior condyle osteotomy plane, the posterior condyle osteotomy plane, the anterior oblique osteotomy plane, and the posterior oblique osteotomy plane of the prosthesis model can be directly obtained in the three-dimensional image space coordinate system. The coordinate values of the center point of each osteotomy plane (the location of the center point is selected by the user and only needs to be roughly in the center of the osteotomy plane) are p a 、p b 、p c 、p d 、p e .
[0070] Furthermore, before calculating the transformation matrix from the femoral model to the prosthesis model, the various osteotomy planes of the femoral model are drawn in the three-dimensional image space according to the coordinate data obtained by the laser tracker, so as to facilitate the subsequent matrix transformation in the three-dimensional image space.
[0071] Specifically, the method for calculating the transformation matrix from the femur model to the prosthesis model includes the following steps:
[0072] The normal vectors of each osteotomy plane of the prosthesis model are is the normal vector of the plane, and the center point p of each osteotomy plane of the prosthesis model is a 、p b 、p c 、p d 、p e As the center point of the plane, draw 5 square planes with side length L (side length L is specified by the user, no special requirements), and record the plane set as A, such as Figure 3 As shown;
[0073] The normal vectors of each osteotomy plane of the femoral model are is the normal vector of the plane, and the geometric center point p of multiple laser target points on each osteotomy plane of the femoral model is 1 、p 2 、p 3 、p 4 、p 5is the center point of the plane. Draw 5 square planes with side length M (the side length M is specified by the user). Denote this set of planes as B, as Figure 4 shown;
[0074] Taking the center points of the osteotomy planes of the prosthesis model as the target data, and the geometric center points of multiple laser target points on each osteotomy plane of the femur model as the starting data, use the vtk Landmark Transform algorithm provided by the VTK library to calculate the transformation matrix from the starting data to the target data, denoted as T1;
[0075] Use the transformation matrix T1 to move the set of planes B. The set of planes B will be moved to a position close to the set of planes A. Take the vertices of the 5 square planes in the moved set of planes B, denoted as the set of points C;
[0076] Taking the set of planes A as the target data and the set of points C as the starting data, use the vtk Iterative Closest Point Transform algorithm (i.e., the icp algorithm) provided by the VTK library to calculate the transformation matrix from the starting data to the target data, denoted as T2. The principle of this algorithm is to first find the point closest to each starting point in the target data, then perform landmark operations, and then move the starting point set, iterating back and forth until the matching degree between the starting data and the target data is higher than the preset threshold. This algorithm is an existing technology in this field.
[0077] Furthermore, first use the transformation matrix T1 to move the set of planes B to roughly align the femur model and the prosthesis model, and then use the transformation matrix T2 to further move the set of planes B to precisely align the femur model and the prosthesis model (here it means aligning the osteotomy planes of the femur model with the corresponding osteotomy planes of the prosthesis model), as Figure 5 shown;
[0078] Furthermore, the side length M of the square plane corresponding to the femur model is less than the side length L of the square plane corresponding to the prosthesis model. Because the 5 square planes (with side length M) of the set of planes B will be matched to the 5 planes (with side length L) of the set of planes A using the icp algorithm later, the icp algorithm needs to find the point on the plane of the set of planes A that is closest to the corner points of the planes in the set of planes B. If the plane of the set of planes A is smaller than the plane of the set of planes B (L < M), the plane size of the set of planes B is larger than the plane size of the set of planes A, which will cause the corner points of a certain plane in the set of planes B to easily find the wrong corresponding plane when looking for the closest point on the plane of the set of planes A (for example, the corner points of the distal osteotomy plane in the set of planes B find the plane points on the anterior oblique osteotomy plane in the set of planes A), resulting in a matching error.
[0079] Specifically, according to the dot product result of the normal vector (the inverse cosine value of the absolute value of the dot product result of the vector can be taken to obtain the angle between the two vectors), the angles between the normal vectors of the femoral model and the prosthesis model corresponding to the osteotomy plane are calculated as θ 1 ,θ 2 ,θ 3 ,θ 4 ,θ 5 The smaller the angle, the higher the TCP accuracy; when the saw blade TCP is completely correct, the above angle values should all be 0.
[0080] A second aspect of an embodiment of the present invention provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and wherein the processor implements the steps of the above-mentioned verification method when executing the computer program.
[0081] A third aspect of an embodiment of the present invention provides a computer-readable storage medium, wherein the storage medium stores a computer program, and is characterized in that when the computer program is executed by a processor, the steps of the above-mentioned verification method are implemented.
[0082] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims
1. A method for verifying the TCP accuracy of a TKA surgical robot, characterized in that: The following steps are involved: The distal part of the femoral model was removed; Controlling the robotic arm to move the saw blade to each osteotomy plane of the femoral model respectively, and obtaining the position and posture data of each osteotomy plane of the femoral model; Obtaining the posture data of each osteotomy plane of the prosthesis model; According to the posture data of each osteotomy plane of the femoral model and the prosthesis model, the transformation matrix from the femoral model to the prosthesis model is calculated; The femoral model was moved using the transformation matrix to align the femoral model with the prosthesis model, and the accuracy of TCP was determined based on the matching degree between the femoral model and the prosthesis model.
2. A method for verifying the TCP accuracy of a TKA surgical robot as claimed in claim 1, characterized in that: The method for obtaining the position data of each osteotomy plane of the femoral model comprises the following steps: At least three non-collinear laser target points are set on the osteotomy surface of the saw blade; The robot arm is controlled to move the saw blade to the distal osteotomy plane, the anterior malleolus osteotomy plane, the posterior malleolus osteotomy plane, the anterior oblique osteotomy plane and the posterior oblique osteotomy plane of the femoral model respectively; A laser tracker is used to obtain the coordinate values of multiple laser target points on each osteotomy plane; The least square method is used to fit each osteotomy plane according to the coordinate values, and the normal vector of each osteotomy plane and the coordinate values of the geometric center points of multiple laser target points on the corresponding osteotomy plane are calculated.
3. A method for verifying the TCP accuracy of a TKA surgical robot as claimed in claim 2, characterized in that: The method for obtaining the position data of each osteotomy plane of the prosthesis model is: importing the prosthesis model into the three-dimensional image space, and directly obtaining the coordinate values of the normal vector and the center point of each osteotomy plane of the prosthesis model in the three-dimensional image space coordinate system.
4. A method for verifying the TCP accuracy of a TKA surgical robot as claimed in claim 2, characterized in that: Before calculating the transformation matrix from the femoral model to the prosthesis model, each osteotomy plane of the femoral model is drawn in the three-dimensional image space according to the coordinate data obtained by the laser tracker.
5. A method for verifying the TCP accuracy of a TKA surgical robot as claimed in claim 3, characterized in that: The method for calculating the transformation matrix from the femur model to the prosthesis model comprises the following steps: Take the normal vector of each osteotomy plane of the prosthesis model as the normal vector of the plane, take the center point of each osteotomy plane of the prosthesis model as the center point of the plane, draw 5 square planes with a side length of L, and record this plane set as A; Take the normal vector of each osteotomy plane of the femoral model as the normal vector of the plane, take the geometric center point of multiple laser target points on each osteotomy plane of the femoral model as the center point of the plane, draw 5 square planes with a side length of M, and record this plane set as B; The center point of each osteotomy plane of the prosthesis model is taken as the target data, and the geometric center point of multiple laser target points on each osteotomy plane of the femoral model is taken as the starting data. The vtk Landmark Transform algorithm is used to calculate the transformation matrix from the starting data to the target data, which is recorded as T1. Use the transformation matrix T1 to move the plane set B, and take the vertices of the five square planes in the moved plane set B, which are recorded as point set C; Taking the plane set A as the target data and the point set C as the starting data, the vtk Iterative Closest Point Transform algorithm is used to calculate the transformation matrix from the starting data to the target data, which is recorded as T2.
6. A method for verifying the TCP accuracy of a TKA surgical robot as claimed in claim 5, characterized in that: First, the plane set B is moved using the transformation matrix T1 to roughly align the femoral model with the prosthesis model, and then the plane set B is further moved using the transformation matrix T2 to accurately align the femoral model with the prosthesis model.
7. A method for verifying the TCP accuracy of a TKA surgical robot as claimed in claim 5, characterized in that: The side length M of the square plane corresponding to the femoral model is smaller than the side length L of the square plane corresponding to the prosthesis model.
8. The method for verifying the TCP accuracy of a TKA surgical robot according to claim 1, characterized in that: The angle between the normal vectors of the corresponding osteotomy planes of the femoral model and the prosthesis model is calculated based on the dot product of the normal vectors. The smaller the angle, the higher the TCP accuracy.
9. An electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, characterized in that: When the processor executes the computer program, the steps of the verification method according to any one of claims 1 to 8 are implemented.
10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the verification method according to any one of claims 1 to 8 are implemented.
Citation Information
Patent Citations
Method and device system for removing material or for working material
CN101259028A
Femoral component for a knee prosthesis with improved articular characteristics
CN103732188A
UR-based knee joint total condyle operation end saw blade posture correction method and system
CN117338424A
Plane correction and verification method for saw blade of swing saw in total knee arthroplasty
CN117562658A
Knee joint osteotomy planning device, knee joint automatic osteotomy device and related equipment
CN117653267A
Cited By
Prosthesis position planning tool and prosthesis visual placement system and method
CN119867929A
