Osteotomy guide plate calibration method and device, electronic equipment and storage medium

Abstract

The invention discloses an osteotomy guide plate calibration method and device, electronic equipment and a storage medium. The method comprises the steps that a first conversion matrix and a second conversion matrix are obtained; obtaining an image obtained by photographing the optical calibration device by the camera; determining a third conversion matrix corresponding to each preset placement point according to the image; determining a direction vector of each coordinate axis of the osteotomy guide plate coordinate system based on the calibration coordinates, the second conversion matrix and third conversion matrixes corresponding to all the preset placement points; determining a fourth conversion matrix based on the direction vectors of all coordinate axes of the osteotomy guide plate coordinate system and the coordinates of the original point in the reference coordinate system; and performing left multiplication on the first conversion matrix and the fourth conversion matrix to obtain a fifth conversion matrix. According to the method, the third conversion matrix from the camera coordinate system to the optical calibration device coordinate system corresponding to each preset placement point is determined according to the image, the osteotomy guide plate can be calibrated when the osteotomy guide plate and the mechanical arm are actually assembled, and the calibration accuracy can be improved.

Description

Technical Field

[0001] The present invention relates to the field of medical technology, and in particular to a calibration method, device, electronic equipment and storage medium for an osteotomy guide plate. Background Art

[0002] In robot-assisted surgery, especially in robot-assisted high tibial osteotomy surgery, the robotic arm is an important surgical auxiliary tool. The osteotomy guide is an osteotomy guide installed at the end of the robotic arm. During the operation, the osteotomy guide is needed to perform osteotomy on the patient's bones. Therefore, it is necessary to accurately position the osteotomy guide to ensure that the position and angle of the surgical incision meet the requirements of preoperative planning. In order to achieve this goal, the position of the osteotomy guide needs to be accurately calibrated.

[0003] At present, the commonly used method is to use the flange coordinate system as the reference coordinate system in mechanical design software (such as SolidWorks), and obtain the coordinates of the tool center point (TCP) of the osteotomy guide in the flange coordinate system through modeling calculation to calibrate the tool center point of the osteotomy guide.

[0004] However, existing methods ignore various error factors that may be introduced during the design of osteotomy guides, actual production, installation, and even use, including but not limited to manufacturing tolerances, installation errors, and wear caused by long-term use. The accumulation of these errors often affects the final calibration accuracy. Summary of the invention

[0005] In response to the shortcomings of the prior art, the present application provides a calibration method, device, electronic device and storage medium for an osteotomy guide plate. By determining the third transformation matrix from the camera coordinate system corresponding to each preset placement point to the coordinate system of the optical calibration device according to the image, and then determining the direction vector of the positive direction of each coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system, the osteotomy guide plate can be calibrated when the osteotomy guide plate is actually assembled with the robotic arm. Compared with the method of calibrating the osteotomy guide plate in the mechanical design software, the calibration accuracy can be improved.

[0006] To solve the above problems, the present invention provides the following technical solutions:

[0007] In a first aspect, an embodiment of the present application provides a calibration method for an osteotomy guide plate, wherein the osteotomy guide plate is mounted on a flange at the end of a robotic arm, and the calibration method comprises:

[0008] Acquire a first conversion matrix and a second conversion matrix, wherein the first conversion matrix is ​​a conversion matrix from a flange coordinate system to a reference coordinate system, and the second conversion matrix is ​​a conversion matrix from a camera coordinate system to the reference coordinate system;

[0009] Whenever the optical calibration device is placed at a preset placement point on the osteotomy guide plate in a preset posture, an image obtained by taking a photo of the optical calibration device by a camera is acquired;

[0010] Determine, according to the image, a third transformation matrix from the camera coordinate system to the optical calibration device coordinate system corresponding to each of the preset placement points, wherein the number of the preset placement points is more than 3;

[0011] Determine the direction vector of each coordinate axis of the osteotomy guide plate coordinate system of the osteotomy guide plate in the reference coordinate system based on the calibration coordinates of the calibration points of the optical calibration device in the optical calibration device coordinate system, the second transformation matrix, and the third transformation matrix corresponding to all the preset placement points;

[0012] Determine a fourth transformation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system, wherein the fourth transformation matrix is ​​a transformation matrix from the reference coordinate system to the osteotomy guide coordinate system;

[0013] The first transformation matrix is ​​multiplied by the fourth transformation matrix to obtain a fifth transformation matrix, wherein the fifth transformation matrix is ​​a transformation matrix from the flange coordinate system to the osteotomy guide plate coordinate system.

[0014] In some embodiments, the method of determining the direction vector of each coordinate axis of the osteotomy guide plate coordinate system of the osteotomy guide plate in the reference coordinate system based on the calibration coordinates of the calibration points of the optical calibration device in the optical calibration device coordinate system, the second transformation matrix, and the third transformation matrix corresponding to all the preset placement points, includes:

[0015] Calculate the coordinates of each of the preset placement points in the reference coordinate system based on the calibration coordinates, the second transformation matrix, and a third transformation matrix corresponding to each of the preset placement points;

[0016] The direction vector of the positive direction of each coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system is determined based on the coordinates of all the preset placement points in the reference coordinate system.

[0017] In some embodiments, the calculating the coordinates of each of the preset placement points in the reference coordinate system based on the calibration coordinates, the second transformation matrix, and a third transformation matrix corresponding to each of the preset placement points includes:

[0018] For each of the preset placement points, the inverse matrix of the second transformation matrix is ​​multiplied by the third transformation matrix corresponding to the preset placement point and multiplied by the calibration coordinate to obtain the coordinates of the preset placement point in the reference coordinate system.

[0019] In some embodiments, the preset placement points include a first preset placement point, a second preset placement point, and a third preset placement point, a first line connecting the first preset placement point and the second preset placement point is perpendicular to a second line connecting the first preset placement point and the third preset placement point, a direction from the first preset placement point to the second preset placement point is the positive direction of the first coordinate axis of the osteotomy guide coordinate system, and a direction from the first preset placement point to the third preset placement point is the positive direction of the second coordinate axis of the osteotomy guide coordinate system.

[0020] In some embodiments, one of the first preset placement point, the second preset placement point, and the third preset placement point is the origin of the osteotomy guide coordinate system.

[0021] In some embodiments, determining the fourth transformation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system includes:

[0022] Determine a rotation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system;

[0023] Determine a translation vector based on the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system;

[0024] The fourth transformation matrix is ​​determined based on the rotation matrix and the translation vector.

[0025] In some embodiments, the preset placement points include a first preset placement point, a second preset placement point, and a third preset placement point, a first line connecting the first preset placement point and the second preset placement point is perpendicular to a second line connecting the first preset placement point and the third preset placement point, a direction from the first preset placement point to the second preset placement point is a positive direction of a first coordinate axis of the osteotomy guide coordinate system, a direction from the first preset placement point to the third preset placement point is a positive direction of a second coordinate axis of the osteotomy guide coordinate system, a coordinate of the first preset placement point in the reference coordinate system is a first coordinate, a coordinate of the second preset placement point in the reference coordinate system is a second coordinate, and a coordinate of the third preset placement point in the reference coordinate system is a third coordinate,

[0026] The step of determining the direction vector of the positive direction of each coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system based on the coordinates of all the preset placement points in the reference coordinate system comprises:

[0027] Determine a first direction vector of the positive direction of the first coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system based on a direction vector obtained by subtracting the first coordinate from the second coordinate;

[0028] Determine a second direction vector of the positive direction of the second coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system based on the direction vector obtained by subtracting the first coordinate from the third coordinate;

[0029] The first direction vector is cross-multiplied with the second direction vector to obtain a third direction vector of the positive direction of the third coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system.

[0030] In a second aspect, an embodiment of the present application provides a calibration device for an osteotomy guide plate, wherein the osteotomy guide plate is mounted on a flange at the end of a robotic arm, and the calibration device includes an acquisition module and a processing module;

[0031] The acquisition module is used to acquire a first conversion matrix and a second conversion matrix, wherein the first conversion matrix is ​​a conversion matrix from a flange coordinate system to a reference coordinate system, and the second conversion matrix is ​​a conversion matrix from a camera coordinate system to the reference coordinate system;

[0032] The acquisition module is also used to acquire an image obtained by taking a photo of the optical calibration device by a camera whenever the optical calibration device is placed at a preset placement point on the osteotomy guide plate in a preset posture;

[0033] The processing module is used to determine, according to the image, a third transformation matrix from the camera coordinate system to the optical calibration device coordinate system corresponding to each of the preset placement points, wherein the number of the preset placement points is more than 3;

[0034] Determine the direction vector of each coordinate axis of the osteotomy guide plate coordinate system of the osteotomy guide plate in the reference coordinate system based on the calibration coordinates of the calibration points of the optical calibration device in the optical calibration device coordinate system, the second transformation matrix, and the third transformation matrix corresponding to all the preset placement points;

[0035] Determine a fourth transformation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system, wherein the fourth transformation matrix is ​​a transformation matrix from the reference coordinate system to the osteotomy guide coordinate system;

[0036] The first transformation matrix is ​​multiplied by the fourth transformation matrix to obtain a fifth transformation matrix, wherein the fifth transformation matrix is ​​a transformation matrix from the flange coordinate system to the osteotomy guide plate coordinate system.

[0037] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising:

[0038] at least one processor; and,

[0039] a memory communicatively connected to the at least one processor; wherein,

[0040] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can perform the calibration method of the osteotomy guide plate as described in the first aspect.

[0041] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores an executable program, and the executable program is executed by a processor to implement the calibration method of the osteotomy guide plate as described in the first aspect.

[0042] The present application provides a calibration method, device, electronic device and storage medium for an osteotomy guide plate. The present application determines the third transformation matrix from the camera coordinate system corresponding to each preset placement point to the coordinate system of the optical calibration device according to the image, and then determines the direction vector of the positive direction of each coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system. The osteotomy guide plate can be calibrated when the osteotomy guide plate is actually assembled with a robotic arm. Compared with the method of calibrating the osteotomy guide plate in the mechanical design software, the calibration accuracy can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 This is an application scenario diagram of the osteotomy guide plate calibration method provided in an embodiment of the present application.

[0044] Figure 2 It is a flow chart of the calibration method of the osteotomy guide plate provided in the embodiment of the present application.

[0045] Figure 3 It is a schematic diagram of an optical calibration device provided in an embodiment of the present application.

[0046] Figure 4 It is a front view of the first embodiment of the osteotomy guide plate provided in the embodiment of the present application.

[0047] Figure 5 It is a front view of the second embodiment of the osteotomy guide plate provided in the embodiment of the present application.

[0048] Figure 6 It is a front view of the third embodiment of the osteotomy guide plate provided in the embodiment of the present application.

[0049] Figure 7 It is a front view of the fourth embodiment of the osteotomy guide plate provided in the embodiment of the present application.

[0050] Figure 8 yes Figure 2 Detailed flowchart of step S400.

[0051] Fig. 9 It is a structural schematic diagram of the calibration device of the osteotomy guide plate provided in an embodiment of the present application.

[0052] Fig.10 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application.

[0053] Fig.11 It is a structural block diagram of a computer-readable storage medium provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0055] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0056] The present application provides a calibration method, device, electronic device and storage medium for an osteotomy guide plate. By determining the third transformation matrix from the camera coordinate system corresponding to each preset placement point to the coordinate system of the optical calibration device according to the image, and then determining the direction vector of the positive direction of each coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system, the osteotomy guide plate can be calibrated when the osteotomy guide plate is actually assembled with a robotic arm. Compared with the method of calibrating the osteotomy guide plate in the mechanical design software, the accuracy of the calibration can be improved.

[0057] The calibration method of the osteotomy guide provided by the present application will be described in detail below with reference to the accompanying drawings.

[0058] See also Figure 1 , Figure 1 : is an application scenario diagram of the osteotomy guide plate calibration method provided in the embodiment of the present application. Figure 1 As shown, in some embodiments, the osteotomy guide plate 20 is mounted on the flange 11 at the end of the mechanical arm 10. The flange is a common mechanical accessory, which is used to connect two mechanical devices and achieve a sealing effect.

[0059] like Figure 1 As shown, in some embodiments, a reference array 12 is also installed at the end of the robot arm 10. In some embodiments, the reference array 12 includes a bracket disposed at the end of the robot arm, and five positioning members disposed on the bracket.

[0060] Optionally, the five positioning members are arranged according to a first position relationship.

[0061] Optionally, the positioning elements are reflective markers, and each positioning element has a reflective center.

[0062] Exemplarily, the reflective marker is a reflective ball, and the center of the reflective ball is the reflective center.

[0063] like Figure 1 As shown, in some embodiments, a camera coordinate system 30 is preset in the optical positioning camera, and the optical positioning camera can obtain the coordinates of the object in the captured image in the camera coordinate system.

[0064] In some embodiments, determining a transformation matrix from a camera coordinate system to a reference coordinate system includes the following steps (1.1) to (1.3).

[0065] (1.1) Obtain an image obtained by taking a picture of the end of the robotic arm on which the reference array is installed by the optical positioning camera.

[0066] (1.2) According to the coordinates of the reflection centers of the multiple positioning parts in the image in (1.1) in the camera coordinate system, the direction vector of the positive direction of each coordinate axis of the reference coordinate system in the camera coordinate system is determined.

[0067] Optionally, the origin of the reference coordinate system is the tool center point (TCP) of the reference array.

[0068] In some embodiments, the reflection center of the first positioning member is selected as the origin of the reference coordinate system, the direction vector from the second positioning member to the reflection center of the third positioning member is the direction vector of the first coordinate axis of the reference coordinate system, the result vector of the direction vector of the first coordinate axis cross-multiplied by the direction vector of the reflection center from the fourth positioning member to the fifth positioning member is the direction vector of the second coordinate axis of the reference coordinate system, and the direction vector of the first coordinate axis cross-multiplied by the direction vector of the second coordinate axis is the direction vector of the third coordinate axis of the reference coordinate system. The first positioning member, the second positioning member, the third positioning member, the fourth positioning member, and the fifth positioning member are different positioning members.

[0069] (1.3) A second transformation matrix is ​​determined based on the direction vectors of all coordinate axes of the reference coordinate system and the coordinates of the origin of the reference coordinate system in the camera coordinate system.

[0070] The second transformation matrix is ​​a transformation matrix from the camera coordinate system to the reference coordinate system.

[0071] The content of step (1.3) refers to the following method for determining the fourth conversion matrix, which will not be repeated here.

[0072] like Figure 1 As shown, in some embodiments, the reference coordinate system 120 of the reference array 12 includes a coordinate axis X1, a coordinate axis Y1, and a coordinate axis Z1.

[0073] like Figure 1 As shown, in some embodiments, the relative position of the flange 11 and the reference array 12 is fixed, so the relative position of the TCP of the flange 11 and the TCP of the reference array 12 is also fixed, and the position of the reference array 12 can be used to determine the position of the flange 11.

[0074] like Figure 1 As shown, in some embodiments, a flange coordinate system 110 of the flange 11 is established, the flange coordinate system 110 includes a coordinate axis X2, a coordinate axis Y2, and a coordinate axis Z2, and the origin of the flange coordinate system 110 is the TCP of the flange 11.

[0075] In some embodiments, the coordinates of the TCP of the flange 11 in the flange coordinate system 110 are predetermined.

[0076] In some embodiments, a first transformation matrix is ​​calculated based on multiple sets of transformation matrices from the robot base coordinate system to the flange coordinate system and the camera coordinate system to the reference coordinate system, wherein the first transformation matrix is ​​a transformation matrix from the flange coordinate system to the reference coordinate system.

[0077] like Figure 1 As shown, in some embodiments, during use, an optical positioning camera is used to take a picture of the reference array 12, and the coordinates of the TCP of the reference array 12 in the camera coordinate system are obtained according to the image. After the flange coordinate system 110, the first conversion matrix, and the second conversion matrix of the flange 11 are determined, the coordinates of the TCP of the flange 11 in the flange coordinate system 110 are multiplied by the inverse matrix of the first conversion matrix, and the coordinates of the TCP of the flange 11 in the reference coordinate system can be obtained. In this way, the coordinates of the TCP of the reference array and the TCP of the flange in the same coordinate system can be obtained, so that the coordinates of the TCP of the flange can be determined according to the coordinates of the TCP of the reference array.

[0078] like Figure 1 As shown, in some embodiments, the osteotomy guide plate 20 is mounted on the flange 11 at the end of the robot arm 10. The osteotomy guide plate 20 is used to allow an osteotomy knife to be inserted to perform osteotomy on the bone of the target object.

[0079] like Figure 1 As shown, in some embodiments, an osteotomy guide coordinate system 21 of the osteotomy guide 20 is established, the origin O of the osteotomy guide coordinate system 21 is the TCP of the osteotomy guide, and the osteotomy guide coordinate system 21 includes a coordinate axis X3, a coordinate axis Y3, and a coordinate axis Z3.

[0080] In some embodiments, the conversion matrix from the flange coordinate system to the osteotomy guide coordinate system is calculated to calibrate the TCP of the osteotomy guide. In this way, the real-time position of the osteotomy guide can be determined by the real-time position of the flange to provide a reference for surgery.

[0081] See also Figure 2 , Figure 2 FIG. 1 is a flow chart of a method for calibrating an osteotomy guide plate provided in an embodiment of the present application. Figure 2 As shown, the osteotomy guide plate calibration method includes: steps S100 to S600.

[0082] Step S100: Acquire a first conversion matrix and a second conversion matrix.

[0083] The first conversion matrix is ​​a conversion matrix from the flange coordinate system to the reference coordinate system, and the second conversion matrix is ​​a conversion matrix from the camera coordinate system to the reference coordinate system.

[0084] In the present method, the first conversion matrix and the second conversion matrix are directly obtained, and the manner of determining the first conversion matrix and the second conversion matrix is ​​not described in detail again.

[0085] During the calibration process, the optical positioning camera, robot arm, flange, and osteotomy guide do not move.

[0086] Step S200: Whenever the optical calibration device is placed at a preset placement point on the osteotomy guide plate in a preset posture, an image obtained by taking a photo of the optical calibration device by a camera is acquired.

[0087] See also Figure 3 , Figure 3 Schematic diagram of an optical calibration device provided in an embodiment of the present application. Figure 3 As shown, in some embodiments, the optical calibration device 40 includes a calibration point 41 and a plurality of positioning members 42, each positioning member 42 having a reflective center.

[0088] Optionally, the positioning member 42 is a reflective marker. Optionally, the reflective marker is a reflective ball.

[0089] In some embodiments, a plurality of positioning members of the optical calibration device are arranged according to a second positional relationship.

[0090] Optionally, the first positional relationship and the second positional relationship are different. In this way, a first pattern formed by multiple reflective centers of the reference array in the image can be different from a second pattern formed by multiple reflective centers of the optical calibration device, and the reference array and the optical calibration device can be distinguished by the first pattern and the second pattern.

[0091] See also Figure 4 , Figure 4 1 is a front view of the first embodiment of the osteotomy guide provided in the embodiment of the present application. Figure 4 As shown, the osteotomy guide plate 20 includes a fixing portion 23 , and the fixing portion 23 is used to install the osteotomy guide plate 20 with the flange 11 at the end of the robot arm 11 .

[0092] like Figure 1 and Figure 4 As shown, in some embodiments, a calibration structure for image calibration is provided on the osteotomy guide plate 20 , and the calibration structure includes a preset placement point 22 .

[0093] Optionally, the preset placement point 22 is a groove point that matches the calibration point 41 of the optical calibration device 40. The preset placement point 22 is used to place the calibration point 41.

[0094] In some embodiments, the optical calibration device is an optical probe, the calibration point is a tip point of the optical probe, and the preset placement point is a groove point of the optical probe.

[0095] In some embodiments, the number of preset placement points is more than 3. For example, the number of preset placement points is 3, 4, 5, or 6.

[0096] In some embodiments, the preset posture of the optical calibration device is: the calibration point of the optical calibration device is placed at a preset placement point on the osteotomy guide, the line connecting the TCP of the optical calibration device and the calibration point is in the vertical direction, and the multiple positioning parts thereon are facing the optical positioning camera.

[0097] In some embodiments, whenever the optical calibration device is placed at a preset placement point on the osteotomy guide in a preset posture, an image of the optical calibration device is acquired by a camera, and the image includes a second pattern formed by multiple reflective centers of the optical calibration device.

[0098] In some embodiments, a plurality of preset placement points on the osteotomy guide are arranged according to a preset positional relationship.

[0099] In some implementations, the number of preset placement points is 3.

[0100] like Figure 4As shown, in some embodiments, the preset placement point 22 includes a first preset placement point 221, a second preset placement point 222, and a third preset placement point 223. A first connecting line L1 between the first preset placement point 221 and the second preset placement point 222 is perpendicular to a second connecting line L2 between the first preset placement point 221 and the third preset placement point 223.

[0101] Optionally, the direction from the first preset placement point 221 to the second preset placement point 222 is the positive direction of the first coordinate axis of the osteotomy guide coordinate system, and the direction from the first preset placement point 221 to the third preset placement point 223 is the positive direction of the second coordinate axis of the osteotomy guide coordinate system.

[0102] In some embodiments, the coordinates of the origin of the osteotomy guide coordinate system in the osteotomy guide coordinate system are predetermined.

[0103] In some embodiments, the origin of the osteotomy guide coordinate system is predetermined.

[0104] In some embodiments, one of the plurality of preset placement points is the origin of the osteotomy guide coordinate system.

[0105] In some embodiments, the preset placement point among the first preset placement point, the second preset placement point, and the third preset placement point is the origin of the osteotomy guide coordinate system.

[0106] See also Figure 5 , Figure 5 2 is a front view of the second embodiment of the osteotomy guide provided in the embodiment of the present application. Figure 5 As shown, in some embodiments, the preset placement point 22 includes a first preset placement point 221 , a third preset placement point 223 , and a fourth preset placement point 224 .

[0107] like Figure 5 As shown, in some embodiments, the line connecting the third preset placement point 223 and the fourth preset placement point 224 is the third line L3, and the intersection H1 of the perpendicular line L4 from the first preset placement point 221 to the third line L3 and the third line L3 is the origin of the osteotomy guide coordinate system.

[0108] In some embodiments, the direction from the first preset placement point 221 to the intersection H1 is the positive direction of the first coordinate axis of the osteotomy guide coordinate system, and the direction from the fourth preset placement point 224 to the third preset placement point 223 is the positive direction of the second coordinate axis of the osteotomy guide coordinate system.

[0109] In some implementations, the number of preset placement points is 4.

[0110] See also Figure 6 , Figure 62 is a front view of the third embodiment of the osteotomy guide provided in the embodiment of the present application. Figure 6 As shown, in some embodiments, the preset placement point 22 includes a first preset placement point 221 , a third preset placement point 223 , a fourth preset placement point 224 and a fifth preset placement point 225 .

[0111] like Figure 6 As shown, in some embodiments, the third connecting line L3 is perpendicular to the fifth connecting line L5 of the third preset placement point 223 and the fourth preset placement point 224 .

[0112] In some embodiments, the direction from the first preset placement point 221 to the fifth preset placement point 225 is the positive direction of the first coordinate axis of the osteotomy guide coordinate system, and the direction from the fourth preset placement point 224 to the third preset placement point 223 is the positive direction of the second coordinate axis of the osteotomy guide coordinate system.

[0113] like Figure 6 As shown, in some embodiments, the intersection H2 of the third line L3 and the fifth line L5 is the origin of the osteotomy guide coordinate system.

[0114] In some embodiments, the number of preset placement points is 5.

[0115] See also Figure 7 , Figure 7 2 is a front view of the fourth embodiment of the osteotomy guide provided in the embodiment of the present application. Figure 7 As shown, in some embodiments, the preset placement point 22 includes a first preset placement point 221 , a third preset placement point 223 , a fourth preset placement point 224 , a fifth preset placement point 225 and a sixth preset placement point 226 .

[0116] like Figure 7 As shown, in some embodiments, the third line L3 is perpendicular to the fifth line L5, and the sixth preset placement point 226 coincides with the intersection of the third line L3 and the fifth line L5.

[0117] In some embodiments, the direction from the first preset placement point 221 to the fifth preset placement point 225 is the positive direction of the first coordinate axis of the osteotomy guide coordinate system, and the direction from the fourth preset placement point 224 to the third preset placement point 223 is the positive direction of the second coordinate axis of the osteotomy guide coordinate system.

[0118] Optionally, the sixth preset placement point 226 is the origin of the osteotomy guide plate coordinate system.

[0119] In some embodiments, the osteotomy guide includes a first side and a second side opposite the first side, each side including an osteotomy groove.

[0120] like Figures 4 to 7 As shown, in some embodiments, an identification mark 24 is provided on the osteotomy guide plate 20, and the identification mark 24 is used to indicate whether the osteotomy groove corresponding to the side is used for osteotomy of the bone on the left side of the target object's body or for osteotomy of the bone on the right side of the target object's body.

[0121] like Figures 4 to 7 As shown, in some embodiments, the mark 24 is "R", indicating that the osteotomy groove corresponding to the side where the mark 24 is located is used to perform osteotomy on the bones on the right side of the target object's body.

[0122] In some embodiments, the mark is "L", indicating that the osteotomy groove corresponding to the side where the mark is located is used to perform osteotomy on the bones on the right side of the target subject's body.

[0123] In some embodiments, a plurality of preset placement points are respectively set on the two sides of the osteotomy guide according to the above-mentioned embodiments. In this way, the osteotomy guide can be calibrated when using any side of the osteotomy guide.

[0124] Optionally, a pattern formed by the plurality of preset placement points on the first side portion is axially symmetrical to a pattern formed by the plurality of preset placement points on the second side portion.

[0125] Step S300: determining a third transformation matrix from the camera coordinate system corresponding to each preset placement point to the optical calibration device coordinate system according to the image.

[0126] In some embodiments, step S300 includes step (300.1) to step (300.2).

[0127] (300.1) Determine the direction vector of the positive direction of each coordinate axis of the optical calibration device coordinate system in the camera coordinate system according to the coordinates of multiple reflection centers of the optical calibration device in the image corresponding to each preset placement point in the camera coordinate system.

[0128] The content of step (300.1) refers to the description of step (1.2) above.

[0129] (300.2) Determine a third transformation matrix corresponding to the preset placement point based on the direction vectors of all coordinate axes of the optical calibration device coordinate system and the coordinates of the origin of the reference coordinate system in the camera coordinate system.

[0130] The content of step (300.2) refers to the following method for determining the fourth conversion matrix, which will not be repeated here.

[0131] In some embodiments, each time the optical positioning camera takes a picture, a preset program is used to calculate a third transformation matrix from the camera coordinate system corresponding to each preset placement point to the optical calibration device coordinate system based on the image corresponding to each preset placement point.

[0132] In some implementations, a third transformation matrix from a camera coordinate system corresponding to each preset placement point to a coordinate system of the optical calibration device is directly acquired.

[0133] Step S400: Determine the direction vector of the positive direction of each coordinate axis of the osteotomy guide coordinate system in the reference coordinate system based on the calibration coordinates of the calibration points of the optical calibration device in the optical calibration device coordinate system, the second transformation matrix and the third transformation matrix corresponding to all preset placement points.

[0134] See also Figure 8 , Figure 8 yes Figure 2 Detailed flow chart of step S400 in FIG. Figure 8 As shown, in some implementations, step S400 includes step S410 and step S420.

[0135] Step S410: Calculate the coordinates of each preset placement point in the reference coordinate system based on the calibration coordinates, the second transformation matrix, and the third transformation matrix corresponding to each preset placement point.

[0136] In some embodiments, the calibration coordinates of the calibration points of the optical calibration device in the optical calibration device coordinate system are predetermined.

[0137] In some implementations, for each preset placement point, the inverse matrix of the second transformation matrix is ​​pre-multiplied by the third transformation matrix corresponding to the preset placement point and pre-multiplied by the calibration coordinates to obtain the coordinates of the preset placement point in the reference coordinate system.

[0138] Optionally, the calculation formula for the coordinates of the preset placement point in the reference coordinate system is:

[0139] ni=A-1Bip,

[0140] Among them, ni represents the vector formed by the coordinates of the i-th preset placement point in the reference coordinate system, A-1 represents the inverse matrix of the second transformation matrix, Bi represents the third transformation matrix corresponding to the i-th preset placement point, and p represents the vector formed by the calibration coordinates.

[0141] Step S420: Determine the direction vector of the positive direction of each coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system based on the coordinates of all preset placement points in the reference coordinate system.

[0142] In some embodiments, the coordinates of the origin of the osteotomy guide plate coordinate system in the reference coordinate system are determined based on the coordinates of the preset placement point in the reference coordinate system.

[0143] As described above, in some embodiments, one of the first preset placement point, the second preset placement point, and the third preset placement point is the origin of the osteotomy guide coordinate system. Therefore, the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system are the coordinates of the first preset placement point in the reference coordinate system, the coordinates of the second preset placement point in the reference coordinate system, or the coordinates of the third preset placement point in the reference coordinate system.

[0144] In some embodiments, the coordinates of the first preset placement point in the reference coordinate system are first coordinates, the coordinates of the second preset placement point in the reference coordinate system are second coordinates, and the coordinates of the third preset placement point in the reference coordinate system are third coordinates.

[0145] exist Figure 4 In the illustrated embodiment, step S420 includes steps (420.1) to (420.3).

[0146] (420.1) Determine a first direction vector of the positive direction of the first coordinate axis of the osteotomy guide coordinate system in the reference coordinate system based on a direction vector obtained by subtracting the first coordinate from the second coordinate.

[0147] In some embodiments, the calculation formula of the first direction vector is: in, represents the first direction vector, n2 represents the vector formed by the second coordinates, n1 represents the vector formed by the first coordinates, and n2-n1 represents the modulus of the resultant vector obtained by subtracting the vector formed by the first coordinates from the vector formed by the second coordinates.

[0148] (420.2) Determine a second direction vector of the positive direction of the second coordinate axis of the osteotomy guide coordinate system in the reference coordinate system based on the direction vector obtained by subtracting the first coordinate from the third coordinate.

[0149] In some embodiments, the calculation formula of the second direction vector is: in, represents the second direction vector, n3 represents the vector formed by the third coordinates, n1 represents the vector formed by the first coordinates, and n3-n1 represents the modulus of the resultant vector obtained by subtracting the vector formed by the first coordinates from the vector formed by the third coordinates.

[0150] (420.3) The first direction vector is cross-multiplied with the second direction vector to obtain a third direction vector of the positive direction of the third coordinate axis of the osteotomy guide coordinate system in the reference coordinate system.

[0151] In some embodiments, the calculation formula of the third direction vector is: in, represents the third direction vector, and × represents the vector cross product.

[0152] like Figure 1 As shown, in some embodiments, the first direction vector is the direction vector of the positive direction of the coordinate axis Z3 in the reference coordinate system 120, the second direction vector is the direction vector of the positive direction of the coordinate axis X3 in the reference coordinate system 120, and the third direction vector is the direction vector of the positive direction of the coordinate axis Y3 in the reference coordinate system 120.

[0153] By means of the preset placement points including a first preset placement point, a second preset placement point and a third preset placement point, a first line connecting the first preset placement point and the second preset placement point being perpendicular to a second line connecting the first preset placement point and the third preset placement point, a direction from the first preset placement point to the second preset placement point being the positive direction of the first coordinate axis of the osteotomy guide coordinate system, and a direction from the first preset placement point to the third preset placement point being the positive direction of the second coordinate axis of the osteotomy guide coordinate system, the direction vector of the positive direction of the coordinate axis in the reference coordinate system can be directly determined by the direction vector determined by the two preset placement points, thereby simplifying the calculation process.

[0154] In some embodiments, the coordinates of the fourth preset placement point in the reference coordinate system are fourth coordinates, the coordinates of the fifth preset placement point in the reference coordinate system are fifth coordinates, and the coordinates of the sixth preset placement point in the reference coordinate system are sixth coordinates.

[0155] exist Figure 5 In the illustrated embodiment, step S420 includes steps (420.4) to (420.6).

[0156] (420.4) Determine a first direction vector of the positive direction of the first coordinate axis of the osteotomy guide coordinate system in the reference coordinate system based on a direction vector obtained by subtracting the first coordinate from the coordinate of the intersection point H1 in the reference coordinate system.

[0157] (420.5) Determine a second direction vector of the positive direction of the second coordinate axis of the osteotomy guide coordinate system in the reference coordinate system based on the direction vector obtained by subtracting the fourth coordinate from the third coordinate.

[0158] (420.6) The first direction vector is cross-multiplied by the second direction vector to obtain a third direction vector of the positive direction of the third coordinate axis of the osteotomy guide coordinate system in the reference coordinate system.

[0159] pass Figure 5 The embodiment shown, relative to Figure 4 The illustrated embodiment can improve the accuracy of the first direction vector, thereby improving the accuracy of calibration, when a first line connecting the first preset placement point and the second preset placement point is not completely perpendicular to a second line connecting the first preset placement point and the third preset placement point due to manufacturing errors.

[0160] exist Figure 6 or Figure 7 In the illustrated embodiment, step S420 includes steps (420.7) to (420.9).

[0161] (420.7) Determine a first direction vector of the positive direction of the first coordinate axis of the osteotomy guide coordinate system in the reference coordinate system based on a direction vector obtained by subtracting the first coordinate from the fifth coordinate.

[0162] (420.8) Determine a second direction vector of the positive direction of the second coordinate axis of the osteotomy guide coordinate system in the reference coordinate system based on the direction vector obtained by subtracting the fourth coordinate from the third coordinate.

[0163] (420.9) The first direction vector is cross-multiplied with the second direction vector to obtain a third direction vector of the positive direction of the third coordinate axis of the osteotomy guide coordinate system in the reference coordinate system.

[0164] The method of calculating the first direction vector, the second direction vector and the third direction vector refers to the above description.

[0165] pass Figure 6 or Figure 7 The embodiment shown, relative to Figure 4 or Figure 5 In the illustrated embodiment, a large number of preset placement points can reduce the calibration error caused by the manufacturing error of a single preset placement point, thereby improving the accuracy of calibration.

[0166] Step S500: Determine a fourth transformation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system.

[0167] In some embodiments, step S500 includes steps (500.1) to (500.3).

[0168] (500.1) Determine a rotation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system.

[0169] In some embodiments, the rotation matrix includes direction vectors of all coordinate axes, and each direction vector is a column vector of the rotation matrix.

[0170] In some embodiments, the calculation formula of the rotation matrix is:

[0171]

[0172] Where R represents the rotation matrix, express The first value of express The first value of express , and so on.

[0173] (500.2) Determine a translation vector based on the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system.

[0174] In some embodiments, the vector formed by the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system is the translation vector.

[0175] In some embodiments, the translation vector is calculated as: Where t represents the translation vector, Represents the vector formed by the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system. express , and so on.

[0176] (500.3) Determine a fourth transformation matrix based on the rotation matrix and the translation vector.

[0177] The fourth transformation matrix is ​​a transformation matrix from the reference coordinate system to the osteotomy guide coordinate system.

[0178] In some implementations, the calculation formula of the fourth conversion matrix is:

[0179]

[0180] Wherein, T4 represents the fourth transformation matrix.

[0181] Step S600: multiplying the first conversion matrix by the fourth conversion matrix to obtain a fifth conversion matrix.

[0182] Among them, the fifth transformation matrix is ​​the transformation matrix from the flange coordinate system to the osteotomy guide plate coordinate system.

[0183] In some embodiments, after obtaining the fifth conversion matrix, the coordinates of the positions in the camera coordinate system, the reference coordinate system, the flange coordinate system, and the osteotomy guide coordinate system can be mutually converted according to the first conversion matrix, the second conversion matrix, the fourth conversion matrix, and the fifth conversion matrix. During the operation, the coordinates of the reference array TCP, the flange TCP, and the TCP of the osteotomy guide in the same coordinate system can be determined according to the image captured by the optical positioning camera, thereby achieving calibration of the osteotomy guide.

[0184] In some embodiments, any coordinate system is selected as a reference coordinate system, and the coordinates of the TCP of the osteotomy guide in the reference coordinate system are determined, so as to position the osteotomy guide during surgery.

[0185] In some embodiments, a camera coordinate system is selected as a reference coordinate system, and a second transformation matrix is ​​determined based on an image captured by an optical positioning camera. The second transformation matrix determined at this time is multiplied by the inverse matrix of the first transformation matrix and the fifth transformation matrix, and the coordinates of the TCP of the osteotomy guide in the osteotomy guide coordinate system are obtained.

[0186] In some embodiments, the coordinates of the TCP of the osteotomy guide in the osteotomy guide coordinate system are obtained by multiplying the second transformation matrix by the fourth transformation matrix.

[0187] In summary, the osteotomy guide plate calibration method provided in the embodiment of the present application has the following advantages:

[0188] 1. By determining the third transformation matrix from the camera coordinate system to the optical calibration device coordinate system corresponding to each preset placement point according to the image, and then determining the direction vector of the positive direction of each coordinate axis of the osteotomy guide coordinate system in the reference coordinate system, the osteotomy guide can be calibrated when the osteotomy guide is actually assembled with the robotic arm. Compared with the method of calibrating the osteotomy guide in the mechanical design software, the calibration accuracy can be improved.

[0189] 2. The preset placement points include a first preset placement point, a second preset placement point and a third preset placement point, a first connecting line between the first preset placement point and the second preset placement point is perpendicular to a second connecting line between the first preset placement point and the third preset placement point, a direction from the first preset placement point to the second preset placement point is the positive direction of the first coordinate axis of the osteotomy guide coordinate system, and a direction from the first preset placement point to the third preset placement point is the positive direction of the second coordinate axis of the osteotomy guide coordinate system, the direction vector of the positive direction of the coordinate axis in the reference coordinate system can be directly determined by the direction vector determined by the two preset placement points, thereby simplifying the calculation process.

[0190] 3. Pass Figure 5 The embodiment shown, relative to Figure 4 The illustrated embodiment can improve the accuracy of the first direction vector, thereby improving the accuracy of calibration, when a first line connecting the first preset placement point and the second preset placement point is not completely perpendicular to a second line connecting the first preset placement point and the third preset placement point due to manufacturing errors.

[0191] 4. Pass Figure 6 or Figure 7 The embodiment shown, relative to Figure 4 or Figure 5 In the illustrated embodiment, a large number of preset placement points can reduce the calibration error caused by the manufacturing error of a single preset placement point, thereby improving the accuracy of calibration.

[0192] See also Fig. 9 , Fig. 9 Schematic diagram of the structure of the calibration device of the osteotomy guide provided in the embodiment of the present application. Fig. 9 As shown, in some embodiments, the calibration device 300 for the osteotomy guide plate includes an acquisition module 310 and a processing module 320 .

[0193] In some embodiments, the acquisition module 310 is used to acquire a first transformation matrix and a second transformation matrix, wherein the first transformation matrix is ​​a transformation matrix from the flange coordinate system to the reference coordinate system, and the second transformation matrix is ​​a transformation matrix from the camera coordinate system to the reference coordinate system.

[0194] In some embodiments, the acquisition module 310 is further configured to acquire an image obtained by taking a photo of the optical calibration device by a camera whenever the optical calibration device is placed at a preset placement point on the osteotomy guide plate in a preset posture.

[0195] In some embodiments, the processing module 320 is used to determine the third transformation matrix from the camera coordinate system corresponding to each preset placement point to the optical calibration device coordinate system according to the image; wherein the number of preset placement points is more than 3; based on the calibration coordinates of the calibration points of the optical calibration device in the optical calibration device coordinate system, the second transformation matrix and the third transformation matrix corresponding to all preset placement points, determine the direction vector of each coordinate axis of the osteotomy guide coordinate system of the osteotomy guide in the reference coordinate system; based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system, determine the fourth transformation matrix, wherein the fourth transformation matrix is ​​the transformation matrix from the reference coordinate system to the osteotomy guide coordinate system; multiply the first transformation matrix by the fourth transformation matrix to obtain the fifth transformation matrix, wherein the fifth transformation matrix is ​​the transformation matrix from the flange coordinate system to the osteotomy guide coordinate system.

[0196] See also Fig.10 , Fig.10 Schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.10 As shown, the electronic device 400 includes: one or more processors 410 and a memory 420, Fig.10 A processor 410 is taken as an example.

[0197] In some implementations, the processor 410 and the memory 420 may be connected via a bus or other means. Fig.10 The example of connecting through bus is taken in the following.

[0198] In some embodiments, the processor 410 is used to obtain a first transformation matrix and a second transformation matrix, wherein the first transformation matrix is ​​a transformation matrix from the flange coordinate system to the reference coordinate system, and the second transformation matrix is ​​a transformation matrix from the camera coordinate system to the reference coordinate system; whenever the optical calibration device is placed at a preset placement point on the osteotomy guide in a preset posture, an image obtained by the camera photographing the optical calibration device is obtained; a third transformation matrix from the camera coordinate system to the optical calibration device coordinate system corresponding to each preset placement point is determined according to the image; wherein the number of preset placement points is more than 3; based on the calibration points of the optical calibration device at the optical The calibration coordinates in the coordinate system of the calibration device, the second transformation matrix, and the third transformation matrix corresponding to all preset placement points determine the direction vector of the positive direction of each coordinate axis of the osteotomy guide coordinate system of the osteotomy guide in the reference coordinate system; based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system, the fourth transformation matrix is ​​determined, wherein the fourth transformation matrix is ​​the transformation matrix from the reference coordinate system to the osteotomy guide coordinate system; the first transformation matrix is ​​multiplied by the fourth transformation matrix on the left to obtain the fifth transformation matrix, wherein the fifth transformation matrix is ​​the transformation matrix from the flange coordinate system to the osteotomy guide coordinate system.

[0199] In some embodiments, the memory 420, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules, such as program instructions / modules of the osteotomy guide plate calibration method in the embodiment of the present application. The processor 410 executes various functional applications and data processing of the electronic device 400 by running the non-volatile software programs, instructions and modules stored in the memory 420, that is, the osteotomy guide plate calibration method of the above method embodiment is implemented.

[0200] In some embodiments, the memory 420 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device 400, etc. In addition, the memory 420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 420 may optionally include a memory remotely arranged relative to the processor 410, and these remote memories may be connected to the controller via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0201] In some embodiments, one or more modules are stored in the memory 420, and when executed by one or more processors 410, the calibration method of the osteotomy guide plate in any of the above method embodiments is executed, for example, the calibration method described above is executed. Figure 2 The method comprises steps S100 to S600.

[0202] Please refer to Fig.11 , Fig.11 5 is a block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable storage medium 500 stores a program code 510, which can be called by a processor to execute the osteotomy guide plate calibration method described in the above method embodiment.

[0203] The computer-readable storage medium 500 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium includes a non-transitory computer-readable storage medium. The computer-readable storage medium 500 has a storage space for program codes for executing any method steps in the above-mentioned method for calibrating an osteotomy guide. These program codes may be read from or written into one or more computer program products. The program code may be compressed, for example, in an appropriate form.

[0204] In summary, the present application provides a calibration method, device, electronic device and storage medium for an osteotomy guide plate. The calibration method for the osteotomy guide plate includes obtaining a first transformation matrix and a second transformation matrix, wherein the first transformation matrix is ​​a transformation matrix from a flange coordinate system to a reference coordinate system, and the second transformation matrix is ​​a transformation matrix from a camera coordinate system to a reference coordinate system; whenever an optical calibration device is placed at a preset placement point on the osteotomy guide plate in a preset posture, an image obtained by a camera photographing the optical calibration device is obtained; a third transformation matrix from the camera coordinate system to the optical calibration device coordinate system corresponding to each preset placement point is determined according to the image; wherein the number of preset placement points is more than 3; based on The calibration coordinates of the calibration points of the optical calibration device in the optical calibration device coordinate system, the second conversion matrix, and the third conversion matrix corresponding to all preset placement points determine the direction vector of each coordinate axis of the osteotomy guide coordinate system in the reference coordinate system; the fourth conversion matrix is ​​determined based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system, wherein the fourth conversion matrix is ​​the conversion matrix from the reference coordinate system to the osteotomy guide coordinate system; the first conversion matrix is ​​multiplied by the fourth conversion matrix to obtain the fifth conversion matrix, wherein the fifth conversion matrix is ​​the conversion matrix from the flange coordinate system to the osteotomy guide coordinate system. The present application determines the third conversion matrix from the camera coordinate system to the optical calibration device coordinate system corresponding to each preset placement point according to the image, and then determines the direction vector of each coordinate axis of the osteotomy guide coordinate system in the reference coordinate system, so that the osteotomy guide can be calibrated when the osteotomy guide is actually assembled with the robotic arm, which can improve the accuracy of calibration compared to the method of calibrating the osteotomy guide in the mechanical design software.

[0205] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for calibrating an osteotomy guide plate, characterized in that: The osteotomy guide plate is mounted on a flange at the end of the robotic arm, and the calibration method includes: Acquire a first conversion matrix and a second conversion matrix, wherein the first conversion matrix is ​​a conversion matrix from a flange coordinate system to a reference coordinate system, and the second conversion matrix is ​​a conversion matrix from a camera coordinate system to the reference coordinate system; Whenever the optical calibration device is placed at a preset placement point on the osteotomy guide plate in a preset posture, an image obtained by taking a photo of the optical calibration device by a camera is acquired; Determine, according to the image, a third transformation matrix from the camera coordinate system to the optical calibration device coordinate system corresponding to each of the preset placement points, wherein the number of the preset placement points is more than 3; Determine the direction vector of each coordinate axis of the osteotomy guide plate coordinate system of the osteotomy guide plate in the reference coordinate system based on the calibration coordinates of the calibration points of the optical calibration device in the optical calibration device coordinate system, the second transformation matrix, and the third transformation matrix corresponding to all the preset placement points; Determine a fourth transformation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system, wherein the fourth transformation matrix is ​​a transformation matrix from the reference coordinate system to the osteotomy guide coordinate system; The first transformation matrix is ​​multiplied by the fourth transformation matrix to obtain a fifth transformation matrix, wherein the fifth transformation matrix is ​​a transformation matrix from the flange coordinate system to the osteotomy guide plate coordinate system.

2. The osteotomy guide plate calibration method according to claim 1, characterized in that: The method of determining the direction vector of each coordinate axis of the osteotomy guide plate coordinate system of the osteotomy guide plate in the reference coordinate system based on the calibration coordinates of the calibration points of the optical calibration device in the coordinate system of the optical calibration device, the second transformation matrix, and the third transformation matrix corresponding to all the preset placement points, comprises: Calculate the coordinates of each of the preset placement points in the reference coordinate system based on the calibration coordinates, the second transformation matrix, and a third transformation matrix corresponding to each of the preset placement points; The direction vector of the positive direction of each coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system is determined based on the coordinates of all the preset placement points in the reference coordinate system.

3. The method for calibrating an osteotomy guide plate according to claim 2, characterized in that: The calculating the coordinates of each of the preset placement points in the reference coordinate system based on the calibration coordinates, the second transformation matrix, and a third transformation matrix corresponding to each of the preset placement points includes: For each of the preset placement points, the inverse matrix of the second transformation matrix is ​​multiplied by the third transformation matrix corresponding to the preset placement point and multiplied by the calibration coordinate to obtain the coordinates of the preset placement point in the reference coordinate system.

4. The osteotomy guide plate calibration method according to any one of claims 1 to 3, characterized in that: The preset placement points include a first preset placement point, a second preset placement point and a third preset placement point, a first line connecting the first preset placement point and the second preset placement point is perpendicular to a second line connecting the first preset placement point and the third preset placement point, a direction from the first preset placement point to the second preset placement point is the positive direction of the first coordinate axis of the osteotomy guide coordinate system, and a direction from the first preset placement point to the third preset placement point is the positive direction of the second coordinate axis of the osteotomy guide coordinate system.

5. The osteotomy guide plate calibration method according to claim 4, characterized in that: One of the first preset placement point, the second preset placement point and the third preset placement point is the origin of the osteotomy guide plate coordinate system.

6. The osteotomy guide plate calibration method according to claim 5, characterized in that: The determining of the fourth transformation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system comprises: Determine a rotation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system; Determine a translation vector based on the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system; The fourth transformation matrix is ​​determined based on the rotation matrix and the translation vector.

7. The osteotomy guide plate calibration method according to claim 2, characterized in that: The preset placement points include a first preset placement point, a second preset placement point and a third preset placement point, a first connecting line between the first preset placement point and the second preset placement point is perpendicular to a second connecting line between the first preset placement point and the third preset placement point, a direction from the first preset placement point to the second preset placement point is a positive direction of a first coordinate axis of the osteotomy guide coordinate system, a direction from the first preset placement point to the third preset placement point is a positive direction of a second coordinate axis of the osteotomy guide coordinate system, a coordinate of the first preset placement point in the reference coordinate system is a first coordinate, a coordinate of the second preset placement point in the reference coordinate system is a second coordinate, and a coordinate of the third preset placement point in the reference coordinate system is a third coordinate, The step of determining the direction vector of the positive direction of each coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system based on the coordinates of all the preset placement points in the reference coordinate system comprises: Determine a first direction vector of the positive direction of the first coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system based on a direction vector obtained by subtracting the first coordinate from the second coordinate; Determine a second direction vector of the positive direction of the second coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system based on the direction vector obtained by subtracting the first coordinate from the third coordinate; The first direction vector is cross-multiplied with the second direction vector to obtain a third direction vector of the positive direction of the third coordinate axis of the osteotomy guide plate coordinate system in the reference coordinate system.

8. A calibration device for an osteotomy guide plate, characterized in that: The osteotomy guide plate is mounted on a flange at the end of the robotic arm, and the calibration device includes an acquisition module and a processing module; The acquisition module is used to acquire a first conversion matrix and a second conversion matrix, wherein the first conversion matrix is ​​a conversion matrix from a flange coordinate system to a reference coordinate system, and the second conversion matrix is ​​a conversion matrix from a camera coordinate system to the reference coordinate system; The acquisition module is also used to acquire an image obtained by taking a photo of the optical calibration device by a camera whenever the optical calibration device is placed at a preset placement point on the osteotomy guide plate in a preset posture; The processing module is used to determine, according to the image, a third transformation matrix from the camera coordinate system to the optical calibration device coordinate system corresponding to each of the preset placement points, wherein the number of the preset placement points is more than 3; Determine the direction vector of each coordinate axis of the osteotomy guide plate coordinate system of the osteotomy guide plate in the reference coordinate system based on the calibration coordinates of the calibration points of the optical calibration device in the optical calibration device coordinate system, the second transformation matrix, and the third transformation matrix corresponding to all the preset placement points; Determine a fourth transformation matrix based on the direction vectors of all coordinate axes of the osteotomy guide coordinate system and the coordinates of the origin of the osteotomy guide coordinate system in the reference coordinate system, wherein the fourth transformation matrix is ​​a transformation matrix from the reference coordinate system to the osteotomy guide coordinate system; The first transformation matrix is ​​multiplied by the fourth transformation matrix to obtain a fifth transformation matrix, wherein the fifth transformation matrix is ​​a transformation matrix from the flange coordinate system to the osteotomy guide plate coordinate system.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can perform the calibration method for the osteotomy guide plate according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an executable program, and the executable program is executed by a processor to implement the calibration method of the osteotomy guide plate according to any one of claims 1 to 7.

Images