Method and system for generating auxiliary operation track of osteotomy robot and storage medium

Through the combination of three-dimensional model and visual navigation devices, the auxiliary operation trajectory of the osteotomy robot is generated and optimized, which solves the problem of insufficient accuracy of the auxiliary operation trajectory of the osteotomy robot, and improves the accuracy and safety of osteotomy surgery.

CN119074216AActive Publication Date: 2024-12-06WUHAN CHANGJIANG LASER TECH CO LTD

Patent Information

Application Number
CN202411335705.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-24
Publication Date
2024-12-06
Estimated Expiration
2044-09-24

AI Technical Summary

Technical Problem

In the prior art, the accuracy of the auxiliary operation trajectory of the osteotomy robot is insufficient, which affects the accuracy and safety of osteotomy surgery.

Method used

By obtaining the three-dimensional model of the bone to be osteocated, combining the visual navigation device to obtain the intraoperative image, generating a conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system, and converting the image coordinate value into the initial operation trajectory of the osteoclast robot, performing Simulate job optimization and generate auxiliary job trajectories to improve the operation accuracy of the osteotomy robot.

Benefits of technology

The accuracy of the auxiliary operation trajectory of the osteotomy robot is improved, the accuracy and safety of osteotomy surgery is ensured, and damage to surrounding tissue is reduced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119074216A_ABST
    Figure CN119074216A_ABST
Patent Text Reader

Abstract

The invention discloses an osteotomy robot auxiliary operation track generation method and system and a storage medium, and the method comprises the steps: obtaining an osteotomy track based on a three-dimensional model of a skeleton to be subjected to osteotomy, and determining an image coordinate value of the osteotomy track; acquiring an intraoperative image of a to-be-cut bone based on a visual navigation device to generate a first conversion matrix; generating a second conversion matrix of the navigation coordinate system and the base coordinate system, and a third conversion matrix of the execution coordinate system and the base coordinate system; according to the first conversion matrix, the second conversion matrix and the third conversion matrix, the image coordinate values are converted into an initial operation track of the osteotomy robot, the initial operation track is optimized according to an operation simulation result of the initial operation track, and an auxiliary operation track of the osteotomy robot is generated. According to the method, the initial operation trajectory is generated through visual trajectory tracking, and the initial operation trajectory is optimized based on the simulation operation of the three-dimensional model of the actual bone to be subjected to osteotomy, so that the generated auxiliary operation trajectory fits the actually required osteotomy trajectory, and high-precision positioning of the auxiliary operation trajectory is realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of robot technology, and in particular to a method, system and storage medium for generating an osteotomy robot-assisted operation trajectory. Background Art

[0002] Osteotomy is a surgery performed when bone deformities occur due to accident trauma, joint diseases, bone dysplasia, developmental deformities, etc. It can be performed in different parts of the body, such as the knee, hip, jaw, spine, etc. Through osteotomy, the deformed bones are cut and repositioned, aligned and repaired to achieve correction and relieve pain.

[0003] With the vigorous development of robotics technology, surgical robots are increasingly widely used in clinical practice. In osteotomy surgery, osteotomy robots can help doctors perform osteotomy tasks according to preoperative planning. Compared with traditional osteotomy surgical instruments, such as oscillating saws, osteotomy robots have the advantages of controllable precision and less damage to surrounding tissues. Whether the osteotomy robot can accurately perform the osteotomy task is closely related to the accurate planning of the auxiliary operation path before surgery. Although there are many ways to generate auxiliary operation paths, the accuracy of the generated paths is not satisfactory. Therefore, how to improve the accuracy of generating the auxiliary operation trajectory of the osteotomy robot is a technical problem that needs to be solved urgently. Summary of the invention

[0004] The main purpose of the present invention is to provide a method, system and storage medium for generating an osteotomy robot-assisted operation trajectory, aiming to solve the technical problem of how to improve the accuracy of generating an osteotomy robot-assisted operation trajectory in the prior art.

[0005] To achieve the above object, the present invention provides a method for generating an osteotomy robot-assisted operation trajectory, wherein the osteotomy robot-assisted operation trajectory generation comprises:

[0006] Acquire a three-dimensional model of the bone to be osteotomized, and acquire an osteotomy trajectory of the bone to be osteotomized based on the three-dimensional model, and determine the image coordinate value of the osteotomy trajectory in a three-dimensional image coordinate system;

[0007] Acquire an intraoperative image of the bone to be osteotomized based on a visual navigation device corresponding to the osteotomy robot, and generate a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device according to the intraoperative image;

[0008] Generate a second conversion matrix between the navigation coordinate system and the base coordinate system in the osteotomy robot, and obtain a third conversion matrix between the execution coordinate system of the end effector in the osteotomy robot and the base coordinate system;

[0009] According to the first transformation matrix, the second transformation matrix and the third transformation matrix, the image coordinate values ​​are converted into the initial operating trajectory of the osteotomy robot, and the three-dimensional model is simulated according to the initial operating trajectory. The operating results are obtained to optimize the initial operating trajectory and generate the auxiliary operating trajectory of the osteotomy robot.

[0010] Preferably, the step of generating a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device according to the intraoperative image comprises:

[0011] identifying first pixel coordinates of a preset marker in the intraoperative image based on the navigation coordinate system, and forming each of the first pixel coordinates into a first coordinate matrix;

[0012] Identify second pixel coordinates of a preset marker in a model image corresponding to the three-dimensional model based on the three-dimensional image coordinate system, and form each of the second pixel coordinates into a second coordinate matrix;

[0013] The first coordinate matrix and the second coordinate matrix are calculated based on a first preset formula to obtain a first rotation matrix. The first preset formula is:

[0014]

[0015] Where min represents the minimum value, N represents the number of elements in the first or second coordinate matrix, qi represents the value of the i-th element in the first coordinate matrix, pi represents the value of the i-th element in the second coordinate matrix, R1 represents the first rotation matrix, ||·|| 2 It is used to calculate the square of the norm, σ() represents the correction function, ω represents the number of reference pixels in the reference image corresponding to the intraoperative image, Bε represents the pixel coordinates of the pixel points corresponding to the reference pixel points in the intraoperative image, and B'ε0 represents the pixel coordinates of the reference pixel points in the reference image;

[0016] Based on the first rotation matrix, the first translation vector is calculated using the following formula:

[0017] T1=q-R1*q;

[0018] Wherein, T1 represents the first translation vector, and q represents the average value of each row element or each column element in the first coordinate matrix;

[0019] The first rotation matrix and the first translation vector are used to generate the first transformation matrix.

[0020] Preferably, the step of generating a second transformation matrix between the navigation coordinate system and the base coordinate system in the osteotomy robot comprises:

[0021] Any pixel coordinate is selected from each of the first pixel coordinates as the target pixel coordinate, and the target pixel coordinate is corrected to obtain the corrected pixel coordinate. The correction formula is:

[0022]

[0023] Where (u, v) represents the corrected pixel coordinates, (u0, v0) represents the target pixel coordinates, D1, D2, and D3 represent the correction parameters, and r represents the minimum distance between the target pixel coordinates and the intraoperative image boundary;

[0024] Identify the first base coordinate value corresponding to the target pixel coordinate in the base coordinate system of the osteotomy robot, and obtain the internal parameters of the visual navigation device;

[0025] The internal parameters, the corrected pixel coordinates and the first base coordinate values ​​are calculated based on a second preset formula to obtain a second rotation matrix and a second translation vector. The second preset formula is:

[0026]

[0027] Wherein, fx, fy, α, β all represent internal parameters, R2 represents the second rotation matrix, T2 represents the second translation vector, and (X0, Y0, Z0) represents the coordinate value of the first base;

[0028] The second rotation matrix and the second translation vector are used to generate the second coordinate matrix.

[0029] Preferably, the step of converting the image coordinate value into the initial operation trajectory of the osteotomy robot according to the first conversion matrix, the second conversion matrix and the third conversion matrix comprises:

[0030] Acquire an intraoperative depth image of the bone to be osteotomized acquired based on the visual navigation device, and form an intraoperative three-dimensional model of the bone to be osteotomized in the navigation coordinate system based on the intraoperative depth image;

[0031] According to the first conversion matrix, converting the image coordinate values ​​into intraoperative coordinate values ​​of the intraoperative three-dimensional model in the navigation coordinate system;

[0032] Based on the second conversion matrix, converting the intraoperative coordinate value into a second base coordinate value on the base coordinate system, and based on the third conversion matrix, converting the second base coordinate value into an execution coordinate value on the execution coordinate system;

[0033] The matching relationship between the osteotomy position corresponding to the osteotomy trajectory and the osteotomy operation parameters is obtained, and the initial operation trajectory is generated based on the execution coordinate value and the matching relationship.

[0034] Preferably, the step of generating the initial operation trajectory based on the execution coordinate value and the matching relationship includes:

[0035] Finding target execution coordinate values ​​corresponding to each osteotomy position in the matching relationship from the execution coordinate values, and determining weight parameters of each target execution coordinate value according to osteotomy operation parameters corresponding to each osteotomy position in the matching relationship;

[0036] Adding default weight parameters to other execution coordinate values ​​in the execution coordinate values ​​except the target execution coordinate value, and generating a weight array of the execution coordinate value by combining the weight parameters and the default weight parameters;

[0037] The execution coordinate value is fitted into an initial operation trajectory according to a preset spline curve function and the weight array, wherein the preset spline curve function is:

[0038]

[0039] Where C(s) represents the position vector of the curve trajectory corresponding to the preset spline curve function, n represents the number of execution coordinate values, w1j represents the weight value corresponding to the j-th execution coordinate value in the weight array, w2j represents the fitting weight factor corresponding to the j-th execution coordinate value, dj represents the j-th execution coordinate value, N j,k (s) represents the k-order spline basis function corresponding to the j-th execution coordinate value in the preset spline curve function, and sj is the vector corresponding to the j-th execution coordinate value.

[0040] Preferably, the step of performing a simulation operation on the three-dimensional model according to the initial operation trajectory, obtaining an operation result to optimize the initial operation trajectory, and generating an auxiliary operation trajectory of the osteotomy robot comprises:

[0041] The three-dimensional model is simulated multiple times according to the initial operation trajectory to obtain multiple operation results, and the error results between the multiple operation results and the osteotomy trajectory are calculated based on a preset error calculation formula, wherein the preset error calculation formula is:

[0042]

[0043] Where L represents the error result calculated based on the preset error calculation formula, G represents the number of simulation operations, m represents the number of executed coordinate values, and x represents the number of coordinate values. τ ,y τ 、z τ , They represent the X-axis value, Y-axis value, Z-axis value and direction of the operation result generated by the simulation operation in the execution coordinate system of the τth execution coordinate value, respectively.τ0 ,y τ0 、z τ0 , They respectively represent the X-axis reference value, Y-axis reference value, Z-axis reference value and reference direction of the τth execution coordinate value in the execution coordinate system, g represents the numerical error calculation function, and f represents the direction error calculation function;

[0044] Comparing the error result with a preset error threshold to determine whether the error result is less than or equal to the preset error threshold, and if the error result is less than or equal to the preset error threshold, generating the initial operation trajectory as the auxiliary operation trajectory;

[0045] If the error result is greater than a preset error threshold, the fitting weight factor in the preset spline curve function is adjusted, and the execution coordinate value is refitted based on the adjusted preset spline curve function to form a new initial operation trajectory, until the error result formed by the initial operation trajectory simulation operation is less than or equal to the preset error threshold.

[0046] Preferably, the step of generating the initial operation trajectory as the auxiliary operation trajectory if the error result is less than or equal to a preset error threshold comprises:

[0047] Determine the operation starting point corresponding to the bone to be osteotomized according to the auxiliary operation trajectory, and control the end effector of the osteotomy robot to move to the operation starting point;

[0048] Controlling the laser device corresponding to the osteotomy robot to start, so that the laser device generates laser light to the end effector, and controlling the end effector to move along the auxiliary operation trajectory to perform an osteotomy operation on the bone to be osteotomized;

[0049] The real-time osteotomy displacement formed by the osteotomy operation is acquired, and the matching degree between the real-time osteotomy displacement and the auxiliary operation trajectory is generated, and the operation of the end effector is regulated according to the matching degree.

[0050] Preferably, the step of obtaining a three-dimensional model of the bone to be osteotomized comprises:

[0051] Acquire multiple CT scan images corresponding to the bone to be osteotomized based on a CT scanning device, and segment the multiple CT scan images after preprocessing to obtain multiple segmentation images;

[0052] Model reconstruction is performed based on the multiple segmentation images to obtain a three-dimensional model of the bone to be osteotomized.

[0053] Furthermore, to achieve the above-mentioned object, the present invention also provides an osteotomy robot-assisted operation trajectory generation system, the osteotomy robot-assisted operation trajectory generation system comprising a storage device, a processor, a communication bus, and a control program stored in the storage device:

[0054] The communication bus is used to realize the connection and communication between the processor and the storage;

[0055] The processor is used to execute the control program to implement the steps of the osteotomy robot-assisted operation trajectory generation method as described above.

[0056] Furthermore, to achieve the above-mentioned purpose, the present invention also provides a storage medium, on which a control program is stored, and when the control program is executed by a processor, the steps of the above-mentioned osteotomy robot-assisted operation trajectory generation method are implemented.

[0057] The method, system and storage medium for generating an auxiliary operation trajectory of an osteotomy robot of the present invention first obtain a three-dimensional model of a bone to be osteotomized, and obtain the osteotomy trajectory of the bone to be osteotomized based on the three-dimensional model, and determine the image coordinate value of the osteotomy trajectory in the three-dimensional image coordinate system; then obtain an intraoperative image of the bone to be osteotomized based on a visual navigation device corresponding to the osteotomy robot, and generate a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device based on the intraoperative image; and generate a second conversion matrix between the navigation coordinate system and the base coordinate system of the osteotomy robot, and obtain a third conversion matrix between the execution coordinate system of the end actuator in the osteotomy robot and the base coordinate system; then, based on the first conversion matrix, the second conversion matrix and the third conversion matrix, convert the image coordinate value into the initial operation trajectory of the osteotomy robot, and perform a simulated operation on the bone to be osteotomized based on the initial operation trajectory, obtain the operation result to optimize the initial operation trajectory, and generate the auxiliary operation trajectory of the osteotomy robot as the operation trajectory of the osteotomy robot for osteotomy. The present invention converts the osteotomy trajectory formed before the operation into the initial operation trajectory during the operation through the first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system, the second conversion matrix between the navigation coordinate system and the base coordinate system, and the third conversion matrix between the base coordinate system and the end effector. Because the first conversion matrix is ​​generated based on the image of the bone to be osteotomized in the actual osteotomy operation, the conversion of the osteotomy trajectory is more accurate, and the initial operation trajectory obtained by the conversion is closer to the trajectory actually required for osteotomy. In addition, the three-dimensional model is also subjected to osteotomy simulation operation based on the initial operation trajectory, and the initial operation trajectory is optimized through the simulation operation results. Because the three-dimensional model is generated based on the bone to be osteotomized, the operation result of the simulated osteotomy reflects the osteotomy accuracy of the actual bone to be osteotomized, so that the auxiliary operation trajectory formed according to the optimization is further close to the trajectory actually required for osteotomy, thereby improving the accuracy of generating the auxiliary operation trajectory of the osteotomy robot. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1 It is a flow chart of the first embodiment of the method for generating osteotomy robot-assisted operation trajectory according to the present invention;

[0059] Figure 2 It is a flow chart of a second embodiment of the method for generating a trajectory for osteotomy robot-assisted operation according to the present invention;

[0060] Figure 3 A schematic flow chart of a third embodiment of a method for generating a robot-assisted osteotomy operation trajectory according to the present invention;

[0061] Figure 4 It is a flow chart of a fourth embodiment of the method for generating a robot-assisted osteotomy operation trajectory according to the present invention;

[0062] Figure 5 This is a schematic diagram of the structure of the hardware operating environment involved in an embodiment of the osteotomy robot-assisted operation trajectory generation system of the present invention.

[0063] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0064] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0065] The present invention provides a method for generating a robot-assisted osteotomy operation trajectory. Figure 1 , Figure 1 This is a flow chart of the first embodiment of the method for generating osteotomy robot-assisted operation trajectory according to the present invention.

[0066] The embodiment of the present invention provides an embodiment of a method for generating a trajectory of an osteotomy robot-assisted operation. It should be noted that although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in an order different from that shown here. Specifically, the method for generating a trajectory of an osteotomy robot-assisted operation in this embodiment includes:

[0067] Step S10, obtaining a three-dimensional model of the bone to be osteotomized, and obtaining an osteotomy trajectory of the bone to be osteotomized based on the three-dimensional model, and determining the image coordinate value of the osteotomy trajectory in a three-dimensional image coordinate system.

[0068] The osteotomy robot auxiliary operation trajectory generation method of this embodiment is applied to the control center of the osteotomy robot system. In addition to the control center, the osteotomy robot system also includes at least an osteotomy robot and a visual navigation device that are connected to the control center for communication. The osteotomy robot can be divided into an end effector that actually performs the osteotomy operation and a base that supports the end effector. In addition, the end effector can be a laser emitting end. In this case, the osteotomy robot system also includes a laser device. The control center controls the laser emitting end to emit a laser to perform the osteotomy operation according to the formed auxiliary operation trajectory.

[0069] Specifically, the control center acquires a three-dimensional model of the bone to be osteotomized that needs osteotomy surgery. The three-dimensional model is one-to-one in size with the bone to be osteotomized, and the characteristics of the bone to be osteotomized can be reflected through model parameters, such as bone density, bone hardness, and the position closest to the blood vessels. In addition, the three-dimensional model can be formed based on CT (Computed Tomography) or MRI (magnetic resonance imaging). Specifically, the step of acquiring the three-dimensional model of the bone to be osteotomized includes:

[0070] Step S11, acquiring a plurality of CT scan images corresponding to the bone to be osteotomized based on a CT scanning device, and performing preprocessing and segmentation on the plurality of CT scan images to obtain a plurality of segmentation images;

[0071] Step S12: reconstructing a model based on the plurality of segmentation images to obtain a three-dimensional model of the bone to be osteotomized.

[0072] Furthermore, the osteotomy robot system is also communicatively connected to a CT scanning device or a magnetic resonance device, which can be a part of the osteotomy robot system or a device independent of the osteotomy robot system, and there is no limitation on this. This embodiment is specifically described with a CT scanning device. Specifically, the tissue part that needs osteotomy is marked with a specific marker, and the tissue part of the patient's bone to be osteotomized is tomographically scanned by a CT scanning device to obtain multiple cross-sectional images as CT scan images corresponding to the bone to be osteotomized. Then, the multiple CT scan images are preprocessed such as filtering and denoising, and the preprocessed CT scan images are threshold segmented to obtain the edge of each layer of the image. Then, the multiple segmented images are modeled and reconstructed, and the two-dimensional array of the image is converted into a three-dimensional array by adding the edge to the Z-axis parameter, and the three-dimensional array information is spliced ​​and fused to form a three-dimensional vector array, so that the final three-dimensional model is formed by the three-dimensional vector array to obtain a three-dimensional model of the bone to be osteotomized.

[0073] Furthermore, the three-dimensional model of the bone to be osteotomized reflects a series of characteristics of the bone to be osteotomized, such as at least the deformed part of the bone to be osteotomized that needs to be removed, the distance between the bone to be osteotomized and the surrounding tissues, such as blood vessels and nerves, etc. In order to accurately remove the deformed part, a professional doctor will view the three-dimensional model of the bone to be osteotomized and determine its appropriate osteotomy trajectory, and then add the determined osteotomy trajectory to the three-dimensional model to form the osteotomy trajectory of the bone to be osteotomized. In addition, the three-dimensional image space where the three-dimensional model is located is pre-set with a coordinate system, which is used as the three-dimensional image coordinate system. By identifying the position and shape of the three-dimensional model in the three-dimensional image coordinate system, and the position and shape of the osteotomy trajectory on the three-dimensional model, the image coordinates of the osteotomy trajectory in the three-dimensional image coordinate system are calculated and determined to reflect the position of the osteotomy trajectory in the three-dimensional image coordinate system.

[0074] Step S20, acquiring an intraoperative image of the bone to be osteotomized based on a visual navigation device corresponding to the osteotomy robot, and generating a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device according to the intraoperative image.

[0075] Furthermore, after the osteotomy trajectory is formed, the patient who needs osteotomy is transferred to the surgical space for the osteotomy operation, in which the osteotomy robot and the visual navigation device included in the osteotomy robot system are arranged. The visual navigation device is preferably a binocular stereo vision. The part of the bone to be osteotomized, that is, the part where the specific marker is located, is photographed by the visual navigation device to obtain an intraoperative image of the bone to be osteotomized. The photographed intraoperative image is a depth map, and usually has a coordinate system in which it is located, for example, a coordinate system formed by the point in the upper left corner of the image, wherein the pixel positions are all determined according to the coordinate system. In this embodiment, the coordinate system is used as a navigation coordinate system accompanying the visual navigation device, and the first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system is generated according to the corresponding relationship between the position of the pixel point of the osteotomy trajectory in the intraoperative image and the position of the osteotomy trajectory in the three-dimensional image coordinate system. Through the first conversion matrix, the image coordinate value of the osteotomy trajectory in the three-dimensional image coordinate system can be converted to the coordinate value in the navigation coordinate system.

[0076] Step S30, generating a second conversion matrix between the navigation coordinate system and the base coordinate system in the osteotomy robot, and acquiring a third conversion matrix between the execution coordinate system of the end effector in the osteotomy robot and the base coordinate system.

[0077] Understandably, the osteotomy robot includes a base and an end effector, and the coordinate reference of the action performed by the end effector is usually directly derived from the movable joint to which it is connected. In order to make the part actually performed by the end effector consistent with the part located and tracked by the visual navigation device, it is necessary to convert the coordinate reference of the visual navigation device with the coordinate reference of the executed action. Because the base of the osteotomy robot is a fixed rigid object, the conversion is based on the base. The coordinate system corresponding to the base is used as the base coordinate system, and the second conversion matrix between the navigation coordinate system and the base coordinate system is generated through the position of the specific marker in the intraoperative image and the position of the specific marker relative to the base coordinate system.

[0078] Furthermore, the coordinate system referenced by the end effector is used as the execution coordinate system, and the conversion matrix between the execution coordinate system of the end effector in the osteotomy robot and the base coordinate system is formed in advance by combining the kinematic model with the joint angle, joint length, etc. of the osteotomy robot. The conversion matrix is ​​obtained as the third conversion matrix to realize the conversion of coordinates between the execution coordinate system and the base coordinate system during the operation.

[0079] Step S40, according to the first transformation matrix, the second transformation matrix and the third transformation matrix, the image coordinate value is converted into the initial operation trajectory of the osteotomy robot, and the three-dimensional model is simulated according to the initial operation trajectory, the operation result is obtained to optimize the initial operation trajectory, and the auxiliary operation trajectory of the osteotomy robot is generated.

[0080] Furthermore, the image coordinate values ​​of the osteotomy trajectory in the three-dimensional image coordinate system are converted into coordinate values ​​in the navigation coordinate system by the first conversion matrix, and then the coordinate values ​​of the navigation coordinate system are converted into coordinate values ​​in the base coordinate system according to the second conversion matrix, and the coordinate values ​​in the base coordinate system are converted into coordinate values ​​in the execution coordinate system according to the third conversion matrix. The coordinate values ​​in the execution coordinate system are then formed into an initial operation trajectory, which is the trajectory of the end actuator performing the osteotomy operation on the bone to be osteotomized.

[0081] Understandably, there may be errors in the conversion of the image coordinate values ​​by the first conversion matrix, the second conversion matrix, and the third conversion matrix, or there may be errors in the formation of the first conversion matrix, the second conversion matrix, and the third conversion matrix, which leads to conversion errors, or there may be errors in the image coordinate values ​​determined based on the osteotomy trajectory. Regardless of the cause of the error, the initial operation trajectory formed will eventually have errors, thereby making the osteotomy operation performed according to the initial operation trajectory inaccurate. Therefore, in order to ensure the accuracy of the osteotomy operation, the present embodiment is provided with a simulation operation mechanism for the initial operation trajectory formed.

[0082] Specifically, a simulated operation is performed on the three-dimensional model according to the initial operation trajectory, the starting point of the initial operation trajectory in the three-dimensional model is identified, and the simulated osteotomy operation is performed with the starting point as the starting point. After the simulated osteotomy operation is completed, the simulated osteotomy trajectory formed by the simulated osteotomy operation is obtained, and the simulated osteotomy trajectory is the operation result of the simulated operation. Then, according to the difference between the operation result reflected by the simulated osteotomy trajectory and the planned osteotomy trajectory, the initial operation trajectory is optimized, so that the operation result formed by the simulated operation according to the optimized initial operation trajectory is closer to the planned osteotomy trajectory. The optimized initial operation trajectory is formed as the auxiliary operation trajectory of the osteotomy robot to ensure the accuracy of osteotomy by the osteotomy robot.

[0083] The method for generating an assisted operation trajectory of an osteotomy robot implemented in this embodiment first obtains a three-dimensional model of the bone to be osteotomized, and obtains the osteotomy trajectory of the bone to be osteotomized based on the three-dimensional model, and determines the image coordinate value of the osteotomy trajectory in the three-dimensional image coordinate system; then, an intraoperative image of the bone to be osteotomized is obtained based on a visual navigation device corresponding to the osteotomy robot, and a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device is generated based on the intraoperative image; and a second conversion matrix between the navigation coordinate system and the base coordinate system of the osteotomy robot is generated, and a third conversion matrix between the execution coordinate system of the end effector in the osteotomy robot and the base coordinate system is obtained; then, based on the first conversion matrix, the second conversion matrix and the third conversion matrix, the image coordinate values ​​are converted into the initial operation trajectory of the osteotomy robot, and a simulated operation is performed on the bone to be osteotomized based on the initial operation trajectory, the operation result is obtained to optimize the initial operation trajectory, and the auxiliary operation trajectory of the osteotomy robot is generated as the operation trajectory of the osteotomy robot for osteotomy. The present invention converts the osteotomy trajectory formed before the operation into the initial operation trajectory during the operation through the first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system, the second conversion matrix between the navigation coordinate system and the base coordinate system, and the third conversion matrix between the base coordinate system and the end effector. Because the first conversion matrix is ​​generated based on the image of the bone to be osteotomized in the actual osteotomy operation, the conversion of the osteotomy trajectory is more accurate, and the initial operation trajectory obtained by the conversion is closer to the trajectory actually required for osteotomy. In addition, the three-dimensional model is also subjected to osteotomy simulation operation based on the initial operation trajectory, and the initial operation trajectory is optimized through the simulation operation results. Because the three-dimensional model is generated based on the bone to be osteotomized, the operation result of the simulated osteotomy reflects the osteotomy accuracy of the actual bone to be osteotomized, so that the auxiliary operation trajectory formed according to the optimization is further close to the trajectory actually required for osteotomy, thereby improving the accuracy of generating the auxiliary operation trajectory of the osteotomy robot.

[0084] For further information, please refer to Figure 2Based on the first embodiment of the osteotomy robot-assisted operation trajectory generation method of the present invention, a second embodiment of the osteotomy robot-assisted operation trajectory generation method of the present invention is proposed.

[0085] The difference between the second embodiment of the osteotomy robot-assisted operation trajectory generation method and the first embodiment of the osteotomy robot-assisted operation trajectory generation method is that the step of generating a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device according to the intraoperative image comprises:

[0086] Step S21, identifying first pixel coordinates of a preset marker in the intraoperative image based on the navigation coordinate system, and forming each of the first pixel coordinates into a first coordinate matrix;

[0087] Step S22, identifying second pixel coordinates of a preset marker in a model image corresponding to the three-dimensional model based on the three-dimensional image coordinate system, and forming each of the second pixel coordinates into a second coordinate matrix;

[0088] Step S23, calculating the first coordinate matrix and the second coordinate matrix based on a first preset formula to obtain a first rotation matrix;

[0089] Step S24, calculating a first translation vector based on the first rotation matrix;

[0090] Step S25: Generate the first transformation matrix from the first rotation matrix and the first translation vector.

[0091] Furthermore, a specific marker set during the CT scan is used as a preset marker, and the preset marker will be imaged in the CT scan image and in the intraoperative image taken by the visual navigation device. According to the navigation coordinate system, the first pixel coordinate of the preset marker in the intraoperative image is identified, and the image position of the preset marker in the intraoperative image is identified. The image position reflects the pixel point position of the preset marker in the navigation coordinate system, and the first pixel coordinate can be obtained by identifying the pixel point coordinate. Among them, the preset marker may occupy more pixels, and the middle position can be selected as the pixel point position. In addition, in order to accurately locate the tissue part of the bone to be osteotomized, the number of markers set is usually multiple, such as 4, 5, etc. After identifying the first pixel coordinates of each preset marker in the intraoperative image, each first pixel coordinate is arranged in rows or columns to form a first coordinate matrix.

[0092] Furthermore, for the imaging of the preset marker in the CT scan image, its pixel coordinates are identified according to the three-dimensional image coordinate system as the second pixel coordinates of the preset marker in the model map corresponding to the three-dimensional model. It should be noted that if the three-dimensional model is not formed according to CT scanning, for example, according to MRI imaging, the pixel coordinates of the preset marker in the MRI imaging map are identified according to the three-dimensional image coordinate system as the second pixel coordinates of the preset marker in the model map corresponding to the three-dimensional model. That is, the model map corresponding to the three-dimensional model is the image based on which the three-dimensional model is formed. Similarly, for the multiple pixel points formed by each preset marker, the pixel point located in the middle position is selected as the pixel point position of the preset marker. And, after identifying the second pixel coordinates of each preset marker in the model map, the second pixel coordinates are arranged in rows or columns to form a second coordinate matrix. Among them, the arrangement position of each second pixel coordinate is the same as the arrangement position of each first pixel coordinate to ensure that the preset markers corresponding to the rows or columns in the first coordinate matrix and the second coordinate matrix are the same.

[0093] It is understandable that different coordinate systems can be transformed by rotation and translation, that is, one coordinate system is transformed to the same direction as another coordinate system by rotation, and one coordinate system is moved to the same position as another coordinate system by translation. In this embodiment, the transformation between the three-dimensional image coordinate system and the navigation coordinate system also includes rotation and translation, so that the first transformation matrix includes a rotation part for rotation and a translation part for translation, the rotation part is a 3*3 matrix, and the translation part is a 3*1 vector. A first preset formula for generating the rotation part in the first transformation matrix is ​​formed in advance through experiments, and the first coordinate matrix and the second transformation matrix are calculated by the first preset formula to obtain a matrix as the first rotation matrix. For the specific first preset formula, please refer to the following formula (1).

[0094]

[0095] Where min represents the minimum value, N represents the number of elements in the first or second coordinate matrix, qi represents the value of the i-th element in the first coordinate matrix, pi represents the value of the i-th element in the second coordinate matrix, R1 represents the first rotation matrix, ||·|| 2 Used to calculate the square of the norm, σ( ) represents the correction function, ω represents the number of reference pixels in the reference image corresponding to the intraoperative image, Bε represents the pixel coordinates of the pixel points in the intraoperative image corresponding to the reference pixel points, and B'ε0 represents the pixel coordinates of the reference pixel points in the reference image.

[0096] By determining the first rotation matrix R that can make the first preset formula obtain the minimum value min, the rotation conversion error between the three-dimensional image coordinate system and the navigation coordinate system by the first selection matrix is ​​minimized. At the same time, it is considered that the intraoperative image captured by the visual navigation device may have image distortion, such as image radial error and eccentricity error caused by the shooting lens factor in the visual navigation device. In order to reduce the influence of the distortion of the intraoperative image on the accuracy of the formed rotation matrix, a reference image as a reference of the intraoperative image is obtained in advance through a standard visual navigation device, and multiple reference pixels are selected from the reference image, and the pixel coordinates of each reference pixel are obtained. The pixel coordinates of the reference pixel are introduced into the first preset formula, and the pixel points corresponding to the reference pixel points are identified from the intraoperative image, and the pixel coordinates of each corresponding pixel point are obtained. Then, the distortion rate of each identified pixel point relative to its reference pixel point is calculated by the pixel coordinates of the identified pixel point and the pixel coordinates of the reference pixel point, and all distortion rates are statistically analyzed to obtain the total distortion rate. A correction function between different distortion rates and correction coefficients is pre-set, and the correction coefficient corresponding to the total distortion rate is determined by the correction function. Then, the first preset formula for forming the first rotation matrix is ​​corrected by the correction coefficient, so that the first rotation matrix determined by the first preset formula is more accurate, further reducing the error of rotation conversion between coordinate systems.

[0097] Furthermore, the translation vector for realizing the translation of the coordinate system can be calculated through the relationship between the translation vector and the rotation matrix. The specific calculation formula is as follows (2).

[0098] T1=q-R1*q (2);

[0099] Wherein, T1 represents the first translation vector, and q represents the average value of each row element or each column element in the first coordinate matrix. It should be noted that if each first pixel coordinate is arranged in a row manner to form the first coordinate matrix, that is, each row contains an XYZ value in a pixel coordinate, then q represents the average value of each column in the first coordinate matrix. If each first pixel coordinate is arranged in a column manner to form the first coordinate matrix, that is, each column contains an XYZ value in a pixel coordinate, then q represents the average value of each row in the first coordinate matrix. The q formed in this way is the pixel X average value, Y average value and Z average value of the image imaging of the preset marker in the operation. The q value and the first rotation matrix are calculated by calculating formula (2) to obtain the first translation vector, and the first rotation matrix and the first translation vector are combined to form a first conversion matrix, which is used to realize the conversion and translation between the three-dimensional image coordinate system and the navigation coordinate system, and convert the coordinates in the three-dimensional image coordinate system into the coordinates in the navigation coordinate system.

[0100] Further, for the second transformation matrix, the step of generating the second transformation matrix between the navigation coordinate system and the base coordinate system in the osteotomy robot includes:

[0101] Step S31, selecting any pixel coordinate from each of the first pixel coordinates as a target pixel coordinate, and correcting the target pixel coordinate to obtain a corrected pixel coordinate;

[0102] Step S32, identifying a first base coordinate value corresponding to the target pixel coordinate in the base coordinate system of the osteotomy robot, and acquiring internal parameters of the visual navigation device;

[0103] Step S33, calculating the internal parameters, the corrected pixel coordinates and the first base coordinate value based on a second preset formula to obtain a second rotation matrix and a second translation vector;

[0104] Step S34: Generate the second coordinate matrix from the second rotation matrix and the second translation vector.

[0105] Furthermore, one of the first pixel coordinates generated based on the plurality of preset markers is randomly selected as the target pixel coordinate, and the target pixel coordinate is corrected by using a preset correction formula in combination with the image distortion problem described above to obtain the corrected pixel coordinate. The correction formula can be specifically referred to in the following formula (3).

[0106]

[0107] Among them, (u, v) represents the corrected pixel coordinates, (u0, v0) represents the target pixel coordinates, D1, D2, and D3 represent correction parameters, and r represents the minimum distance between the target pixel coordinates and the boundary of the intraoperative image.

[0108] Furthermore, the target pixel coordinates are the pixel coordinates of a preset marker imaged in the intraoperative image. A probe is provided on the osteotomy robot, and the coordinate position of the preset marker in the base coordinate system of the osteotomy robot can be identified by controlling the contact between the probe and the preset marker, and the coordinate position is determined as the first base coordinate value corresponding to the target pixel coordinate in the base coordinate system.

[0109] Furthermore, the internal parameters of the visual navigation device are obtained, and such internal parameters can be determined in advance by calibrating the visual navigation device. Then, the internal parameters, the target pixel coordinates and the first base coordinate values ​​are calculated by a second preset formula to obtain a second rotation matrix and a second translation vector. The second preset formula is specifically shown in the following formula (4).

[0110]

[0111] Among them, fx, fy, α, β all represent internal parameters, R2 represents the second rotation matrix, T2 represents the second translation vector, and (X0, Y0, Z0) represents the first base coordinate value.

[0112] The second preset formula is formed in advance through experimental settings, and the second rotation matrix and the second translation vector are calculated by the formula to realize the rotation and translation between the navigation coordinate system and the base coordinate system, and the coordinates in the navigation coordinate system are converted into coordinates in the base coordinate system. In addition, since the corrected pixel coordinates used for calculation are corrected by the target pixel coordinates through the correction formula, the image distortion caused by the visual navigation device can be effectively avoided, so that the corrected pixel coordinates more accurately reflect the imaging of the preset marker in the intraoperative image, thereby improving the accuracy of the calculation of the second rotation matrix and the second translation vector, making the conversion between the navigation coordinate system and the base coordinate system more accurate.

[0113] Furthermore, in order to further improve the accuracy of the conversion, multiple target pixel coordinates can be selected from the first pixel coordinates for correction. The multiple pixel coordinates are corrected individually to form corresponding corrected pixel coordinates for processing by formula (4). The processing method may be to form each corrected pixel coordinate as a corrected mean, and to find the first base coordinate value corresponding to each, to form each first base coordinate value as a base mean, and then to process the corrected mean and the base mean by formula (4) to obtain a second rotation matrix and a second translation vector. In addition, it is also possible to first find the first base coordinate value corresponding to each corrected pixel value, and to process them separately by formula (4) to obtain multiple sets of second rotation matrices and second translation matrices for mean operation to obtain the final second rotation matrix and second translation matrix.

[0114] This embodiment takes into account the possible image distortion effects of intraoperative images taken by the visual navigation device, sets up a relevant correction mechanism, and generates a first transformation matrix and a second transformation matrix based on this, so that the generated first transformation matrix and second transformation matrix are more accurate, thereby improving the accuracy of the conversion between the three-dimensional image coordinate system and the navigation coordinate system, and between the navigation coordinate system and the base coordinate system, which is conducive to generating an accurate osteotomy operation trajectory.

[0115] For further information, please refer to Figure 3 Based on the first and second embodiments of the osteotomy robot-assisted operation trajectory generation method of the present invention, a third embodiment of the osteotomy robot-assisted operation trajectory generation method of the present invention is proposed.

[0116] The difference between the third embodiment of the osteotomy robot-assisted operation trajectory generation method and the first and second embodiments of the osteotomy robot-assisted operation trajectory generation method is that the step of converting the image coordinate value into the initial operation trajectory of the osteotomy robot according to the first conversion matrix, the second conversion matrix and the third conversion matrix includes:

[0117] Step S41, acquiring an intraoperative depth image of the bone to be osteotomized acquired based on the visual navigation device, and forming an intraoperative three-dimensional model of the bone to be osteotomized in the navigation coordinate system based on the intraoperative depth image;

[0118] Step S42, converting the image coordinate values ​​into intraoperative coordinate values ​​of the intraoperative three-dimensional model in the navigation coordinate system according to the first conversion matrix;

[0119] Step S43, based on the second conversion matrix, converting the intraoperative coordinate value into a second base coordinate value in the base coordinate system, and based on the third conversion matrix, converting the second base coordinate value into an execution coordinate value in the execution coordinate system;

[0120] Step S44, obtaining the matching relationship between the osteotomy position corresponding to the osteotomy trajectory and the osteotomy operation parameters, and generating the initial operation trajectory based on the execution coordinate value and the matching relationship.

[0121] Furthermore, multiple depth images of the bone to be osteotomized during surgery are collected by the visual navigation device, and the control center obtains the collected multiple depth images as intraoperative depth images, and then performs three-dimensional reconstruction based on the intraoperative depth images to obtain an intraoperative three-dimensional model of the bone to be osteotomized in the navigation coordinate system. Among them, the depth image is taken based on the preset markers and is used to represent the image of the part where osteotomy is required, and the corresponding intraoperative three-dimensional model is also used to represent the three-dimensional shape of the part where osteotomy is required.

[0122] Furthermore, the image coordinate values ​​are transformed by the first transformation matrix and converted into coordinate values ​​in the navigation coordinate system. The intraoperative three-dimensional model is located in the navigation coordinate system to represent the part where osteotomy is required, and the transformed coordinate values ​​are located on the three-dimensional model, indicating the specific position of osteotomy. Therefore, the transformed coordinate values ​​are the intraoperative coordinate values ​​of the three-dimensional model in the navigation coordinate system.

[0123] Furthermore, the intraoperative coordinate value in the navigation coordinate system is converted to the second base coordinate value in the base coordinate system through the second conversion matrix, and the second base coordinate value in the base coordinate system is converted to the execution coordinate value in the execution coordinate system through the third conversion matrix. The execution coordinate value reflects the coordinate position of the actual operation of the end effector of the osteotomy robot when performing the osteotomy operation, because it is converted from the image coordinate value corresponding to the osteotomy trajectory, so that the end effector can perform the actual osteotomy operation according to the planned osteotomy trajectory.

[0124] Furthermore, the planned osteotomy trajectory includes the osteotomy starting point and the end point, as well as the turning position or the turning position between the starting point and the end point. In order to enable the end effector to start osteotomy at the starting point and accurately turn or turn at the turning position or the turning position, the converted execution coordinate value needs to be generated as the initial operation trajectory of the end effector in the osteotomy robot, so as to control the end effector to run according to the initial operation trajectory to perform the osteotomy operation.

[0125] In addition, it is considered that different positions of the bone to be osteotomized often have different bone hardness or bone density, or different positions have different distances from different tissues, such as the distance from blood vessels or nerves. The bone hardness, bone density, or distance information between other tissues at different positions can be obtained during the CT scanning process and reflected in the three-dimensional model formed based on the CT scan. In the process of forming the osteotomy trajectory based on the three-dimensional model, the doctor marks the positions where the bone hardness is large and the execution energy consumption of the end actuator of the cutting robot needs to be increased. At the same time, the positions where the execution speed of the end actuator needs to be adjusted due to the proximity to other tissues are also marked. This type of marking forms a matching relationship between the osteotomy position and the osteotomy operation parameters in the osteotomy trajectory. In the process of forming the initial operation trajectory, the matching relationship between the osteotomy position and the osteotomy operation parameters needs to be considered, and the initial operation trajectory is formed based on the matching relationship and the execution coordinate value, so that the formed initial operation trajectory has different osteotomy operation parameters at different operation positions, so that different positions match different energy consumption or speeds for osteotomy. Specifically, the step of generating the initial operation trajectory based on the execution coordinate value and the matching relationship includes:

[0126] Step S441, searching the target execution coordinate values ​​corresponding to each osteotomy position in the matching relationship from the execution coordinate values, and determining the weight parameters of each target execution coordinate value according to the osteotomy operation parameters corresponding to each osteotomy position in the matching relationship;

[0127] Step S442, adding default weight parameters to other execution coordinate values ​​in the execution coordinate values ​​except the target execution coordinate value, and generating a weight array of the execution coordinate value by combining the weight parameters and the default weight parameters;

[0128] Step S443: fitting the execution coordinate values ​​into an initial operation trajectory according to a preset spline curve function and the weight array.

[0129] It is understandable that in the matching relationship between the osteotomy position and the osteotomy operation parameters formed by the doctor's annotation, the osteotomy position corresponds to the osteotomy trajectory, and the reference coordinate system is the three-dimensional image coordinate system, so it is necessary to convert it to the position on the execution coordinate system based on the first conversion matrix, the second conversion matrix and the third conversion matrix. The conversion method is the same as the image coordinate value, which will not be repeated here. After the conversion, the matching relationship between the osteotomy position on the execution coordinate system and the osteotomy operation parameters is obtained.

[0130] It should be noted that the matching relationship between the osteotomy position and the osteotomy operation parameters is formed in a standard manner for positions that require specific energy consumption and speed, and other positions can set preset energy consumption and speed for osteotomy. Therefore, the energy consumption and speed of the initial operation trajectory formed are also different between the specific position and other positions. Specifically, the target execution coordinate values ​​corresponding to each osteotomy position in the matching relationship are found from the execution coordinate value, and the osteotomy operation parameters corresponding to each osteotomy position in the matching relationship are found, and the weight parameters of each target execution coordinate value are generated according to each osteotomy operation parameter. Among them, the osteotomy operation parameters include at least two aspects of energy consumption and speed, so that the weight parameters also at least reflect the weights of these two aspects. In addition, a corresponding relationship is pre-set between the osteotomy operation parameters and the weight parameters. After determining the osteotomy operation parameters corresponding to the target execution coordinate value, the corresponding weight parameters can be found from the corresponding relationship as the weight parameters of the target execution coordinate value. When the osteotomy robot end actuator performs the osteotomy operation at the position corresponding to the target execution coordinate value, it runs according to the energy consumption and speed reflected by the weight parameters to meet the osteotomy operation requirements of different positions.

[0131] Furthermore, except for the target execution coordinate value, other execution coordinate values ​​in the execution coordinate value do not require specific energy consumption and speed, and the end effector of the osteotomy robot can run at the preset energy consumption and speed at the position corresponding to the execution coordinate value. For this, a default weight parameter is pre-set, and the default weight parameter is added to the execution coordinate value other than the target execution coordinate value. Then, each weight parameter and each default weight parameter are generated into a weight array of the execution coordinate value according to the execution coordinate value corresponding to each of them.

[0132] In addition, a preset spline curve function is pre-set to fit the execution coordinate value into a curve, and the execution coordinate value is fitted into an initial operation trajectory through the preset spline curve function in combination with the weight array. The preset spline curve function is specifically shown in the following formula (5).

[0133]

[0134] Where C(s) represents the position vector of the curve trajectory corresponding to the preset spline curve function, n represents the number of execution coordinate values, w1j represents the weight value corresponding to the jth execution coordinate value in the weight array, w2i represents the fitting weight factor corresponding to the jth execution coordinate value, dj represents the jth execution coordinate value, N j,k (s) represents the k-order spline basis function corresponding to the j-th execution coordinate value in the preset spline curve function, and sj is the vector corresponding to the j-th execution coordinate value.

[0135] In this embodiment, the requirements for osteotomy energy consumption and speed at different positions of the bone to be osteotomized are generated as a weight matrix, and the converted execution coordinate values ​​are fitted according to the weight matrix to generate an initial operation curve. In addition to reflecting the operation path of the end effector of the osteotomy robot, the initial operation curve also reflects the requirements for operation energy consumption and operation speed at each position in the initial operation curve, so that the end effector structure can operate according to the required operation energy consumption and operation speed, thereby making the osteotomy robot more accurate in cutting the bone to be osteotomized.

[0136] For further information, please refer to Figure 4 Based on the first, second and third embodiments of the osteotomy robot-assisted operation trajectory generation method of the present invention, a fourth embodiment of the osteotomy robot-assisted operation trajectory generation method of the present invention is proposed.

[0137] The fourth embodiment of the osteotomy robot-assisted operation trajectory generation method is different from the first, second and third embodiments of the osteotomy robot-assisted operation trajectory generation method in that the three-dimensional model is simulated according to the initial operation trajectory, the operation result is obtained to optimize the initial operation trajectory, and the step of generating the osteotomy robot's auxiliary operation trajectory includes:

[0138] Step S45, performing multiple simulation operations on the three-dimensional model according to the initial operation trajectory to obtain multiple operation results, and calculating the error results between the multiple operation results and the osteotomy trajectory based on a preset error calculation formula;

[0139] Step S46, comparing the error result with a preset error threshold to determine whether the error result is less than or equal to the preset error threshold, and if the error result is less than or equal to the preset error threshold, generating the initial operation trajectory as the auxiliary operation trajectory;

[0140] Step S47, if the error result is greater than the preset error threshold, the fitting weight factor in the preset spline curve function is adjusted, and the execution coordinate value is refitted based on the adjusted preset spline curve function to form a new initial operation trajectory, until the error result formed by the initial operation trajectory simulation operation is less than or equal to the preset error threshold.

[0141] In this embodiment, a preset error calculation formula is pre-set to evaluate the effect of the simulated operation based on the initial operation trajectory. The preset error calculation formula is used to calculate the error result between the simulated osteotomy trajectory generated by the simulated operation and the osteotomy trajectory indicated by the doctor's planning to represent the actual needs, so as to optimize the initial operation trajectory and form the final auxiliary operation trajectory. Specifically, multiple simulation operations are performed on the three-dimensional model according to the initial operation trajectory, and a simulated osteotomy trajectory can be generated after each simulation operation is completed. This type of simulated operation trajectory is used as the operation result of the simulated operation, and the preset error calculation formula is used to calculate the error result between the simulated operation trajectory and the osteotomy trajectory in the operation result.

[0142] The specific preset error calculation formula can be found in the following formula (6).

[0143]

[0144] Where L represents the error result calculated based on the preset error calculation formula, G represents the number of simulation operations, m represents the number of executed coordinate values, and x represents the number of coordinate values. τ ,y τ 、z τ , They represent the X-axis value, Y-axis value, Z-axis value and direction of the operation result generated by the simulation operation in the execution coordinate system of the τth execution coordinate value, respectively. τ0 ,y τ0 、z τ0 , Respectively represent the X-axis reference value, Y-axis reference value, Z-axis reference value and reference direction of the τth execution coordinate value in the execution coordinate system, g represents the numerical error calculation function, and f represents the direction error calculation function. In this way, for each execution coordinate value, the calculated error result includes position error and direction error, and the combination of the two makes the calculation of the error result more accurate. In turn, the optimization of the initial operation trajectory based on the error result is more accurate, which is conducive to generating an accurate auxiliary operation trajectory.

[0145] Furthermore, a preset error threshold indicating the size of the error result is pre-set, and the calculated error result is compared with the preset error threshold to determine whether the error result is less than or equal to the preset error threshold. If it is less than or equal to, it means that the simulated osteotomy trajectory formed by the simulated operation according to the initial operation trajectory is close to the planned osteotomy trajectory, and the end effector of the osteotomy robot can achieve a better osteotomy effect by osteotomizing the bone to be osteotomized according to the initial operation trajectory, so the initial operation trajectory is generated as the final auxiliary operation trajectory.

[0146] On the contrary, if the error result is determined to be greater than the preset error threshold through comparison, it means that the difference between the simulated osteotomy trajectory formed by the simulated operation based on the initial operation trajectory and the planned osteotomy trajectory is large, and the end effector of the osteotomy robot cannot meet the actual osteotomy requirements by osteotomizing the bone to be osteotomized according to the initial operation trajectory. At this time, the fitting weight factor in the preset spline curve function is adjusted, and the fitting degree of each execution coordinate value is changed by adjusting the fitting weight factor, so that the initial operation trajectory obtained by fitting is more in line with the actual operation trajectory. Among them, the adjustment method of the fitting weight factor can be pre-set, for example, it can be pre-set to adjust according to a certain ratio, or to adjust according to a certain difference, or to adjust in a way that is verified to make the fitting effect better.

[0147] Furthermore, after adjusting the fitting weight factor, the execution coordinate value is formed into a new initial operation trajectory according to the adjusted fitting weight factor, and the simulation operation is performed with the new initial operation trajectory to form an error result between the operation result calculation and the osteotomy trajectory, until the calculated error result is less than or equal to the preset error threshold, and the newly formed initial operation trajectory is generated as an auxiliary operation trajectory.

[0148] Furthermore, for the auxiliary operation trajectory generated by the simulation operation and determined to have a good osteotomy effect, the end effector of the osteotomy robot needs to be controlled to perform the osteotomy operation on the bone to be osteotomized according to the auxiliary operation trajectory. Specifically, if the error result is less than or equal to the preset error threshold, the step of generating the initial operation trajectory as the auxiliary operation trajectory includes:

[0149] Step a, determining an operation starting point corresponding to the bone to be osteotomized according to the auxiliary operation trajectory, and controlling the end effector of the osteotomy robot to move to the operation starting point;

[0150] Step b, controlling the laser device corresponding to the osteotomy robot to start, the laser device generates laser light to the end effector, and controlling the end effector to move along the auxiliary operation trajectory to perform an osteotomy operation on the bone to be osteotomized;

[0151] Step c, obtaining the real-time osteotomy displacement formed by the osteotomy operation, generating a matching degree between the real-time osteotomy displacement and the auxiliary operation trajectory, and regulating the operation of the end effector according to the matching degree.

[0152] Furthermore, based on the auxiliary operation trajectory, the operation starting point of the bone to be osteotomized is identified, and the end effector of the osteotomy robot is controlled to move to the operation starting point. The end effector is a laser emitting end, and the osteotomy operation is performed by emitting laser through the laser emitting end. In order to emit laser, the osteotomy robot system is provided with a laser device corresponding to the osteotomy robot. After the end effector moves to the operation starting point, the laser device is controlled to start, and the laser generated by the laser device is emitted by the laser emitting end as the end effector, and the end effector is controlled to move according to the auxiliary operation trajectory to perform the osteotomy operation on the bone to be osteotomized.

[0153] Furthermore, in order to ensure the accuracy of osteotomy, the real-time osteotomy displacement formed by the osteotomy operation is obtained, and the real-time osteotomy displacement is the osteotomy trajectory formed by the real-time movement of the end actuator. At the same time, the reference displacement corresponding to the real-time movement is obtained from the auxiliary operation trajectory, and then the matching degree between the real-time osteotomy displacement and the reference displacement is generated. The matching degree represents the overlap between the two displacements. The higher the matching degree, the higher the overlap, and the more accurate the osteotomy. Therefore, the overlap threshold can be set by default. If the generated matching degree is greater than the overlap threshold, it means that the current time has achieved accurate osteotomy. If the generated matching degree is less than the overlap threshold, it means that the current time osteotomy is inaccurate. At this time, according to the degree of deviation of the real-time osteotomy displacement represented by the matching degree relative to the reference displacement, the operation of the end actuator is regulated so that the real-time osteotomy displacement of the end actuator performing the osteotomy operation is aligned with the required reference displacement.

[0154] On the one hand, before the actual osteotomy, the implementation obtains the auxiliary operation trajectory that fits the required osteotomy trajectory through simulation operation, ensuring the accuracy of osteotomy according to the auxiliary operation trajectory during the actual osteotomy process. On the other hand, during the actual osteotomy process, the real-time osteotomy displacement at each current time is obtained and compared with the reference displacement, and the accuracy of the real-time displacement at each current time is ensured to make the entire osteotomy trajectory meet the planning requirements.

[0155] In addition, an embodiment of the present invention also provides a system for generating a trajectory for an osteotomy robot-assisted operation. Figure 5 , Figure 5 It is a structural schematic diagram of the equipment hardware operating environment involved in the embodiment of the osteotomy robot-assisted operation trajectory generation system of the present invention.

[0156] like Figure 5As shown, the osteotomy robot-assisted operation trajectory generation system may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a storage 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The storage 1005 may be a high-speed RAM storage, or a stable storage (non-volatile memory), such as a disk storage. The storage 1005 may also be a storage device independent of the aforementioned processor 1001.

[0157] Those skilled in the art will understand that Figure 5 The hardware structure of the osteotomy robot-assisted operation trajectory generation system shown in the figure does not constitute a limitation of the osteotomy robot-assisted operation trajectory generation system, and may include more or fewer components than shown in the figure, or a combination of certain components, or a different arrangement of components.

[0158] like Figure 5 As shown, the storage 1005 as a storage medium may include an operating system, a network communication module, a user interface module and a control program. The operating system is a program for managing and controlling the osteotomy robot-assisted operation trajectory generation system and software resources, and supports the operation of the network communication module, the user interface module, the control program and other programs or software; the network communication module is used to manage and control the network interface 1004; the user interface module is used to manage and control the user interface 1003.

[0159] exist Figure 5 In the hardware structure of the osteotomy robot-assisted operation trajectory generation system shown in the figure, the network interface 1004 is mainly used to connect to other system servers and communicate data with other system servers; the user interface 1003 is mainly used to connect to the client (user end) and communicate data with the client; the processor 1001 can call the control program stored in the storage 1005 and perform the following operations:

[0160] Acquire a three-dimensional model of the bone to be osteotomized, and acquire an osteotomy trajectory of the bone to be osteotomized based on the three-dimensional model, and determine the image coordinate value of the osteotomy trajectory in a three-dimensional image coordinate system;

[0161] Acquire an intraoperative image of the bone to be osteotomized based on a visual navigation device corresponding to the osteotomy robot, and generate a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device according to the intraoperative image;

[0162] Generate a second conversion matrix between the navigation coordinate system and the base coordinate system in the osteotomy robot, and obtain a third conversion matrix between the execution coordinate system of the end effector in the osteotomy robot and the base coordinate system;

[0163] According to the first transformation matrix, the second transformation matrix and the third transformation matrix, the image coordinate values ​​are converted into the initial operating trajectory of the osteotomy robot, and the three-dimensional model is simulated according to the initial operating trajectory. The operating results are obtained to optimize the initial operating trajectory and generate the auxiliary operating trajectory of the osteotomy robot.

[0164] Furthermore, the step of generating a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device according to the intraoperative image includes:

[0165] identifying first pixel coordinates of a preset marker in the intraoperative image based on the navigation coordinate system, and forming each of the first pixel coordinates into a first coordinate matrix;

[0166] Identify second pixel coordinates of a preset marker in a model image corresponding to the three-dimensional model based on the three-dimensional image coordinate system, and form each of the second pixel coordinates into a second coordinate matrix;

[0167] The first coordinate matrix and the second coordinate matrix are calculated based on a first preset formula to obtain a first rotation matrix. The first preset formula is:

[0168]

[0169] Where min represents the minimum value, N represents the number of elements in the first or second coordinate matrix, qi represents the value of the i-th element in the first coordinate matrix, pi represents the value of the i-th element in the second coordinate matrix, R1 represents the first rotation matrix, ||·|| 2 It is used to calculate the square of the norm, σ() represents the correction function, ω represents the number of reference pixels in the reference image corresponding to the intraoperative image, Bε represents the pixel coordinates of the pixel points corresponding to the reference pixel points in the intraoperative image, and B'ε0 represents the pixel coordinates of the reference pixel points in the reference image;

[0170] Based on the first rotation matrix, the first translation vector is calculated using the following formula:

[0171] T1=q-R1*q;

[0172] Wherein, T1 represents the first translation vector, and q represents the average value of each row element or each column element in the first coordinate matrix;

[0173] The first rotation matrix and the first translation vector are used to generate the first transformation matrix.

[0174] Furthermore, the step of generating a second transformation matrix between the navigation coordinate system and the base coordinate system in the osteotomy robot includes:

[0175] Any pixel coordinate is selected from each of the first pixel coordinates as the target pixel coordinate, and the target pixel coordinate is corrected to obtain the corrected pixel coordinate. The correction formula is:

[0176]

[0177] Where (u, v) represents the corrected pixel coordinates, (u0, v0) represents the target pixel coordinates, D1, D2, and D3 represent the correction parameters, and r represents the minimum distance between the target pixel coordinates and the intraoperative image boundary;

[0178] Identify the first base coordinate value corresponding to the target pixel coordinate in the base coordinate system of the osteotomy robot, and obtain the internal parameters of the visual navigation device;

[0179] The internal parameters, the corrected pixel coordinates and the first base coordinate values ​​are calculated based on a second preset formula to obtain a second rotation matrix and a second translation vector. The second preset formula is:

[0180]

[0181] Wherein, fx, fy, α, β all represent internal parameters, R2 represents the second rotation matrix, T2 represents the second translation vector, and (X0, Y0, Z0) represents the coordinate value of the first base;

[0182] The second rotation matrix and the second translation vector are used to generate the second coordinate matrix.

[0183] Furthermore, the step of converting the image coordinate value into an initial operation trajectory of the osteotomy robot according to the first conversion matrix, the second conversion matrix and the third conversion matrix includes:

[0184] Acquire an intraoperative depth image of the bone to be osteotomized acquired based on the visual navigation device, and form an intraoperative three-dimensional model of the bone to be osteotomized in the navigation coordinate system based on the intraoperative depth image;

[0185] According to the first conversion matrix, converting the image coordinate values ​​into intraoperative coordinate values ​​of the intraoperative three-dimensional model in the navigation coordinate system;

[0186] Based on the second conversion matrix, converting the intraoperative coordinate value into a second base coordinate value on the base coordinate system, and based on the third conversion matrix, converting the second base coordinate value into an execution coordinate value on the execution coordinate system;

[0187] The matching relationship between the osteotomy position corresponding to the osteotomy trajectory and the osteotomy operation parameters is obtained, and the initial operation trajectory is generated based on the execution coordinate value and the matching relationship.

[0188] Furthermore, the step of generating the initial operation trajectory based on the execution coordinate value and the matching relationship includes:

[0189] Finding target execution coordinate values ​​corresponding to each osteotomy position in the matching relationship from the execution coordinate values, and determining weight parameters of each target execution coordinate value according to osteotomy operation parameters corresponding to each osteotomy position in the matching relationship;

[0190] Adding default weight parameters to other execution coordinate values ​​in the execution coordinate values ​​except the target execution coordinate value, and generating a weight array of the execution coordinate value by combining the weight parameters and the default weight parameters;

[0191] The execution coordinate value is fitted into an initial operation trajectory according to a preset spline curve function and the weight array, wherein the preset spline curve function is:

[0192]

[0193] Where C(s) represents the position vector of the curve trajectory corresponding to the preset spline curve function, n represents the number of execution coordinate values, w1j represents the weight value corresponding to the j-th execution coordinate value in the weight array, w2j represents the fitting weight factor corresponding to the j-th execution coordinate value, dj represents the j-th execution coordinate value, N j,k (s) represents the k-order spline basis function corresponding to the j-th execution coordinate value in the preset spline curve function, and sj is the vector corresponding to the j-th execution coordinate value.

[0194] Furthermore, the step of simulating the operation on the three-dimensional model according to the initial operation trajectory, obtaining the operation result to optimize the initial operation trajectory, and generating the auxiliary operation trajectory of the osteotomy robot includes:

[0195] The three-dimensional model is simulated multiple times according to the initial operation trajectory to obtain multiple operation results, and the error results between the multiple operation results and the osteotomy trajectory are calculated based on a preset error calculation formula, wherein the preset error calculation formula is:

[0196]

[0197] Where L represents the error result calculated based on the preset error calculation formula, G represents the number of simulation operations, m represents the number of executed coordinate values, and x represents the number of coordinate values. τ ,y τ 、z τ , They represent the X-axis value, Y-axis value, Z-axis value and direction of the operation result generated by the simulation operation in the execution coordinate system of the τth execution coordinate value, respectively. τ0 ,y τ0 、z τ0 , They respectively represent the X-axis reference value, Y-axis reference value, Z-axis reference value and reference direction of the τth execution coordinate value in the execution coordinate system, g represents the numerical error calculation function, and f represents the direction error calculation function;

[0198] Comparing the error result with a preset error threshold to determine whether the error result is less than or equal to the preset error threshold, and if the error result is less than or equal to the preset error threshold, generating the initial operation trajectory as the auxiliary operation trajectory;

[0199] If the error result is greater than a preset error threshold, the fitting weight factor in the preset spline curve function is adjusted, and the execution coordinate value is refitted based on the adjusted preset spline curve function to form a new initial operation trajectory, until the error result formed by the initial operation trajectory simulation operation is less than or equal to the preset error threshold.

[0200] Further, after the step of generating the initial operation trajectory as the auxiliary operation trajectory if the error result is less than or equal to the preset error threshold, the processor 1001 may call the control program stored in the storage 1005 and perform the following operations:

[0201] Determine the operation starting point corresponding to the bone to be osteotomized according to the auxiliary operation trajectory, and control the end effector of the osteotomy robot to move to the operation starting point;

[0202] Controlling the laser device corresponding to the osteotomy robot to start, so that the laser device generates laser light to the end effector, and controlling the end effector to move along the auxiliary operation trajectory to perform an osteotomy operation on the bone to be osteotomized;

[0203] The real-time osteotomy displacement formed by the osteotomy operation is acquired, and the matching degree between the real-time osteotomy displacement and the auxiliary operation trajectory is generated, and the operation of the end effector is regulated according to the matching degree.

[0204] Furthermore, the step of obtaining a three-dimensional model of the bone to be osteotomized includes:

[0205] Acquire multiple CT scan images corresponding to the bone to be osteotomized based on a CT scanning device, and segment the multiple CT scan images after preprocessing to obtain multiple segmentation images;

[0206] Model reconstruction is performed based on the multiple segmentation images to obtain a three-dimensional model of the bone to be osteotomized.

[0207] The specific implementation of the osteotomy robot-assisted operation trajectory generation system of the present invention is basically the same as the above-mentioned osteotomy robot-assisted operation trajectory generation method embodiments, and will not be repeated here.

[0208] The embodiment of the present invention further provides a storage medium having a control program stored thereon, and when the control program is executed by a processor, the steps of the above-mentioned method for generating an osteotomy robot-assisted operation trajectory are implemented.

[0209] The storage medium of the present invention may be a computer-readable storage medium, and its implementation is substantially the same as the above-mentioned embodiments of the osteotomy robot-assisted operation trajectory generation method, and will not be described in detail herein.

[0210] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the enlightenment of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims. All equivalent structures or equivalent process changes made using the contents of the specification and drawings of the present invention, or directly or indirectly used in other related technical fields, are protected by the present invention.

Claims

1. A method for generating trajectory of osteotomy robot-assisted operation. It is characterized in that The osteotomy robot-assisted operation trajectory generation method comprises: Acquire a three-dimensional model of the bone to be osteotomized, and acquire an osteotomy trajectory of the bone to be osteotomized based on the three-dimensional model, and determine the image coordinate value of the osteotomy trajectory in a three-dimensional image coordinate system; Acquire an intraoperative image of the bone to be osteotomized based on a visual navigation device corresponding to the osteotomy robot, and generate a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device according to the intraoperative image; Generate a second conversion matrix between the navigation coordinate system and the base coordinate system in the osteotomy robot, and obtain a third conversion matrix between the execution coordinate system of the end effector in the osteotomy robot and the base coordinate system; According to the first transformation matrix, the second transformation matrix and the third transformation matrix, the image coordinate values ​​are converted into the initial operating trajectory of the osteotomy robot, and the three-dimensional model is simulated according to the initial operating trajectory. The operating results are obtained to optimize the initial operating trajectory and generate the auxiliary operating trajectory of the osteotomy robot.

2. The osteotomy robot-assisted operation trajectory generation method according to claim 1, It is characterized in that The step of generating a first conversion matrix between the three-dimensional image coordinate system and the navigation coordinate system corresponding to the visual navigation device according to the intraoperative image comprises: identifying first pixel coordinates of a preset marker in the intraoperative image based on the navigation coordinate system, and forming each of the first pixel coordinates into a first coordinate matrix; Identify second pixel coordinates of a preset marker in a model image corresponding to the three-dimensional model based on the three-dimensional image coordinate system, and form each of the second pixel coordinates into a second coordinate matrix; The first coordinate matrix and the second coordinate matrix are calculated based on a first preset formula to obtain a first rotation matrix. The first preset formula is: Where min represents the minimum value, N represents the number of elements in the first or second coordinate matrix, qi represents the value of the i-th element in the first coordinate matrix, pi represents the value of the i-th element in the second coordinate matrix, R1 represents the first rotation matrix, ||·|| 2 It is used to calculate the square of the norm, σ( ) represents the correction function, ω represents the number of reference pixels in the reference image corresponding to the intraoperative image, Bε represents the pixel coordinates of the pixel corresponding to the reference pixel in the intraoperative image, and B′ε0 represents the pixel coordinates of the reference pixel in the reference image; Based on the first rotation matrix, the first translation vector is calculated using the following formula: T1=q-R1*q; Wherein, T1 represents the first translation vector, and q represents the average value of each row element or each column element in the first coordinate matrix; The first rotation matrix and the first translation vector are used to generate the first transformation matrix.

3. The osteotomy robot-assisted operation trajectory generation method according to claim 2, It is characterized in that The step of generating a second transformation matrix between the navigation coordinate system and the base coordinate system in the osteotomy robot comprises: Any pixel coordinate is selected from each of the first pixel coordinates as the target pixel coordinate, and the target pixel coordinate is corrected to obtain the corrected pixel coordinate. The correction formula is: Where (u, v) represents the corrected pixel coordinates, (u0, v0) represents the target pixel coordinates, D1, D2, and D3 represent the correction parameters, and r represents the minimum distance between the target pixel coordinates and the intraoperative image boundary; Identify the first base coordinate value corresponding to the target pixel coordinate in the base coordinate system of the osteotomy robot, and obtain the internal parameters of the visual navigation device; The internal parameters, the corrected pixel coordinates and the first base coordinate values ​​are calculated based on a second preset formula to obtain a second rotation matrix and a second translation vector. The second preset formula is: Wherein, fx, fy, α, β all represent internal parameters, R2 represents the second rotation matrix, T2 represents the second translation vector, and (X0, Y0, Z0) represents the coordinate value of the first base; The second rotation matrix and the second translation vector are used to generate the second coordinate matrix.

4. The osteotomy robot-assisted operation trajectory generation method according to claim 1, It is characterized in that The step of converting the image coordinate value into the initial operation trajectory of the osteotomy robot according to the first conversion matrix, the second conversion matrix and the third conversion matrix comprises: Acquire an intraoperative depth image of the bone to be osteotomized acquired based on the visual navigation device, and form an intraoperative three-dimensional model of the bone to be osteotomized in the navigation coordinate system based on the intraoperative depth image; According to the first conversion matrix, converting the image coordinate values ​​into intraoperative coordinate values ​​of the intraoperative three-dimensional model in the navigation coordinate system; Based on the second conversion matrix, converting the intraoperative coordinate value into a second base coordinate value on the base coordinate system, and based on the third conversion matrix, converting the second base coordinate value into an execution coordinate value on the execution coordinate system; The matching relationship between the osteotomy position corresponding to the osteotomy trajectory and the osteotomy operation parameters is obtained, and the initial operation trajectory is generated based on the execution coordinate value and the matching relationship.

5. The osteotomy robot-assisted operation trajectory generation method according to claim 4, It is characterized in that The step of generating the initial operation trajectory based on the execution coordinate value and the matching relationship includes: Finding target execution coordinate values ​​corresponding to each osteotomy position in the matching relationship from the execution coordinate values, and determining weight parameters of each target execution coordinate value according to osteotomy operation parameters corresponding to each osteotomy position in the matching relationship; Adding default weight parameters to other execution coordinate values ​​in the execution coordinate values ​​except the target execution coordinate value, and generating a weight array of the execution coordinate value by combining the weight parameters and the default weight parameters; The execution coordinate value is fitted into an initial operation trajectory according to a preset spline curve function and the weight array, wherein the preset spline curve function is: Where C(s) represents the position vector of the curve trajectory corresponding to the preset spline curve function, n represents the number of execution coordinate values, w1j represents the weight value corresponding to the j-th execution coordinate value in the weight array, w2j represents the fitting weight factor corresponding to the j-th execution coordinate value, dj represents the j-th execution coordinate value, N j,k (s) represents the k-order spline basis function corresponding to the j-th execution coordinate value in the preset spline curve function, and sj is the vector corresponding to the j-th execution coordinate value.

6. The osteotomy robot-assisted operation trajectory generation method according to claim 1, It is characterized in that The step of simulating the operation on the three-dimensional model according to the initial operation trajectory, obtaining the operation result to optimize the initial operation trajectory, and generating the auxiliary operation trajectory of the osteotomy robot comprises: The three-dimensional model is simulated multiple times according to the initial operation trajectory to obtain multiple operation results, and the error results between the multiple operation results and the osteotomy trajectory are calculated based on a preset error calculation formula, wherein the preset error calculation formula is: Where L represents the error result calculated based on the preset error calculation formula, G represents the number of simulation operations, m represents the number of executed coordinate values, and x represents the number of coordinate values. τ ,y τ 、z τ , They represent the X-axis value, Y-axis value, Z-axis value and direction of the operation result generated by the simulation operation in the execution coordinate system of the τth execution coordinate value, respectively. τ0、 y τ0 、z τ0 , They respectively represent the X-axis reference value, Y-axis reference value, Z-axis reference value and reference direction of the τth execution coordinate value in the execution coordinate system, g represents the numerical error calculation function, and f represents the direction error calculation function; Comparing the error result with a preset error threshold to determine whether the error result is less than or equal to the preset error threshold, and if the error result is less than or equal to the preset error threshold, generating the initial operation trajectory as the auxiliary operation trajectory; If the error result is greater than a preset error threshold, the fitting weight factor in the preset spline curve function is adjusted, and the execution coordinate value is refitted based on the adjusted preset spline curve function to form a new initial operation trajectory, until the error result formed by the initial operation trajectory simulation operation is less than or equal to the preset error threshold.

7. The osteotomy robot-assisted operation trajectory generation method according to claim 6, It is characterized in that After the step of generating the initial operation trajectory as the auxiliary operation trajectory if the error result is less than or equal to the preset error threshold, the following steps are included: Determine the operation starting point corresponding to the bone to be osteotomized according to the auxiliary operation trajectory, and control the end effector of the osteotomy robot to move to the operation starting point; Controlling the laser device corresponding to the osteotomy robot to start, so that the laser device generates laser light to the end effector, and controlling the end effector to move along the auxiliary operation trajectory to perform an osteotomy operation on the bone to be osteotomized; The real-time osteotomy displacement formed by the osteotomy operation is acquired, and the matching degree between the real-time osteotomy displacement and the auxiliary operation trajectory is generated, and the operation of the end effector is regulated according to the matching degree.

8. The method for generating a robot-assisted osteotomy operation trajectory according to any one of claims 1 to 7, It is characterized in that The step of obtaining a three-dimensional model of the bone to be osteotomized comprises: Acquire multiple CT scan images corresponding to the bone to be osteotomized based on a CT scanning device, and segment the multiple CT scan images after preprocessing to obtain multiple segmentation images; Model reconstruction is performed based on the multiple segmentation images to obtain a three-dimensional model of the bone to be osteotomized.

9. A robot-assisted osteotomy operation trajectory generation system, It is characterized in that The osteotomy robot-assisted operation trajectory generation system includes a storage device, a processor, a communication bus, and a control program stored in the storage device: The communication bus is used to realize the connection and communication between the processor and the storage; The processor is used to execute the control program to implement the steps of the osteotomy robot-assisted operation trajectory generation method according to any one of claims 1-8.

10. A storage medium, It is characterized in that The storage medium stores a control program, and when the control program is executed by the processor, the steps of the osteotomy robot-assisted operation trajectory generation method according to any one of claims 1 to 8 are implemented.

Citation Information

Patent Citations

  • Coordinate conversion relation acquisition method and device, electronic equipment and storage medium

    CN112837391A

  • Orthopedic surgery navigation method and device, computer equipment, system and storage medium

    CN113100939A

  • Vertebral plate grinding track planning method for spinal surgical robot

    CN115462900A

  • Surgical robot calibration method and device, surgical robot and storage medium

    CN115813556A

  • Robot control method and device, processor and electronic equipment

    CN116672031A

Cited By

  • Positioning method and positioning system of robot tail end guiding device

    CN119770174A