Punching control method, device and equipment, mechanical arm and medium
By installing the external shaft on the end effector of the robotic arm and controlling the drilling according to the bone density threshold, the problems of the robotic arm torque exceeding and vibration in the bone stiff bone duct are solved, extending the service life of the robotic arm and improving the drilling is improved efficiency.
Patent Information
- Application Number
- CN202411189760.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-28
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2044-08-28
AI Technical Summary
When using robotic arms to drill holes, especially in bone tracts with hard bones and long lengths, robotic arms are prone to torque overlimits and vibration problems, which affects their service life.
By installing an external axis on the end effector of the robot arm, the density of the current bone tract is judged based on the planned trajectory and bone density threshold, the robot arm is controlled to drill holes on points with higher density to avoid relying on large-scale robot arms, thereby Reduce torque overlimits and vibrations.
It effectively avoids torque over-limits and vibrations, extends the service life of the robotic arm, and achieves efficient hole drilling at high density bone tracts.
Smart Images

Figure CN119074208A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the technical field of motion control of a robotic arm, and in particular to a punching control method, device, equipment, a robotic arm and a medium. Background Art
[0002] Since the bone of the bone tunnel is relatively hard, when using a robot arm to drill a hole in the bone tunnel, the drilling capability of the robot arm is required to be relatively high. For example, when drilling a bone tunnel that is hard and long, the arm span of the robot arm and the torque that the axis can withstand are required to be very high.
[0003] In the prior art, when using a mechanical arm to drill a bone tunnel, a large-sized mechanical arm is generally used. However, when using a large-sized mechanical arm to drill a bone tunnel point with very hard bone (i.e., a bone tunnel point with high density), the problem of excessive torque is likely to occur, and at the same time, the mechanical arm will also be subjected to large vibrations, thereby affecting the service life of the mechanical arm. Summary of the invention
[0004] In order to solve the above technical problems, the present disclosure provides a punching control method, device, equipment and medium.
[0005] In a first aspect, the present disclosure provides a drilling control method, which is applied to an electronic device corresponding to a robotic arm, wherein an end effector of the robotic arm is equipped with an external shaft, and the method comprises:
[0006] When the robot arm moves to the current trajectory point according to the planned trajectory, determining whether the bone density of the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is greater than a first density threshold, wherein the first density threshold is greater than the average bone density of the target bone tunnel;
[0007] If the bone density of the current bone tunnel point is greater than the first density threshold, determining the current bone tunnel point as a first density bone point;
[0008] The external axis of the end effector on the robot arm is controlled to punch a hole in the first density bone point.
[0009] In a second aspect, the present disclosure provides a drilling control device, which is configured in an electronic device corresponding to a robotic arm, wherein an end effector of the robotic arm is equipped with an external shaft, and the device comprises:
[0010] A first determination module is used to determine whether the bone density of the current bone tunnel point corresponding to the current track point on the target bone tunnel is greater than a first density threshold when the robot arm moves to the current track point according to the planned track, wherein the first density threshold is greater than the average bone density of the target bone tunnel;
[0011] A second determination module, configured to determine that the current bone tunnel point is a first-density bone point if the bone density of the current bone tunnel point is greater than the first density threshold;
[0012] The drilling control module is used to control the external axis of the end effector on the robot arm to drill the first density bone point.
[0013] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the device comprising:
[0014] one or more processors;
[0015] a storage device for storing one or more programs,
[0016] When one or more programs are executed by one or more processors, the one or more processors implement the method provided in the first aspect.
[0017] In a fourth aspect, the present disclosure also provides a mechanical arm, comprising: a base and an end effector; wherein:
[0018] The end effector is mounted with an external shaft;
[0019] The base is installed with a first axis, a second axis and a third axis; the direction of the first axis is consistent with the flange direction of the robotic arm, the flange direction is consistent with the bone channel direction of the target bone channel to be punched, and the second axis and the third axis are both perpendicular to the first axis.
[0020] In a fifth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, which implements the method provided in the first aspect when the computer program is executed by a processor.
[0021] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:
[0022] The present invention discloses a method, device, equipment, mechanical arm and medium for controlling drilling holes. The method is applied to an electronic device corresponding to the mechanical arm, and the end effector of the mechanical arm is equipped with an external shaft. The method includes: when the mechanical arm moves to the current trajectory point according to the planned trajectory, determining whether the bone density of the current bone channel point corresponding to the current trajectory point on the target bone channel is greater than a first density threshold, wherein the first density threshold is greater than the average bone density of the target bone channel; if the bone density of the current bone channel point is greater than the first density threshold, determining the current bone channel point as a first density bone point; and controlling the external shaft of the end effector on the mechanical arm to drill holes at the first density bone point. In this way, drilling holes at bone channels with higher density can be achieved by only installing an external shaft on the end effector of the mechanical arm, without relying on a large-sized mechanical arm, thereby avoiding the problem of torque overrun. At the same time, the mechanical arm is prevented from being directly subjected to large vibrations, thereby increasing the service life of the mechanical arm. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0024] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0025] Figure 1 A schematic diagram of the structure of a mechanical arm provided in an embodiment of the present disclosure;
[0026] Figure 2 A flowchart of a punching control method provided in an embodiment of the present disclosure;
[0027] Figure 3 A schematic diagram of the structure of a punching control device provided in an embodiment of the present disclosure;
[0028] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0029] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0030] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0031] In order to solve the above problems, Figure 1 Figure 2 shows a schematic diagram of the structure of the robotic arm. Figure 1 As shown, the robot arm includes: an end effector 100 and a base 200 .
[0032] The end effector 100 is equipped with an external shaft 110. Specifically, when the robot arm punches a target bone tunnel, the external shaft 110 on the end effector 100 of the robot arm is activated to punch a bone point with a high density on the target bone tunnel.
[0033] Therefore, there is no need to rely on a large-sized robotic arm, thus avoiding the problem of torque excess. At the same time, the robotic arm is protected from large vibrations, thereby increasing the service life of the robotic arm.
[0034] The base 200 is provided with a first axis, a second axis and a third axis. The first axis is the rotation axis of the robot arm, and the second axis and the third axis are the translation axes of the robot arm.
[0035] Specifically, before using the robotic arm to drill the target bone channel, first, the planned path and planned posture of the robotic arm must be determined; then, at each trajectory point on the planned path, it is determined based on the planned posture of the robotic arm whether the robotic arm can reach the bone channel point corresponding to each trajectory point, based on the planned posture of the robotic arm, it is determined whether the singularity of the robotic arm at each trajectory point meets the condition for moving out of the singular area, and based on the planned posture of the robotic arm, it is determined whether the planned stiffness of the robotic arm for the target bone channel meets the drilling stiffness condition; then, if the robotic arm cannot reach the bone channel point corresponding to each trajectory point, it is necessary to control the base 200 to translate along the second axis and / or the third axis, so as to update the posture of the robotic arm at each trajectory point, so that the robotic arm can be determined based on the updated posture of the robotic arm at each trajectory point. The bone channel point is reachable at each trajectory point; similarly, if the singularity of the robot arm at each trajectory point meets the condition for moving out of the singular area, the base 200 is controlled to rotate around the first axis, and / or the base 200 is controlled to translate along the second axis, and / or the base 200 is controlled to translate along the third axis, thereby updating the posture of the robot arm at each trajectory point, so that the robot arm is controlled to move out of the singular area and the step size of the planned trajectory is adjusted based on the updated posture of the robot arm at each trajectory point; similarly, if the planned stiffness of the robot arm to the target bone channel at each trajectory point does not meet the drilling stiffness condition, the base 200 is controlled to rotate around the first axis, thereby updating the posture of the robot arm at each trajectory point, so that the stiffness of the robot arm to the target bone channel determined based on the posture of the robot arm at each trajectory point meets the drilling stiffness condition.
[0036] In this way, three axes are installed on the base of the robotic arm to adjust the position of the robotic arm, so that when the robotic arm encounters problems such as the inability to reach the bone channel point, the existence of a singular area of the robotic arm, and the insufficient rigidity of the robotic arm, it is only necessary to control the robotic arm to rotate or translate around the axis to ensure the reachability of the drilling robotic arm, move out of the singular area, and have sufficient rigidity. Compared with using a robotic arm with larger size specifications, the operation method is more convenient and the cost is lower.
[0037] Combine the following Figure 2 The punching control method provided in the embodiment of the present disclosure is described. In the embodiment of the present disclosure, the punching control method can be Figure 1 The electronic equipment corresponding to the robotic arm shown in the figure is executed. Figure 1 As shown, the end effector 100 of the robot arm is equipped with an external axis 110, and the electronic device may include a tablet computer, a desktop computer, a laptop computer and other devices with communication functions, and may also include a virtual machine or a device simulated by a simulator.
[0038] Figure 2 A flow chart of a punching control method provided in an embodiment of the present disclosure is shown.
[0039] like Figure 2 As shown, the punching control method may include the following steps.
[0040] S210. When the robot arm moves to the current trajectory point according to the planned trajectory, determine whether the bone density of the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is greater than a first density threshold, wherein the first density threshold is greater than the average bone density of the target bone tunnel.
[0041] In this embodiment, before the robot arm is used to punch the target bone tunnel, the electronic device determines the planned trajectory of the robot arm according to the entry point coordinates, exit point coordinates, safe extra-skin preparation point coordinates, the length of the target bone tunnel, and the step length between trajectory points. In addition, when the electronic device determines the trajectory points, it also determines the trajectory points corresponding to each bone tunnel point on the target bone tunnel, so that the robot arm moves to each trajectory point on the planned trajectory to punch the corresponding bone tunnel point on the target bone tunnel.
[0042] The target bone channel refers to any bone channel that needs to be drilled.
[0043] In this embodiment, when the robotic arm moves to any current trajectory point according to the planned trajectory, the electronic device needs to determine whether the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is a point with higher density, specifically, whether the bone density of the current bone tunnel point is greater than the first density threshold, so as to analyze whether the bone of the current bone tunnel point is hard.
[0044] In some embodiments, the specific implementation method of "determining whether the bone density of the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is greater than the first density threshold" in S210 includes but is not limited to the following method: determining the bone position area to which the current bone tunnel point belongs on the target bone tunnel; if the bone density of the bone position area is greater than the first density threshold, then determining that the bone density of the current bone tunnel point is greater than the first density threshold, wherein the bone position area included in the target bone tunnel and the bone density corresponding to the bone position area are determined by pre-segmenting the scanned image of the target bone tunnel.
[0045] Specifically, before the target bone channel is punched with the robotic arm, the electronic device obtains a scanned image of the target bone channel, and performs image segmentation on the scanned image to determine different bone position areas on the target bone channel and the bone density of the different bone position areas. When the target bone channel is punched with the robotic arm, the bone position area to which the current bone channel point belongs on the target bone channel is determined based on the coordinate data of the current bone channel point and the coordinate range of each bone position area on the target bone channel. Since the bone density of the bone position area to which the current bone channel point belongs can be used as the bone density of the current bone channel point, by judging whether the bone density of this bone position area is greater than the first density area, it can be determined whether the bone density of the current bone channel point is greater than the first density threshold.
[0046] In order to more accurately determine the bone density of the current bone channel point, the position of the current bone channel point can also be corrected. For example, the position of the current bone channel point is represented as d, and the bone density of the current bone channel point is represented as ρ. After the position of the current bone channel point is corrected, the corrected position of the current bone channel point is represented as d+δ. At this time, the relationship between the corrected position of the current bone channel point and the bone density is represented as (ρ, d+δ). In this way, the bone position area to which the current bone channel point belongs is determined according to the corrected position of the current bone channel point, and then the bone density of the bone position area is determined as the corrected bone density of the current bone channel point.
[0047] In other embodiments, the specific implementation method of "determining whether the bone density of the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is greater than the first density threshold" in S210 includes but is not limited to the following method: obtaining the force exerted on the robotic arm at the current bone tunnel point; performing frequency domain analysis on the force to determine the ratio of the sum of the first frequency amplitudes of the force to the sum of the total frequency amplitudes, wherein the sum of the first frequency amplitudes is the sum of multiple first frequency amplitudes, and any first frequency amplitude is greater than the average value of the sum of the total frequency amplitudes; if the ratio is greater than the preset ratio, it is determined that the bone density of the current bone tunnel point is greater than the first density threshold.
[0048] Specifically, one or more force sensors are installed on the robotic arm, and the electronic device can control the robotic arm to approach the current bone tunnel point. When the robotic arm starts to drill the current bone tunnel point, the force sensor on the robotic arm collects the force applied to the robotic arm. Then, the electronic device performs frequency domain analysis on the force used to determine the ratio of the sum of the first frequency amplitudes of the force to the sum of the total frequency amplitudes. Then, since any one of the first frequency amplitudes is greater than the average value of the total frequency sum, the first frequency amplitude can be considered to be a high-frequency amplitude. Finally, the electronic device compares the ratio with a preset ratio to determine whether the bone density of the current bone tunnel point is greater than a first density threshold.
[0049] Optionally, the ratio of the sum of the first frequency amplitudes of the force to the sum of the total frequency amplitudes may be determined as follows:
[0050]
[0051] Among them, I ω is the ratio of the sum of the first frequency amplitudes of the forces to the sum of the total frequency amplitudes, ω stop is the frequency cutoff point of the first frequency amplitude, ω pass is the frequency passing point of the first frequency amplitude, ω T is the frequency period, and P(ω) is the frequency amplitude.
[0052] The preset ratio is a critical value preset based on experience. T .
[0053] Through the above method, it is possible to determine whether the bone density of the current bone tunnel point is greater than the first density threshold by analyzing the frequency domain data of the applied force. It is also possible to determine whether the bone density of the current bone tunnel point is greater than the first density threshold by using the image segmentation result and combining it with the position of the current bone tunnel point. Therefore, it can be adapted to different analysis needs and improves flexibility.
[0054] S220: If the bone density of the current bone tunnel point is greater than the first density threshold, determine the current bone tunnel point as a first density bone point.
[0055] It can be understood that since the first density threshold is greater than the average density of the target bone channel, and if the bone density of the current bone channel point is greater than the first density threshold, it can be determined that the current bone channel point is a high-density point in the bone of the target bone channel, that is, the bone at the current bone channel point is harder and it is more difficult to drill.
[0056] The first density bone point is a point with a higher density (ie, a point with a harder bone) on the target bone tunnel.
[0057] S230, controlling the external axis of the end effector on the robot arm to punch a bone point of the first density.
[0058] In this embodiment, after the electronic device determines that the current bone channel point is a first-density bone point, the external axis of the end effector on the robotic arm is started, and the external axis is controlled to drill holes in the first-density bone point, so as to achieve drilling of high-density points in the bone using the external axis of the end effector without increasing the torque of the robotic arm. At the same time, it also avoids the robotic arm from being subjected to large vibrations, thereby increasing the service life of the robotic arm.
[0059] A drilling control method of an embodiment of the present disclosure is applied to an electronic device corresponding to a robotic arm, and an external shaft is installed on the end effector of the robotic arm. The method includes: when the robotic arm moves to the current trajectory point according to the planned trajectory, determining whether the bone density of the current bone channel point corresponding to the current trajectory point on the target bone channel is greater than a first density threshold, wherein the first density threshold is greater than the average bone density of the target bone channel; if the bone density of the current bone channel point is greater than the first density threshold, then determining the current bone channel point as a first density bone point; and controlling the external shaft of the end effector on the robotic arm to drill the first density bone point. In this way, only the external shaft needs to be installed on the end effector of the robotic arm to achieve drilling of bone channel points with higher density, without relying on a large-sized robotic arm, thereby avoiding the problem of torque overrun. At the same time, it prevents the robotic arm from being directly subjected to large vibrations, thereby increasing the service life of the robotic arm.
[0060] In this embodiment, after executing S210, the method also includes: if the bone density of the current bone tunnel point is less than the first density threshold, determining whether the bone density of the current bone tunnel point is less than the second density threshold; if the bone density of the current bone tunnel point is less than the second density threshold, determining that the current bone tunnel point is a second density bone point, wherein the second density threshold is less than the average bone density inside the target bone tunnel, or the second density threshold is less than the average bone density outside the target bone tunnel; and controlling the end effector of the robotic arm to punch the second density bone point.
[0061] It is understandable that, since the second density threshold is less than the average bone density or the average bone density outside the target bone channel, and if the bone density of the current bone channel point is not only less than the first density threshold but also less than the second density threshold, it can be determined that the current bone channel point is a low-density point in the bone or a low-density point outside the bone of the target bone channel, that is, the bone of the current bone channel point is softer and the drilling difficulty is relatively small. In this case, the electronic device controls the end effector of the robotic arm to drill the second-density bone point.
[0062] In this way, for low-density points inside or outside the bone, the end effector of the robotic arm can be used to drill holes. This process can be carried out smoothly even if the torque of the robotic arm is not increased. At the same time, even if the robotic arm is subjected to large vibrations during this process, directly using the end effector of the robotic arm to drill holes will not affect the service life of the robotic arm.
[0063] In another embodiment of the present disclosure, the base of the robot arm is installed with a first axis, a second axis and a third axis; the first axis is the rotation axis of the robot arm, and the second axis and the third axis are the translation axes of the robot arm. Before drilling, the robot arm rotates around the first axis, and / or translates the second axis, and / or translates the third axis to ensure that the robot arm has accessibility, moves out of the singular area, and has sufficient rigidity during the drilling process.
[0064] In some embodiments, before executing S210, the method further includes:
[0065] Based on the planned position of the robot arm at the current trajectory point, determine whether the robot arm at the current trajectory point meets the accessibility condition for the current bone channel point;
[0066] If the robot arm does not meet the accessibility condition for the current bone channel point at the current trajectory point, the robot arm is controlled to translate along the second axis and / or the third axis so that the planned posture of the robot arm at the current trajectory point is adjusted to the first target posture;
[0067] If, based on the first target posture, it is determined that the robotic arm meets the accessibility condition for the current bone channel point at the current trajectory point, the robotic arm is controlled to move to the current trajectory point according to the planned trajectory; otherwise, the robotic arm continues to be controlled to translate along the second axis and / or the third axis until, based on the updated target posture of the robotic arm at the current trajectory point, it is determined that the robotic arm meets the accessibility condition for the current bone channel point at the current trajectory point.
[0068] Specifically, before the robotic arm punches a hole in the target bone tunnel, the electronic device determines whether the robotic arm can reach the current bone tunnel point at the current trajectory point based on the planned posture of the robotic arm at any current trajectory point, the posture of the current bone tunnel point, and the length of the robotic arm, that is, determines whether the reachability condition is met; if the robotic arm does not meet the reachability condition, the electronic device controls the robotic arm to translate along at least one of the second axis and the third axis, and at the same time, can also control the base of the robotic arm to move a certain distance (such as two steps) along the bone tunnel direction of the target bone tunnel to update the posture of the robotic arm; then, based on the updated posture of the robotic arm, the posture of the current bone tunnel point, and the length of the robotic arm The length of the arm is determined, and whether the robotic arm meets the accessibility condition is re-determined; if the robotic arm meets the accessibility condition at this time, the electronic device controls the robotic arm to move to the current trajectory point according to the planned trajectory to start punching the target bone channel; if the robotic arm does not meet the accessibility condition at this time, the electronic device continues to control the robotic arm to translate along at least one of the second axis and the third axis, and at the same time, the base of the robotic arm can be controlled to move a certain distance (such as two steps) along the bone channel direction of the target bone channel to continue to update the posture of the robotic arm until the robotic arm meets the accessibility condition, and controls the robotic arm to move to the current trajectory point according to the planned trajectory to start punching the target bone channel.
[0069] In this way, before the robot arm is used to drill the target bone tunnel, the robot arm changes its posture by translating at least one of the second axis and the third axis, so that the robot arm with the changed posture has accessibility during the drilling process.
[0070] In some embodiments, before executing S210, the method further includes:
[0071] Based on the planned position of the robot arm at the current trajectory point, determine the singularity of the robot arm at the current trajectory point;
[0072] If it is determined based on the singularity degree that the robot arm satisfies the singularity region exit condition at the current trajectory point, the robot arm is controlled to rotate about the first axis, and / or the robot arm is controlled to translate along the second axis, and / or the robot arm is controlled to translate along the third axis, so that the planned posture of the robot arm at the current trajectory point is adjusted to the second target posture;
[0073] Control the robot arm to move out of the singular area corresponding to the current trajectory point based on the second target posture, and adjust the step size of the planned trajectory;
[0074] Control the robot arm that has moved out of the singular area and move to the current trajectory point according to the planned trajectory after the step size is adjusted.
[0075] Specifically, before the robotic arm punches the target bone tunnel, the electronic device calculates the Jacobi eigenvalue in Cartesian space based on the planned posture of the robotic arm at the current trajectory point, and uses the Jacobi eigenvalue as the singularity of the robotic arm at the current trajectory point; then, based on the component of the singularity in the bone tunnel direction of the target bone tunnel, it is determined whether the robotic arm meets the condition for moving out of the singular area at the current trajectory point; if so, the robotic arm is controlled to rotate around the first axis, and / or the robotic arm is controlled to translate along at least one of the second axis and the third axis to update the posture of the robotic arm; at the same time, a circle is drawn with the singular point corresponding to the current trajectory point of the robotic arm as the center and a preset length as the radius to determine the singular area; then the robotic arm is controlled to move out of the singular area according to the updated posture, and the step size of the planned trajectory is adjusted at the same time; finally, the robotic arm that has moved out of the singular area is controlled to move to the current trajectory point according to the planned trajectory after the step size is adjusted to start punching the target bone tunnel.
[0076] Alternatively, the Jacobi eigenvalue can be expressed as: {λ x ,λ y ,λ z ,λ Rx ,λ Ry ,λ Rz}. Among them, λ x It refers to the singularity of the position component of the Jacobi eigenvalue on the second axis (x axis), λ y It refers to the singularity of the position component of the Jacobi eigenvalue on the first axis (y axis), λz It refers to the singularity of the position component of the Jacobi eigenvalue on the third axis (z axis), λ Rx It refers to the singularity of the rotation component of the Jacobi eigenvalue on the second axis (x axis), λ Ry It refers to the singularity of the rotation component of the Jacobi eigenvalue on the first axis (y axis), λ Rz It refers to the singularity of the rotation component of the Jacobi eigenvalue about the second axis (z axis).
[0077] Alternatively, the preset length may be determined empirically.
[0078] Correspondingly, when λ min <λ y <λ T When it is determined that the robot arm meets the condition for moving out of the singular area at the current trajectory point, the position and posture of the robot arm are updated, and the robot arm is controlled to move out of the singular area. At the same time, it is explained that the planned trajectory can be retained, and only the step size of the planned trajectory needs to be adjusted (for example, the step size is adjusted to the minimum step size). Finally, the robot arm that has moved out of the singular area is controlled to move to the current trajectory point according to the planned trajectory after the step size is adjusted, and then the drilling of the target bone channel is started.
[0079] Among them, λ T It refers to the maximum component of the first axis (y axis), which can be determined based on experience. min It refers to the minimum component of the first axis (y-axis), which can be determined empirically.
[0080] In this way, before using the robotic arm to drill the target bone channel, if the singularity of the robotic arm meets the singularity removal condition, the robotic arm is controlled to rotate around the first axis, and / or the robotic arm is controlled to translate along at least one of the second axis and the third axis to change the posture of the robotic arm, so that the robotic arm after the posture change can move out of the singularity area.
[0081] In some embodiments, before executing S210, the method further includes:
[0082] Based on the planned position of the robot arm at the current trajectory point, determine the planned stiffness of the robot arm to the target bone channel;
[0083] If the planned stiffness of the robot arm for the target bone channel does not meet the drilling stiffness condition, the robot arm is controlled to rotate around the first axis so that the planned posture of the robot arm at the current trajectory point is adjusted to the third target posture;
[0084] determining a target stiffness of the robot arm to the target bone tunnel based on the third target posture;
[0085] If the target stiffness meets the punching stiffness condition, the robot arm is controlled to move to the current trajectory point according to the planned trajectory. Otherwise, the robot arm is controlled to continue rotating around the first axis and the stiffness is recalculated until the re-determined stiffness meets the punching stiffness condition.
[0086] Specifically, before the robotic arm drills the target bone channel, the electronic device determines the drilling ability of the robotic arm based on the planned position and posture of the robotic arm at the current trajectory point, that is, determines the planned stiffness of the robotic arm for the target bone channel; then, it determines whether the planned stiffness of the robotic arm for the target bone channel meets the drilling stiffness condition; if so, the robotic arm rotates around the first axis to update the position and posture of the robotic arm, and continues to determine the target stiffness of the robotic arm for the target bone channel based on the updated position and posture of the robotic arm; if the electronic device determines that the target stiffness of the robotic arm meets the drilling stiffness condition, the robotic arm is controlled to move to the current trajectory point according to the planned trajectory to start drilling the target bone channel, otherwise, the robotic arm is continued to be controlled to rotate around the first axis, and the stiffness is recalculated until the re-determined stiffness meets the drilling stiffness condition, and the robotic arm is controlled to move to the current trajectory point according to the planned trajectory to start drilling the target bone channel.
[0087] Optionally, the planning stiffness of the manipulator to the target bone channel is expressed as {S x ,S y ,S z ,S Rx ,S Ry ,S Rz}. Among them, S x It refers to the stiffness evaluation index of the position component of the planning stiffness on the second axis (x axis), S y It refers to the stiffness evaluation index of the position component of the planned stiffness on the first axis (y axis), S z It refers to the stiffness evaluation index of the position component of the planning stiffness on the third axis (z axis), S Rx It refers to the stiffness evaluation index of the rotational component of the planning stiffness on the second axis (x axis), S Ry It refers to the stiffness evaluation index of the rotational component of the planned stiffness on the first axis (y axis), S Rz It refers to the stiffness evaluation index of the rotational component of the planned stiffness on the second axis (z axis). x , S z , S Rx , S Rz Any one of them is less than the stiffness threshold (S T ), it is determined that the robotic arm meets the punching stiffness conditions.
[0088] Among them, the stiffness threshold (S T ) can be determined based on experience.
[0089] In this way, before using the robotic arm to drill the target bone tunnel, if the planned stiffness of the robotic arm for the target bone tunnel does not meet the drilling stiffness condition, the robotic arm is controlled to rotate around the first axis to ensure that the stiffness of the robotic arm during the drilling process is large enough.
[0090] The present disclosure also provides a punching control device for implementing the above-mentioned punching control method. The device is configured to Figure 1 In the electronic device corresponding to the robotic arm shown. Figure 1 As shown, the end effector 100 of the robot arm is equipped with an external shaft 110. In the embodiment of the present disclosure, the punching control device can be an electronic device. The electronic device can include a tablet computer, a desktop computer, a laptop computer and other devices with communication functions, and can also include a virtual machine or a simulator simulated device. Figure 3 Provide explanation.
[0091] Figure 3 A schematic structural diagram of a punching control device provided in an embodiment of the present disclosure is shown.
[0092] like Figure 3 As shown, the punching control device 300 may include:
[0093] A first determination module 310 is used to determine whether the bone density of the current bone tunnel point corresponding to the current track point on the target bone tunnel is greater than a first density threshold when the robot arm moves to the current track point according to the planned track, wherein the first density threshold is greater than the average bone density of the target bone tunnel;
[0094] A second determination module 320, configured to determine that the current bone tunnel point is a first-density bone point if the bone density of the current bone tunnel point is greater than the first density threshold;
[0095] The drilling control module 330 is used to control the external axis of the end effector on the robot arm to drill the first density bone point.
[0096] A drilling control device according to an embodiment of the present disclosure is configured on an electronic device corresponding to a robotic arm, and an external shaft is installed on the end effector of the robotic arm. The method includes: when the robotic arm moves to the current trajectory point according to the planned trajectory, determining whether the bone density of the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is greater than a first density threshold, wherein the first density threshold is greater than the average bone density of the target bone tunnel; if the bone density of the current bone tunnel point is greater than the first density threshold, determining the current bone tunnel point as a first-density bone point; and controlling the external shaft of the end effector on the robotic arm to drill the first-density bone point. In this way, drilling of bone tunnel points with higher density can be achieved by only installing an external shaft on the end effector of the robotic arm, without relying on a large-sized robotic arm, thereby avoiding the problem of torque overrun. At the same time, the robotic arm is prevented from being directly subjected to large vibrations, thereby increasing the service life of the robotic arm.
[0097] In some embodiments of the present disclosure, the first determination module 310 includes:
[0098] A first determining unit, configured to determine a bone position region to which the current bone tunnel point belongs on the target bone tunnel;
[0099] A second determination unit is used to determine that the bone density of the current bone tunnel point is greater than the first density threshold if the bone density of the bone position area is greater than the first density threshold, wherein the bone position area included in the target bone tunnel and the bone density corresponding to the bone position area are determined by performing image segmentation on a scanned image of the target bone tunnel in advance.
[0100] In some embodiments of the present disclosure, the first determination module 310 includes:
[0101] A first acquisition unit, used for acquiring the force applied to the robotic arm at the current bone channel point;
[0102] a third determination unit, configured to perform frequency domain analysis on the force to determine a ratio of a sum of first frequency amplitudes of the force to a sum of total frequency amplitudes, wherein the sum of the first frequency amplitudes is a sum of a plurality of first frequency amplitudes, and any of the first frequency amplitudes is greater than an average value of the sum of the total frequency amplitudes;
[0103] The fourth determining unit is configured to determine that the bone density of the current bone tunnel point is greater than the first density threshold if the ratio is greater than a preset ratio.
[0104] In some embodiments of the present disclosure, the device further includes:
[0105] a judgment module, configured to judge whether the bone density of the current bone tunnel point is less than a second density threshold if the bone density of the current bone tunnel point is less than the first density threshold;
[0106] a third determination module, configured to determine the current bone tunnel point as a second density bone point if the bone density of the current bone tunnel point is less than the second density threshold, wherein the second density threshold is less than an average bone density inside the target bone tunnel, or the second density threshold is less than an average bone density outside the target bone tunnel;
[0107] The first control module is used to control the end effector of the robotic arm to punch the second density bone point.
[0108] In some embodiments of the present disclosure, the base of the robotic arm is installed with a first axis, a second axis and a third axis; the first axis is the rotation axis of the robotic arm, and the second axis and the third axis are the translation axes of the robotic arm.
[0109] In some embodiments of the present disclosure, the device further includes:
[0110] A fourth determination module, configured to determine whether the robotic arm at the current trajectory point satisfies a reachability condition for the current bone channel point based on the planned posture of the robotic arm at the current trajectory point;
[0111] A second control module is configured to control the robotic arm to translate along the second axis and / or the third axis if the robotic arm does not meet the accessibility condition for the current bone tunnel point at the current trajectory point, so that the planned posture of the robotic arm at the current trajectory point is adjusted to the first target posture;
[0112] The third control module is used for controlling the robotic arm to move to the current trajectory point according to the planned trajectory if it is determined based on the first target posture that the robotic arm satisfies the reachability condition for the current bone channel point at the current trajectory point; otherwise, continuing to control the robotic arm to translate along the second axis and / or the third axis until it is determined based on the updated target posture of the robotic arm at the current trajectory point that the robotic arm satisfies the reachability condition for the current bone channel point at the current trajectory point.
[0113] In some embodiments of the present disclosure, the device further includes:
[0114] A fifth determination module, configured to determine a singularity degree of the robotic arm at the current trajectory point based on a planned posture of the robotic arm at the current trajectory point;
[0115] a fourth control module, for controlling the mechanical arm to rotate around the first axis, and / or controlling the mechanical arm to translate along the second axis, and / or controlling the mechanical arm to translate along the third axis, if it is determined based on the singularity degree that the mechanical arm satisfies the singularity region moving-out condition at the current trajectory point, so that the planned posture of the mechanical arm at the current trajectory point is adjusted to a second target posture;
[0116] a fifth control module, configured to control the robotic arm to move out of the singular area corresponding to the current trajectory point based on the second target posture, and to adjust the step length of the planned trajectory;
[0117] The sixth control module is used to control the robot arm that has moved out of the singular area to move to the current trajectory point according to the planned trajectory after the step size is adjusted.
[0118] In some embodiments of the present disclosure, the device further includes:
[0119] a sixth determination module, configured to determine a planned stiffness of the robotic arm for the target bone tunnel based on a planned posture of the robotic arm at the current trajectory point;
[0120] a sixth control module, configured to control the robotic arm to rotate about the first axis if the planned stiffness of the robotic arm for the target bone tunnel does not meet the drilling stiffness condition, so that the planned posture of the robotic arm at the current trajectory point is adjusted to a third target posture;
[0121] a seventh determination module, configured to determine a target stiffness of the robotic arm relative to the target bone tunnel based on the third target posture;
[0122] The seventh control module is used to control the robot arm to move to the current trajectory point according to the planned trajectory if the target stiffness meets the punching stiffness condition; otherwise, control the robot arm to continue rotating around the first axis and recalculate the stiffness until the re-determined stiffness meets the punching stiffness condition.
[0123] It should be noted that Figure 3 The punch control device 300 shown can perform Figure 2 The various steps in the method embodiment shown in the figure are implemented Figure 2 The various processes and effects in the method embodiment shown are not described in detail here.
[0124] Figure 4 A schematic structural diagram of an electronic device provided by an embodiment of the present disclosure is shown.
[0125] like Figure 4 As shown, the electronic device may include a processor 401 and a memory 402 storing computer program instructions.
[0126] Specifically, the processor 401 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.
[0127] The memory 402 may include a large capacity memory for information or instructions. By way of example and not limitation, the memory 402 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a tape, or a universal serial bus (USB) drive or a combination of two or more of these. Where appropriate, the memory 402 may include a removable or non-removable (or fixed) medium. Where appropriate, the memory 402 may be inside or outside the integrated gateway device. In a particular embodiment, the memory 402 is a non-volatile solid-state memory. In a particular embodiment, the memory 402 includes a read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (Electrically Erasable Programmable ROM, EEPROM), an electrically rewritable ROM (EAROM) or a flash memory, or a combination of two or more of these.
[0128] The processor 401 reads and executes the computer program instructions stored in the memory 402 to perform the steps of the punching control method provided in the embodiment of the present disclosure.
[0129] In one example, the electronic device may further include a transceiver 403 and a bus 404. Figure 4 As shown, the processor 401, the memory 402 and the transceiver 403 are connected via a bus 404 and communicate with each other.
[0130] The bus 404 includes hardware, software, or both. For example, but not limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industrial Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a Memory bus, a MicroChannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or other suitable buses or a combination of two or more of these. Where appropriate, the bus 404 may include one or more buses. Although embodiments of the present application describe and illustrate a particular bus, the present application contemplates any suitable bus or interconnect.
[0131] The following is an embodiment of a computer-readable storage medium provided in an embodiment of the present disclosure. The computer-readable storage medium and the punching control method of the above-mentioned embodiments belong to the same inventive concept. For details not described in detail in the embodiment of the computer-readable storage medium, please refer to the embodiment of the above-mentioned punching control method.
[0132] This embodiment provides a storage medium containing computer executable instructions. When the computer executable instructions are executed by a computer processor, they are used to execute a punching control method. The method is applied to an electronic device corresponding to a robot arm, and the end effector of the robot arm is equipped with an external axis. The method includes:
[0133] When the robot arm moves to the current trajectory point according to the planned trajectory, determining whether the bone density of the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is greater than a first density threshold, wherein the first density threshold is greater than the average bone density of the target bone tunnel;
[0134] If the bone density of the current bone tunnel point is greater than the first density threshold, determining the current bone tunnel point as a first density bone point;
[0135] The external axis of the end effector on the robot arm is controlled to punch a hole in the first density bone point.
[0136] Of course, the storage medium containing computer executable instructions provided by the embodiment of the present disclosure, whose computer executable instructions are not limited to the above method operations, can also execute related operations in the punching control method provided by any embodiment of the present disclosure.
[0137] Through the above description of the implementation methods, the technicians in the relevant field can clearly understand that the present disclosure can be implemented by means of software and necessary general hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present disclosure can be essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions for a computer cloud platform (which can be a personal computer, a server, or a network cloud platform, etc.) to execute the punching control method provided by each embodiment of the present disclosure.
[0138] Note that the above are only preferred embodiments of the present disclosure and the technical principles used. Those skilled in the art will understand that the present disclosure is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present disclosure. Therefore, although the present disclosure is described in more detail through the above embodiments, the present disclosure is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present disclosure, and the scope of the present disclosure is determined by the scope of the appended claims.
Claims
1. A punching control method, characterized in that: Applied to an electronic device corresponding to a robotic arm, the end effector of the robotic arm is equipped with an external axis, and the method comprises: When the robot arm moves to the current trajectory point according to the planned trajectory, determining whether the bone density of the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is greater than a first density threshold, wherein the first density threshold is greater than the average bone density of the target bone tunnel; If the bone density of the current bone tunnel point is greater than the first density threshold, determining the current bone tunnel point as a first density bone point; The external axis of the end effector on the robot arm is controlled to punch a hole in the first density bone point.
2. The method according to claim 1, characterized in that The determining whether the bone density of the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is greater than a first density threshold includes: Determine the bone position area to which the current bone tunnel point belongs on the target bone tunnel; If the bone density of the bone position area is greater than the first density threshold, it is determined that the bone density of the current bone tunnel point is greater than the first density threshold, wherein the bone position area included in the target bone tunnel and the bone density corresponding to the bone position area are determined by pre-segmenting the scanned image of the target bone tunnel.
3. The method according to claim 1, characterized in that The determining whether the bone density of the current bone tunnel point corresponding to the current trajectory point on the target bone tunnel is greater than a first density threshold includes: Obtaining the force applied to the robotic arm at the current bone tunnel point; Performing frequency domain analysis on the force to determine a ratio of a sum of first frequency amplitudes of the force to a sum of total frequency amplitudes, wherein the sum of the first frequency amplitudes is a sum of a plurality of first frequency amplitudes, and any of the first frequency amplitudes is greater than an average value of the sum of the total frequency amplitudes; If the ratio is greater than a preset ratio, it is determined that the bone density of the current bone tunnel point is greater than the first density threshold.
4. The method according to claim 1, characterized in that: Also includes: If the bone density of the current bone tunnel point is less than the first density threshold, determining whether the bone density of the current bone tunnel point is less than a second density threshold; If the bone density of the current bone tunnel point is less than the second density threshold, the current bone tunnel point is determined to be a second density bone point, wherein the second density threshold is less than the average bone density inside the target bone tunnel, or the second density threshold is less than the average bone density outside the target bone tunnel; The end effector of the robotic arm is controlled to punch a hole in the second-density bone point.
5. The method according to claim 1, characterized in that The base of the robotic arm is installed with a first axis, a second axis and a third axis; the first axis is the rotation axis of the robotic arm, and the second axis and the third axis are the translation axes of the robotic arm.
6. The method according to claim 5, characterized in that Also includes: Based on the planned position of the robotic arm at the current trajectory point, determining whether the robotic arm at the current trajectory point meets the accessibility condition for the current bone channel point; If the robotic arm does not meet the accessibility condition for the current bone tunnel point at the current trajectory point, control the robotic arm to translate along the second axis and / or the third axis, so that the planned posture of the robotic arm at the current trajectory point is adjusted to the first target posture; If it is determined based on the first target posture that the robotic arm satisfies the reachability condition for the current bone channel point at the current trajectory point, the robotic arm is controlled to move to the current trajectory point according to the planned trajectory; otherwise, the robotic arm continues to be controlled to translate along the second axis and / or the third axis until it is determined based on the updated target posture of the robotic arm at the current trajectory point that the robotic arm satisfies the reachability condition for the current bone channel point at the current trajectory point.
7. The method according to claim 5, characterized in that Also includes: Determining the singularity of the robotic arm at the current trajectory point based on the planned posture of the robotic arm at the current trajectory point; If it is determined based on the singularity degree that the robotic arm satisfies the singularity region exit condition at the current trajectory point, controlling the robotic arm to rotate around the first axis, and / or controlling the robotic arm to translate along the second axis, and / or controlling the robotic arm to translate along the third axis, so that the planned posture of the robotic arm at the current trajectory point is adjusted to the second target posture; Controlling the robotic arm to move out of the singular area corresponding to the current trajectory point based on the second target posture, and adjusting the step length of the planned trajectory; The robot arm that has moved out of the singular area is controlled to move to the current trajectory point according to the planned trajectory after the step size is adjusted.
8. The method according to claim 5, characterized in that Also includes: Determining a planned stiffness of the robotic arm with respect to the target bone tunnel based on a planned posture of the robotic arm at the current trajectory point; If the planned stiffness of the robotic arm for the target bone tunnel does not meet the drilling stiffness condition, controlling the robotic arm to rotate around the first axis so that the planned posture of the robotic arm at the current trajectory point is adjusted to a third target posture; Determining a target stiffness of the robotic arm relative to the target bone tunnel based on the third target posture; If the target stiffness meets the drilling stiffness condition, the robotic arm is controlled to move to the current trajectory point according to the planned trajectory; otherwise, the robotic arm is controlled to continue rotating around the first axis and the stiffness is recalculated until the re-determined stiffness meets the drilling stiffness condition.
9. A punching control device, characterized in that: An electronic device is configured to correspond to a mechanical arm, wherein the end effector of the mechanical arm is provided with an external axis, and the device comprises: A first determination module is used to determine whether the bone density of the current bone tunnel point corresponding to the current track point on the target bone tunnel is greater than a first density threshold when the robot arm moves to the current track point according to the planned track, wherein the first density threshold is greater than the average bone density of the target bone tunnel; A second determination module, configured to determine that the current bone tunnel point is a first-density bone point if the bone density of the current bone tunnel point is greater than the first density threshold; The drilling control module is used to control the external axis of the end effector on the robot arm to drill the first density bone point.
10. An electronic device, characterized in that: include: processor; A memory for storing executable instructions; The processor is used to read the executable instructions from the memory and execute the executable instructions to implement the method described in any one of claims 1 to 8.
11. A robotic arm, characterized in that: include: A base and an end effector; wherein, The end effector is mounted with an external shaft; The base is installed with a first axis, a second axis and a third axis; the direction of the first axis is consistent with the flange direction of the robotic arm, the flange direction is consistent with the bone channel direction of the target bone channel to be punched, and the second axis and the third axis are both perpendicular to the first axis.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Active collision avoidance system and method for robot
CN113370210A
Machine control method and device, surgical robot and readable storage medium
CN113855249A
Readable storage medium, surgical robot system, and adjustment system
CN115429432A
Visual servo correction-based force-position hybrid control method and device
CN118177964A
Drilling control method, device and system and electronic equipment
CN118267040A
