Control method and apparatus of slave end surgical arm of surgical robot and medium

By acquiring the motion information of the master hand and inverse kinematics, and using preset unlocking logic to unlock the arm joint of the slave surgical arm, the problem of long unlocking time in the prior art is solved, thus improving surgical efficiency and safety.

WO2024239600A1PCT designated stage expired Publication Date: 2024-11-28HARBIN SIZHERUI INTELLIGENT MEDICAL EQUIP CO LTD

Patent Information

Application Number
PCT/CN2023/137445
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-19
Filing Date
2023-12-08
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

In existing technologies, when the slave surgical arm of a split surgical robot moves beyond a preset limit, the master-slave connection needs to be disconnected for unlocking, resulting in a long unlocking time and affecting surgical efficiency and safety.

Method used

By acquiring the motion information of the master hand at the master end of the surgical robot, the command pose of the slave surgical arm is determined, and the locked arm joint is unlocked based on the inverse kinematics solution and the preset unlocking logic, thus restoring control over the unlocked arm joint.

Benefits of technology

It enables rapid and safe unlocking of the arm joint of the distal surgical arm, simplifying the unlocking process and improving unlocking efficiency and safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2023137445_28112024_PF_FP_ABST
    Figure CN2023137445_28112024_PF_FP_ABST
Patent Text Reader

Abstract

A control method and apparatus of a slave end surgical arm of a surgical robot and a medium. The control method comprises: in a case where at least one arm joint of a slave end surgical arm of a surgical robot is locked, acquiring master hand motion information of a master end of the surgical robot, and determining an instruction pose of the slave end surgical arm on the basis of the master hand motion information (S110); determining a preset unlocking logic corresponding to the locked arm joint, and unlocking the locked arm joint on the basis of an inverse kinematic result of the instruction pose of the slave end surgical arm and the preset unlocking logic (S120); and in a case where the locked arm joint has been unlocked, restoring control over the unlocked arm joint (S130).
Need to check novelty before this filing date? Find Prior Art

Description

Control method, device and medium for surgical robot slave surgical arm

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 19, 2023, with application number 202310568413.9. The entire contents of the above application are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of medical robots, for example, to a control method, device and medium for a surgical robot's slave surgical arm. Background Art

[0003] Each slave surgical arm of a split surgical robot has a movable base, allowing it to move according to control commands from the master console. When the slave arm's movement exceeds a preset limit, it triggers a protective lock, affecting the normal operation and requiring the arm to be unlocked. Related technologies often require disconnecting the master console from the slave arm and moving the slave arm to release the protective lock.

[0004] The above unlocking method cannot directly and quickly unlock the locked slave surgical arm. It is necessary to disconnect the connection between the master and slave ends, and unlocking takes a long time, which greatly affects the efficiency and safety of the operation.

[0005] Summary of the Invention

[0006] The present application provides a control method, device and medium for a slave surgical arm of a surgical robot to optimize the unlocking method of the slave surgical arm.

[0007] The present application provides a method for controlling a surgical arm of a surgical robot slave end, comprising:

[0008] When at least one arm joint of a slave-end surgical arm of the surgical robot is locked, obtaining master hand motion information of the master-end surgical robot, and determining a command posture of the slave-end surgical arm based on the master hand motion information;

[0009] Determining a preset unlocking logic corresponding to the locked arm joint, and unlocking the locked arm joint based on an inverse kinematic solution result of the commanded posture of the slave surgical arm and the preset unlocking logic;

[0010] When the locked arm joint is unlocked, the control of the unlocked arm joint is restored.

[0011] The present application also provides a control device for a surgical robot slave-end surgical arm, comprising:

[0012] a master hand motion analysis module configured to obtain master hand motion information of the master end of the surgical robot when at least one arm joint of the slave end surgical arm of the surgical robot is locked, and determine a command posture of the slave end surgical arm based on the master hand motion information;

[0013] an arm joint unlocking module, configured to determine a preset unlocking logic corresponding to a locked arm joint, and unlock the locked arm joint based on a kinematic inverse solution result of the commanded posture of the slave surgical arm and the preset unlocking logic;

[0014] The arm joint control module is configured to restore control of the unlocked arm joint when the locked arm joint is unlocked.

[0015] The present application also provides an electronic device, comprising:

[0016] at least one processor; and

[0017] A memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the method for controlling the surgical arm of the surgical robot from any embodiment of the present application.

[0018] The present application also provides a computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a processor to implement the control method of the surgical robot slave end surgical arm described in any embodiment of the present application when executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] FIG1 is a flow chart of a method for controlling a slave surgical arm of a surgical robot provided in an embodiment of the present application;

[0020] FIG2 is a flow chart of another method for controlling a slave surgical arm of a surgical robot provided in an embodiment of the present application;

[0021] FIG3 is a flow chart of another method for controlling a slave surgical arm of a surgical robot provided in an embodiment of the present application;

[0022] FIG4 is a schematic structural diagram of a control device for a slave surgical arm of a surgical robot provided in an embodiment of the present application;

[0023] FIG5 shows a schematic structural diagram of an electronic device that can be used to implement the embodiments of the present application. DETAILED DESCRIPTION

[0024] The terms "first", "second" etc. of the present application are used to distinguish similar features, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable in appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, in addition to comprising the process, method, system, product or equipment of a series of steps or units shown in the embodiments of the present application, other processes, methods, systems, products or equipment of this series of steps or units not clearly listed may also be included, or other steps or units inherent to these processes, methods, systems, products or equipment.

[0025] FIG1 is a flow chart of a method for controlling a slave surgical arm of a surgical robot provided by an embodiment of the present application. This embodiment is applicable to unlocking a locked slave surgical arm of a surgical robot. The method can be executed by a control device of the slave surgical arm of the surgical robot. The control device of the slave surgical arm of the surgical robot can be implemented in the form of hardware and / or software. The control device of the slave surgical arm of the surgical robot can be configured in the surgical robot. As shown in FIG1 , the method includes:

[0026] S110. When at least one arm joint of the surgical arm of the slave end of the surgical robot is locked, obtain the master hand motion information of the surgical robot master end, and determine the command posture of the surgical arm of the slave end of the surgical robot based on the master hand motion information.

[0027] Surgical robots can perform surgical operations by operating machines. Surgical robots include at least one of laparoscopic surgical robots, orthopedic surgical robots, panvascular surgical robots, and natural orifice surgical robots.

[0028] The slave surgical arm is the arm in a separate surgical robot that moves to perform surgery. The master surgical arm is the console that operates the robot. A separate surgical robot consists of a master and slave surgical arms. The user operating the robot observes the surgical process through the master arm and inputs surgical instructions. The slave surgical arm receives these instructions and then performs the surgery according to them.

[0029] Master hand motion information can be used to control the movement of the surgical robot's master hand. The surgical robot can process the control instructions corresponding to the master hand motion information to obtain the command position and posture for controlling the slave surgical arm. In a split surgical robot, the master end of the surgical robot is typically equipped with at least one master hand for operation. The user can control the movement of the slave surgical arm of the surgical robot by operating the master hand. The surgical robot's control system processes the control instructions corresponding to the master hand motion information to obtain the command position and posture for controlling the slave surgical arm, thereby enabling the master hand to control the slave surgical arm.

[0030] The arm joint may be a movable joint in the slave surgical arm. The arm joint may be a component of the surgical robot other than surgical instruments that is used to perform surgical actions. Optionally, when the split surgical robot performs surgery, when the medical staff manipulates the movement of the slave surgical arm to exceed the software limit of the arm joint of the current slave surgical arm, in order to protect the surgical robot, the arm joint of the slave surgical arm will trigger a protective lock, locking the arm joint of the slave surgical arm, so that the arm joint of the current slave surgical arm cannot continue to move, and the slave surgical arm cannot correctly reproduce the operating instructions of the master end, which leads to a mismatch between the master and slave end postures of the surgical robot. Therefore, it is necessary to unlock the arm joint of the protectively locked slave surgical arm.

[0031] The mismatch between the master and slave poses of the surgical robot results in at least one arm joint of the slave arm being locked. When at least one arm joint of the slave arm is locked, the surgical robot actively acquires master hand motion information and determines a command pose for the slave arm based on the master hand motion information.

[0032] S120: Determine a preset unlocking logic corresponding to the locked arm joint, and unlock the locked arm joint based on a kinematic inverse solution result of the command posture of the slave surgical arm and the preset unlocking logic.

[0033] The preset unlocking logic may be a logic that is pre-set to unlock the arm joint of the slave surgical arm. When the arm joint of the slave surgical arm of the surgical robot is locked, it may cause other arm joints of the same slave surgical arm to trigger protective locking. In order to unlock the currently locked arm joint when it is necessary, the preset unlocking logic corresponding to the current arm joint may be obtained first to determine whether the current arm joint can be unlocked. Exemplarily, the preset unlocking logic includes independent unlocking of a single arm joint and linkage unlocking of multiple arm joints. Among them, independent unlocking of a single arm joint may be unlocking for a single arm joint, and linkage unlocking of multiple arm joints may be unlocking for multiple arm joints that have a linkage unlocking relationship. Optionally, the method of unlocking multiple arm joints that have a linkage unlocking relationship may be to unlock them according to a preset unlocking priority, or to unlock multiple arm joints that have a linkage unlocking relationship together.

[0034] Optionally, in the main end of the surgical robot, a corresponding preset unlocking logic will be pre-set for each arm joint of the surgical arm of the slave end, and the arm joint and the corresponding preset unlocking logic will be stored accordingly. After obtaining the locked arm joint, the preset unlocking logic corresponding to the arm joint can be directly obtained.

[0035] The inverse kinematics solution can be a method of solving the positions of different motion joints of the robot based on the end posture of the robot.

[0036] The inverse kinematic solution result may be the arm joint adjustment parameters obtained by converting the master hand motion information of the surgical robot master into the commanded position of the slave surgical arm and then performing an inverse kinematic solution on the commanded position of the slave surgical arm. The arm joint adjustment parameters may include, but are not limited to, the arm joint angle and / or the movement distance of the arm joint along a preset direction.

[0037] In a surgical robot including a master and a slave, the surgical robot operates the slave surgical arm through the master hand. The surgical robot processes the master hand motion information according to the control system according to the control instruction to obtain the command posture of the slave surgical arm. The slave surgical arm moves according to the command posture, and then the command posture of the slave surgical arm can be inversely kinematically solved, and the condition of the arm joint of the slave surgical arm can be known based on the result of the inverse kinematic solution.

[0038] Obtain the locked arm joint, determine the preset unlocking logic corresponding to the locked arm joint, obtain the kinematic inverse solution result obtained after performing kinematic inverse solution on the command posture of the slave surgical arm of the surgical robot, and unlock the arm joint based on the kinematic inverse solution result and the preset unlocking logic of the arm joint.

[0039] Optionally, in another optional embodiment of the present application, determining the preset unlocking logic corresponding to the locked arm joint includes: determining a locking triggering mode of the locked arm joint, and determining the preset unlocking logic based on the locking triggering mode.

[0040] The locking triggering mode may be a protective locking triggering mode for protecting the arm joint. Optionally, the locking triggering mode may include arm joints individually triggering protective locking and arm joint associated locking. Arm joints individually triggering protective locking may be a protective locking triggered when the movement of the arm joint exceeds the software limit. Arm joint associated locking may be due to the locking of other associated arm joints, resulting in the performance of the device being reduced in some slave surgical arm positions, thereby locking all associated arm joints. Exemplarily, in the slave surgical arm, when the upper limit of the arm rotation mechanism, parallelogram mechanism and slide mechanism triggers protective locking, all joints are locked to ensure surgical safety. When the slide exceeds the lower limit of the joint, that is, when the protective locking is triggered at the lower limit of the slide, only the slide is locked, and the remaining joints except the slide can be controlled normally without being locked. In any of the above cases, the opening and closing angles of the instrument clamp are directly controlled by the opening and closing angles of the master hand clamp.

[0041] The locked arm joint is obtained, a locking triggering mode of the arm joint is determined, and a preset unlocking logic corresponding to the locked arm joint is determined according to the locking triggering mode of the arm joint.

[0042] Optionally, in another optional embodiment of the present application, the arm joint includes at least one of an arm rotation mechanism, a parallelogram mechanism and a sliding mechanism; the arm joint limit includes at least one of an upper limit of the arm joint and a lower limit of the arm joint; the locking triggering method includes: the movement intention of the arm rotation mechanism exceeds the upper limit of the arm rotation mechanism, the movement intention of the arm rotation mechanism exceeds the lower limit of the arm rotation mechanism, the movement intention of the parallelogram mechanism exceeds the upper limit of the parallelogram mechanism, the movement intention of the parallelogram mechanism exceeds the lower limit of the parallelogram mechanism, the movement intention of the sliding mechanism exceeds the upper limit of the sliding mechanism and the movement intention of the sliding mechanism exceeds at least one of the lower limit of the sliding mechanism.

[0043] S130: When the locked arm joint is unlocked, restore control of the unlocked arm joint.

[0044] In the slave surgical arm, when the arm joint has been unlocked, the control of the unlocked arm joint by the surgical robot master can be restored, and the unlocked arm joint can be operated by the surgical robot master.

[0045] Optionally, in another optional embodiment of the present application, the control method of the slave-end surgical arm of the surgical robot further includes: when the slave-end surgical arm of the surgical robot has been locked, in response to the opening and closing control instructions input by the master end of the surgical robot for the clamping mechanism, performing an opening and closing action corresponding to the opening and closing control instructions.

[0046] The clamping mechanism can be a mechanism located at the end of the slave surgical arm and capable of opening and closing for surgical purposes. It is understood that the clamping mechanism can have functions such as clamping, expanding, and shearing. For example, the clamping mechanism can be a surgical instrument clamp, a vascular opener, or surgical scissors.

[0047] In the surgical robot, the clamping mechanism is located at the end of the slave surgical arm. When the slave surgical arm of the surgical robot has been locked, the clamping mechanism is not locked. When the slave surgical arm is locked, it does not affect the clamping mechanism from executing the operating instructions of the master end of the surgical robot. Therefore, the clamping mechanism can respond to the opening and closing control instructions input by the master end of the surgical robot to the clamping mechanism, and perform the opening and closing actions corresponding to the opening and closing control instructions.

[0048] Optionally, in another optional embodiment of the present application, the control method of the slave surgical arm of the surgical robot further includes: when the slave surgical arm of the surgical robot has been locked, generating locking prompt information for prompting that the slave surgical arm has been locked, and / or unlocking guide information for guiding the user to unlock the slave surgical arm.

[0049] The lock prompt information is a notification to the user that the surgical robot's slave surgical arm is locked. The lock prompt information may include at least one of a voice announcement, a device indicator light, and an operation instruction animation. For example, the voice announcement may include a "surgical arm locked" prompt or a "beep" sound; the device indicator light may display a green light or no light when the slave surgical arm is unlocked, and a red light when the slave surgical arm is locked; and the operation instruction animation may include an animation showing that the slave surgical arm cannot be operated.

[0050] The unlocking guidance information can be used to provide guidance information for prompting the user on how to unlock the device. For example, when the slave surgical arm is locked, the master end of the surgical robot displays guidance information for unlocking the device.

[0051] When the slave surgical arm used by the user has been locked, the master end of the surgical robot generates locking prompt information to prompt that the slave surgical arm has been locked, and / or unlocking guide information to guide the user to unlock the slave surgical arm.

[0052] The technical solution of the embodiment of the present application is to obtain the master hand motion information of the master end of the surgical robot when at least one arm joint of the slave end surgical arm of the surgical robot is locked, and determine the command position of the slave end surgical arm based on the master hand motion information to achieve master-slave control; determine the preset unlocking logic corresponding to the locked arm joint, unlock the locked arm joint based on the kinematic inverse solution result of the command position of the slave end surgical arm and the preset unlocking logic, determine the motion state of the arm joint according to the kinematic inverse solution result, unlock the arm joint that meets the unlocking condition, realize step-by-step unlocking of the arm joint, and can implement different unlocking logics for different arm joints, simplify the unlocking steps, and improve the unlocking efficiency; when the locked arm joint has been unlocked, restore control of the unlocked arm joint. The solution of the present application unlocks the arm joint of the slave end surgical arm based on the master hand motion information and the preset unlocking logic, simplifies the difficulty of unlocking the arm joint of the slave end surgical arm, and improves the unlocking safety of the arm joint of the slave end surgical arm.

[0053] Figure 2 is a flow chart of another method for controlling a surgical robot's slave arm according to an embodiment of the present application. This embodiment illustrates a method for independently unlocking a single arm joint. As shown in Figure 2, the method for controlling a surgical robot's slave arm includes:

[0054] S210. When at least one arm joint of the slave-end surgical arm of the surgical robot is locked, obtain master hand motion information of the master-end surgical robot, and determine the command posture of the slave-end surgical arm based on the master hand motion information.

[0055] S220. For the locked arm joint to be unlocked, determine whether the movement intention of the arm joint to be unlocked exceeds the arm joint limit corresponding to the arm joint to be unlocked based on the kinematic inverse solution result of the command posture of the slave surgical arm.

[0056] The movement intention may be the arm joint position that the arm joint will move to. The arm joint limit may be the position where the arm joint triggers protective locking.

[0057] Optionally, if the arm joint of the slave surgical arm is locked, the individual arm joints are determined to determine whether they meet the unlocking conditions. If so, they can be unlocked independently. This allows for step-by-step unlocking of locked arm joints. The unlocking condition can be that the intended movement of the arm joint does not exceed the arm joint limit.

[0058] Determine the arm joint to be unlocked, obtain the motion intention of the arm joint based on the kinematic inverse solution result of the command posture of the surgical arm at the slave end, and determine whether the motion intention of the arm joint exceeds the arm joint limit corresponding to the arm joint.

[0059] S230. Unlock the arm joint to be unlocked if the preset unlocking logic corresponding to the arm joint to be unlocked is independent unlocking of a single arm joint and the movement intention of the arm joint to be unlocked does not exceed the arm joint limit.

[0060] Determine the arm joint to be unlocked, obtain the motion intention of the arm joint based on the kinematic inverse solution result of the command posture of the surgical arm at the slave end, determine whether the motion intention of the arm joint exceeds the arm joint limit corresponding to the arm joint, if the motion intention of the arm joint does not exceed the arm joint limit corresponding to the arm joint, determine whether the preset unlocking logic corresponding to the arm joint is independent unlocking of a single arm joint, if the preset unlocking logic corresponding to the arm joint is independent unlocking of a single arm joint, unlock the arm joint.

[0061] Optionally, if the movement intention of the arm joint exceeds the arm joint limit corresponding to the arm joint, the arm joint continues to be locked; if the movement intention of the arm joint does not exceed the arm joint limit corresponding to the arm joint, and the preset unlocking logic corresponding to the arm joint is not for independent unlocking of a single arm joint, the arm joint continues to be locked.

[0062] S240: When the locked arm joint is unlocked, restore control of the unlocked arm joint.

[0063] In the embodiment of the present application, optionally, if the movement intention of the slide mechanism exceeds the lower limit of the slide to trigger the slide mechanism lock, the slide mechanism can be unlocked independently.

[0064] The technical solution of the embodiment of the present application is to obtain the master hand motion information of the master end of the surgical robot when at least one arm joint of the slave end surgical arm of the surgical robot is locked, and determine the command posture of the slave end surgical arm based on the master hand motion information to realize master-slave control; for the locked arm joint to be unlocked, determine whether the motion intention of the arm joint to be unlocked exceeds the arm joint limit corresponding to the arm joint to be unlocked based on the kinematic inverse solution result of the command posture of the slave end surgical arm; judge each arm joint separately to improve the unlocking efficiency, and unlock the arm joint to be unlocked when the preset unlocking logic corresponding to the arm joint to be unlocked is independent unlocking of a single arm joint and the motion intention of the arm joint to be unlocked does not exceed the arm joint limit, thereby realizing step-by-step rapid unlocking of the arm joint, and restoring control of the unlocked arm joint when the locked arm joint has been unlocked.

[0065] FIG3 is a flow chart of another method for controlling a surgical robot's slave arm according to an embodiment of the present application. This embodiment illustrates a method for unlocking multiple linkage arm joints that are in a linkage unlocking relationship. As shown in FIG3 , the method for controlling a surgical robot's slave arm includes:

[0066] S310. When at least one arm joint of the slave-end surgical arm of the surgical robot is locked, obtain master hand motion information of the master-end surgical robot, and determine the command posture of the slave-end surgical arm based on the master hand motion information.

[0067] S320. For the arm joint to be unlocked, the locked arm joint to be unlocked is taken as the first arm joint. When the preset unlocking logic corresponding to the first arm joint is the linkage unlocking of multiple arm joints, the second arm joint that has a linkage unlocking relationship with the first arm joint is determined based on the preset unlocking logic.

[0068] The first arm joint can be any arm joint to be unlocked; the second arm joint can be multiple arm joints that have a linkage unlocking relationship with the first arm joint. Select any arm joint in the locked slave surgical arm as the first arm joint, determine the other arm joints that have a linkage unlocking relationship with the first arm joint, and use the other arm joints that have a linkage unlocking relationship as the second arm joint. Exemplarily, when the upper limit of the arm rotation mechanism, parallelogram mechanism and slide mechanism of the slave surgical arm triggers the protective lock, the arm rotation mechanism is selected as the first arm joint, and the parallelogram mechanism and slide mechanism that have a linkage unlocking relationship with the arm rotation mechanism are used as the second arm joint.

[0069] Optionally, the preset unlocking logic includes the linkage unlocking of multiple arm joints. In the slave surgical arm of the surgical robot, the slave surgical arm receives the manipulation command issued by the surgical robot, and according to the manipulation command, the multiple arm joints are linked to move together to reach a posture corresponding to the motion information of the master hand of the surgical robot master. During the movement of the multiple arm joints, when any of the arm joints triggers a protective lock, in order to protect the slave surgical arm, the arm joints linked to the locked arm joint will also be locked, thereby unlocking the multiple arm joints that have a linkage unlocking relationship.

[0070] For the arm joints to be unlocked, each arm joint to be unlocked is taken as the first arm joint, and the preset unlocking logic corresponding to the first arm joint is obtained. When the preset unlocking logic corresponding to the first arm joint is the linkage of multiple arm joints, the second arm joint that has a linkage unlocking relationship with the first arm joint is determined according to the preset unlocking logic.

[0071] S330. Based on the kinematic inverse solution results of the command posture of the slave surgical arm, determine whether the movement intention of the first arm joint exceeds the arm joint limit corresponding to the first arm joint, and whether the movement intention of the second arm joint exceeds the arm joint limit corresponding to the second arm joint.

[0072] Optionally, when an arm joint in a linkage unlocking relationship is locked in the surgical arm at the slave end, the locked first and second arm joints are determined to determine whether the first and second arm joints meet the unlocking conditions. If both the first and second arm joints meet the unlocking conditions, the first and second arm joints are linkage unlocked. Linking and unlocking all arm joints in a linkage relationship improves unlocking efficiency and ensures unlocking safety.

[0073] Determine the first arm joint and the second arm joint to be unlocked, obtain the motion intentions of the first arm joint and the second arm joint respectively according to the kinematic inverse solution results of the command posture of the surgical arm at the slave end, and then obtain the arm joint limit corresponding to the first arm joint and the arm joint limit corresponding to the second arm joint, and determine whether the motion intention of the first arm joint exceeds the arm joint limit corresponding to the first arm joint, and whether the motion intention of the second arm joint exceeds the arm joint limit corresponding to the second arm joint.

[0074] S340: When the movement intentions of the first arm joint and the second arm joint do not exceed the arm joint limits, unlock the first arm joint and the second arm joint.

[0075] It is determined whether the movement intentions of the first arm joint and the second arm joint exceed the arm joint limit. When the movement intentions of the first arm joint and the second arm joint do not exceed the arm joint limit, the first arm joint and the second arm joint are unlocked in linkage.

[0076] Optionally, when the movement intention of any one of the first arm joint and the second arm joint exceeds the arm joint limit, the first arm joint and the second arm joint continue to be locked.

[0077] S350: When the locked arm joint is unlocked, restore control of the unlocked arm joint.

[0078] In the case where the arm rotation mechanism of the slave surgical arm exceeds the arm joint limit corresponding to the arm rotation mechanism, the slave surgical arm may not be able to correctly reproduce the manipulation instructions corresponding to the master hand motion information of the surgical robot master due to the lack of arm rotation mechanism cooperation, resulting in posture mismatch, thereby locking all arm joints to ensure surgical safety. When unlocking the arm rotation mechanism in the slave surgical arm, the preset unlocking logic of the arm rotation mechanism includes multiple arm joint linkage unlocking, with the arm rotation mechanism as the first arm joint and the other arm joints as the second arm joints. According to the kinematic inverse solution results of the command posture of the slave surgical arm, it is determined whether the movement intentions of the first arm joint and the second arm joint exceed their respective arm joint limits. If the movement intentions of the first arm joint and the second arm joint do not exceed their respective arm joint limits, all arm joints are unlocked; if the movement intention of any one of the first arm joint and the second arm joint exceeds the corresponding arm joint limit, all arm joints continue to be locked.

[0079] The technical solution of the embodiment of the present application is to take the locked arm joint to be unlocked as the first arm joint, and when the preset unlocking logic corresponding to the first arm joint is the linkage unlocking of multiple arm joints, determine the second arm joint that has a linkage unlocking relationship with the first arm joint based on the preset unlocking logic; based on the kinematic inverse solution result of the command posture of the slave surgical arm, determine whether the movement intention of the first arm joint exceeds the arm joint limit corresponding to the first arm joint, and whether the movement intention of the second arm joint exceeds the arm joint limit corresponding to the second arm joint; jointly judge the arm joints that have a linkage unlocking relationship to improve the unlocking efficiency, and unlock the first arm joint and the second arm joint when the movement intentions of the first arm joint and the second arm joint do not exceed the arm joint limit, thereby realizing the linkage and synchronous unlocking of the arm joints, ensuring the safety of arm joint unlocking, and restoring control of the unlocked arm joint when the locked arm joint has been unlocked.

[0080] FIG4 is a schematic diagram of a control device for a slave surgical arm of a surgical robot according to an embodiment of the present invention. As shown in FIG4 , the device includes a master hand motion analysis module 410 , an arm joint unlocking module 420 , and an arm joint control module 430 .

[0081] The master hand motion analysis module 410 is configured to obtain the master hand motion information of the master end of the surgical robot when at least one arm joint of the slave end surgical arm of the surgical robot is locked, and determine the command posture of the slave end surgical arm based on the master hand motion information; the arm joint unlocking module 420 is configured to determine the preset unlocking logic corresponding to the locked arm joint, and unlock the locked arm joint based on the kinematic inverse solution result of the command posture of the slave end surgical arm and the preset unlocking logic; the arm joint control module 430 is configured to restore control of the unlocked arm joint when the locked arm joint has been unlocked.

[0082] The technical solution of the embodiment of the present application is to obtain the master hand motion information of the master end of the surgical robot when at least one arm joint of the slave end surgical arm of the surgical robot is locked, and determine the command posture of the slave end surgical arm based on the master hand motion information to achieve master-slave control; determine the preset unlocking logic corresponding to the locked arm joint, unlock the locked arm joint based on the kinematic inverse solution result of the command posture of the slave end surgical arm and the preset unlocking logic, unlock the arm joint that meets the unlocking conditions according to the kinematic inverse solution result, thereby achieving step-by-step unlocking of the arm joint, simplifying the unlocking steps, and further improving the unlocking efficiency; and restore control of the unlocked arm joint when the locked arm joint has been unlocked. The technical solution of the present application unlocks the slave end surgical arm joint based on the master hand motion information and the preset unlocking logic, simplifies the difficulty of unlocking the slave end surgical arm joint, and improves the unlocking safety of the slave end surgical arm joint.

[0083] Optionally, the preset unlocking logic includes independent unlocking of a single arm joint; the arm joint unlocking module 420 is configured to unlock the locked arm joint in the following manner: for the locked arm joint to be unlocked, determine whether the movement intention of the arm joint to be unlocked exceeds the arm joint limit corresponding to the arm joint to be unlocked based on the kinematic inverse solution result of the command posture of the slave surgical arm; when the preset unlocking logic corresponding to the arm joint to be unlocked is independent unlocking of a single arm joint and the movement intention of the arm joint to be unlocked does not exceed the arm joint limit, the arm joint to be unlocked is unlocked.

[0084] Optionally, the preset unlocking logic includes multiple arm joint linkage unlocking; the arm joint unlocking module 420 is configured to unlock the locked arm joint in the following manner: taking the locked arm joint to be unlocked as the first arm joint, and when the preset unlocking logic corresponding to the first arm joint is multiple arm joint linkage unlocking, determining the second arm joint that has a linkage unlocking relationship with the first arm joint based on the preset unlocking logic; based on the kinematic inverse solution result of the command posture of the slave surgical arm, determining whether the movement intention of the first arm joint exceeds the arm joint limit corresponding to the first arm joint, and whether the movement intention of the second arm joint exceeds the arm joint limit corresponding to the second arm joint; when the movement intentions of the first arm joint and the second arm joint do not exceed the arm joint limit, unlocking the first arm joint and the second arm joint.

[0085] Optionally, the arm joint unlocking module 420 is configured to determine a preset unlocking logic corresponding to the locked arm joint in the following manner: determining a locking triggering mode of the locked arm joint, and determining the preset unlocking logic based on the locking triggering mode.

[0086] Optionally, the arm joint includes at least one of an arm rotation mechanism, a parallelogram mechanism and a sliding mechanism; the arm joint limit includes at least one of an upper limit of the arm joint and a lower limit of the arm joint; the locking triggering method includes: the movement intention of the arm rotation mechanism exceeds the upper limit of the arm rotation mechanism, the movement intention of the arm rotation mechanism exceeds the lower limit of the arm rotation mechanism, the movement intention of the parallelogram mechanism exceeds the upper limit of the parallelogram mechanism, the movement intention of the parallelogram mechanism exceeds the lower limit of the parallelogram mechanism, the movement intention of the sliding mechanism exceeds the upper limit of the sliding mechanism, and the movement intention of the sliding mechanism exceeds at least one of the lower limit of the sliding mechanism.

[0087] Optionally, the control device of the surgical robot's slave-end surgical arm also includes: a clamping mechanism control module, which is configured to respond to the opening and closing control instructions input by the master end of the surgical robot for the clamping mechanism when the slave-end surgical arm of the surgical robot has been locked, and perform opening and closing actions corresponding to the opening and closing control instructions.

[0088] Optionally, the control device of the slave surgical arm of the surgical robot also includes: an information prompt module, which is configured to generate a locking prompt information for prompting that the slave surgical arm has been locked when the slave surgical arm of the surgical robot has been locked, and / or an unlocking guide information for guiding the user to unlock the slave surgical arm.

[0089] The control device of the surgical robot slave-end surgical arm provided in the embodiment of the present disclosure can execute the control method of the surgical robot slave-end surgical arm provided in any embodiment of the present disclosure, and has functional modules and effects corresponding to the execution method.

[0090] It is worth noting that the units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific name of each functional unit is only for the convenience of distinguishing each other, and is not used to limit the protection scope of the embodiment of the present disclosure.

[0091] FIG5 shows a schematic diagram of the structure of an electronic device that can be used to implement an embodiment of the present application, and the electronic device 10 can be provided in a surgical robot. The electronic device 10 can be a digital computer in various forms, such as a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device 10 can also be represented as a mobile device in various forms, such as a personal digital processing, a cellular phone, a smart phone, a wearable device (such as a helmet, glasses, a watch, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described herein and / or the conditions.

[0092] As shown in Figure 5, the electronic device 10 includes at least one processor 11 and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by the at least one processor, and the processor 11 can perform a variety of appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In RAM 13, various programs and data required for the operation of the surgical robot can also be stored. The processor 11, ROM 12 and RAM 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0093] Multiple components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0094] The processor 11 can be a general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors that run machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 11 executes the methods and processes described above, such as the control method of the surgical robot's slave surgical arm.

[0095] In some embodiments, the control method of the surgical robot's slave-end surgical arm may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed into the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the control method of the surgical robot's slave-end surgical arm described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the control method of the surgical robot's slave-end surgical arm in any other appropriate manner (e.g., by means of firmware).

[0096] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0097] Computer programs for implementing the methods of the present application can be written in one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0098] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. A machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM) or a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0099] To provide for user interaction, the systems and techniques described herein can be implemented on a surgical robot having: a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor) configured to display information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the surgical robot. Other types of devices can also be configured to provide for user interaction. For example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and the input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0100] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, and front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0101] A computing system may include a client and a server. The client and server are generally remote from each other and typically interact via a communication network. This client-server relationship is established by running a computer program on the computer. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a host product within a cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosts and virtual private server (VPS) services.

[0102] This embodiment provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a method for controlling a slave surgical arm of a surgical robot as provided in any embodiment of the present application, the method comprising: when at least one arm joint of the slave surgical arm of the surgical robot is locked, obtaining master hand motion information of the master end of the surgical robot, and determining the command posture of the slave surgical arm based on the master hand motion information; determining a preset unlocking logic corresponding to the locked arm joint, and unlocking the arm joint based on the kinematic inverse solution result of the command posture of the slave surgical arm and the preset unlocking logic; and when the arm joint is unlocked, restoring control of the unlocked arm joint.

[0103] The computer storage medium of the embodiment of the present application can adopt any combination of one or more computer-readable media.Computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium.Computer-readable storage medium can be, for example, but not limited to: a system, device or component of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above.Computer-readable storage medium can (non-exhaustive list) include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM) or a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.Herein, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, a device or a device or used in combination with an instruction execution system, a device or a device.

[0104] A computer-readable signal medium may include a data signal propagated in baseband or as a carrier wave, which carries computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0105] The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wire, optical cable, radio frequency (RF), etc., or any suitable combination thereof.

[0106] The computer program code for performing the operations of the present application can be written in one or more programming languages, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0107] Those skilled in the art will appreciate that the modules or steps of the present application described above can be implemented using a general-purpose computing device. They can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they can be implemented using program code executable by a computer device, so that they can be stored in a storage device and executed by the computing device, or they can be fabricated into integrated circuit modules, or multiple modules or steps can be fabricated into a single integrated circuit module for implementation. Thus, the present application is not limited to any particular combination of hardware and software.

Claims

1. A method for controlling a surgical arm of a surgical robot slave end, comprising: When at least one arm joint of a surgical arm of a slave end of the surgical robot is locked, obtaining master hand motion information of a master end of the surgical robot, and determining a command posture of the surgical arm of the slave end based on the master hand motion information; Determine a preset unlocking logic corresponding to the locked arm joint, and unlock the locked arm joint based on a kinematic inverse solution result of the command posture of the slave surgical arm and the preset unlocking logic; When the locked arm joint is unlocked, the control of the unlocked arm joint is restored.

2. The method according to claim 1, wherein: The preset unlocking logic includes independent unlocking of a single arm joint; The method of unlocking the locked arm joint based on the kinematic inverse solution result of the command posture of the slave surgical arm and the preset unlocking logic includes: For the locked arm joint to be unlocked, determining whether the movement intention of the arm joint to be unlocked exceeds the arm joint limit corresponding to the arm joint to be unlocked based on the kinematic inverse solution result of the command posture of the slave surgical arm; When the preset unlocking logic corresponding to the arm joint to be unlocked is independent unlocking of a single arm joint and the movement intention of the arm joint to be unlocked does not exceed the arm joint limit, the arm joint to be unlocked is unlocked.

3. The method according to claim 1, wherein: The preset unlocking logic includes multiple arm joint linkage unlocking; The method of unlocking the locked arm joint based on the kinematic inverse solution result of the command posture of the slave surgical arm and the preset unlocking logic includes: The locked arm joint to be unlocked is taken as the first arm joint, and when the preset unlocking logic corresponding to the first arm joint is multiple arm joints being unlocked in linkage, a second arm joint having a linkage unlocking relationship with the first arm joint is determined based on the preset unlocking logic; Based on the kinematic inverse solution result of the command posture of the slave surgical arm, determine whether the movement intention of the first arm joint exceeds the arm joint limit corresponding to the first arm joint, and whether the movement intention of the second arm joint exceeds the arm joint limit corresponding to the second arm joint; When the movement intentions of the first arm joint and the second arm joint do not exceed the arm joint limit, the first arm joint and the second arm joint are unlocked.

4. The method according to claim 1, wherein: The determining of the preset unlocking logic corresponding to the locked arm joint includes: A locking triggering mode of the locked arm joint is determined, and a preset unlocking logic is determined based on the locking triggering mode.

5. The method according to claim 4, wherein: The arm joint includes at least one of the following: an arm rotation mechanism, a parallelogram mechanism, and a slide mechanism; The arm joint limit includes at least one of the following: an upper limit of the arm joint and a lower limit of the arm joint; The locking triggering method includes at least one of the following: the movement intention of the arm rotating mechanism exceeds the upper limit of the arm rotating mechanism, the movement intention of the arm rotating mechanism exceeds the lower limit of the arm rotating mechanism, the movement intention of the parallelogram mechanism exceeds the upper limit of the parallelogram mechanism, the movement intention of the parallelogram mechanism exceeds the lower limit of the parallelogram mechanism, the movement intention of the slide mechanism exceeds the upper limit of the slide mechanism, and the movement intention of the slide mechanism exceeds the lower limit of the slide mechanism.

6. The method according to claim 1, further comprising: In a case where the surgical arm of the slave end of the surgical robot has been locked, in response to an opening and closing control instruction input by the master end of the surgical robot to the clamping mechanism, an opening and closing action corresponding to the opening and closing control instruction is performed.

7. The method according to claim 1, further comprising: When the slave surgical arm of the surgical robot has been locked, at least one of locking prompt information for prompting that the slave surgical arm has been locked and unlocking guide information for guiding a user to unlock the slave surgical arm is generated.

8. A control device for a surgical robot slave end surgical arm, comprising: A master hand motion analysis module, configured to obtain master hand motion information of the master end of the surgical robot when at least one arm joint of the slave end surgical arm of the surgical robot is locked, and determine the command posture of the slave end surgical arm based on the master hand motion information; An arm joint unlocking module, configured to determine a preset unlocking logic corresponding to the locked arm joint, and unlock the locked arm joint based on a kinematic inverse solution result of the command posture of the slave surgical arm and the preset unlocking logic; The arm joint control module is configured to restore control of the unlocked arm joint when the locked arm joint is unlocked.

9. An electronic device, arranged in a surgical robot, comprising: at least one processor; as well as a memory communicatively coupled to the at least one processor; Wherein, the memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the control method of the surgical robot slave end surgical arm according to any one of claims 1-7.

10. A computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable a processor to implement the control method for a surgical robot slave end surgical arm according to any one of claims 1 to 7 when executed.

Citation Information

Patent Citations

  • Tele-operative surgical systems and methods of control at joint limits using inverse kinematics

    CN106456265A

  • Mechanical arm unlocking method and device

    CN110216679A

  • Mechanical arm anti-collision method and device, robot and storage medium

    CN113334392A

  • Interventional surgery robot system, control method and medium

    CN114917029A

  • Surgical robot, control method and device for slave end surgical arm of surgical robot and medium

    CN116602772A

Cited By

  • Master-slave displacement compensation method and device of surgical robot, electronic equipment and storage medium

    CN119655902A