Detecting collisions of robot arms
By using position sensors and torque sensors in surgical robot systems, candidate forces are calculated to detect collisions and control the drive to prevent collisions, the problem of not being able to detect and prevent robot arm collisions in independently installed robot systems is solved, achieving safety and stability surgical operation.
Patent Information
- Application Number
- CN201980044134.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-06-29
- Filing Date
- 2019-06-27
- Publication Date
- 2024-11-22
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In a independently installed surgical robot system, collisions between robot arms cannot be detected and prevented because the relative position of the robot arms cannot be determined.
By installing position sensors and torque sensors on each robot arm, the control unit receives these sensing data, calculates candidate forces on each arm to detect collisions, and controls the driver to prevent or remove the robot arm when the collision is determined.
It realizes detection and prevention of collisions between robot arms without knowing the relative position of the robot arms, ensuring the safety and stability of surgical operations.
Smart Images

Figure CN112384336B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to controlling the motion of a robot, particularly a surgical robot. Background Art
[0002] Figure 1 A plurality of robots 101, 102, 103 are shown operating in a common workspace. In this example, the robots are surgical robots for performing operations on a person 104. Each robot comprises a base connected to a surgical instrument by a flexible arm. The robot is remotely controlled by a surgeon. The surgeon is located at a surgeon console 200, such as Figure 2 As shown. The surgeon manipulates hand controllers 201, 202. The control system converts the movements of the hand controllers into control signals to move the arm joints and / or instrument end effectors of the surgical robot. More than one robot can move simultaneously.
[0003] Operating robotic arms in a common workspace introduces the risk of collisions between these robotic arms. In a compact common workspace, it is especially likely that the operating area of one robot will significantly overlap with the operating area of another robot. In master-slave robot systems, such as the surgeon-robot system described above, the likelihood of collisions is increased because the movements of the robotic arms are not preplanned but are executed in response to the surgeon's input.
[0004] In a master-slave manipulator system with multiple robots, it is known to mount all the robots on a common chassis. In this case, the relative positions of the robot bases are known. Using the sensory data, the pose of each robot arm can be determined. Thus, the position of each point on one robot arm can be determined relative to the position of each point on another robot arm. Using this information, the control system can detect an impending collision of the robot arms and modify the motion of the robot arms to prevent a collision.
[0005] In systems where the robots are not mounted on a common chassis but are mounted independently, the position of one robot relative to the other is not inherently known. If the relative positions of the robots cannot be determined in some other way, then the above mechanisms cannot be used to detect and prevent collisions. Furthermore, once a collision occurs, the part of the robot arm that collided cannot be determined.
[0006] What is needed is a control system for detecting robot arm collisions without requiring knowledge of the relative positions of the robot arms. Summary of the invention
[0007] According to a first aspect, a robot system is provided, comprising: a first robot and a second robot, each robot having a base and an arm extending from the base to an attachment of an instrument, the arm comprising a plurality of joints, whereby the configuration of the arm can be changed; for each joint, the robot comprising a driver configured to drive the joint to move, and a position sensor and a torque sensor configured to sense the joint; and a control unit, the control unit being configured to receive inputs from the position sensor and the torque sensor, and to control the driver based on the received inputs, the control unit being configured to: determine a gravity torque on the joints of the arms of the first robot and the second robot in an arm configuration indicated by the inputs from the position sensor; determine a residual torque on the joints of the arms of the first robot and the second robot in the indicated arm configuration based on the inputs from the torque sensor and the determined gravity torque; calculate one or more candidate forces for each arm, the candidate forces causing the determined residual torque when applied to the arm; and determine a collision if the one or more candidate forces on the arm of the first robot balance the opposite candidate forces on the arm of the second robot.
[0008] The control unit may control the driver to prevent the arms of the first robot and the second robot from moving when the collision is determined.
[0009] The control unit may control the driver to move the arms of the first robot and the second robot away from a contact point when a collision is determined.
[0010] The control unit may control the actuator only when the candidate force exceeds a threshold force.
[0011] The control unit may control the actuator only when the temporal profile of the candidate force has a gradient greater than a threshold gradient.
[0012] The control unit may control the actuator only when the candidate force has a magnitude greater than a baseline value for a time period less than a threshold time period.
[0013] The robot system may include additional robots, wherein each additional robot has a base and an arm extending from the base to an attachment of the instrument, the arm including multiple joints, thereby allowing the configuration of the arm to be changed; for each joint, the robot includes a drive configured to drive the joint to move, and a position sensor and a torque sensor configured to sense the joint; the control unit is configured to: determine the gravity torque on the joint of the arm of the additional robot in the arm configuration indicated by the input of the position sensor; determine the residual torque on the joint of the arm of the additional robot in the indicated arm configuration based on the input from the torque sensor and the determined gravity torque; calculate one or more candidate forces for each arm of the additional robots, which candidate forces will cause the determined residual torque when applied to the arm; and control the drive only when it is determined that a candidate force on the arm of the first robot that collides and balances the opposite candidate force on the arm of the second robot does not also balance the opposite candidate force on the arm of the additional robot.
[0014] The control unit may store the configuration of the arm of the first robot and the configuration of the arm of the second robot at the time of the determined collision and subsequently prevent the first robot and the second robot from simultaneously adopting those stored configurations.
[0015] The control unit may determine the relative position of the arm of the first robot and the arm of the second robot based on the determined collision and subsequently prevent the arm of the first robot and the arm of the second robot from simultaneously adopting the same relative position.
[0016] The control unit may operate without knowledge of the relative positions of the first robot and the second robot.
[0017] The control unit may assume that the first robot and the second robot each adopt a predetermined orientation relative to each other.
[0018] The control unit may calculate only a single candidate force for each arm which, when applied to that arm, would cause the determined residual torque.
[0019] The control unit may determine that no collision has occurred in the absence of a single candidate force which, when applied to the arm of the first robot, would produce the determined residual torque on the joint of the arm of the first robot in the indicated arm configuration.
[0020] The control unit may calculate only a single candidate force range for each arm which, when applied to that arm, would result in the determined residual torque.
[0021] The single candidate force range may include a candidate magnitude range and a candidate line of action range.
[0022] The control unit may determine that no collision occurs when the candidate action line range of the arm of the first robot does not overlap with the candidate action line range of the arm of the second robot.
[0023] The control unit may determine that no collision occurs when the candidate action line range of the arm of the first robot does not include an action line in a direction opposite to an action line in the candidate action line range of the arm of the second robot.
[0024] The control unit may determine that no collision occurs, if the candidate magnitude range of the arm of the first robot does not overlap with the candidate magnitude range of the arm of the second robot.
[0025] The control unit may determine a plurality of candidate forces for each arm, each candidate force causing the determined residual torque when applied to the arm; the plurality of candidate forces comprising a combined candidate force which is a combination of two or more individual candidate forces; the control unit being configured to determine a collision if a single candidate force of the combined candidate force on the arm of the first robot balances an opposite candidate force on the arm of the second robot.
[0026] The robotic system may be a surgical robotic system, and the first robot and the second robot may be surgical robots.
[0027] According to a second aspect, a method for determining a collision between a first robot and a second robot of a robot system is provided, wherein each robot has a base and an arm extending from the base to an attachment of an instrument, the arm including a plurality of joints, whereby the configuration of the arm can be changed; for each joint, the robot includes a drive configured to drive the joint to move, and a position sensor and a torque sensor configured to sense the joint; the robot system further includes a control unit for receiving inputs from the position sensor and the torque sensor, and controlling the drive based on the received inputs, the method comprising: determining a gravity torque on the joints of the arms of the first robot and the second robot in an arm configuration indicated by the inputs from the position sensor; determining a residual torque on the joints of the arms of the first robot and the second robot in the indicated arm configuration based on the inputs from the torque sensor and the determined gravity torque; calculating one or more candidate forces for each arm, the candidate forces causing the determined residual torque when applied to the arm; and determining a collision if the one or more candidate forces on the arm of the first robot balance the opposite candidate forces on the arm of the second robot. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] The present disclosure will now be described by way of example with reference to the accompanying drawings. In the drawings:
[0029] Figure 1 shows a person undergoing surgery by a robotic system including three surgical robots;
[0030] Figure 2 The surgeon's console is shown;
[0031] Figure 3 shows a schematic diagram of a robotic system;
[0032] Figure 4 A robot is shown;
[0033] Figure 5 is a flow chart illustrating a process of determining the residual torque acting on a robot arm; and
[0034] Figure 6a , 6b and 6c are collision analysis flow charts. DETAILED DESCRIPTION
[0035] The following description relates to a robot system including a plurality of robots and a control unit. The control unit drives the robots to move. Position sensors and torque sensors on the robot arms transmit sensing data to the control unit. The control unit uses the sensing data to detect external forces acting on the robot arms. If the external force acting on one arm balances the opposite external force acting on the other arm, the control unit determines that a collision has occurred between the two arms.
[0036] The following examples involve surgical robotic systems. Figure 3, the surgical robot system 300 includes two surgical robots 301, 302 driven by a control unit 303. The control unit 303 receives inputs 307 from a surgeon's console 304, including inputs from first and second hand controllers 305, 306. The control unit may receive other inputs 307 from the surgeon's console, such as foot pedal inputs, button inputs, voice recognition inputs, gesture recognition inputs, eye recognition inputs, etc. The control unit 303 also receives inputs 308 from the surgical robots 301, 302. These inputs include sensory data from position sensors and torque sensors located on the robot arm joints. The control unit 303 may receive other inputs 308 from each robot, such as force feedback, data from surgical instruments, etc. The control unit 303 drives the robots 301, 302 in response to inputs received from the robots and the surgeon's console. The control unit 303 includes a processor 309 and a memory 310. The memory stores software code in a non-transitory manner that can be executed by the processor to cause the processor to control the drive in the manner described herein.
[0037] Each robot 301, 302 has Figure 4 The robot is shown in the form 400. The robot comprises a base 401 which is fixed in place when the surgical procedure is performed. Suitably, the base 401 is mounted on a chassis. The chassis may be a cart, such as a bedside cart for mounting the robot at bed height. Alternatively, the chassis may be a device mounted on a ceiling, or a device mounted on a bed.
[0038] The arm 402 extends from the base 401 of the robot to an attachment 403 for a surgical instrument 404. The arm is flexible. It is articulated by a plurality of flexible joints 405 along its length. Between the joints are rigid arm members 406. Figure 4 The arm in has seven joints. The joints include one or more roll joints (which have an axis of rotation along the longitudinal direction of the arm member on either side of the joint), one or more pitch joints (which have an axis of rotation transverse to the longitudinal direction of the previous arm member), and one or more yaw joints (which also have an axis of rotation transverse to the longitudinal direction of the previous arm member and also transverse to the axis of rotation of the co-located pitch joint). However, the arm can have different joints. For example, the arm can have fewer or more joints. The arm can include joints that allow movement between corresponding sides of the joint other than rotation, such as telescopic joints. The robot includes a set of drives 407, each drive 407 driving one or more joints 405.
[0039] Attachment 403 enables surgical instrument 404 to be releasably connected to the distal end of the arm. Surgical instrument 404 has a linear rigid shaft and a working tip at the distal end of the shaft. The working tip includes an end effector for participating in a medical procedure. The surgical instrument can be configured to extend linearly parallel to the axis of rotation of the distal joint of the arm. For example, the surgical instrument can extend along an axis that coincides with the axis of rotation of the distal joint of the arm. Surgical instrument 404 can be, for example, a cutting, grasping, cauterizing, or imaging device.
[0040] The robot arm includes a series of sensors 408, 409. For each joint, these sensors include a position sensor 408 for sensing the position of the joint and a torque sensor 409 for sensing the torque applied around the joint's axis of rotation. One or both of the position sensor and torque sensor of a joint may be integrated with the motor of that joint. The output of the sensor is passed to the control unit 303, where the output of the sensor forms the input of the processor 309.
[0041] An example in which the control unit 303 detects a collision between robot arms using sensor data received from the robots 301 , 302 is described below.
[0042] Firstly, for each robot arm, the control unit determines whether any unaccounted-for forces act on this robot arm. Figure 5 is a flowchart illustrating the steps implemented by the control unit 303.
[0043] The control unit receives as input position sensing data 501 from position sensors 408 on the joints of the robot arm. For example, each position sensor may report the joint angle of the joint it is sensing. The control unit stores the geometry / layout of the robot arm 500 in the memory 310. The processor 309 of the control unit retrieves the stored geometry of the robot arm from the memory 310. In step 502, the processor 309 of the control unit determines the current configuration of the robot arm based on the received position sensing data and the geometry of the robot arm. The configuration of the robot arm is also referred to as the pose of the robot arm. Suitably, the processor 309 stores the current configuration of the arm in the memory 310.
[0044] The control unit stores a gravity model 503 of the robot arm in the memory 310. The memory 310 stores, for each element of the arm and the connected instrument, its mass, the distance of its center of mass from the previous joint of the arm, and the relationship between the center of mass and the position output of the joint sensor of the previous joint. The processor 309 of the control unit retrieves the stored gravity model 503 from the memory 310. In step 504, the processor 309 of the control unit models the effect of gravity on the elements of the robot arm for the current configuration of the robot arm using the current configuration of the robot arm and the gravity model. In doing so, the processor 309 determines the torque caused by gravity acting on each joint of the robot arm.
[0045] The control unit receives as input torque sensing data 505 from torque sensors 409 on the joints of the robot arm. In step 506, the processor 309 of the control unit calculates the residual torque on each joint of the robot arm. The residual torque is the joint torque measured by the torque sensor, from which the known torque acting on the joint has been subtracted. For example, the processor 309 can calculate the residual torque by subtracting the gravity torque calculated in step 504 from the measured joint torque. If the control unit drives the joint to move under the control of the surgeon's console, the processor 309 can subtract the known driving torque value from the measured joint torque when determining the residual torque. Suitably, the processor 309 stores the residual joint torque in the memory 310.
[0046] The control unit does not need to actually determine the pose of the robot arm. The control unit can calculate the gravity torque directly from the position sensing data, the known geometry of the robot arm and the gravity model.
[0047] The control unit does not need to actually determine the gravity torque acting on each joint of the robot arm. The control unit can calculate the residual torque directly from the position sensing data, the known geometry of the robot arm, the gravity model and the torque sensing data.
[0048] The control unit performs the combination of all robot arms connected to it Figure 5 Describe the steps.
[0049] By analyzing the residual torques acting on the joints of the robot arms, the control unit 303 determines whether those residual torques are caused in part or in whole by a robot collision. The control unit does this without knowing the relative positions of the robots. However, the control unit does assume that the robots adopt a predetermined orientation relative to each other. Optionally, the relative orientation of the robots in the system may be input to the control unit before the control unit determines whether the robots have collided. For example, the relative orientation of the robots may be provided to the control unit when the robots are set up before an operation begins.
[0050] Some examples of how the control unit 303 analyses the residual torque acting on the joints of the robot arms in order to determine whether a collision occurs between two robot arms will now be described.
[0051] Figure 6a A first example embodiment is shown, involving a robot arm A and a robot arm B. The residual joint torques calculated for arm A are denoted by RTAj (j=1, 2...J). The residual joint torques for arm B are denoted by RTB1 (l=1, 2...L).
[0052] The control unit retrieves the current configuration of arm A from memory 310. It also retrieves the residual joint torque RTAj of arm A from memory 310. In step 601, the control unit 303 determines a set of candidate forces FAi (i=1, 2...N) that will produce the residual joint torque RTAj in the current configuration of arm A.
[0053] The control unit retrieves the current configuration of arm B from the memory 310. It also retrieves the residual joint torque RTB1 of arm B from the memory 310. In step 604, the control unit 303 determines a set of candidate forces FBk (k=1, 2...N) that will produce the residual joint torque RTB1 in the current configuration of arm B.
[0054] A candidate force is a force applied externally to the arm in question. The set of candidate forces may include only one candidate force. The set of candidate forces may include separate candidate forces. In other words, the control unit may determine a single external force that will alone cause all residual joint torques of the arm. The set of candidate forces may include a combined candidate force. In other words, the control unit may determine two or more external forces that together will cause all residual joint torques of the arm. The set of candidate forces may include single candidate forces and combined candidate forces. The set of candidate forces may include all external forces that may be applied to the arm to cause residual joint torques of the arm.
[0055] At step 608, the control unit compares candidate forces FAi and FBk, where i=1, k=1. In other words, the control unit compares the first candidate force of arm A FA1 and the first candidate force of arm B FB1. If the compared candidate forces are balanced and opposite, then at step 609, the control unit determines that arm A has collided with arm B. Specifically, the control unit may compare the magnitude, line of action, and direction of the line of action of the candidate forces FA1 and FB1. If the magnitudes of the forces are equal and act on parallel lines in opposite directions, then the control unit determines that a collision has occurred between arm A and arm B.
[0056] If, at step 608, the control unit determines that the candidate forces FA1 and FB1 are unbalanced and opposite, no collision is detected. At step 610, the control unit checks whether there is an additional candidate force in the set of candidate forces for arm B. In other words, the control unit checks whether there is a k=k+1 force. If there is an additional candidate force, then at step 611, k is set to k+1 and the analysis returns to step 608. At this point, the control unit compares the candidate forces FAi and FBk+1, in other words, FA1 and FB2. If the two candidate forces are balanced and opposite, the control unit determines that arm A has collided with arm B.
[0057] If at step 608 the control unit determines that candidate forces FA1 and FB2 are unbalanced and opposite, no collision is detected and further steps 610, 611 and 608 are repeated. The repetition continues until candidate force FA1 is evaluated against all candidate forces FBk, or a collision is detected.
[0058] If, at step 610, the control unit determines that arm B has no additional candidate forces, the process continues to step 612. At step 612, the control unit checks if there are additional candidate forces in the set of candidate forces for arm A. In other words, it checks if there is an ai=i+1 force. If there are additional candidate forces, then at step 613, I is set to i+1 and k is set to 1. The analysis then returns to step 608. At this point, the control unit compares candidate forces FAi+1 and FBk, in other words, FA2 and FB1. If the two candidate forces are balanced and opposite, the control unit determines that arm A has collided with arm B.
[0059] If at step 608 the control unit determines that candidate forces FA2 and FB1 are unbalanced and opposite, no collision is detected and further steps 610, 611 and 608 are repeated. The repetition continues until candidate force FA2 is evaluated against all candidate forces FBk, or a collision is detected.
[0060] The residual candidate forces of arm A are similarly compared with the candidate forces of arm B in the above manner. If any candidate force of arm A FAi is balanced and opposite to any candidate force of arm B FBk, the control unit 303 determines a collision. If none of the candidate forces of arm A FAi is balanced and opposite to the candidate force of arm B FBk, the control unit 303 determines that no collision has occurred.
[0061] Once a collision is determined, i.e., once a pair of mutually balanced and opposite candidate forces is identified, the control unit 303 may stop Figure 6a Alternatively, the control unit 303 may compare each candidate force of arm A with each candidate force of arm B, regardless of whether a collision has been detected.
[0062] When a collision is determined, the control unit may store candidate forces of the arms A and B that are balanced and opposite to each other in the memory 310. The control unit may also store in the memory 310 the configurations of the two arms A and B at the time of the collision.
[0063] This collision analysis accurately detects collisions of robot arms even if the collision occurs while other external forces are acting on one or both of the colliding robot arms.
[0064] Figure 6b A second example implementation is shown, involving robot arm A and robot arm B. Figure 6a Likewise, the residual joint torque calculated for arm A is denoted by RTAj (j=1, 2...J). The residual joint torque for arm B is denoted by RTB1 (l=1, 2...L).
[0065] Similarly, the control unit is configured to assume that a single external force causes only a residual joint torque on arm A. Therefore, the control unit is configured to calculate only a single candidate force for each arm that will cause a residual joint torque when applied to that arm. A single candidate force is an individual candidate force, not a combined candidate force.
[0066] The control unit retrieves the current configuration of arm A from the memory 310. It also retrieves the residual joint torque RTAj of arm A from the memory 310. At step 620, the control unit 303 determines a single candidate force FA1 that will produce the residual joint torque RTAj in the current configuration of arm A. If no single candidate force FA1 can be determined, then at step 627, the control unit determines that no collision has occurred.
[0067] The control unit retrieves the current configuration of arm B from the memory 310. It also retrieves the residual joint torque RTB1 of arm B from the memory 310. At step 624, the control unit 303 determines a single candidate force FB1 that will produce the residual joint torque RTB1 in the current configuration of arm B. If a single candidate force FB1 cannot be determined, then at step 628, the control unit determines that no collision has occurred.
[0068] If the candidate force FA1 and the candidate force FB1 are determined at steps 620 and 624, the control unit compares FA1 and FB1 at step 629. If the compared candidate forces are balanced and opposite, then at step 630, the control unit determines that arm A has collided with arm B. Specifically, the control unit may compare the magnitude, line of action, and direction of the line of action of the candidate forces FA1 and FB1. If the magnitudes of the forces are equal and act on parallel lines in opposite directions, the control unit determines that a collision has occurred between arm A and arm B.
[0069] If, at step 629, the control unit determines that the candidate forces FA1 and FB1 are unbalanced and opposite, then no collision is detected.
[0070] About Figure 6a Compared with the collision analysis described in Figure 6b The collision analysis described is less computationally intensive.
[0071] and Figure 6a and 6b Likewise, the residual joint torque calculated for arm A is denoted by RTAj (j=1, 2...J). The residual joint torque for arm B is denoted by RTB1 (l=1, 2...L).
[0072] The control unit is configured to assume that a single external force causes only a residual joint torque on arm A. Similarly, the control unit is configured to assume that a single external force causes only a residual joint torque on arm B. The control unit is configured to calculate a range of magnitudes and a range of lines of action of a single candidate force that, when applied to the arm, will cause a residual joint torque. The single candidate force is an individual candidate force, not a combined candidate force.
[0073] The control unit retrieves the current configuration of arm A from the memory 310. It also retrieves the residual joint torque RTAj of arm A from the memory 310. At step 640, the control unit 303 determines a range of magnitudes and lines of action of a single candidate force FA1 that will produce the residual joint torque RTAj in the current configuration of arm A. If a single candidate range of magnitudes and lines of action of force FA1 cannot be determined, then at step 647, the control unit determines that no collision has occurred.
[0074] The control unit retrieves the current configuration of arm B from the memory 310. It also retrieves the residual joint torque RTB1 of arm B from the memory 310. In step 644, the control unit 303 determines a range of magnitudes and a range of lines of action of a single candidate force FB1 that will produce the residual joint torque RTB1 in the current configuration of arm B. If a single candidate range of magnitudes and a range of lines of action of force FB1 cannot be determined, then in step 648, the control unit determines that no collision has occurred.
[0075] If the candidate magnitude range and candidate line of action range of the FA1 force and the candidate magnitude range and candidate line of action range of the FB1 force are determined in steps 640 and 644, the analysis proceeds to step 649. In step 649, the control unit compares the line of action ranges of FA1 and FB1. If the line of action range of FA1 does not overlap with the line of action range of FB1, then in step 650, the control unit determines that no collision has occurred. If the line of action range of FA1 overlaps with the line of action range of FB1, the analysis proceeds to step 651.
[0076] At step 651, the control unit compares the directions of the lines of action within the range of force FA1 with the directions of the lines of action within the range of force FB1 in the overlapping region of those ranges. If, in the overlapping region of the line of action ranges of forces FA1 and FB1, there are no lines of action in one range that are opposite in direction to the lines of action in the other range, then at step 652, the control unit determines that no collision has occurred. However, if, in the overlapping region of the line of action ranges of forces FA1 and FB1, there is at least one line of action in one range that is opposite in direction to the line of action in the other range, then the analysis proceeds to step 653.
[0077] Alternatively, steps 649 and 651 may be considered together by the control unit, rather than separately. In this case, the control unit compares the ranges of the lines of action of FA1 and FB1, including the directions of these lines of action. If there is no overlapping area in the ranges of the lines of action of the forces FA1 and FB1 where the lines of action in one range are in the opposite direction to the lines of action in the other range, the control unit determines that no collision has occurred. If there is an overlapping area in the ranges of the lines of action of the forces FA1 and FB1 where the lines of action in one range are in the opposite direction to the lines of action in the other range, the analysis proceeds to step 653.
[0078] At step 653, the control unit compares the magnitude range of force FA1 with the magnitude range of force FB1. If the magnitude range of force FA1 does not overlap with the magnitude range of force FB1, then at step 654, the control unit determines that no collision has occurred. However, if the magnitude range of force FA1 overlaps with the magnitude range of force FB1, then at step 655, the control unit 303 determines that a collision has occurred.
[0079] Alternatively, if the magnitude range of force FA1 overlaps with the magnitude range of force FB1, the control unit 303 may determine that a collision is possible. The control unit may then return to steps 640 and 644 and further repeat the reference steps. Figure 6c During the repetition, the control unit calculates a narrower amplitude range and / or a narrower line of action range for a single candidate force that would cause a residual joint torque when the candidate force is applied to the arm. If, after the repetition, the magnitude range of force FA1 still overlaps with the magnitude range of force FB1, the control unit 303 can determine that a collision has occurred. This determination will have a higher confidence than if the same determination had been made in a previous repetition. Optionally, the control unit 303 can perform the above steps by returning to steps 640 and 644 each time the answer to step 653 is "yes". Figure 6cFurther iterations of the method are performed, with each subsequent iteration being performed for a narrower amplitude range and / or a narrower line of action range than the previous iteration. The iteration process continues until one of the following occurs: (i) the control unit 303 determines that no collision has occurred, or (ii) the range is narrow enough for the control unit to determine that a collision has occurred. After a predetermined number of iterations, the range may be narrow enough.
[0080] Alternatively, if at step 653, the magnitude range of force FA1 overlaps with the magnitude range of force FB1, then control unit 303 may determine that a collision is possible. The control unit may then use reference Figure 6a Describes the method for determining whether a collision has occurred.
[0081] Alternatively, if at step 653, the magnitude range of force FA1 overlaps with the magnitude range of force FB1, then control unit 303 may determine that a collision is possible. The control unit may then use reference Figure 6b Describes the method to determine whether a collision has occurred.
[0082] For example, in step 650, if the ranges of the lines of action do not overlap, once it is determined that no collision has occurred, the control unit 303 may stop Figure 6c Alternatively, the collision analysis may continue to compare other properties of the candidate forces described in steps 651 and 653.
[0083] In some cases, relative to Figure 6c The described crash analysis enables the control unit to compare Figure 6a and 6b The described collision analysis more quickly eliminates residual joint torques detected on two robot arms that are not indicative of a collision.
[0084] Reference Figure 6a , 6b The above examples described in 6c explain how the control unit determines whether a collision has occurred between the two robotic arms. If it is determined that no collision has occurred, the control unit causes the two robotic arms to continue to operate as they did before the collision assessment. For example, if the control unit drives the joints of the robotic arms to move in response to input from the surgeon's console, the control unit continues to drive the joints in this manner.
[0085] If the control unit determines that a collision has occurred, it may respond by preventing further movement of the two robot arms that have collided. If the robot is manipulated in response to input from the surgeon's console, then preventing the movement of the robot arms prevents the surgeon from manipulating the robot arms. The robot may be placed in a compliant mode, in which the joints of each robot arm move in response to an external force while keeping the instruments in the same position and configuration as at the time of the collision. In this case, the operating room staff may push the robot arms away from each other. For example, in the compliant mode, the control unit may receive sensor input from force sensors on the robot arm joints. Based on the sensor input, the control unit determines that an external force has been applied to the robot arms. The control unit extracts a component of the external force, the direction of which will move the robot arms away from the collision point. The control unit then drives the robot arm joints to move the robot arms in the direction of the external force component. In this approach, the robot arms can only be repositioned by the operating room staff in a way that moves the robot arms away from the collision point with the other robot arm. Once one or both robot arms have been repositioned, the control unit may return the robot arms to an operational mode in which the robot arms are manipulated in response to input from the surgeon's console.
[0086] Alternatively, if the control unit determines that a collision has occurred, it can respond by controlling the robot arms away from the point of contact of the two arms. Based on the collision analysis, the control unit has determined for each robot the line of action of the external force that caused the collision. Based on the current configuration of the robot arms, the control unit can determine where on each robot arm the force is applied. The location of the force on each robot arm is the point of contact of that robot arm with the other robot arm.
[0087] As reference Figure 6a , 6b As described in any of 6c or 6c, the control unit may directly respond to the detected collision by preventing the movement of the robot arm or driving the robot arm away from the contact point, as described above. Alternatively, once a collision is detected, the control unit may require that one or more additional conditions be met in order to react to the detected collision as described above.
[0088] For example, the control unit may need to exceed a threshold force. In this case, upon detecting a collision, the control unit may compare the magnitude of the candidate force to the force threshold. If the magnitude of the candidate force exceeds the threshold force value, the control unit may react to the detected collision as described above. If the magnitude of the candidate force does not exceed the threshold force value, the control unit does not react to the detected collision as described above. Instead, the control unit drives the robot arm to continue normal operation.
[0089] In another example, the control unit may require that the candidate force have a specific waveform. For example, the control unit may require that the candidate force exhibit a sharp increase in force indicating a sudden collision. In this case, once a collision is detected, the control unit may evaluate the time domain profile of the candidate force. Specifically, the control unit may evaluate the gradient (i.e., magnitude vs. time) of the time domain profile of the candidate force during the time when the magnitude of the force is greater than the baseline value. If during this period, the time domain profile includes a gradient greater than a threshold gradient, the control unit may react to the detected collision as described above. If during this period, the time domain profile does not include a gradient greater than a threshold gradient, the control unit does not react to the detected collision. Instead, the control unit drives the robot arm to continue to operate normally.
[0090] As another example, the control unit may require that the waveform of the candidate force resemble a step function. Once a collision is detected, the control unit may achieve this by: (i) evaluating whether the magnitude of the candidate force is greater than the baseline value within a time period less than a threshold time period, and (ii) evaluating whether the time domain profile includes a gradient greater than a threshold gradient. If the control unit determines that the magnitude of the candidate force is greater than the baseline value within a time period less than the threshold time period, and the gradient of the candidate force is greater than the threshold gradient within the time period, the control unit may react to the detected collision as described above. If during this period, one or both of these requirements are not met, the control unit does not react to the detected collision as described above. Instead, the control unit drives the robot arm to continue normal operation.
[0091] The robot system may include additional robots in addition to the first and second robots described above. Each additional robot has a reference Figure 4 in the form described above. The control unit is configured to receive the same sensory data from each additional robot and drive each additional robot as described above for the first and second robots. The control unit also performs the above-mentioned collision analysis on each additional robot. The control unit may require that, in order to react to the detected collision as described above, only two robot arms have residual joint torques that are determined to be caused by balanced and opposite candidate forces. If the control unit determines that three or more robots have residual joint torques that may be caused by balanced and opposite candidate forces, the control unit does not react to the detected collision as described above. Instead, the control unit drives the robot arms to continue normal operation.
[0092] It is unlikely that more than two robotic arms will collide at the same time. If the control unit detects balanced and opposing candidate forces on more than two robotic arms, the source of the external forces is most likely the patient (to which all the robotic arms are connected as their instruments enter the surgical site in the patient's body) rather than the other robotic arms. Therefore, the control unit responds to this finding by enabling the robotic arms to continue their normal operation.
[0093] As described above, the control unit may require any one or combination of these further conditions to be satisfied in order to respond to a detected collision by preventing movement of the robotic arms or driving the robotic arms away from the contact point. This is to reduce the number of false positives from the collision analysis. In other words, to reduce the number of cases where the control unit detects a collision between the robotic arms when the actual detected force has another origin. This therefore reduces the likelihood that the control unit will cease operation and take control of the surgical instrument from the surgeon's console when no collision has occurred between the robotic arms.
[0094] After detecting a collision, the control unit may store in the memory 310 the configuration of each colliding robot arm at the time of the collision. In subsequent operations, the control unit prevents both robot arms from simultaneously adopting the stored configurations. The control unit thereby prevents the two robot arms from colliding again in the same manner as the first collision. The control unit does this throughout the remaining process, or until one or both robot bases are moved.
[0095] In the event of a collision between two robot arms, an external force is applied to both robot arms simultaneously. The magnitude of the force on each robot arm is the same, and the lines of action of the force are in opposite directions on the two arms. As described herein, even if the relative position of the robot arms is unknown, since the geometry of the robot arms and their relative orientation are known, the sensor data from the robot arms can be used to identify the collision. In addition, knowing the geometry of the robot arms and their relative orientation, the control unit can use the detected collision and its known lines of action to determine the relative positions of the robot arms. Once the relative positions of the robot arms are known, the control unit can use collision avoidance methods known in the art to avoid collisions between the robot arms.
[0096] The control unit may periodically perform the collision analysis. Figure 5 The residual torque is determined continuously as described, and each time the residual torque on the two robot arms is calculated, Figure 6a , 6b and 6c. In order to trigger a subsequent collision analysis, it may be necessary that the residual torque on both robot arms is greater than the baseline value.
[0097] The position sensors and torque sensors used to provide sensor data to the control unit in the above-mentioned crash analysis are not only used for crash analysis. The position sensors are used to determine the configuration of the robot arm for other purposes. The torque sensors are used to measure the external forces applied to the robot arm. In the compliance mode of the robot arm, the control unit responds to the external force by driving the robot to move in the direction of the applied external force.
[0098] Position sensors can be, for example, potentiometers, optical position encoders, ultrasonic or radio distance sensors. Force sensors can be, for example, resistor-based strain gauges, piezoelectric strain gauges, optical strain gauges or semiconductor strain gauges. Actuators that drive the motion of the robot joints can be rotary or linear motors, or devices other than motors: for example, hydraulic or pneumatic pistons.
[0099] Robots can be used for purposes other than surgery. For example, robots can be used in car manufacturing to look inside engines.
[0100] Applicants hereby disclose separately each individual feature described herein and any combination of two or more such features, to the extent that such feature or combination can be implemented according to the common knowledge of a person skilled in the art based on this specification as a whole, regardless of whether the feature or combination of features solves any problem disclosed herein, and without limiting the scope of the claims. Applicants point out that various aspects of the present invention may include any such individual feature or combination of features. In view of the foregoing, it will be apparent to those skilled in the art that various modifications may be made within the scope of the present invention.
Claims
1. A surgical robot system, include: a first surgical robot and a second surgical robot, each of the first surgical robot and the second surgical robot having a base and an arm extending from the base to an attachment of an instrument, the arm including a plurality of joints whereby the configuration of the arm can be changed; For each joint, the corresponding first surgical robot and the second surgical robot include: a driver configured to drive the joint to move, and a position sensor and a torque sensor configured to sense the joint; and a control unit configured to receive inputs from the position sensor and the torque sensor, the relative orientations of the first surgical robot and the second surgical robot being input to the control unit, and to control the drive according to the received inputs, the control unit being configured to: determining a gravitational torque on joints of the arms of the first surgical robot and the second surgical robot in the arm configuration indicated by the input from the position sensor; determining a residual torque on joints of the arms of the first surgical robot and the second surgical robot in the indicated arm configuration based on input from the torque sensor and the determined gravity torque; calculating a set of one or more candidate forces for each arm that, when applied to each arm, would cause the determined residual torque; comparing the set of one or more candidate forces on the arm of the first surgical robot to the set of one or more candidate forces on the arm of the second surgical robot; and A collision is determined if one or more candidate forces in the set of one or more candidate forces on the arm of the first surgical robot balance an opposing candidate force on the arm of the second surgical robot.
2. The surgical robot system according to claim 1, in, The control unit is configured to control the driver to prevent the arms of the first surgical robot and the second surgical robot from moving when a collision is determined.
3. The surgical robot system according to claim 1, in, The control unit is configured to control the driver to move the arms of the first surgical robot and the second surgical robot away from a contact point when a collision is determined.
4. The surgical robot system according to claim 2 or 3, in, The control unit is configured to control the actuator only when the candidate force exceeds a threshold force.
5. The surgical robot system according to claim 2 or 3, in, The control unit is configured to control the actuator only when a gradient of the temporal profile of the candidate force is greater than a threshold gradient.
6. The surgical robot system according to claim 2 or 3, in, The control unit is configured to control the actuator only when a magnitude of the candidate force is greater than a baseline value for a time period that is less than a threshold time period.
7. The surgical robot system according to claim 1 or 2, in, The control unit is configured to store the configuration of the arm of the first surgical robot and the configuration of the arm of the second surgical robot at the time of the determined collision and subsequently prevent the first surgical robot and the second surgical robot from simultaneously adopting those stored configurations.
8. The surgical robot system according to claim 1 or 2, in, The control unit is configured to determine the relative position of the arm of the first surgical robot and the arm of the second surgical robot based on the determined collision and subsequently prevent the arm of the first surgical robot and the arm of the second surgical robot from simultaneously adopting the same relative position.
9. The surgical robot system according to claim 1 or 2, in, The control unit is configured to operate without knowledge of the relative positions of the first surgical robot and the second surgical robot.
10. The surgical robot system according to claim 1 or 2, in, The control unit is configured to calculate only a single candidate force for each arm which, when applied to that arm, would cause the determined residual torque.
11. The surgical robot system according to claim 10, in, The control unit is configured to determine that no collision has occurred if there is no single candidate force that, when applied to the arm of the first surgical robot, would cause the determined residual torque on the joint of the arm of the first surgical robot in the indicated arm configuration.
12. The surgical robot system according to claim 1 or 2, in, The control unit is configured to calculate only a single candidate force range for each arm which, when applied to that arm, would result in the determined residual torque.
13. The surgical robot system according to claim 12, in, The single candidate force range includes a candidate magnitude range and a candidate line of action range.
14. The surgical robot system according to claim 13, in, The control unit is configured to determine that no collision has occurred if the candidate line-of-action range of the arm of the first surgical robot does not overlap with the candidate line-of-action range of the arm of the second surgical robot.
15. The surgical robot system according to claim 13, in, The control unit is configured to determine that no collision has occurred if the candidate action line range of the arm of the first surgical robot does not include an action line in a direction opposite to an action line in the candidate action line range of the arm of the second surgical robot.
16. The surgical robot system according to claim 13, in, The control unit is configured to determine that no collision has occurred if the candidate magnitude range of the arm of the first surgical robot does not overlap with the candidate magnitude range of the arm of the second surgical robot.
17. The surgical robot system according to claim 1 or 2, in, The control unit is configured to determine a plurality of candidate forces for each arm, each candidate force causing the determined residual torque when applied to the arm; the plurality of candidate forces comprising a combined candidate force which is a combination of two or more individual candidate forces; the control unit is configured to determine a collision if a single candidate force of the combined candidate force on the arm of the first surgical robot balances an opposite candidate force on the arm of the second surgical robot.
18. A method for determining a collision between a first surgical robot and a second surgical robot of a surgical robot system, in, Each of the first surgical robot and the second surgical robot has a base and an arm extending from the base to an attachment of an instrument, the arm including a plurality of joints whereby the configuration of the arm can be changed; For each joint, the corresponding first surgical robot and the second surgical robot include a driver configured to drive the joint to move, and a position sensor and a torque sensor configured to sense the joint; the surgical robot system further includes a control unit for receiving inputs from the position sensor and the torque sensor, the relative orientation of the first surgical robot and the second surgical robot is input to the control unit, and the driver is controlled according to the received input, and the method includes: determining a gravitational torque on joints of the arms of the first surgical robot and the second surgical robot in the arm configuration indicated by the input from the position sensor; determining a residual torque on joints of the arms of the first surgical robot and the second surgical robot in the indicated arm configuration based on input from the torque sensor and the determined gravity torque; calculating a set of one or more candidate forces for each arm that, when applied to each arm, would cause the determined residual torque; comparing the set of one or more candidate forces on the arm of the first surgical robot to the set of one or more candidate forces on the arm of the second surgical robot; and A collision is determined if one or more candidate forces in the set of one or more candidate forces on the arm of the first surgical robot balance an opposing candidate force on the arm of the second surgical robot.
