System and method for damping operations of medical devices

Abstract

Regarding robotic arms, in particular, we provide a system for damping operations of medical instruments in robot-assisted medical systems. [Solution] The system includes a robotic joint configured for use with a robotic arm having one or more links and one or more joints that work together to move the medical device, and a control unit configured to receive the current position of the robotic joint as the medical device moves in three-dimensional space, determine the distance between the current position of the robotic joint and a first range of motion of the robotic joint, and apply a damping function to the robotic joint based on the distance to correct the resistance to the movement of the medical device.

Description

Technical Field

[0001] This application relates to a robotic arm, and more particularly to the damping operation of medical instruments in a robotic-assisted medical system.

Background Art

[0002] In certain medical procedures, a robotic-enabled medical system can be used to control the insertion and / or manipulation of instruments and their end effectors. The robotic-enabled medical system may include a robotic arm or other instrument positioning device. The robotic-enabled medical system may also include a controller used to control the positioning of the instrument during the procedure.

Summary of the Invention

Means for Solving the Problems

[0003] The systems, methods, and devices of the present disclosure each have several innovative aspects, and no single one of the desirable attributes disclosed herein alone encompasses them all.

[0004] According to various aspects, a system for damping operation of a medical instrument is disclosed. The system includes a robotic arm having one or more links and one or more joints that cooperate to move the medical instrument, and a control unit that receives the position and velocity of a first joint among the one or more joints, applies a damping function to the first joint based on the received position or velocity to modify the force or torque of the first joint, and changes the damping function applied to the first joint based on the position or velocity when the position or velocity changes while the medical instrument is moving.

[0005] In some embodiments, the damping function is based on the current position of the robot arm relative to a virtual wall. In some embodiments, the damping function causes a reduction in the velocity of the first joint when it reaches the pre-tactile limit relative to the virtual wall. In some embodiments, the damping function changes the damping coefficient as the first joint moves between the pre-tactile limit and the virtual wall. In some embodiments, the damping coefficient increases as the first joint moves from the pre-tactile limit toward the virtual wall. In some embodiments, the damping coefficient remains constant when the first joint moves beyond the virtual wall. In some embodiments, the damping function determines the damping coefficient based on the velocity of the robot arm. In some embodiments, the damping function changes the damping coefficient as the velocity of the robot arm increases. In some embodiments, the robot arm is impedance controllable. In some embodiments, the damping function includes a first damping region and a second damping region that are selectable to modify the force or torque of the first joint based on the current position or velocity of the first joint, the first damping region modifying the force or torque differently from the second damping region. In some embodiments, the damping function includes (i) a first damping region that modifies the force or torque of the first joint by a variable amount in response to the current position of the first joint satisfying a first threshold, and (ii) a second damping region that modifies the force or torque according to a fixed amount in response to the current position of the first joint satisfying a second threshold.

[0006] According to various embodiments, a system for damping operations of a medical device comprises a robotic joint configured for use with a robotic arm having one or more links and one or more joints that cooperate to move the medical device, and a control unit, The system includes a control unit configured to receive the current position of a robot joint as the medical device moves in three-dimensional space, determine the distance between the current position of the robot joint and a first range of motion of the robot joint, and apply a damping function to the robot joint based on the distance to correct the resistance to the movement of the medical device. In some embodiments, the control unit determines the current velocity of the robot joint, It is further configured to change the damping function applied to the robot joints based on the current velocity and current position.

[0007] According to various embodiments, a method for damping a medical device includes providing a robotic joint configured for use with a robotic arm having one or more links and one or more joints that cooperate to move the medical device; receiving the current position of the robotic joint as the medical device is moved in three-dimensional space; determining the distance between the current position of the robotic joint and a first range of motion of the robotic joint; and applying a damping function to the robotic joint based on the distance to modify the resistance to the movement of the medical device. In some embodiments, the method also includes determining the current velocity of the robotic joint, The method further includes changing the damping function applied to the robot joint based on the current velocity and current position. In some embodiments, determining the damping function further includes determining a first damping coefficient for correcting the resistance force or torque to the movement of the robot joint when the distance satisfies a first threshold, and determining a second damping coefficient for correcting the resistance force or torque when the distance satisfies a second threshold.

[0008] It will be understood that other configurations of the subject art will be readily apparent to those skilled in the art from the following detailed description, in which various configurations of the subject art are shown and described as examples. As will be understood, the subject art may also have other different configurations, and some of its details may be modified in various other ways without departing from the spirit of the subject art. Therefore, the drawings and description will be considered illustrative rather than restrictive. [Brief explanation of the drawing]

[0009] The disclosed aspects will be described below in conjunction with the attached drawings, and will be shown, but not limited to, the disclosed aspects, and similar designations will indicate similar elements. [Figure 1]This illustrates one exemplary embodiment of a cart-based robotic system positioned for diagnostic and / or therapeutic bronchoscopy procedures. [Figure 2] Further aspects of the robot system shown in Figure 1 are depicted. [Figure 3] Another exemplary embodiment of the robotic system shown in Figure 1, configured for ureteroscopy, is presented. [Figure 4] Another exemplary embodiment of the robotic system shown in Figure 1, configured for vascular procedures, is presented. [Figure 5] This shows an exemplary embodiment of a table-based robotic system positioned for bronchoscopy procedures. [Figure 6] A second diagram of the robot system shown in Figure 5 is provided. [Figure 7] An example of a system configured to house a robotic arm is shown. [Figure 8] An exemplary embodiment of a table-based robotic system configured for ureteroscopy procedures is shown. [Figure 9] An exemplary embodiment of a table-based robotic system configured for laparoscopic procedures is shown. [Figure 10] Figures 5 to 9 illustrate an exemplary embodiment of a table-based robot system having pitch or tilt adjustment. [Figure 11] Figures 5 to 10 provide illustrative diagrams of the interface between tables and columns in a table-based robot system. [Figure 12] An example of a device driver is shown. [Figure 13] An exemplary medical device having a pair of instrument drivers is shown. [Figure 14] A second design of an instrument driver and instrument is shown, in which the shaft of the drive unit is parallel to the shaft of the instrument's elongated shaft. [Figure 15] A block diagram is drawn showing a positioning system for estimating the position of one or more elements of the robot system shown in Figures 1 to 10, such as the position of the devices shown in Figures 13 and 14, according to an exemplary embodiment. [Figure 16A]A block diagram showing an exemplary embodiment of a robot-enabled medical system including a controller for a robot-enabled medical device. [Figure 16B] A block diagram showing an exemplary embodiment of the controller of FIG. 16A that can be configured for hybrid impedance and admittance control. [Figure 16C] An isometric view of an exemplary embodiment of a controller including two gimbals and a positioning platform. [Figure 17] An isometric view of an exemplary embodiment of a gimbal for a controller. [Figure 18] An exemplary damping function for applying a constant virtual damping is shown. [Figure 19] A perspective view of a second embodiment of a controller according to the subject technology disclosed herein. [Figure 20A] A first exemplary damping function including four regions for selecting different damping coefficients according to aspects of the subject technology disclosed herein is shown. [Figure 20B] A second exemplary damping function including a transition regime is shown. [Figure 20C] A third exemplary damping function including multiple transition regimes is shown. [Figure 21] An exemplary process for variable damping of a manual control input device that provides damping control for a medical device according to aspects of the subject technology disclosed herein is shown. [Figure 22] A first exemplary virtual tactile wall for a robotic joint including a tactile wall damping region according to aspects of the subject technology disclosed herein is shown. [Figure 23] A second exemplary virtual tactile wall for a robotic joint including a tactile wall damping region and a pre-tactile wall damping region according to aspects of the subject technology disclosed herein is shown. [Figure 24] An exemplary damping function for damping the movement of a joint including damping within a pre-tactile wall damping region and damping within a tactile wall damping region according to aspects of the subject technology disclosed herein is shown. [Figure 25]This specification describes an exemplary process for damping operations of medical devices according to aspects of the subject technology disclosed herein. [Modes for carrying out the invention]

[0010] 1. Overview. Aspects of this disclosure may be integrated into a robot-enabled medical system capable of performing a variety of medical procedures, including both minimally invasive procedures such as laparoscopy and non-invasive procedures such as endoscopy. This system can perform endoscopic procedures such as bronchoscopy, ureteroscopy, and gastroscopy.

[0011] In addition to performing a wide range of procedures, the system can offer additional benefits such as enhanced imaging and guidance to assist physicians. Furthermore, the system can give physicians the ability to perform procedures with improved ease of use, allowing one or more of the system's instruments to be controlled by a single user.

[0012] Various embodiments will be described below, along with drawings, for illustrative purposes. It should be understood that many other implementations of the concepts of this disclosure are conceivable, and various advantages may be realized in such implementations. This specification includes headings for reference and to help locate the various sections. These headings are not intended to limit the scope of the concepts described therein. Such concepts may be applied throughout this specification.

[0013] A. Robot system - cart. Robot-enabled medical systems can be configured in various ways depending on the specific procedure. Figure 1 shows one embodiment of a cart-based robot-enabled system 10 arranged for diagnostic and / or therapeutic bronchoscopy procedures. During a bronchoscopy, the system 10 may include a cart 11 having one or more robotic arms 12 for delivering medical instruments, such as a maneuverable endoscope 13 which may be a procedure-specific bronchoscope for bronchoscopy, to a natural opening access point (i.e., the patient's mouth positioned on a table in this example) for delivering diagnostic and / or therapeutic tools. As shown, the cart 11 can be positioned close to the patient's upper torso to provide access to the access point. Similarly, the robotic arms 12 can be actuated to position the bronchoscope relative to the access point. The arrangement in Figure 1 can also be used when performing gastrointestinal (GI) procedures using a gastroscope, which is an endoscope specifically designed for GI procedures. Figure 2 shows an example of a cart embodiment in more detail.

[0014] Continuing to refer to Figure 1, once the cart 11 is properly positioned, the robotic arm 12 can insert the maneuverable endoscope 13 into the patient robotically, manually, or a combination thereof. As shown, the maneuverable endoscope 13 may comprise at least two nesting parts, such as an inner leader section and an outer sheath section, each section coupled to a separate instrument driver from a set of instrument drivers 28, each instrument driver being coupled to the distal end of an individual robotic arm. This linear arrangement of the instrument drivers 28, which facilitates the coaxial alignment of the leader section with the sheath section, creates a “virtual rail” 29 that allows one or more robotic arms 12 to be repositioned in space by skillfully maneuvering them at various angles and / or positions. The virtual rail described herein is depicted in the figure using dashed lines, and therefore the dashed lines do not depict any physical structure of the system. Translation of the instrument drivers 28 along the virtual rail 29 causes the inner leader section to nest with the outer sheath section, or moves the endoscope 13 forward or backward from the patient. The angle of the virtual rail 29 can be adjusted, translated, or pivoted based on clinical use or physician preference. For example, in bronchoscopy, the angle and position of the virtual rail 29 shown represent a compromise between providing physician access to the endoscope 13 and minimizing friction resulting from bending the endoscope 13 into the patient's mouth.

[0015] The endoscope 13 may be directed downstream of the patient's trachea and lungs after insertion using precise commands from the robotic system until it reaches the target location or surgical site. To enhance navigation through the patient's lung network and / or reach the desired target, the endoscope 13 can be manipulated to enhance joint movement and increase the bending radius by extending the inner leader section in a nested manner from the outer sheath section. The use of a separate instrument driver 28 also allows the leader section and the sheath section to be driven independently of each other.

[0016] For example, the endoscope 13 may be directed to deliver a biopsy needle to a target such as a lesion or nodule in the patient's lung. The needle can be extended to a working channel along the length of the endoscope to obtain a tissue sample to be analyzed by a pathologist. Depending on the pathological results, further tools can be extended to the working channel of the endoscope for further biopsies. After identifying a nodule as malignant, the endoscope 13 can deliver tools endoscopically to excise the potentially cancerous tissue. In some cases, diagnostic and therapeutic procedures may need to be delivered in separate procedures. In these situations, the endoscope 13 may also be used to deliver a reference to "mark" the location of the target nodule. In other cases, diagnostic and therapeutic procedures can be delivered during the same procedure.

[0017] System 10 may also include a tower 30 connected to the cart 11 via support cables, which can provide support for control, electronics, fluid elements, optics, sensors, and / or power to the cart 11. According to various embodiments, the tower 30 may function as, or include, a control unit for the operation of various components of the robotic system, including the robotic arm(s) and haptic interface devices described herein. By placing such functions in the tower 30, the form factor of the cart 11 can be reduced, and the surgeon and their staff can more easily adjust and / or reposition the cart 11. Additionally, the separation of functions between the cart / table and the support tower 30 reduces clutter in the operating room and facilitates improved clinical workflow. The cart 11 may be positioned close to the patient, while the tower 30 can be housed in a separate location so as not to interfere during the procedure. In some embodiments, the tower 30 may be movable.

[0018] To support the robotic system described above, the tower 30 may include components of a computer-based control system that store computer program instructions in a non-temporary computer-readable storage medium, such as a persistent magnetic memory drive or a solid-state drive. The execution of these instructions may control the entire system or its subsystems, whether the execution takes place within the tower 30 or within the cart 11. For example, when executed by the processor of the computer system, the instructions can cause components of the robotic system to actuate the carriage and arm mount, actuate the robotic arm, and control medical devices. For example, in response to receiving a control signal, motors in the joints of the robotic arm may position the arm in a specific posture.

[0019] The tower 30 may also include a pump, flow meter, valve control, and / or fluid access to provide controlled irrigation and suction capabilities to the system that can be deployed through the endoscope 13. These components may also be controlled using the computer system of the tower 30. In some embodiments, irrigation and suction capabilities can be brought directly to the endoscope 13 via separate cables.

[0020] The tower 30 may include voltage and surge protectors designed to provide filtered and protected power to the cart 11, thereby avoiding the need to place power transformers and other auxiliary power components within the cart 11, making the cart 11 smaller and more portable.

[0021] Tower 30 may also include support equipment for sensors deployed throughout the robot system 10. For example, Tower 30 may include optoelectronic equipment for detecting, receiving, and processing data received from optical sensors or cameras throughout the robot system 10. In combination with a control system, such optoelectronic equipment can be used to generate real-time images for display on any number of consoles deployed throughout the system, including within Tower 30. Similarly, Tower 30 may also include electronic subsystems for receiving and processing signals from deployed electromagnetic (EM) sensors. Tower 30 can also be used to house and position EM field generators for detection by EM sensors within or on medical devices.

[0022] Tower 30 may also include console 31, in addition to other consoles available in the rest of the system, such as a console mounted on top of a cart. Console 31 may include a user interface and a display screen, such as a touchscreen, for the operator, a physician. The consoles of system 10 are typically designed to provide both robotic control and pre-operative and real-time information of the procedure, such as navigation and positioning information for the endoscope 13. If console 31 is not the only console available to the physician, a second operator, such as a nurse, may also use console 31 to monitor the patient's health or life and the system's progress, as well as to provide procedure-specific data such as navigation and positioning information. In other embodiments, console 30 is housed in a separate body from tower 30.

[0023] The tower 30 may be connected to the cart 11 and the endoscope 13 via one or more cables or connectors (not shown). In some embodiments, the support functions from the tower 30 are provided to the cart 11 through a single cable, thereby simplifying and organizing the operating room. In other embodiments, specific functions can be connected via separate cables and connectors. For example, power can be supplied to the cart through only one power cable, while support for control devices, optics, fluid elements, and / or navigation can be provided through separate cables.

[0024] Figure 2 provides a detailed diagram of an embodiment of a cart from the cart-based robot-enabled system shown in Figure 1. The cart 11 typically includes an elongated support structure 14 (often referred to as a “column”), a cart base 15, and a console 16 located at the top of the column 14. The column 14 may include one or more carriages, such as carriages 17 (alternatively referred to as “arm supports”), for supporting the deployment of one or more robot arms 12 (three are shown in Figure 2). The carriages 17 may include individually configurable arm mounts that rotate along orthogonal axes to adjust the base of the arms 12 for better positioning relative to the patient. The carriages 17 also include a carriage interface 19 that allows the carriages 17 to translate vertically along the column 14.

[0025] The carriage interface 19 is connected to the column 14 through slots such as slots 20 positioned on both sides of the column 14 to guide the vertical translation of the carriage 17. The slots 20 contain vertical translation interfaces for positioning and holding the carriage at various vertical heights relative to the cart base 15. The vertical translation of the carriage 17 allows the cart 11 to adjust the reach of the robotic arm 12 to meet various table heights, patient sizes, and physician preferences. Similarly, individually configurable arm mounts on the carriage 17 allow the robotic arm base 21 of the robotic arm 12 to be angled in various configurations.

[0026] In some embodiments, a slot cover may be added to the slot 20, which is coplanar and parallel to the slot surface, to prevent dirt and fluid from entering the internal chamber of the column 14 and the vertical translation interface as the carriage 17 translates vertically. The slot cover can be deployed through a pair of spring spools positioned near the vertical top and bottom of the slot 20. The cover is coiled within the spool until it unfolds from a coiled state to expand and contract as the carriage 17 translates vertically up and down. The spring mechanism of the spool provides a force that retracts the cover into the spool when the carriage 17 translates toward the spool, while also maintaining a seal when the carriage 17 translates toward the spool. To ensure that the cover expands and contracts appropriately as the carriage 17 translates, the cover can be attached to the carriage 17 using, for example, a bracket located at the carriage interface 19.

[0027] Column 14 may include internal mechanisms such as gears and motors, designed to use vertically aligned main screws to mechanically translate the carriage 17 in response to control signals generated in response to user input, such as input from a console 16.

[0028] The robotic arm 12 may generally include a robotic arm base 21 and end effectors 22 separated by a series of links 23 connected by a series of joints 24, each joint including an independent actuator, and each actuator including an independently controllable motor. Each separately controllable joint represents an independent degree of freedom that the robotic arm can use. Each arm 12 has seven joints, resulting in seven degrees of freedom. The numerous joints result in numerous degrees of freedom, enabling "redundant" degrees of freedom. Redundant degrees of freedom allow the robotic arm 12 to position its respective end effectors 22 in space at specific positions, orientations, and trajectories using various link positions and joint angles. This allows the system to position and orient medical instruments from desired locations in space, while allowing physicians to move the arm joints to clinically convenient positions away from the patient to provide greater access while avoiding arm collisions.

[0029] The cart base 15 balances the weight of the column 14, carriage 17, and arm 12 on the floor. Thus, the cart base 15 houses heavier components, such as electronics, motors, power supplies, and components that enable either movement or fixation of the cart. For example, the cart base 15 includes casters 25 with rotatable wheels that allow the cart to be easily moved around the room before treatment. Once it reaches the appropriate position, the casters 25 may be prevented from moving using wheel locks to hold the cart 11 in place during treatment.

[0030] The console 16, positioned at the vertical end of column 14, provides both a user interface and a display screen (or a dual-purpose device such as a touchscreen 26) for receiving user input, and provides the physician user with both preoperative and intraoperative data. Potential preoperative data on the touchscreen 26 may include preoperative planning, navigation and mapping data derived from preoperative computerized tomography (CT) scans, and / or notes from preoperative patient interviews. Intraoperative data on the display may include essential patient statistics such as respiration, heart rate, and / or pulse, along with optical information provided by the tools, sensor information and coordinate information from sensors. The console 16 can be positioned and tilted to allow the physician to access the console from the column 14 side opposite the carriage 17. From this position, the physician can view the console 16, the robotic arm 12, and the patient while operating the console 16 from behind the cart 11. As shown, the console 16 also includes a handle 27 that helps to skillfully maneuver and stabilize the cart 11.

[0031] Figure 3 shows an embodiment of the robot-enabled system 10 configured for ureteroscopy. In a ureteroscopy procedure, the cart 11 can be positioned to deliver a ureteroscope 32, a procedure-specific endoscope designed to pass through the patient's urethra and ureters, to the patient's lower abdominal region. In ureteroscopy, it is sometimes desirable that the ureteroscope 32 be directly aligned with the patient's urethra to minimize friction and force against sensitive anatomical structures in that region. As shown, the cart 11 can be positioned on a table leg to allow the robot arm 12 to position the ureteroscope 32 for direct linear access to the patient's urethra. From the table leg, the robot arm 12 can insert the ureteroscope 32 along a virtual rail 33 directly into the patient's lower abdomen through the urethra.

[0032] After being inserted into the urethra using control techniques similar to those used in bronchoscopy, the ureteroscope 32 may be navigated to the bladder, ureters, and / or kidneys for diagnostic and / or therapeutic purposes. For example, the ureteroscope 32 can be directed to the ureters and kidneys, and a laser or ultrasonic lithotripter deployed below the working channel of the ureteroscope 32 can be used to break up any formed kidney stones. After lithotripsy is complete, the resulting stone fragments can be removed using a basket that deploys the ureteroscope 32.

[0033] Figure 4 shows an embodiment of a robot-enabled system similarly configured for vascular procedures. In vascular procedures, the system 10 may be configured such that a cart 11 can deliver a medical instrument 34, such as a maneuverable catheter, to an access point in the femoral artery in the patient's leg. The femoral artery provides both a larger diameter for navigation and a relatively less detour and tortuous passage to the patient's heart, thereby facilitating navigation. By positioning the cart 11 toward the patient's leg and lower abdomen, as seen in ureteroscopy procedures, it is possible to provide a robotic arm 12 with a virtual rail 35 for direct linear access to the femoral artery access point in the patient's thigh / lumbar region. After insertion into the artery, the medical instrument 34 can be oriented and inserted by translating the instrument driver 28. In addition to or instead of this, the cart may be positioned around the patient's upper abdomen to reach alternative vascular access points, such as the carotid and brachial arteries near the shoulder and wrist.

[0034] B. Robot system - Table. Embodiments of robot-enabled medical systems may also incorporate a patient table. Incorporating a table can reduce the amount of capital equipment in the operating room by removing the cart and improve access to the patient. Figure 5 shows one embodiment of such a robot-enabled system configured for bronchoscopy procedures. System 36 includes a support structure or column 37 for supporting a platform 38 (illustrated as “table” or “bed”) across the entire floor. Similar to cart-based systems, the end effector of the robotic arm 39 of system 36 includes an instrument driver 42 designed to skillfully manipulate elongated medical instruments, such as the bronchoscope 40 in Figure 5, through or along a virtual rail 41 formed from the linear alignment of the instrument driver 42. In practice, by placing the emitter and detector around the table 38, the C-arm for obtaining fluoroscopic imaging can be positioned across the entire upper abdominal region of the patient.

[0035] Figure 6 provides another diagram of the system 36 without a patient and medical equipment for illustrative purposes. As shown, the column 37 may include one or more carriages 43, shown as a ring shape, which can serve as bases for one or more robotic arms 39 in the system 36. The carriages 43 can translate along a vertical column interface 44 running along the length of the column 37, providing various viewpoints from which the robotic arms 39 can be positioned to reach the patient. The carriages 43 can rotate around the column 37 using a mechanical motor positioned within the column 37, allowing the robotic arms 39 to access multiple sides of a table 38, such as both sides of the patient. In embodiments with multiple carriages, the carriages may be positioned separately on the column and may translate and / or rotate independently of other carriages. The carriages 43 do not need to surround the column 37, nor do they even need to be circular, but the illustrated ring shape facilitates the rotation of the carriages 43 around the column 37 while maintaining structural balance. The rotation and translation of the carriage 43 allows the system to position medical instruments such as endoscopes and laparoscopes at various access points on the patient. In other embodiments (not shown), the system 36 may include a patient table or patient bed having an adjustable arm support in the form of a bar or rail extending alongside it. One or more robotic arms 39 can be attached to the vertically adjustable arm support (e.g., via a shoulder having an elbow joint). The vertical adjustment allows the robotic arms 39 to be compactly housed under the patient table or patient bed and then conveniently raised during treatment.

[0036] The arm 39 may be mounted on the carriage via a set of arm mounts 45, each having a series of joints that can individually rotate and / or extend in a nesting manner to provide additional configurability for the robot arm 39. Furthermore, the arm mounts 45 can be positioned on the carriage 43, and when the carriage 43 is rotated appropriately, the arm mounts 45 can be positioned on the same side of the table 38 (as shown in Figure 6), on either side of the table 38 (as shown in Figure 9), or on adjacent sides of the table 38 (not shown).

[0037] Column 37 structurally provides support for the table 38 and a path for the vertical translation of the carriage. Internally, column 37 may include a main screw for guiding the vertical translation of the carriage and a motor for mechanizing the translation of the carriage based on the main screw. Column 37 can also transmit power signals and control signals to the carriage 43 and to the robotic arm 39 attached thereto.

[0038] The table base 46 performs a similar function to the cart base 15 of the cart 11 shown in Figure 2, and accommodates heavier components to balance the table / bed 38, column 37, carriage 43, and robot arm 39. The table base 46 can also incorporate rigid casters to provide stability during treatment. The casters, which extend from the bottom of the table base 46, extend in opposite directions on both sides of the base 46 and can be retracted when it is necessary to move the system 36.

[0039] Continuing with Figure 6, the system 36 may also include a tower (not shown) that divides the functions of the system 36 between the table and the tower, thereby reducing the form factor and bulk of the table. As seen in previously disclosed embodiments, the tower can provide the table with various supporting functions such as processing power, computing power, and control power, power, fluid elements, and / or optical and sensor processing. The tower can also be moved to be positioned away from the patient to improve physician access and keep the operating room tidy. Furthermore, by placing components in the tower, it becomes possible to expand storage space in the table base for possible accommodation of robotic arms. The tower may also include a master controller or console that provides both a user interface for user input, such as a keyboard and / or pendant, and a display screen (or touchscreen) for preoperative and intraoperative information, such as real-time imaging, navigation, and tracking information. In some embodiments, the tower may also include a holder for a gas tank used for ventilation.

[0040] In some embodiments, the table base may house and store a robot arm when not in use. Figure 7 shows a system 47 for housing a robot arm in one embodiment of a table-based system. In system 47, the carriage 48 can be translated vertically into the base 49 so that the robot arm 50, arm mount 51, and carriage 48 are housed within the base 49. The base cover 52 can be translated to allow the carriage 48, arm mount 51, and arm 50 to unfold around the column 53, retracted and opened, and closed to store and protect them when not in use. The base cover 52 can be sealed with a membrane 54 along the edge of its opening to prevent the ingress of dirt and fluids when closed.

[0041] Figure 8 shows one embodiment of a robot-enabled table-based system configured for ureteroscopy procedures. In ureteroscopy, the table 38 may include a swivel section 55 for positioning the patient at an off-angle from the column 37 and the table base 46. The swivel section 55 can rotate or pivot about a pivot point (e.g., located below the patient's head) to position the bottom of the swivel section 55 away from the column 37. For example, pivoting the swivel section 55 allows a C-arm (not shown) to be positioned across the patient's lower abdomen without competing for space with the column (not shown) below the table 38. By rotating a carriage 35 (not shown) around the column 37, the robotic arm 39 may directly insert the ureteroscope 56 into the patient's inguinal region along a virtual rail 57 to reach the urethra. In ureteroscopy, stirrups 58 may also be attached to the swivel section 55 of the table 38 to support the patient's leg position throughout the procedure and to allow clear access to the patient's inguinal region.

[0042] In laparoscopic procedures, minimally invasive instruments may be inserted into the patient's anatomical structures through small incisions in the patient's abdominal wall. In some embodiments, the minimally invasive instruments include elongated, rigid members such as shafts used to access anatomical structures within the patient. After the patient's abdominal cavity is expanded, the instrument can be directed to perform surgical or medical tasks such as grasping, cutting, ablation, and suturing. In some embodiments, the instrument may include a scope such as a laparoscope. Figure 9 shows one embodiment of a robot-enabled table-based system configured for laparoscopic procedures. As illustrated in Figure 9, the carriage 43 of the system 36 may rotate and be vertically adjusted to position a pair of robotic arms 39 on either side of the table 38 so that the instrument 59 can be positioned using arm mounts 45 to pass through minimal incisions on either side of the patient and reach the patient's abdominal cavity.

[0043] To accommodate laparoscopic procedures, the robot-enabled table system may also tilt the platform to a desired angle. Figure 10 shows one embodiment of a pitch-adjustable or tilt-adjustable robot-enabled medical system. As shown in Figure 10, the system 36 positions one part of the table higher off the floor than the other part to accommodate the tilt of the table 38. Furthermore, the arm mount 45 can rotate to match the tilt such that the arm 39 maintains the same planar relationship as the table 38. To accommodate steep angles, the column 37 may also include a nested section 60 that allows for vertical extension of the column 37 to prevent the table 38 from contacting the floor or colliding with the base 46.

[0044] Figure 11 provides a detailed diagram of the interface between the table 38 and the column 37. A pitch rotation mechanism 61 can be configured to change the pitch angle of the table 38 relative to the column 37 with multiple degrees of freedom. The pitch rotation mechanism 61 can be activated by positioning orthogonal axes 1 and 2 in the column-table interface, with each axis actuated by separate motors 3 and 4 in response to an electrical pitch angle command. Rotation along one screw 5 is thought to allow tilt adjustment along one axis 1, while rotation along another screw 6 is thought to allow tilt adjustment along the other axis 2. In some embodiments, a ball joint can be used to change the pitch angle of the table 38 relative to the column 37 with multiple degrees of freedom.

[0045] For example, pitch adjustment is particularly useful when positioning the table in the Trendelenburg position, that is, when positioning the patient's lower abdomen higher off the floor than the patient's lower abdomen for lower abdominal surgery. The Trendelenburg position allows gravity to slide the patient's internal organs into the upper abdomen, emptying the abdominal cavity when minimally invasive tools are inserted to perform lower abdominal surgical or medical procedures such as laparoscopic prostatectomy.

[0046] C. Equipment drivers and interfaces. The end effector of the system's robotic arm includes (i) an instrument driver (alternatively called an "instrument drive mechanism" or "instrument device manipulator") that incorporates electromechanical means for operating a medical instrument, and (ii) a removable or detachable medical instrument which may lack any electromechanical components such as a motor. This dichotomy may arise from the need to sterilize medical instruments used in medical procedures and the inability to adequately sterilize expensive capital equipment due to the complex mechanical assembly and sensitive electronics of the medical instruments. Therefore, medical instruments can be designed to be detached, removed, and replaced from the instrument driver (and by extension, the system) during individual sterilization or disposal by the physician or physician's staff. In contrast, the instrument driver does not need to be replaced or sterilized and can be covered with a cloth for protection.

[0047] Figure 12 shows an exemplary instrument driver. Positioned at the distal end of a robotic arm, the instrument driver 62 consists of one or more drive units 63 arranged with parallel axes to provide controlled torque to a medical instrument via a drive shaft 64. Each drive unit 63 comprises a separate drive shaft 64 for interacting with the instrument, a gearhead 65 for converting motor shaft rotation into a desired torque, a motor 66 for generating the drive torque, an encoder 67 for measuring the rotational speed of the motor shaft and providing feedback to the control circuit, and a control circuit 68 for receiving a control signal and operating the drive unit. Each drive unit 63 is controlled and motorized independently of others, and the instrument driver 62 can provide multiple (four in Figure 12) independent drive outputs to the medical instrument. When operating, the control circuit 68 is thought to receive a control signal, transmit a motor signal to the motor 66, compare the resulting motor rotational speed measured by the encoder 67 with a desired rotational speed, and modulate the motor signal to produce the desired torque.

[0048] For procedures requiring a sterile environment, the robotic system may incorporate a drive interface, such as a sterilization adapter connected to a sterilization drape, positioned between the instrument driver and the medical instrument. The primary purpose of the sterilization adapter is to transmit angular motion from the instrument driver's drive shaft to the instrument's drive input while maintaining physical separation of the drive shaft and drive input, and thus sterility. Thus, an example of a sterilization adapter may consist of a set of rotational inputs and outputs intended to be opposed to the instrument driver's drive shaft, and a drive input to the instrument. The sterilization drape connected to the sterilization adapter is made of a thin, flexible material such as clear or translucent plastic and is designed to cover the instrument driver, robotic arm, and capital equipment such as a cart (in a cart-based system) or table (in a table-based system). The use of the drape allows the capital equipment to be positioned close to the patient while still remaining in an area where sterilization is not required (i.e., a non-sterilized field). On the other side of the sterilization drape, the medical instrument can be connected to the patient at an interface in the area where sterilization is required (i.e., a sterile field).

[0049] D. Medical devices. Figure 13 shows an exemplary medical instrument with a pair of instrument drivers. Like other instruments designed for use in robotic systems, the medical instrument 70 comprises an elongated shaft 71 (or elongated body) and an instrument base 72. The instrument base 72, also called an “instrument handle” due to its design intended for manual interaction by a physician, may have a rotary drive input 73, such as a receptacle, pulley, or spool, which is designed to face a drive output 74 that penetrates the drive interface on the instrument driver 75 at the distal end of a robotic arm 76. When physically connected, when latched, and / or coupled, the opposing drive input 73 of the instrument base 72 can share a rotation axis with the drive output 74 in the instrument driver 75, allowing for the transmission of torque from the drive output 74 to the drive input 73. In some embodiments, the drive output 74 may have a spline designed to face a receptacle on the drive input 73.

[0050] The elongated shaft 71 is designed to be delivered through either an anatomical opening or lumen, such as in an endoscope, or a minimally invasive incision, such as in a laparoscopy. The elongated shaft 71 may be flexible (e.g., having properties similar to an endoscope) or rigid (e.g., having properties similar to a laparoscope), or may include a customized combination of both flexible and rigid sections. When designed for laparoscopy, the distal end of the rigid elongated shaft can be connected to an end effector extending from an articulated list formed from a clevis with at least one degree of freedom, and the distal end of the rigid elongated shaft can be connected to a surgical tool or medical instrument, such as a gripper or scissors, which can be actuated based on a force from a tendon as the drive input rotates in response to torque received from the drive output 74 of the instrument driver 75. When designed for endoscopy, the distal end of a flexible elongated shaft may include a maneuverable or controllable bend that can be articulated and bent based on torque received from the drive output 74 of the instrument driver 75.

[0051] Torque from the instrument driver 75 is transmitted downstream of the elongated shaft 71 via tendons along the shaft 71. These individual tendons, such as pull wires, can be individually secured to individual drive inputs 73 within the instrument handle 72. From the handle 72, the tendons travel one or more pull lumens along the elongated shaft 71 and are secured to the distal portion of the elongated shaft 71 or to a wrist located at the distal portion of the elongated shaft. During surgical procedures such as laparoscopy, endoscopic procedures, or hybrid procedures, these tendons can be coupled to distal attachment end effectors such as wrists, grippers, or scissors. In such arrangements, the torque applied to the drive inputs 73 is thought to actuate the end effector in some way by transmitting tension to the tendons. In some embodiments, during surgical procedures, the tendons may move the end effector in one direction or another by rotating a joint around an axis. In addition to or instead of this, a tendon can be connected to one or more jaws of the gripping device at the distal end of the elongated shaft 71, such that the gripping device is closed by tension from the tendon.

[0052] In endoscopy, tendons may be coupled to flexures or articulation points positioned along the elongated shaft 71 (e.g., at the distal end) via adhesive, control rings, or other mechanical fixation. When fixed and attached to the distal end of a flexure, the torque applied to the drive input 73 is transmitted to the tendon, causing the softer flexure (sometimes called an articulation point or articulation region) to bend or articulate. Along the non-flexure sections, it may be convenient to equilibrium the radial forces resulting from the tension in the pull wire by making the individual pull lumens that orient the individual tendons along (or inward) the wall of the endoscope shaft spiral or spiral. The angles of the spirals and / or spacing between them can be varied or cleverly engineered for specific purposes, with narrower spirals resulting in inferior shaft compression under load, while reduced spiral degree results in superior shaft compression under load, but also exhibits bending limitations. At the other end of the spectrum, oriented the lumen parallel to the longitudinal axis of the elongated shaft 71 allows for controlled joint movement in the desired curved or articulated portion.

[0053] In endoscopic procedures, the elongated shaft 71 houses several components that support robotic procedures. The elongated shaft may consist of working channels for deploying surgical tools (or medical instruments), irrigation, and / or aspiration to the surgical site at the distal end of the shaft 71. The elongated shaft 71 may also house wires and / or optical fibers that transmit signals to and from an optical assembly, which may include an optical camera, at the distal end. The shaft 71 may also house optical fibers for transporting light from a proximal light source, such as a light-emitting diode, to the distal end of the shaft.

[0054] At the distal end of the instrument 70, the distal tip may include an opening for a working channel for delivering the tool to the surgical site for diagnosis and / or treatment, irrigation, and aspiration. The distal tip may also include a port for a camera, such as a fiberscope or digital camera, to capture images of the internal anatomical space. In connection with this, the distal tip may also include a port for a light source to illuminate the anatomical space when using the camera.

[0055] In the embodiment shown in Figure 13, the drive shaft axis, and therefore the drive input axis, is perpendicular to the axis of the elongated shaft. However, this arrangement complicates the rolling capability of the elongated shaft 71. As the elongated shaft 71 is rolled along its axis while the drive input 73 is stationary, the tendon leaves the drive input 73 and enters the lumen within the elongated shaft 71, resulting in undesirable entanglement of the tendon. Such resulting tendon entanglement can interfere with any control algorithm intended to predict the movement of the flexible elongated shaft during endoscopic procedures.

[0056] Figure 14 shows another design of the tool driver and tool, in which the axis of the drive unit is parallel to the axis of the tool's elongated shaft. As shown, the circular tool driver 80 comprises four drive units, whose drive outputs 81 are aligned parallel to each other at the end of the robot arm 82. The drive units and their respective drive outputs 81 are housed in a rotary assembly 83 of the tool driver 80, which is driven by one of the drive units within its assembly 83. In response to the torque provided by the rotary drive units, the rotary assembly 83 rotates along a circular bearing that connects the rotary assembly 83 to the non-rotating part 84 of the tool driver. Power and control signals can be transmitted from the non-rotating part 84 of the tool driver 80 to the rotary assembly 83 through electrical contacts and can be maintained through rotation by brushed slip ring connections (not shown). In other embodiments, the rotary assembly 83 can be integrated with the non-rotatable part 84 and thus respond to a separate drive unit that is not parallel to the other drive units. The rotation mechanism 83 enables the device driver 80 to rotate the drive unit and its respective drive outputs 81 as a single unit centered on the device driver shaft 85.

[0057] Similar to the embodiments disclosed previously, the instrument 86 may include an elongated shaft portion 88 and an instrument base 87 (shown by a transparent outer skin for illustrative purposes) which includes a plurality of drive inputs 89 (such as receptacles, pulleys, and spools) configured to receive drive outputs 81 in the instrument driver 80. Unlike the embodiments disclosed previously, the instrument shaft 88 extends from the center of the instrument base 87, and its axis is substantially parallel to the axis of the drive input portion 89, rather than being orthogonal as in the design of Figure 13.

[0058] When coupled to the rotating assembly 83 of the instrument driver 80, the medical instrument 86, including the instrument base 87 and instrument shaft 88, rotates together with the rotating assembly 83 around the instrument driver shaft 85. Because the instrument shaft 88 is positioned at the center of the instrument base 87, the instrument shaft 88 becomes coaxial with the instrument driver shaft 85 when mounted. Therefore, the rotation of the rotating assembly 83 causes the instrument shaft 88 to rotate around its own longitudinal axis. Also, because the instrument base 87 rotates together with the instrument shaft 88, none of the tendons connected to the drive input 89 on the instrument base 87 become entangled during rotation. Thus, the parallelism of the axes of the drive output 81, drive input 89, and instrument shaft 88 enables shaft rotation without any control tendons becoming entangled.

[0059] E. Navigation and control. Conventional endoscopy may involve the use of fluoroscopy (e.g., delivered via a C-arm) and other forms of radiation-based imaging modalities to provide intracavitary guidance to the operating physician. In contrast, the robotic systems intended by the subject technology can provide non-radiation-based navigation and localization means to reduce physician exposure to radiation and reduce the amount of equipment in the operating room. As used herein, the term “localization” may refer to determining and / or monitoring the position of an object within a reference coordinate system. Techniques such as preoperative imaging, computer vision, real-time EM tracking, and robot command data can be used individually or in combination to achieve a radiation-free surgical environment. In other cases where radiation-based imaging modalities are still used, preoperative imaging, computer vision, real-time EM tracking, and robot command data can be used individually or in combination to enhance the information that can only be obtained through radiation-based imaging modalities.

[0060] Figure 15 is a block diagram illustrating a positioning system 90 for estimating the location of one or more elements of a robotic system, such as the location of an instrument, according to an exemplary embodiment. The positioning system 90 may be a set of one or more computer devices configured to execute one or more instructions. The computer devices may be embodied by one (or more) processors and computer-readable memory in one or more components considered above. For example, the computer devices may be, but are not limited to, the tower 30 shown in Figure 1, the carts shown in Figures 1 to 4, and the beds shown in Figures 5 to 10.

[0061] As shown in Figure 15, the positioning system 90 may include a positioning module 95 that processes input data 91-94 to generate position data 96 of the distal end of the medical device. The position data 96 may be data or logic representing the location and / or orientation of the distal end of the device relative to a reference system. The reference system may be a reference system relative to the anatomical structure of a patient or to a known object such as an EM field generator (see the following discussion on EM field generators).

[0062] Here, various input data 91-94 are described in more detail. Preoperative mapping can be achieved through the use of low-dose CT scan acquisition. Preoperative CT scans are reconstructed into three-dimensional images that are visualized, for example, as "slices" of the patient's internal anatomical structures. When analyzed as a whole, it is possible to generate image-based models targeting anatomical cavities, anatomical spaces, and anatomical structures of the patient's anatomical structures, such as the patient's lung network. Techniques such as the centerline shape can be determined and approximated from the CT images to create a three-dimensional volume of the patient's anatomical structures called model data 91 (also called "preoperative model data" if generated using only preoperative CT scans). The use of the centerline shape is discussed in U.S. Patent Application No. 14 / 523,760, the contents of which are incorporated in their entirety herein. Network phase models can also be derived from CT images and are particularly suitable for bronchoscopy.

[0063] In some embodiments, the instrument may be equipped with a camera to provide visual data 92. The localization module 95 can process the visual data to enable one or more vision-based location tracking. For example, preoperative model data can be used in conjunction with the visual data 92 to enable computer vision-based tracking of a medical instrument (e.g., an endoscope, or an instrument that advances through the working channel of an endoscope). For example, using preoperative model data 91, the robotic system can generate a predicted endoscopic image library from the model based on the expected movement path of the endoscope, with each image linked to a location in the model. During surgery, the robotic system can refer to this library to aid in localization by comparing real-time images captured by a camera (e.g., a camera at the distal end of the endoscope) with those in the image library.

[0064] Other computer vision-based tracking techniques use feature tracking to determine the movement of the camera, and consequently, the endoscope. Several features of the localization module 95 can identify circular geometric shapes corresponding to anatomical lumens in preoperative model data 91, track changes in these geometric shapes, and determine which anatomical lumen was selected, as well as the relative rotation and / or translational movement of the camera. The use of phase maps can further enhance vision-based algorithms or techniques.

[0065] Optical flow, another computer vision-based technique, may analyze the displacement and translation of image pixels in a video sequence within visual data 92 to infer camera movement. Examples of optical flow techniques include motion detection, object segmentation calculation, luminance, motion compensation coding, and stereoscopic disparity measurement. By comparing multiple frames across multiple iterations, the movement and location of the camera (and therefore the endoscope) can be determined.

[0066] The positioning module 95 can generate the real-time position of the endoscope in a global coordinate system that can be registered in the patient's anatomical structure represented by a preoperative model, using real-time EM tracking. In EM tracking, an EM sensor (or tracker) consisting of one or more sensor coils embedded in one or more locations and orientations in a medical instrument (e.g., an endoscope instrument) measures fluctuations in the EM field produced by one or more static EM field generators positioned in known locations. The location information detected by the EM sensor is stored as EM data 93. An EM field generator (or transmitter) can be placed near the patient to produce a low-intensity magnetic field that the embedded sensor can detect. The magnetic field induces a small current in the sensor coil of the EM sensor, and this current can be analyzed to determine the distance and angle between the EM sensor and the EM field generator. This distance and orientation can be intraoperatively "oriented" to the patient's anatomical structure (e.g., preoperative model) to determine a geometric transformation that aligns the location in the preoperative model of the patient's anatomical structure with a single location in the coordinate system. Once aligned, an EM tracker embedded in one or more locations on the medical instrument (e.g., the distal tip of an endoscope) can provide a real-time display of the medical instrument's progression through the patient's anatomical structure.

[0067] Robot command and kinematic data 94 may also be used by a positioning module 95 to provide positioning data 96 for the robotic system. During preoperative calibration, device pitch and yaw derived from joint motion commands can be verified. Intraoperatively, these calibration measurements can be used in combination with known insertion depth information to estimate the position of the instrument. In addition to or instead of this, these calculations can be analyzed in combination with EM, vision, and / or phase modeling to estimate the position of the medical instrument in the network.

[0068] As shown in Figure 15, several other input data can be used by the positioning module 95. For example, although not shown in Figure 15, a device utilizing a shape-sensing fiber can provide shape data that the positioning module 95 can use to determine the position and shape of the device.

[0069] The positioning module 95 can use a combination of input data 91-94. In some cases, such a combination may use a probabilistic approach in which the positioning module 95 assigns confidence weights to locations determined from each of the input data 91-94. Therefore, if the EM data is unreliable (for example, if there is EM interference), the reliability of the location confirmed by the EM data 93 may decrease, and the positioning module 95 may rely more heavily on the visual data 92 and / or the robot command and kinematic data 94.

[0070] As discussed above, the robotic systems considered herein can be designed to incorporate one or more combinations of the above-described technologies. The computer-based control system of a tower, bed, and / or cart-based robotic system may store computer program instructions in a non-temporary computer-readable storage medium, such as a persistent magnetic memory drive or a solid-state drive, which, when executed, cause the system to receive and analyze sensor data and user commands, generate control signals for the entire system, and display navigation and localization data such as the position of instruments in a global coordinate system and an anatomical map.

[0071] 2. Controller for robot-compatible remote control systems Robot-enabled remote control systems, such as those described above, may include input devices or controllers configured to enable an operator (e.g., a physician performing a robot-enabled medical procedure) to operate and control one or more instruments. In some embodiments, the robot-enabled remote control system comprises a controller for operating one or more medical instruments. Those skilled in the art will understand that the controllers described herein may also be applicable in non-medical situations. For example, a controller may be useful for operating tools involving hazardous substances. In addition, in some embodiments, the controllers described herein may be useful for grasping objects in a physical and / or virtual environment. In some embodiments, the controller may be self-sufficient as a service robot interacting with a human operator. In some embodiments, the controller may be coupled (e.g., communicatively, electronically, electrically, wirelessly, and / or mechanically) with an instrument (e.g., a medical instrument) such that operation of the controller triggers a corresponding operation of the instrument. In some embodiments, the controller and instrument are arranged within a master-slave pair. In some embodiments, the controller may be referred to as a manipulator, emulator, master, interface, etc. In some embodiments, the controller may comprise multiple links assembled in parallel or in series.

[0072] A controller can function as an input device for an operator to control the movement of medical instruments such as endoscopes, intracavitary, laparoscopes, or open surgery instruments. Movement of the controller by the operator can lead to movement of the medical instrument. For example, if the operator translates the controller in three-dimensional space (e.g., up, down, left, right, backward, forward), the system can cause the corresponding translation of the medical instrument. Similarly, if the operator rotates the controller (e.g., around any of three orthogonal axes), the system can cause the corresponding rotational movement of the medical instrument. The controller can also include inputs that allow the operator to operate the medical instrument. For example, if the medical instrument includes a gripping device, the controller can include inputs that allow the operator to open and close the gripping device.

[0073] The controller can also provide perceptual feedback to the operator. For example, in some embodiments, force or torque applied to a medical device can be sent back to the operator via the controller. In some embodiments, providing perceptual feedback to the operator via the controller provides the user with an improved motion, control, or driving experience. In some embodiments, crisp haptic cues can be provided to facilitate the operator's interaction with the controller and operate the system.

[0074] In some embodiments, the controller is also used to align the operator's hand with the orientation of a medical instrument, for example, when switching medical instruments. For example, if a medical instrument is positioned within a patient during a medical procedure, it is important that the medical instrument does not move unexpectedly or unintentionally. Therefore, if the operator wishes to control a medical instrument that is already positioned within the body, the controller can first move to align with the orientation of the medical instrument while the instrument remains in place. With the controller precisely oriented to align with the orientation of the medical instrument, the operator can use the controller to operate the medical instrument.

[0075] In some embodiments, a robot-enabled medical system includes a controller having 7 degrees of freedom that follow the movements of an operator's hand, the 7 degrees of freedom including 3 positional degrees of freedom (e.g., translational motion in x, y, and z space), 3 rotational degrees of freedom (rotational motion around the pitch, roll, and yaw axes), and 1 (or more) instrument operating degrees of freedom (e.g., angular degrees of freedom). In some embodiments, the instrument operating degrees of freedom can control the opening and closing of an end effector of a medical instrument, such as a gripper or grasping device for holding an object. In some embodiments, the instrument operating degrees of freedom may be omitted. In some embodiments, the controller may include more or fewer degrees of freedom. For example, in some embodiments, the controller may include more than 3 positional degrees of freedom or more than 3 rotational degrees of freedom to provide one or more redundant degrees of freedom. In some embodiments, redundant degrees of freedom can provide the controller with additional mechanical flexibility, for example, to avoid singularities caused by the controller's mechanical structure.

[0076] Figure 16A shows a block diagram of an embodiment of the robot-enabled medical system 100, including a schematic diagram of an embodiment of the controller 102 and a schematic diagram of an embodiment of the robot-enabled medical device 310. As briefly described above, the controller 102 can be coupled with the robot-enabled medical device 310 such that operation of the controller 102 triggers substantially corresponding movements of the robot-enabled medical device 310, and the force applied to the robot-enabled medical device 310 can be sent back to the controller and perceptually communicated to the operator. In some embodiments, the controller 102 and the robot-enabled medical device 310 are arranged in a master-slave configuration.

[0077] In an illustrated embodiment of system 100, the controller 102 includes a handle 104, a gimbal 106, and a positioning platform 108. The handle 104 may be configured to be held by an operator. As shown, in some embodiments, the handle 104 is coupled to the gimbal 106 and the positioning platform 108. As described above, the handle 104 may include one or more degrees of freedom for operating the instrument. The gimbal 106 may be configured to provide one or more rotational degrees of freedom that allow an operator to rotate the handle 104. In some embodiments, the gimbal 106 is configured to provide at least 3 rotational degrees of freedom. For example, the gimbal 106 may be configured to allow an operator to rotate the handle 104 around the pitch, roll, and yaw axes. The positioning platform 108 may be configured to provide one or more translational (also referred to herein as positional) degrees of freedom that allow an operator to translate the handle 104. In some embodiments, the positioning platform 108 is configured to provide at least 3 positional degrees of freedom. For example, the positioning platform 108 may be configured to allow an operator to translate the handle 104 in three-dimensional space (e.g., in the x, y, and z directions). An exemplary positioning platform 108 can be seen in Figures 16C and 19 and will be described in more detail below. Together, the gimbal 106 and the positioning platform 108 can allow the user to operate the handle 104.

[0078] In the embodiments shown, the robot-compatible medical instrument 310 includes an instrument or tool 312 (which may include an end effector), an instrument driver 314, and a robotic arm 316 (or other instrument positioning device). The medical instrument 312 may be, for example, the laparoscopic instrument 59 shown in Figure 9 above, and other types of endoscopic or laparoscopic medical instruments described throughout this application and apparent to those skilled in the art. The medical instrument 312 may include an end effector or a plurality of end effectors. The end effector may be positioned at the distal end of the medical instrument 312. The end effector may be configured to be inserted into the patient's body. In some embodiments, the end effector may be, among other things, a gripper, a cutter, a basket device, or scissors. In some embodiments, the medical instrument 312 may include a scope or a camera.

[0079] The medical instrument 312 may be mounted on an instrument driver 314. The instrument driver 314 may be configured to actuate the medical instrument 312 as described above. For example, the instrument driver 314 may be configured to actuate the medical instrument 312 by pulling one or more pull wires of the medical instrument 312. In some embodiments, the instrument driver 314 may be an instrument drive mechanism as described above. The instrument driver 314 may be mounted on a robotic arm 316, for example, as shown in Figure 13. The robotic arm 316 may be configured to articulate or move to further manipulate and position the medical instrument 312. Exemplary medical instruments / tools, instrument drivers, and robotic arms are shown in the systems of Figures 1 to 15 above.

[0080] The controller 102 may be coupled with a robot-compatible medical instrument 310 such that the operation of the handle 104 causes substantially corresponding movement of the medical instrument 312, and the force applied to the medical instrument 312 can be perceptually transmitted to the operator through the handle 104. The operation of the handle 104 can be measured or determined by measuring the force and movement of the gimbal 106 and positioning platform 108. The movement of the medical instrument 312 may be caused by the joint movements and movements of the instrument driver 314 and / or the robot arm 316. Thus, by operating the handle 104, the operator can control the medical instrument 312.

[0081] In many cases, it is desirable that the controller 102 be easy for the operator to operate so that the operator can finely and precisely control the medical instrument 312 and use the controller 102 without becoming overly fatigued. One metric for measuring the ease of operation of a controller is the perceived inertia and / or perceived mass of the system. In some embodiments, the perceived inertia of the system is the mass of the system that the user perceives as a point mass when operating the handle 104. Generally, a controller 102 with lower perceived inertia may be easier to operate. In other embodiments, perceived inertia includes the moment of inertia that the user perceives when operating the handle 104.

[0082] As described below, the controllers described herein include several novel and non-obvious features that offer advantages over existing systems. In some embodiments, the controllers described herein are advantageously configured to employ damping algorithms and / or functions for precise control of both the controller, robotic arm, and medical device. According to various embodiments, the controllers disclosed herein operate in both admittance control and / or impedance control. As described below, hybrid controllers incorporating both admittance control and impedance control can provide an improved operating experience. According to various embodiments, the disclosed controllers can advantageously provide lower or reduced perceptual inertia compared to other controllers. In some embodiments, the disclosed controllers can provide improved perceptual feedback and response. Furthermore, as described below, in some embodiments, the controllers described herein can prevent or reduce the possibility of mechanical short circuits (described below) that could cause irregular and unpredictable movement. These and other features and advantages of the controllers described herein are further discussed in the following sections.

[0083] A. Hybrid Controller Figure 16B is a block diagram of one embodiment of a controller 102 configured to operate using both impedance control and admittance control. Such a controller 102 may be referred to as a hybrid controller.

[0084] Impedance control and admittance control are two control schemes for controlling robotic systems. Under impedance control, the system measures displacement (e.g., changes in position and velocity) and outputs force. For example, in impedance control, the system can measure how far or fast an operator moves the controller and, based on that measurement, generate force in the instrument (e.g., by activating a motor). Under impedance control, the operator's movement of the controller can back-drive parts of the instrument. Often, the use of impedance control can result in a large perceived inertia. This may be because, for example, impedance control relies on the operator moving the controller. Under impedance control, the operator may need to overcome its perceived mass or inertia to make the controller feel heavy in order to move it. In impedance control, the operator must physically overcome most or all of the inertia in the system in order to move the controller. Other controllers rely solely on impedance control, and therefore the system may have a higher perceived inertia or mass compared to the controllers described herein. Due to the higher perceived inertia, operators may become fatigued when using such other controllers.

[0085] Under admittance control, the system measures the force and / or torque applied to the controller by the operator and outputs the corresponding speed and / or position of the controller. In some respects, admittance control is the inverse of impedance control. In some embodiments, the use of admittance control can favorably result in a reduction of the perceived inertia or mass of the system. By using admittance control, the dynamics of a controller that is perceived to have high mass or inertia can be altered. In some cases, by using admittance control, the operator does not need to overcome all of the inertia in the system to move the controller. For example, under admittance control, when a user applies force to the controller, the system can measure the force and assist the user in moving the controller by driving one or more motors associated with the controller, thereby bringing the controller to a desired speed and / or position. In other words, in admittance control, a force sensor or load cell measures the force the operator is applying to the controller and moves the controller and the coupled robot-compatible medical device 310 so as to sense light. Under admittance control, the motor within the controller can help accelerate the mass, thus masking the perceived inertia of the controller. Therefore, admittance control can feel lighter than impedance control. In contrast, with impedance control, the user is involved in all or substantially all of the mass acceleration.

[0086] As shown in the illustrated embodiment of Figure 16B, the controller 102 includes a handle 104, a gimbal 106, and a positioning platform 108. As described above, the gimbal 106 may be configured to provide one or more rotational degrees of freedom (e.g., three or four), and the positioning platform 108 may be configured to provide one or more rotational degrees of freedom (e.g., three or four). The gimbal 106 and the positioning platform 108 enable the user to move the handle 104 in three-dimensional space and rotate the handle 104 around the pitch axis, roll axis, and yaw axis. Manipulation of the handle 104 results in the movement of the corresponding medical device. Furthermore, the handle 104, gimbal 106, and positioning platform 108 may be configured to provide the operator with perceptual feedback representing the force applied to the medical device.

[0087] As shown by the dashed box in Figure 16B, in the controller 102, the gimbal 106 is configured to be impedance controlled, and the positioning platform 108 is configured to be admittance controlled. Thus, in some embodiments, the translational or positional degrees of freedom of the positioning platform 108 depend on admittance control, and the rotational degrees of freedom of the gimbal 106 depend on impedance control. As will be further described below, this type of hybrid controller 102 can have several advantages. In other embodiments (not shown), the gimbal 106 is configured to be admittance controlled, and the positioning platform 108 is configured to be impedance controlled. In some embodiments, both the gimbal 106 and the positioning platform may be configured to be admittance controlled, or both may be configured to be impedance controlled.

[0088] To utilize admittance control, the controller 102 includes at least one force sensor or load cell 112. The load cell 112 is configured to measure the force applied to the controller 102 by the operator (typically the force applied to the handle 104). In addition to, or instead, as further described with respect to Figures 18-25, each joint of the controller 102 may report motion information, including current speed, velocity, force, and torque, including the force and / or torque applied to the joint.

[0089] Continuing to refer to Figure 16B, the output signal (measurement of force) of the load cell 112 is used to provide a control signal that controls the movement of the controller 102, such as the positioning platform 108. The robot-enabled medical instrument 310 follows the movement of the handle 104 (for example, by acting on one or more motors in the instrument driver 314 or the robot arm 316). In some embodiments, the load cell 112 may be a three-degree-of-freedom load cell that measures force in three directions.

[0090] In the shown embodiment, the load cell 112 is positioned within the gimbal 106. Other positions of the load cell 112 are possible. In some embodiments, the load cell 112 is positioned within the positioning platform 108. In some embodiments, more than one load cell 112 (e.g., two, three, four, or more load cells) may be included and positioned within the handle 104, the gimbal 106, and / or the positioning platform 108.

[0091] In some embodiments, the load cell 112 is positioned distally (closer to the handle 104) within the controller 102, which is advantageous. This is because, in some embodiments, admittance control can be used to conceal the perceived mass of the portion of the controller 102 located proximal to the load cell 112 (for example, the portion of the controller 102 located opposite the load cell 112 as seen from the handle 104).

[0092] Figure 16C is a perspective view of an embodiment of the controller 102. In the shown embodiment, the controller 102 is configured to enable the operation of one or more medical devices. As shown, the controller 102 may include a pair of handles 104. In some embodiments, the pair of handles 104 operate a single device, while in other embodiments, each of the pair of handles 104 operates its own corresponding device. Each handle 104 is connected to a gimbal 106. Each gimbal is connected to a positioning platform 108. In some embodiments, the handles 104 are considered distal to the gimbal 106, which is considered distal to the positioning platform 108. The handles 104 and gimbal 106 are shown in more detail in Figure 17 and described below.

[0093] As shown in Figure 16C, in the illustrated embodiment, each positioning platform 108 includes a selective compliance assembly robot arm (SCARA) arm 118 having multiple links coupled to a column 114 by a linear joint 116. The linear joint 116 is configured to translate along the column 114 (e.g., along a rail 117) to translate the handle 104 in the z direction, providing a first degree of freedom. The SCARA arm 118 is configured to allow movement of the handle 104 in the xy plane, providing an additional degree of freedom 2. Thus, each of the positioning platforms 108 shown in Figure 16C is configured to provide a positional or translational degree of freedom 3, allowing an operator to position the handle 104 at any position in three-dimensional (e.g., x, y, z) space (within the reach of the positioning platform).

[0094] In some embodiments, the column 114 (and rail 117) extends along an axis aligned with the vertical direction of the workspace (e.g., the z-direction as shown), and this axis can be aligned with the direction of gravity. An advantage of this positioning platform 108 is that it can provide gravity compensation. In other words, the linear joint 116 of the positioning platform 108 can maintain a constant orientation of the gimbal 106 relative to gravity.

[0095] In some embodiments, the positioning platform 108 may have other configurations. For example, the positioning platform 108 does not need to include linear joints and / or SCARA arms in all embodiments.

[0096] In some embodiments, a load cell 112 (not shown in Figure 16C) may be provided within a portion of the controller 102 (e.g., within the gimbal 106). The addition of the load cell 112 allows the controller to have admittance control in addition to impedance control. Under admittance control, the perceived inertia of the controller 102 can be reduced. This is because the mass of the gimbal 106 and / or positioning platform can be hidden through the load cell 112. This may be because the load cell 112 can measure the force applied to the controller and be used to drive a motor within the controller 102 to provide an output that assists the operation of the controller 102. The amount of hidden mass depends on the position of the load cell 112. In some embodiments, the mass proximal to the load cell 112 may be partially or substantially hidden, while the mass distal to the load cell 112 is not hidden.

[0097] In some embodiments, the mass of the gimbal 106 can be partially or substantially hidden while the controller 102 is operating by positioning the load cell 112 distally on the controller 102 (for example, within the gimbal 106 as shown in Figure 16C). Similarly, the mass of the positioning platform 108 (which has a relatively higher mass than the gimbal 106) can also be partially or substantially hidden while the controller 102 is operating. Hidden mass advantageously results in lower inertia perceived by the clinician. Without the load cell 112, in order to move the handle 104 in the z direction, the operator would need to apply sufficient force to the handle 104 to lift the handle 104, the gimbal 106, and the SCARA arm 118 upwards. Furthermore, it may be assumed that less force is required to move the handle in the xy plane than to move it in the z direction. This parallax is likely to result in an uneven operating experience for the operator, making it difficult to use the controller 102. Therefore, by including a load cell 112 as described herein, the controller 102 can assist the user in translating the handle 104 in the x, y, and z directions, providing a much more uniform and controlled operating experience. In some embodiments, the load cell 112 allows the positioning platform 108 to operate substantially or completely under admittance control. In contrast to the positioning platform 108, the moment of inertia of the gimbal 106 can be relatively low. This may be because the gimbal 106 is generally much smaller than the positioning platform 108. For this reason, at least a portion of the gimbal 106 may be suitable for impedance control.

[0098] One advantage of the hybrid impedance / admittance controller 102 described herein is that the perceived inertia of the system may be relatively lower than that of a system that relies entirely on impedance control. Furthermore, the mechanical structure of the hybrid controller 102 may be simpler because admittance control can be used to compensate for and average out the movement of the system. In contrast, the mechanical structure of an impedance-only system is often very complex because it attempts to normalize the forces required to move the system in different directions and minimize the perceived inertia.

[0099] In some embodiments, by using a hybrid controller 102 as described herein, the majority of the total mass and inertia of the controller 102 can be hidden by the admittance control of the positioning platform, thus making it possible to effectively increase the mass and inertia of the gimbal 106 compared to a gimbal with an impedance-only controller. Increasing the size of the gimbal can, in some embodiments, allow the use of larger motors, thereby enabling the controller to provide stronger perceptual feedback forces compared to other systems that need to use lighter gimbals and motors to avoid an increase in overall mass and inertia.

[0100] As illustrated in Figure 16C, the hybrid controller 102 can be viewed, for example, as a serial link manipulator, consisting of multiple links and joints in sequence. The handle 104, gimbal 106, and positioning platform 108 each have one or more links operably coupled, with the most proximal link adjacent to the column 114 of the positioning platform 108, and the most distal link being part of the handle 104 itself. In some embodiments, one or more load cells 112 (not shown in Figure 16C) can be inserted into the controller 102 to provide admittance control of at least a portion of the controller 102. The rest of the controller 102 can be controlled by impedance control (or, in some cases, passive control) by a clinician or operator. In some embodiments, the links and joints proximal to the load cells 112 may be directly or indirectly affected by the load cells 112. Thus, manipulation of these proximal links and joints can assist in admittance control. In some embodiments, links and joints distal to the load cell 112 may not be directly or indirectly affected by the load cell 112. Therefore, the operation of these distal links and joints can be assisted by impedance control. For example, in the embodiment of Figure 19A (discussed in more detail below), the load cell 112 is positioned within the gimbal 106 such that the distal joints 128, 130, and 132 (shown in Figure 17) cannot be directly or indirectly affected by the load cell 112. In other words, the operation of the axes of the gimbal 106 at these joints is not directly or indirectly based on the output of the load cell 112. These distal links and joints can be moved by impedance control. In contrast, links and joints proximal to the load cell 112 (such as those in the positioning platform 108) may be directly or indirectly affected by the load cell 112. In other words, the operation of the axes at these joints is directly or indirectly based on the output of the load cell 112. These proximal links and joints can be moved by admittance control.

[0101] Gimbal for haptic interface control As described above, in some embodiments, the load cell 112 (or force sensor) is positioned within the gimbal 106. In some embodiments, the gimbal 106 provides rotational degrees of freedom for the controller 102 having impedance control, while the positioning platform 108 can provide positional degrees of freedom for the controller 102 having admittance control (for example, based on the output of the load cell 112 positioned within the gimbal 106). There are many ways in which the load cell 112 can be positioned within the gimbal 106. The degree to which the perceived inertia of the controller 102 is reduced can be based in part on the position of the load cell 112 within the gimbal 106. Two exemplary embodiments showing the load cell 112 positioned in two different parts of the gimbal 106 are described in this section. Other embodiments are also possible.

[0102] Figure 17 is an isometric view of one embodiment of the gimbal 106. As shown, in some embodiments, the gimbal 106 is positioned at the distal end of the positioning platform 108 (only the last link of the positioning platform 108 is shown in Figure 17). As used in this application, in relation to the controller 102, the term distal refers to the direction toward the handle 104 (e.g., the handle 104 is the most distal component of the controller 102), and the term proximal refers to the opposite direction (e.g., toward the column 114, see Figure 16C). Thus, the proximal end of the gimbal 106 may be attached to the distal end of the positioning platform 108. Furthermore, the handle 104 may be positioned at the distal end of the gimbal 106.

[0103] In some embodiments, the handle 104 is configured to be held by an operator. The handle 104 may be configured to simulate or mimic a medical instrument used for control by the controller 102. In some embodiments, the handle includes a gripping handle (e.g., a radially symmetric gripping handle), a stylus, a paddle-type handle, and the like. In the shown embodiment, the handle 104 includes two operating arms 120 configured to provide the instrument operating degrees of freedom discussed above. While holding the handle 104, the operator can adjust the angle between the operating arms 120 to control the corresponding angle associated with the controlled medical instrument. For example, if the medical instrument is a gripping tool, a shearing tool, etc., the angle between the operating arms 120 can be used to control the angle between the two jaws of the gripping tool.

[0104] In the shown embodiment, the gimbal 106 comprises three arms or links connected by joints. Arranged distal to proximal, as shown in Figure 17, the gimbal 106 comprises a first link 122, a second link 124, and a third link 126. Arranged distal to proximal, as shown in Figure 17, the gimbal 106 comprises a first joint 128, a second joint 130, a third joint 132, and a fourth joint 134. The joints allow the various links to rotate, providing the gimbal 106 with the aforementioned degrees of rotational freedom.

[0105] The handle 104 is connected to the distal end of the first link 122 by a first joint 128. The first joint 128 may be configured to allow the handle 104 to rotate relative to the first link 122. In the shown embodiment, the first joint 128 allows the handle 104 to rotate around a roll axis 136. In some embodiments, the roll axis 136 is aligned with the longitudinal axis of the handle 104. The first joint 128 may be an external rotation joint.

[0106] The proximal end of the first link 122 is connected to the distal end of the second link 124 by a second joint 130. The second joint 130 may be configured to allow the handle 104 and the first link 122 to rotate relative to the second link 124. In the shown embodiment, the second joint 130 allows the handle 104 and the first link 122 to rotate around a yaw axis 138. In some embodiments, the yaw axis 138 extends through the second joint 130 and intersects with the roll axis 136 at the center point of the handle 104. The second joint 130 may be an external rotation joint. As shown, in some embodiments, the first link 122 includes an L-shape. In some embodiments, the first link 122 has a recess formed therein for receiving the second link 124 and is configured to allow the second link 124 to rotate relative to the first link 122.

[0107] The proximal end of the second link 124 is connected to the distal end of the third link 126 by a third joint 132. The third joint 132 may be configured to allow the handle 104, the first link 122, and the second link 124 to rotate relative to the third link 126. In the shown embodiments, the third joint 132 allows the handle 104, the first link 122, and the second link 124 to rotate around a pitch axis 140. In some embodiments, the pitch axis 140 extends through the third joint 132 and intersects the roll axis 136 and the yaw axis 138 at the center point of the handle 104. The third joint 132 may be an external rotation joint. As shown, in some embodiments, the second link 124 includes an L-shape. In some embodiments, the L-shaped second link 124 is received in a recess of the L-shaped first link 122 (as shown in Figure 17). In another embodiment, the L-shaped first link 122 can be received in a recess of the L-shaped second link 124.

[0108] In the shown embodiment, the first joint 128, the first link 122, the second joint 130, the second link 124, and the third joint 132 provide rotational degrees of freedom 3, allowing the rotation of the handle 104 to be adjusted in pitch, roll, and yaw. In the shown embodiment, the gimbal 106 further includes a third link 126 and a fourth joint 134, which provide redundant rotational degrees of freedom. While this is not required in all embodiments, it can provide greater mechanical flexibility to the gimbal 106.

[0109] As shown, the distal end of the third link 126 is connected to the proximal end of the second link 124 by a third joint 132. The proximal end of the third link 126 is connected to the distal end of the positioning platform 108 by a fourth joint 134. The fourth joint 134 can be configured to allow the handle 104, the first link 122, the second link 124, and the third link 126 to rotate relative to the positioning platform 108. In the shown embodiment, the fourth joint 134 allows the handle 104, the first link 122, the second link 124, and the third link 126 to rotate around an axis 142. In some embodiments, the axis 142 is parallel to the yaw axis 138. In some embodiments, the yaw axis 138 and axis 142 are coaxial, but as shown, this is not required in all embodiments. The axis 142 (and yaw axis 138) is parallel to the direction of gravity, and the orientation of the gimbal relative to the direction of gravity can be maintained as described above. The fourth joint 134 may be an external rotation joint. As shown in the figures, in some embodiments, the third link 126 includes an L-shape.

[0110] C. Variable damping for haptic interface control A haptic interface device (HID), including any of the aforementioned controllers for controlling a robotic system, robotic arm, and / or instrument, is mechanically designed with the goal of being as back-driveable as possible. Components are designed or selected to minimize mechanical dissipative effects such as friction and damping. In this way, the HID is designed to be transparent to the user, meaning that the user should not feel much resistance or impedance when moving the HID in free space, thereby allowing the user to complete surgical tasks with minimal burden and distraction imposed by the HID.

[0111] On the other hand, very little dissipation can have undesirable consequences. For example, if the steering wheel is hit or the vehicle is lost from user control, the stopping distance may be very large. Similarly, users may feel that the HID interface is running away or moving too easily, especially at low speeds.

[0112] As shown in Figure 18, a certain virtual damping can be added through impedance control of the HID. The damping force (e.g., torque) can be calculated by multiplying the current linear (e.g., angular) velocity by a constant damping coefficient. In some cases, determining a constant level of damping to apply can be difficult, and even paradoxical. For example, a large damping coefficient at low speeds may be desirable to prevent the HID from feeling like it could "run away," but such a coefficient has been found to destabilize the system at very low speeds, making it difficult for the operator to move the controller. Similarly, a high damping coefficient at high speeds may reduce or disable the HID's back-driveable capability. Furthermore, the desired damping behavior may differ and even contradictory for different applications. To overcome such challenges, the subject technology includes a novel variable damping solution that provides an appropriate level of damping resistance to the system and / or user-based input, partly based on how the HID is operated by the user. The control unit described herein (e.g., including one or more processors) may apply different variable damping coefficients to the robot user interface based on one or more variables.

[0113] Figure 19 is a perspective view of a second embodiment of the HID or controller 102. In the shown embodiment, the controller 102 is configured to enable the operation of one or more medical devices, as described above. As illustrated, the controller 102 may include one or more handles 104. According to various implementations, the controller includes two handles (as shown in Figure 16C), one of which is depicted in Figure 19. A pair of handles 104 may be configured to operate a single device (together with other components of the robotic system). In some embodiments, each of the pair of handles 104 may act as its own device. Each handle 104 is connected to a gimbal 106. Each gimbal is connected to a positioning platform 108, which includes links 118a and 118b. In some embodiments, the handles 104 are considered distal to the gimbal 106.

[0114] The difference between the illustrated positioning platform 108 and that shown in Figure 16C is that the illustrated positioning platform 108 translates in the Z direction based on the movement of link 118a rather than the vertical translation of the linear joint 116 along the column 114, whereas the translation in the Y direction is based on the movement of the platform by joint 120 rather than the lateral movement of link 118 (as shown in Figure 16C). Link 118 is configured to translate vertically by the rotation of joints 116a and 116b about axes G1 and G2, respectively, allowing the handle 104 to translate in the z direction, thereby providing a first degree of freedom. The arm 118 is configured to translate around axis G0 via joint 120 (and the gimbal 106 around axis G3 via joint 116c) to allow the handle 104 to move in the xy plane, providing an additional degree of freedom 2. Therefore, the positioning platform 108 shown in Figure 19 is configured to provide 3 positional or translational degrees of freedom, allowing the operator to position the handle 104 at any position in three-dimensional (e.g., x, y, z) space (within the reach of the positioning platform).

[0115] In various embodiments, the HID controller 102 may operate under robot impedance control, thereby allowing user movement to backdrive the robotic tool. In addition to or instead of this, the HID controller 102 may operate under admittance control or hybrid admittance impedance control. In such embodiments, the control unit can measure the force the user is applying to the HID controller 102 and output the position of the HID controller 102. In other words, impedance control measures displacement (position and velocity) and outputs force, while admittance does the opposite. Often, admittance control feels lighter than impedance control because, under admittance control, the motor in the tactile master (e.g., in the positioning platform) can help accelerate the mass, thus masking the perceived mass.

[0116] Since surgeons use HID to operate instruments remotely, the HID system is designed to be as back-driveable as possible. As previously mentioned, the illustrated components are designed or selected to minimize mechanical dissipation effects such as friction and damping. By providing such back-driveability, the user operating the controller 102 can feel as if the medical instrument being operated is under the user's direct control with as little resistance or impedance as possible.

[0117] Under certain conditions, such as when the steering wheel is subjected to an impact, loses user control, or is highly prone to runaway, a damping force can be provided by multiplying the linear velocity and / or angular velocity measured by the controller by a damping modifier. Examples of the use of damping coefficients are provided herein. However, the disclosed damping modifiers may include any function or variable for correcting the damping of the disclosed HID or its components.

[0118] According to various embodiments, the control unit of the disclosed robot system incorporates an algorithm for damping having a non-constant or variable damping coefficient (e.g., using impedance control). Instead of being constant, the algorithm can determine the damping coefficient as a function of the current damping regime (described below) and / or a system variable that is directly measured or calculated based on other real-time measurements on the fly (e.g., the current HID velocity). This damping coefficient can be multiplied by the linear velocity and / or angular velocity to determine the virtual damping force applied to the HID.

[0119] In some embodiments, the damping coefficient applied to the HID may remain constant, and the damping force (e.g., torque) may be calculated by multiplying the linear (angular) velocity by a constant damping coefficient, as shown in Figure 18. As will be further described, constant or variable damping modifiers may generally be applied to the HID, or one or more robotic joints of the HID (e.g., joint 116), to modify the force or torque of the joint. According to various embodiments, the damping modifier is applied during the operation of a medical device 312, and according to various embodiments, provides resistance to the movement of the joint or medical device.

[0120] The damping algorithm can use a damping function with multiple damping regimes. For example, one damping regime may provide a relatively low amount of resistance to the user (e.g., a hand moving in water), while a different damping regime may provide a relatively high amount of resistance to the user (e.g., a hand moving in molasses). Another damping regime may provide a variable amount of resistance depending on the motion information received from the HID (e.g., from the joints). In some embodiments, the resistance may be proportional or inversely proportional to a variable received in the motion information.

[0121] Incorporating multiple or variable damping regimes into the disclosed system can benefit the medical procedures being performed. For example, when a surgeon is slowly driving an HID, one regime may provide some damping so that the surgeon feels they are in control of very fine movements. As the surgeon begins to make larger movements, another regime can be selected to reduce the damping force, as too much damping force could cause fatigue. In other words, as the speed of the HID increases, the damping coefficient and associated damping can be reduced.

[0122] According to various embodiments, the damping algorithm performed by the control unit can determine the damping coefficient as a function of variables directly measured or calculated based on the current damping regime and / or real-time measurements. For example, a damping function can be used to dynamically determine the damping coefficient according to motion information received from the HID. In this regard, the received motion information may include the speed or velocity of the HID, the current position of the HID, or a force applied to the HID, or a part thereof (such as one or more joints associated with the HID). Each robot joint may report motion information to the control unit, for example, including the joint velocity, the current position of the joint, or the current force or torque of the joint. In some embodiments, the reported force or torque may include, or may not include, a force or torque resisting the movement of the joint or medical device.

[0123] In some embodiments, the damping function may be selected in a graphical user interface (GUI) associated with a control unit (e.g., console 16 or 31), and the damping coefficient may then be determined based on motion information. In some embodiments, the damping function may be selected by the control unit based on the medical procedure being performed. In some embodiments, the control unit can determine which scenario (e.g., avoiding instability, avoiding runaway sensation, increasing backdrive, avoiding overspeed, etc.) is most relevant to a particular procedure.

[0124] Another measurement variable may include the force applied by the user to the HID (or one or more joints). For example, the force on the HID can inform the system of the amount of grip applied to the HID by the user, thereby informing the system of the risk of potential loss of control or drift of the HID. If the risk of undesirable drift is high, the selection of a damping function with a damping regime having a higher damping coefficient can be ensured.

[0125] One application of a variable damping regime (other than remote control of equipment) is in camera control, where both HID arms are connected by a virtual spring to provide a steering wheel-like tactile effect. The user can pan and roll the camera as if operating a steering wheel. Due to the very low output impedance and the ergonomics of the steering wheel-like motion, the user may be prone to unintended roll motions while panning the camera. Applying a large virtual damping to the roll motion can prevent unintended rolls of the camera, but it can also make it more difficult to intentionally roll the camera. To address this, the damping coefficient can be set higher at lower speeds to prevent unintended rolls and provide better control for finer roll motions. At higher speeds, positive rolling motion is detected from the user's movement of the HID, so the damping coefficient can be reduced, thereby providing the user with a better camera control experience.

[0126] Another example may involve support-assisted HID control, in which case it may be desirable for the HID to dissipate kinetic energy stably and quickly to prevent unintended movement, while still allowing the user remote control capability. The selected damping function may include rapidly increasing the damping coefficient at low speeds and maintaining a high damping coefficient w / torque saturation at high speeds, or adjusting the damping coefficient, thereby allowing the user to further backdrive the HID for continuous remote control.

[0127] In some embodiments, a virtual or imaginary wall can be used that the HID cannot physically pass through. The HID can slow down even before reaching the virtual wall, for example, ending in a hard stop. Thus, the position of the HID can be yet another variable that triggers different damping regimes. For example, the damping coefficient may be based on the current position of the HID relative to the virtual wall. In such embodiments, the damping function may determine a first damping coefficient for correcting the resistance force or torque of the robot joint when the distance satisfies a first threshold, and a second damping coefficient for correcting the resistance force or torque when the distance satisfies a second threshold.

[0128] Figures 20A, 20B, and 20C show three exemplary damping functions for selecting a damping coefficient based on velocity, according to embodiments of the subject art disclosed herein. The illustrated damping functions are merely representative ways in which a system can be programmed to modify the behavior of an HID in response to a changing velocity, and should not be considered exhaustive. For example, the velocity at which the behavior is modified may represent the velocity of the HID. In some embodiments, the illustrated damping functions may determine the damping coefficient based on other factors in addition to velocity, or alternative to velocity, such as the position of the HID or the force applied to the HID. In some embodiments, the velocity, position, or force used by the damping function may include the rotational velocity, position, or force (or torque) of one or more joints within or associated with the HID.

[0129] Figure 20A shows a first exemplary damping function that includes four regions for selecting different damping coefficients. For the purposes of disclosure, each region may correspond to a different range of a given variable, thereby implementing a different regime for determining the damping coefficient. In this regard, the terms “region” and “regime” may be used interchangeably when describing how the function modifies the damping of HID or its joints (e.g., by determining the damping coefficient).

[0130] In the illustrated example, the first regime (Regime 1) can be used at very low speeds. In this regard, it may be beneficial to have some damping, as this can help prevent the system from vibrating. At some point, higher speeds are reached, and the second regime (Regime 2) may be adopted to provide more damping to avoid runaway. This may be beneficial, for example, if the surgeon loses grip at this higher speed, as higher damping minimizes drift. A third regime (Regime 3) may be used when the speed increases further. In the third regime, the need for damping may actually decrease. This is because, at higher speeds, the surgeon tends to grip the HID more firmly and securely, thereby minimizing the possibility of uncontrolled drift. Thus, the damping coefficient may actually be lower in the third regime (Regime 3) than in the second regime (Regime 2).

[0131] At higher speeds, it may be necessary to increase the damping coefficient again. For example, at very high speeds, concerns about HID runaway may decrease, while concerns about HID overspeeding may increase. If the HID moves too fast, the patient-side robotic arm or instrument may not be able to follow. Therefore, a fourth regime (regime 4) can provide a higher damping coefficient.

[0132] As shown in Figure 20A, one regime may select a damping coefficient that modifies the movement of the HID or robot joint in a manner proportional to the current speed or velocity of the HID or robot joint (for example, in regime 1), while another regime may select a damping coefficient that modifies the movement of the HID or robot joint inversely proportional to the current speed or velocity of the HID or robot joint (for example, during the transition between regime 2 and regime 3). The movement may be modified by an applied damping coefficient that changes the force or torque of at least one joint. According to various embodiments, the damping modifier may be selected to keep the movement (or, for example, the velocity, force, or torque of one or more joints) fixed when the current speed and / or velocity are within a certain range, as shown by the plateaus in regimes 2, 3, and 4 in Figure 20A.

[0133] Figure 20B shows a second exemplary damping function including a transition regime. In some embodiments, a low damping coefficient may be desired at low speeds (Regime A.1) for high backdriveability. On the other hand, a higher damping coefficient at higher speeds may also be desirable, for example, to avoid overspeed in HID (Regime A.3). An abrupt rise between the low-damping regime (Regime A.1) and the high-damping regime (Regime A.3) may be undesirable because it may not provide the user with smooth control. Therefore, the illustrated damping function provides a transition damping region (Regime A.2) between the two other regimes.

[0134] The applicable damping coefficient(s) may be selected to modify the force or torque of one or more robot joints in order to dynamically adjust the speed of the HID. The force or torque may be modified by a fixed amount when the current speed or velocity of a portion of the robot user interface is within a first range (e.g., corresponding to regime A.1), by a variable amount (e.g., increasing in the illustrated embodiment) when the current speed or velocity of a portion of the robot user interface is within a second range (e.g., corresponding to regime A.2), and by another fixed amount when it is within a second range greater than the first range (e.g., corresponding to the illustrated plateau of regime A.3).

[0135] The illustrated damping region provides a continuous transition, but in some embodiments, the transition may not be continuous. For example, the transition may include several sub-regions, each having its own damping coefficient, which eventually progress to a high-damping region (see, for example, Figure 23).

[0136] Figure 20C shows a third exemplary damping function that includes multiple transition regimes. The illustrated damping function is similar to the damping function in Figure 20B, but includes a fourth regime in which the damping coefficient decreases. The fourth damping regime may be implemented, for example, when the HID velocity is high, but the surgeon has greater control over the HID, thereby ensuring a lower damping coefficient. In the illustrated example, when the current velocity or speed is within the fourth range, the applied damping modifier modifies the motion of the HID according to logarithmic damping (for example, by modifying the force or torque of one or more joints).

[0137] Figure 21 shows an exemplary process for variable damping of a manual control input device, providing damping control of a medical device, according to an embodiment of the subject technology disclosed herein. For illustrative purposes, various blocks of the exemplary process 200 are described herein with reference to the components and / or processes described herein. One or more of the blocks of process 200 may be implemented by, for example, one or more computing devices, including software executed by the control unit of the robotic system described herein. In some embodiments, one or more of the blocks may be implemented based on one or more machine learning algorithms. In some embodiments, one or more of the blocks may be implemented by one or more different processors or devices, apart from the other blocks. For further illustrative purposes, the blocks of the exemplary process 200 are described as occurring sequentially or linearly. However, multiple blocks of the exemplary process 200 may occur in parallel. In addition, the blocks of the exemplary process 200 do not need to be executed in the order shown, and / or one or more of the blocks of the exemplary process 200 do not need to be executed.

[0138] In the illustrated example, the control unit of the disclosed robotic system robotically facilitates the movement of a medical device through three-dimensional space based on the operation of a robotic user interface (202). The robotic interface (e.g., HID) includes one or more links and one or more joints that cooperate to facilitate the remote operation of the medical device based on user input, for example, as depicted in Figure 19.

[0139] Motion information is received from one or more joints (204). According to various embodiments, each joint may report its velocity and position (e.g., angular velocity and angular position) to the control unit. In some embodiments, the joint may report the angular force or torque applied by or to the joint. In some embodiments, the motion information may include the magnitude of the force applied to the robot user interface or the velocity of the robot user interface. In some embodiments, the motion information includes the current position of the robot user interface.

[0140] According to various embodiments, the control unit can receive motion information from each joint and determine the velocity vector of the entire robot interface, or the velocity vectors of each joint or other part of the interface (e.g., the gimbal 106 or handle 104, or one or more links 116 of each). In some embodiments, the motion information may include the vector or force contribution associated with each joint and the velocity vector determined based on the collective contribution. The velocity vector may correspond to the path taken by the robot interface through three-dimensional space.

[0141] Based on the received motion information, the damping modifier is determined from a plurality of different damping modifiers based on the received motion information (206). According to various embodiments, determining the damping modifier may include determining a damping function, such as those previously described with respect to Figures 20A to 20C, which can then determine the damping coefficient based on the received variables of the motion information. In some embodiments, the damping modifier includes a damping coefficient determined based on the measured parameters, as described above.

[0142] In some embodiments, the damping coefficient is selected based on a damping function that includes (i) a first damping region in response to a velocity vector satisfying a first threshold, and (ii) a second damping region in response to a velocity vector satisfying a second threshold. In some embodiments, the damping coefficient may be determined by indexing a plurality of damping coefficients (e.g., stored in a database) by the speed or velocity of at least some of the robot user interface to obtain the damping coefficient corresponding to the speed or velocity. In some embodiments in which velocity vectors are derived, the damping coefficient may be determined based on the magnitude of the velocity vectors. As shown in Figures 20A to 20C, the damping coefficients may have a continuous, non-constant relationship depending on the given parameters.

[0143] The determined damping modifier is applied to at least one of one or more joints to modify the force or torque of at least one joint during the operation of a medical device (208). The damping modifier may also be applied, for example, to modify the angular velocity of at least one of the joints, and in some embodiments, it may modify the movement of the robotic user interface, including resistance to the movement of the robotic user interface or a part thereof.

[0144] In some embodiments, the applied damping modifier changes the force or torque of at least one joint in proportion to the current speed or velocity of a portion of the robot user interface when the current speed or velocity is within a first range, and inversely proportional to the current speed or velocity when the current speed or velocity is within a second range. The fluctuating damping coefficient in Figure 20A provides an example of such an embodiment.

[0145] On the other hand, as shown in the illustrated examples in Figures 20A to 20C, the applied damping modifier can keep the force or torque of one or more joints fixed when they are within a third range. In some embodiments, the applied damping modifier can modify the force or torque of a joint(s) by a variable amount when the current speed or velocity of a portion of the robot user interface is within a first range, and by a fixed amount when it is within a second range greater than the first range. In some embodiments, as shown in Figure 20C, the applied damping modifier can modify the force or torque according to logarithmic damping when the current speed or velocity is within a fourth range.

[0146] According to various embodiments, the aforementioned cycle of receiving motion information (e.g., from joints), determining and applying damping modifiers, can be repeated continuously. For example, a control unit can process several cycles per second, if not hundreds. In this way, the damping can be adjusted as the robot interface moves, and the various changes in resistance are hardly perceptible to the user, thereby improving the movement of the interface and enhancing the user experience.

[0147] C. Variable damping for robotic operation of medical devices The previous section dealt with providing a variable damping regime in the HID or controller, but this section deals with providing a variable damping regime when manually controlling the movement of a robot arm or joint. Figure 22 shows a first exemplary virtual tactile wall for a robot joint 24, including a tactile wall damping region 220, according to an aspect of the subject art disclosed herein. The robot joint 24 may be part of a robot arm 12, for example, as previously described with respect to Figure 2.

[0148] According to various embodiments, the virtual tactile wall 220 is a virtual tactile force or torque acting near a predetermined joint limit 222, which may be applied to prevent the joint from reaching its joint limit. According to various embodiments, the robot arm may be configured to operate under impedance control, during which the tactile wall 220 may be used. The impedance mode (a control mode with gravity and friction compensation) may allow the user to move the robot joint by directly pulling or pushing the robot arm. However, when the joint strikes the virtual tactile wall at high speed, the user may over-power the tactile wall, causing the joint to move beyond its joint limit and resulting in a malfunction. At this point, the user may be unable to further use the robot arm until the malfunction is resolved. The subject art reduces the speed of entry into the tactile wall to avoid this over-power supply.

[0149] The described example shows how the joint velocity in the robot arm 12, or the resistance of the robot arm to the movement of a medical device, can be modified based on the joint position 224. One or more motion limits are determined for the joint 24. According to various embodiments, each robot joint 24 may have two limits, i.e., one limit for each rotational direction. As the joint moves or rotates (e.g., angular rotation), position information is provided to the control unit. The control unit may be pre-programmed with each joint limit 222, or it may compare the current position information received from each joint 24 with its respective limit. Thus, the control unit can determine the distance between the current position reported by the robot joint 24 and the motion limit. Based on this distance, a damping coefficient can be determined and applied to the robot joint to modify the force or torque of the robot joint 24. In this way, the resistance of the robot arm 24 to the movement of a medical device is affected. According to various embodiments, the damping coefficient may not be determined until the joint moves (e.g., rotates) past a predetermined tactile wall entry position 226.

[0150] Figure 23 shows a second exemplary virtual tactile wall for a robot joint 24, including a tactile wall damping region 230 and a tactile anterior wall damping region 232, according to embodiments of the subject art disclosed herein. According to various embodiments, the maximum entry speed into the tactile wall 220 is limited by varying the damping coefficient 234 depending on the joint position and speed. With respect to the joint position, when the rotational position of the joint 24 is far from the tactile wall entry position 226, the damping coefficient 234 applied to the joint may be low. However, as the joint moves closer to the tactile wall entry position 226, the damping coefficient 234 and the resulting damping force or torque may become higher, which slows down the joint speed.

[0151] With respect to speed, a lower damping coefficient can be applied at lower speeds, and a higher damping coefficient can be applied at higher speeds. In this regard, the joint may be more easily moved at low and medium speeds, while still limiting the maximum joint speed, including the entry speed into the tactile wall. Figure 24 shows an exemplary damping function for damping joint movement, including damping in the anterior tactile wall damping region 232 and damping in the tactile wall damping region 220, according to embodiments of the subject art disclosed herein. In the illustrated example, in the anterior tactile wall damping region 232, joint movement is damped based on the transition regime 240. The adjustment to the damping coefficient may be continuous and / or linear, as described above with respect to Figures 20A-20C, or may include one or more different linear adjustments, as shown in Figure 24. In the tactile wall damping region 220, joint movement may be damped by a fixed amount 242, as described above.

[0152] Figure 25 illustrates an exemplary process for attenuation operation of a medical device according to an aspect of the subject art disclosed herein. For illustrative purposes, various blocks of the exemplary process 300 are described herein with reference to components and / or processes described herein. One or more blocks of the process 300 may be implemented by, for example, one or more computing devices, including software executed by the control unit of the robotic system described herein. In some embodiments, one or more blocks may be implemented based on one or more machine learning algorithms. In some embodiments, one or more blocks may be implemented by one or more different processors or devices, apart from the other blocks. For further illustrative purposes, the blocks of the exemplary process 300 are described as occurring sequentially or linearly. However, multiple blocks of the exemplary process 300 may occur in parallel. In addition, the blocks of the exemplary process 300 do not need to be executed in the order shown, and / or one or more blocks of the exemplary process 300 do not need to be executed.

[0153] In the illustrated example, a robotic joint 24 is provided that is configured for use with a robotic arm 12 (302). As previously stated, the robotic arm 12 includes one or more links and one or more joints (including robotic joints) that cooperate to move a medical instrument.

[0154] As the medical device moves in three-dimensional space, the current position of the robot joint is received by the control unit (304). According to various embodiments, the control unit may also receive and / or determine the current velocity of the robot joint 24. As previously stated, each joint 24 may report its velocity and position (e.g., angular velocity and angular position) to the control unit. In addition to, or instead of, the joint 24 may report the angular force or torque applied by or to the joint.

[0155] Next, the control unit determines the distance between the current position of the robot joint 24 and the first motion limit of the robot joint (306). For example, the current position may be the rotational position of the robot joint 24, and the distance may be the rotational distance of the joint. In some embodiments, the robot joint 24 is associated with two respective motion limits, each limit being associated with the respective rotational direction of the robot joint.

[0156] Next, the control unit applies a damping function to the robot joint 24 based on distance to modify the resistance to the movement of the medical device (308). In this way, damping control of the joint can be obtained. According to various embodiments, the damping function causes an increase in the resistance force or torque to the movement of the robot joint (for example, by applying a damping coefficient). In some embodiments where the joint velocity is received or determined, the damping function applied to the robot joint can also be based on the current velocity.

[0157] Similar to other embodiments described above, the control unit may determine a first damping coefficient for modifying the resistance force or torque to the movement of the robot joint when the distance satisfies a first threshold, and a second damping coefficient for modifying the resistance force or torque when the distance satisfies a second threshold.

[0158] Each rotational direction of the robot joint 24 may be associated with multiple damping regions, and each damping region in each rotational direction determines a different damping coefficient for modifying the force or torque of the robot joint. For example, the damping function may include a first damping region that modifies the force or torque of the joint 24 by a variable amount depending on the current position of the joint 24 that satisfies a first threshold, and a second damping region that modifies the force or torque according to a fixed amount depending on the current position of the joint 24 that satisfies a second threshold.

[0159] As illustrated with respect to Figures 23 and 24, the damping function applied can be based on the current position of the robot arm relative to the virtual wall, and a damping coefficient can be selected based on the position of the joint within one or more damping regions leading to the virtual wall, with the force or torque being modified differently in each damping region. Thus, the damping function may begin to reduce the velocity of the joint 24 when it reaches the pre-tactile limit 232 to the virtual wall. The damping function can vary the damping coefficient 234 as the joint 24 moves between the pre-tactile limit 232 and the virtual wall 226. Briefly referring to Figure 23, the damping coefficient 234 may increase as the joint moves from the pre-tactile limit toward the virtual wall 226. The damping coefficient 234 may then remain constant as the joint 24 moves beyond the virtual wall 226. In some embodiments, the damping function may include a hard stop at the tactile wall limit 222.

[0160] In some embodiments, the damping function may determine the damping coefficient based on the velocity of the robot arm, and the damping function may vary the damping coefficient as the velocity of the robot arm increases. Similar to the embodiments described above, the velocity vector may be determined, for example, from the force, position, and / or velocity contributions associated with each joint. The velocity vector may correspond to the path taken by the robot interface through three-dimensional space.

[0161] Many of the exemplary processes 200 and 300 described above, as well as related features and applications, may also be implemented as software processes designated as a set of instructions recorded on a computer-readable storage medium (also called a computer-readable medium), which may be executed automatically (e.g., without user intervention). When these instructions are executed by one or more processing units (e.g., one or more processors, processor cores, or other processing units), these instructions cause the processing units to perform the actions indicated in the instructions. Examples of computer-readable media include, but are not limited to, CD-ROMs, flash drives, RAM chips, hard drives, and EPROMs, and computer-readable media do not include carrier waves and electronic signals transmitted via wireless or wired connections.

[0162] The term “software” means, where appropriate, firmware residing in read-only memory or applications stored in magnetic storage devices that can be loaded into memory for processing by a processor. Furthermore, in some embodiments, multiple software modes of this disclosure may be implemented as subparts of a larger program while maintaining separate software modes of the subject art. In some embodiments, multiple software modes may also be implemented as separate programs. Finally, any combination of separate programs that implement together the software modes described herein is within the scope of this disclosure. In some embodiments, a software program defines one or more specific mechanical embodiments that, when installed to operate on one or more electronic systems, perform and carry out the operation of the software program.

[0163] Computer programs (also known as programs, software, software applications, scripts, or code) can be written in any form of programming language, including compiled or interpreted languages, declarative or procedural languages, and can be deployed as standalone programs or in any form, including modules, components, subroutines, objects, or other units suitable for use in a computing environment. Computer programs may or may not correspond to files in a file system. A program may be stored in part of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program, or in multiple collaborative files (e.g., a file that stores one or more modules, subprograms, or parts of code). Computer programs may be deployed to run on one computer, or on multiple computers located in one site or distributed across multiple sites and interconnected by a communication network.

[0164] 3. Implementation system and terminology. Embodiments disclosed herein provide systems, methods, and apparatus for robot-controlled medical systems. Various embodiments described herein include controllers for robot-enabled medical systems.

[0165] When used herein, the terms “to join,” “joined,” “joined,” or other variations of the word “join” may indicate either an indirect or direct connection. For example, when a first component is “joined” to a second component, the first component may be indirectly connected to the second component via another component, or directly connected to the second component.

[0166] The position estimation and robot motion operation functions described herein may be stored as one or more instructions on a processor-readable medium or computer-readable medium. The term “computer-readable medium” means any available medium that a computer or processor can access. Examples, but not limited to, such mediums may include random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory, compact disc read-only memory (CD-ROM), or other optical disc storage devices, magnetic disc storage devices, or other magnetic storage devices, or any other medium that can be used to store desired program code in the form of instructions or data structures and can be accessed by a computer. Note that computer-readable medium may be tangible and non-temporary. As used herein, the term “code” may mean software, instructions, code, or data that is executable by a computing device or processor.

[0167] The methods disclosed herein include one or more steps or actions for achieving the described method. The method steps and / or actions are interchangeable with one another, as long as they do not deviate from the claims. In other words, the order and / or use of any particular steps and / or actions can be modified, as long as they do not deviate from the claims, unless a particular order of steps or actions is required for the proper implementation of the described method.

[0168] As used herein, the term “plural” refers to two or more. For example, “plural components” means two or more components. The term “determining” encompasses a wide variety of actions, and therefore “determining” can include calculating, computing, processing, deriving, investigating, looking up (e.g., examining a table, database, or another data structure), verifying, etc. “Determining” can also include receiving (e.g., receiving information), accessing (e.g., accessing data in memory), etc. “Determining” can also include resolving, selecting, electing, establishing, etc.

[0169] The phrase "based on" does not mean "based solely on" unless explicitly specified otherwise. In other words, the phrase "based on" can mean both "based solely on" and "based at least on."

[0170] As used herein, the terms “approximately” or “about” refer to a range of measurement for length, thickness, quantity, duration, or other measurable value. Such ranges include variations of no more than + / -10%, preferably no more than + / -5%, more preferably no more than + / -1%, and even more preferably no more than + / -0.1% of the specified value, provided that such variations are appropriate for functioning in the disclosed devices, systems, and technologies.

[0171] The foregoing description of the disclosed implementations is provided to enable any person skilled in the art to manufacture or use the present invention. A person skilled in the art will readily recognize various modifications to these implementations, and the general principles set forth herein can be applied to other implementations without departing from the scope of the present invention. For example, a person skilled in the art will recognize that many corresponding alternatives and equivalent structural details can be employed, such as similar methods for fastening, mounting, joining, or engaging tool components, equivalent mechanisms for producing specific operating motions, and equivalent mechanisms for delivering electrical energy. Thus, the present invention is not limited to the implementations shown herein, but is given the broadest scope that is consistent with the principles and novel features disclosed herein.

[0172] The following clauses describe several embodiments or implementations. Article 1. A system for damping operations of medical devices, A robotic arm having one or more links and one or more joints for collaboratively moving medical instruments, It is a control unit, The position and velocity of the first joint among one or more joints are received. To correct the force or torque at the first joint, a damping function is applied to the first joint based on the received position or velocity. A system including a control unit configured to change a damping function applied to a first joint based on its position or velocity if the position or velocity of the medical device changes while it is moving.

[0173] Clause 2. The damping function is based on the current position of the robot arm relative to the virtual wall, as described in Clause 1.

[0174] Clause 3. The damping function causes a reduction in the velocity of the first joint when it reaches the pre-tactile limit against the virtual wall, as described in Clause 2.

[0175] Clause 4. The damping function is the system described in Clause 3, which changes the damping coefficient as the first joint moves between the tactile prelimit and the virtual wall.

[0176] Clause 5. The damping coefficient increases as the first joint moves from the pretactile limit toward the virtual wall, as described in Clause 4.

[0177] Clause 6. The damping coefficient remains constant when the first joint moves beyond the virtual wall, as described in Clause 4 or 5.

[0178] Clause 7. The damping function determines the damping coefficient based on the speed of the robot arm, as described in any of Clauses 1 to 6.

[0179] Clause 8. The damping function is a system described in Clause 7, in which the damping coefficient changes as the speed of the robot arm increases.

[0180] Clause 9. The robotic arm is an impedance-controlled system as described in any of Clauses 1 to 8.

[0181] Clause 10. The damping function includes a first damping region and a second damping region that are selectable to modify the force or torque of the first joint based on the current position or speed of the first joint, wherein the first damping region modifies the force or torque differently from the second damping region, as described in any of Clauses 1 to 9.

[0182] Clause 11. The system according to any one of Clauses 1 to 9, wherein the damping function includes (i) a first damping region that modifies the force or torque of the first joint by a variable amount in response to the current position of the first joint satisfying a first threshold, and (ii) a second damping region that modifies the force or torque according to a fixed amount in response to the current position of the first joint satisfying a second threshold.

[0183] Article 12. A system for damping operations of medical devices, A robotic joint configured for use with a robotic arm having one or more links and one or more joints for moving medical instruments in cooperation, It is a control unit, When a medical device is moved in 3D space, the current position of the robot joint is received. Determine the distance between the current position of the robot joint and the first limit of motion of the robot joint. A system including a control unit configured to apply a damping function to robotic joints based on distance to correct resistance to the movement of medical devices.

[0184] Clause 13. The control unit shall Determine the current velocity of the robot joint, The system according to Clause 12, further configured to vary the damping function applied to the robot joints based on the current velocity and current position.

[0185] Clause 14. The damping function determines a first damping coefficient for correcting the resistance force or torque to the movement of a robot joint when the distance satisfies a first threshold, and a second damping coefficient for correcting the resistance force or torque when the distance satisfies a second threshold, as described in Clause 12 or 13.

[0186] Clause 15. A system as described in any of Clauses 12-14, where distance is the rotational distance, current position is the rotational position, and damping function causes an increase in resistance or torque to the movement of the robot joint.

[0187] Clause 16. A robotic joint is associated with two respective motion limits, each limit associated with the respective rotational direction of the robotic joint, as described in any of Clauses 12-15.

[0188] Clause 17. The system described in Clause 16, wherein each rotational direction of a robot joint is associated with a plurality of damping regions, and each damping region in each rotational direction determines a different damping coefficient for correcting the force or torque of the robot joint.

[0189] Article 18. To provide a robotic joint configured for use with a robotic arm having one or more links and one or more joints for collaboratively moving medical devices, When a medical device is moved in 3D space, the current position of the robot joint is received, Determining the distance between the current position of the robot joint and the first limit of motion of the robot joint, A method for damping operations on medical devices, including applying a damping function to robotic joints based on distance to modify the resistance to the movement of the medical device.

[0190] Article 19. Determining the current velocity of the robot joint, The method according to clause 18, further comprising changing the damping function applied to the robot joint based on the current velocity and current position.

[0191] Clause 20. Determining the damping function is When the distance satisfies a first threshold, a first damping coefficient is determined to correct the resistance force or torque to the movement of the robot joint, The method according to clause 18 or 19, comprising determining a second damping coefficient for correcting resistance or torque when the distance satisfies a second threshold.

[0192] [Implementation Method] (1) A system for damping operations of medical devices, A robotic arm having one or more links and one or more joints that work together to move the medical device, It is a control unit, The position and velocity of the first joint among the one or more joints are received. To correct the force or torque of the first joint, a damping function is applied to the first joint based on the received position or velocity. A system including a control unit configured to change the damping function applied to the first joint based on the position or velocity if the position or velocity changes while the medical device is moving. (2) The system according to Embodiment 1, wherein the damping function is based on the current position of the robot arm relative to the virtual wall. (3) The system according to Embodiment 2, wherein the damping function causes a reduction in the velocity of the first joint when it reaches a pre-tactile limit with respect to a virtual wall. (4) The system according to Embodiment 3, wherein the damping function changes the damping coefficient as the first joint moves between the tactile prelimit and the virtual wall. (5) The system according to Embodiment 4, wherein the damping coefficient increases as the first joint moves from the pre-tactile limit toward the virtual wall.

[0193] (6) The damping coefficient remains constant when the first joint moves beyond the virtual wall, according to Embodiment 4. (7) The damping function determines the damping coefficient based on the speed of the robot arm, according to Embodiment 1. (8) The damping function changes the damping coefficient as the speed of the robot arm increases, according to the system of embodiment 7. (9) The system according to Embodiment 1, wherein the robot arm is capable of impedance control. (10) The damping function includes a first damping region and a second damping region that are selectable to modify the force or torque of the first joint based on the current position or speed of the first joint, wherein the first damping region modifies the force or torque differently from the second damping region, according to Embodiment 1.

[0194] (11) The system according to Embodiment 1, wherein the damping function includes (i) a first damping region that modifies the force or torque of the first joint by a variable amount in response to the current position of the first joint satisfying a first threshold, and (ii) a second damping region that modifies the force or torque according to a fixed amount in response to the current position of the first joint satisfying a second threshold. (12) A system for damping operations of medical devices, A robotic joint configured for use with a robotic arm having one or more links and one or more joints that work together to move the medical device, It is a control unit, When the medical device is moved in three-dimensional space, the current position of the robot joint is received. Determine the distance between the current position of the robot joint and the first limit of motion of the robot joint. A system including a control unit configured to apply a damping function to the robot joint based on the distance to modify the resistance to the movement of the medical device. (13) The control unit is Determine the current velocity of the robot joint, The system according to embodiment 12, further configured to change the damping function applied to the robot joint based on the current velocity and the current position. (14) The system according to Embodiment 12, wherein the damping function determines a first damping coefficient for correcting the resistance force or torque to the movement of the robot joint when the distance satisfies a first threshold, and determines a second damping coefficient for correcting the resistance force or torque when the distance satisfies a second threshold. (15) The system according to Embodiment 12, wherein the distance is the rotational distance, the current position is the rotational position, and the damping function causes an increase in resistance or torque to the movement of the robot joint.

[0195] (16) The system according to Embodiment 12, wherein the robot joint is associated with two respective motion limits, each limit being associated with the respective rotational direction of the robot joint. (17) The system according to Embodiment 16, wherein each rotational direction of the robot joint is associated with a plurality of damping regions, and each damping region in each rotational direction determines a different damping coefficient for correcting the force or torque of the robot joint. (18) To provide a robotic joint configured for use with a robotic arm having one or more links and one or more joints for moving medical instruments in cooperation, When the medical device is moved in three-dimensional space, the current position of the robot joint is received, Determining the distance between the current position of the robot joint and the first limit of motion of the robot joint, A method for damping a medical device, comprising applying a damping function to the robot joint based on the distance to modify the resistance to the movement of the medical device. (19) Determining the current velocity of the robot joint, The method according to Embodiment 18, further comprising changing the damping function applied to the robot joint based on the current velocity and the current position. (20) Determining the damping function is When the distance satisfies a first threshold, a first damping coefficient is determined for correcting the resistance force or torque to the movement of the robot joint. The method according to Embodiment 18, comprising determining a second damping coefficient for correcting the resistance force or torque when the distance satisfies a second threshold.

Claims

1. A system for damping operations of medical devices, A robotic joint configured for use with a robotic arm having one or more links and one or more joints that work together to move the medical device, It is a control unit, When the medical device is moved in three-dimensional space, the current position of the robot joint is received. Determine the distance between the current position of the robot joint and the first limit of motion of the robot joint. A system including a control unit configured to apply a damping function to the robot joint based on the distance to modify the resistance to the movement of the medical device.

2. The control unit is Determine the current velocity of the robot joint, The system according to claim 1, further configured to change the damping function applied to the robot joint based on the current velocity and the current position.

3. The system according to claim 1, wherein the damping function determines a first damping coefficient for correcting the resistance force or torque to the movement of the robot joint when the distance satisfies a first threshold, and determines a second damping coefficient for correcting the resistance force or torque when the distance satisfies a second threshold.

4. The system according to claim 1, wherein the distance is the rotational distance, the current position is the rotational position, and the damping function causes an increase in resistance or torque to the movement of the robot joint.

5. The system according to claim 1, wherein the robot joint is associated with two respective motion limits, each limit being associated with the respective rotational direction of the robot joint.

6. The system according to claim 5, wherein each rotational direction of the robot joint is associated with a plurality of damping regions, and each damping region in each rotational direction determines a different damping coefficient for correcting the force or torque of the robot joint.

7. To provide a robotic joint configured for use with a robotic arm having one or more links and one or more joints for collaboratively moving medical devices, When the medical device is moved in three-dimensional space, the current position of the robot joint is received, Determining the distance between the current position of the robot joint and the first limit of motion of the robot joint, A method for damping a medical device, comprising applying a damping function to the robot joint based on the distance to modify the resistance to the movement of the medical device.

8. Determining the current velocity of the robot joint, The method according to claim 7, further comprising changing the damping function applied to the robot joint based on the current velocity and the current position.

9. Determining the aforementioned damping function means When the distance satisfies a first threshold, a first damping coefficient is determined for correcting the resistance force or torque to the movement of the robot joint. The method according to claim 7, comprising determining a second damping coefficient for correcting the resistance force or torque when the distance satisfies a second threshold.

Images