System and methods for performing force and moment sensor bias calibration

The control system addresses bias drift in force sensors by determining and implementing valid bias results during instrument movements, ensuring accurate and intuitive operation of computer-assisted systems.

WO2026236587A1PCT designated stage Publication Date: 2026-11-12INTUITIVE SURGICAL OPERATIONS INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/US2026/027232
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-05-09
Filing Date
2026-05-08
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Force sensor systems in computer-assisted systems experience bias value drift, leading to non-intuitive operation due to inaccurate zero offset signals, especially after repeated installation, removal, and transport, affecting the coordination between the instrument and user input system.

Method used

A control system communicatively coupled to a repositionable assembly and force sensor system determines bias results by analyzing outputs during commanded movements, identifying valid or invalid bias, and controlling the system accordingly to maintain accurate instrument operation.

Benefits of technology

The solution ensures intuitive and accurate operation of computer-assisted systems by continuously calibrating force sensors within a cannula, reducing unintended movements and enhancing system functionality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure US2026027232_12112026_PF_FP_ABST
    Figure US2026027232_12112026_PF_FP_ABST
Patent Text Reader

Abstract

A computer-assisted system includes: a repositionable assembly configured to support an instrument; and a control system communicatively coupled to the repositionable assembly and a force sensor system coupled to the instrument. The control system is configured to: receive an output generated by the force sensor system during a commanded movement of a distal portion of the instrument within a cannula; determine a bias result of the force sensor system based on a portion of the output that corresponds to a force detected during the commanded movement; and control the computer-assisted system based on the bias result.
Need to check novelty before this filing date? Find Prior Art

Description

SYSTEM AND METHODS FOR PERFORMING FORCE AND MOMENT SENSOR BIAS CALIBRATIONCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims priority to and the benefit of the filing date of U.S. Provisional Patent Application 63 / 802,841, filed on May 9, 2025, which is hereby incorporated by reference herein in its entirety.BACKGROUNDField of Invention

[0002] The present invention generally provides improved computer-assisted systems and methods.Overview

[0003] Computer-assisted systems can be used to perform a task at a work site. For example, a computer-assisted system may comprise an input system (e.g., a console, a surgeon's console), a repositionable assembly, and a control system. As an example, in a medical context, the repositionable assembly may be used to perform diagnosis, non-surgical treatment, surgical treatment (e.g, through minimally invasive apertures or natural orifices) and is guided by the user based on images or video from an imaging device. As another example, a computer-assisted system may comprise a robotic system (e.g, industrial and recreational systems), and may include one or more robotic manipulators or repositionable assemblies to manipulate instruments for performing the task.

[0004] The computer-assisted system can be automated, semi-automated, teleoperated, or any combination thereof. Furthermore, operation of the computer-assisted system may be augmented with sensor information obtained by a force sensor system coupled to an instrument supported by the repositionable assembly (e.g., force feedback to a user input system based on forces experienced by the instrument, sensor-based control algorithms for a procedure or safety feature). However, one or more bias values (e.g., a zero offset value) of the force sensor system can drift or shift throughout the life of the instrument (e.g., after repeated installation, removal, transport, reprocessing), potentially resulting in non-intuitive operation of the computer-assisted system based on an erroneous sensor value.Therefore, a robust method of calibrating a force sensor is beneficial to improve system functionality and to reduce the occurrence or degree of non-intuitive operation.SUMMARY

[0005] In general, in one aspect, one or more embodiments relate to a computer-assisted system comprising: a repositionable assembly configured to support an instrument; and a control system communicatively coupled to the repositionable assembly and a force sensor system coupled to the instrument. The control system is configured to: receive an output generated by the force sensor system during a commanded movement of a distal portion of the instrument within a cannula; determine a bias result of the force sensor system based on a portion of the output that corresponds to a force detected during the commanded movement; and control the computer-assisted system based on the bias result.

[0006] In general, in one aspect, one or more embodiments relate to a computer-assisted system comprising: a repositionable assembly configured to support an instrument; and a control system communicatively coupled to the repositionable assembly and a force sensor system coupled to the instrument. The control system is configured to: receive an output generated by the force sensor system during a commanded roll movement of a distal portion of the instrument within a cannula; identify, within the output generated during the commanded roll movement, a first portion of the output that has variability less than a predetermined threshold; determine a first bias result of the force sensor system based on the first portion of the output; and determine whether or not the first bias result is valid or invalid. In response to the first bias result being valid, the control system is configured to control the computer-assisted system based on the first bias result. In response to the first bias result being invalid, the control system is configured to: identify, within the output generated during the commanded roll movement, a second portion of the output; determine a second bias result of the force sensor system based on the second portion of the output; and control the computer-assisted system based on the second bias result.

[0007] Other aspects of the invention will be apparent from the following description and the appended claims.BRIEF DESCRIPTION OF DRAWINGS

[0008] The accompanying drawings are not intended to be drawn to scale. In the drawings, each identical or nearly identical component that is illustrated in various figuresmay be represented by a like numeral. For purposes of clarity, not every component may be labeled in every drawing. In the drawings:

[0009] FIG. 1 A shows an example computer-assisted system, in accordance with one or more embodiments.

[0010] FIG. IB shows an example repositionable assembly, in accordance with one or more embodiments.

[0011] FIG. 2 shows an example control system, in accordance with one or more embodiments.

[0012] FIG. 3 A shows an example of an instrument installed in a repositionable assembly, in accordance with one or more embodiments.

[0013] FIG. 3B shows an example instrument, in accordance with one or more embodiments.

[0014] FIG. 3C shows a distal portion of an example instrument, in accordance with one or more embodiments.

[0015] FIG. 4A shows a side view of a distal portion of an instrument within a cannula, in accordance with one or more embodiments.

[0016] FIG. 4B is a diagram based on outputs from a force sensor system.

[0017] FIG. 5A shows different contributions to a displacement based contact force, in accordance with one or more embodiments.

[0018] FIG. 5B shows a side view of a distal portion of an instrument within a cannula, in accordance with one or more embodiments.

[0019] FIG. 5C is a diagram based on outputs from a force sensor system, in accordance with one or more embodiments.

[0020] FIG. 6 shows a model workflow, in accordance with one or more embodiments.

[0021] FIG. 7 is a flowchart of a method, in accordance with one or more embodiments.

[0022] FIG. 8 is a flowchart of a method, in accordance with one or more embodiments.

[0023] FIG. 9 is a flowchart of a method, in accordance with one or more embodiments.

[0024] FIG. 10 is a diagram based on outputs from a force and moment sensor system, in accordance with one or more embodiments.DETAILED DESCRIPTION

[0025] In the following description, specific details are set forth describing some embodiments consistent with the present disclosure. Numerous specific details are set forth in order to provide a thorough understanding of the embodiments. It will be apparent, however, to one skilled in the art that some embodiments can be practiced without some or all of these specific details. The specific embodiments disclosed herein are meant to be illustrative but not limiting. One skilled in the art may realize other elements that, although not specifically described here, are within the scope and the spirit of this disclosure. In addition, to avoid unnecessary repetition, one or more features shown and described in association with one embodiment may be incorporated into other embodiments unless specifically described otherwise or if the one or more features would make an embodiment non-functional.

[0026] In some instances, well known methods, procedures, components, and circuits have not been described in detail so as not to unnecessarily obscure aspects of the embodiments. For example, devices and substitutes that provide or enable linear actuation, such as pneumatic cylinders and lead screws are well understood without detailed descriptions of aspects of such devices like gaskets, thread pitch, etc. Thus, specific descriptions regarding such devices, procedures, components, and how circuits can be integrated with, or used within, embodiments of the instant disclosure are omitted herein for concision where applicable without causing undue ambiguity or uncertainty.

[0027] Throughout the application, ordinal numbers (e.g., first, second, third, efc.) may be used as an adjective for an element ( / .< ., any noun in the application). The use of ordinal numbers is not to imply or create any particular ordering of the elements nor to limit any element to being only a single element unless expressly disclosed, such as using the terms “before,” “after,” “single,” and other such terminology. Rather, the use of ordinal numbers is to distinguish between the elements. By way of an example, a first element is distinct from a second element, and the first element can encompass more than one element and succeed (or precede) the second element in an ordering of elements.

[0028] It is to be understood that the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise.

[0029] Terms such as “approximately,” “substantially,” etc., mean that the recited characteristic, parameter, or value need not be achieved exactly, but that deviations or variations, including for example, tolerances, measurement error, measurement accuracylimitations and other factors known to those of skill in the art, may occur in amounts that do not preclude the effect the characteristic was intended to provide.

[0030] In the following description, any component described with regard to a figure, in various embodiments disclosed herein, may be equivalent to one or more like-named components described with regard to any other figure. For brevity, descriptions of these components are not necessarily repeated with regard to each figure. Thus, each and every embodiment of the components of each figure is incorporated by reference and assumed to be optionally present within every other figure having one or more like-named components. Additionally, in accordance with various embodiments disclosed herein, any description of the components of a figure is to be interpreted as an optional embodiment which may be implemented in addition to, in conjunction with, or in place of the embodiments described with regard to a corresponding like-named component in any other figure.

[0031] Considering the figures, specific non-limiting embodiments are described in further detail. It should be understood that the various systems, components, features, and methods described relative to these embodiments can be used either individually and / or in any desired combination as the disclosure is not limited to only the specific embodiments described herein.

[0032] This disclosure describes various devices, elements, and portions of computer-assisted systems and elements in terms of their state in three-dimensional space. As used herein, the term “location” refers to the spatial placement of an element or a portion of an element (e.g., three degrees of translational freedom in a three-dimensional space, such as along Cartesian x-, y-, and z-coordinates). As used herein, the term “orientation” refers to the rotational placement of an element or a portion of an element (e.g., three degrees of rotational freedom in three-dimensional space, such as about roll, pitch, and yaw axes, represented in angle-axis, rotation matrix, quaternion representation, and / or the like). As used herein, and for a device with a kinematic series, such as with a repositionable assembly with a plurality of links coupled by one or more joints, the term “proximal” refers to a direction toward a base of the kinematic series, and “distal” refers to a direction away from the base along the kinematic series.

[0033] As used herein, the term “pose” refers to the multi-degree of freedom (DOF) spatial placement and orientation of a coordinate system of interest attached to a rigid body. In general, a pose includes a pose variable for each of the DOFs in the pose. For example, a full 6-DOF pose for a rigid body in three-dimensional space would include 6 pose variables corresponding to the 3 locational DOFs (e.g., x, y, and z) and the 3 orientational DOFs (e.g.,roll, pitch, and yaw). A 3-DOF location only pose would include only pose variables for the 3 locational DOFs. Similarly, a 3-DOF orientation only pose would include only pose variables for the 3 rotational DOFs. Further, a velocity of the pose captures the change in pose over time (e.g., a first derivative of the pose). For a full 6-DOF pose of a rigid body in three-dimensional space, the velocity would include 3 translational velocities and 3 rotational velocities. Poses with other numbers of DOFs would have a corresponding number of velocities translational and / or rotational velocities.

[0034] Aspects of this disclosure are described in reference to computer-assisted systems, which can include devices that are teleoperated, externally manipulated, autonomous, semiautonomous, and / or the like. Further, aspects of this disclosure are described in terms of an implementation using a teleoperated surgical system, such as the da Vinci® Surgical System commercialized by Intuitive Surgical, Inc. of Sunnyvale, California. Knowledgeable persons will understand, however, that inventive aspects disclosed herein may be embodied and implemented in various ways, including teleoperated and nonteleoperated, and medical and non-medical embodiments and implementations.Implementations on da Vinci® Surgical Systems are merely exemplary and are not to be considered as limiting the scope of the inventive aspects disclosed herein. For example, techniques described with reference to surgical instruments and surgical methods may be used in other contexts. Thus, the instruments, systems, and methods described herein may be used for humans, animals, portions of human or animal anatomy, industrial systems, general robotic, or teleoperated systems. As further examples, the instruments, systems, and methods described herein may be used for non-medical purposes including industrial uses, general robotic uses, sensing or manipulating non-tissue work pieces, cosmetic improvements, imaging of human or animal anatomy, gathering data from human or animal anatomy, setting up or taking down systems, training medical or non-medical personnel, and / or the like.Additional example applications include use for procedures on tissue removed from human or animal anatomies (with or without return to a human or animal anatomy) and for procedures on human or animal cadavers. Further, these techniques can also be used for medical treatment or diagnosis procedures that include, or do not include, surgical aspects.

[0035] Force sensors (e.g., electrical sensor elements (e.g., strain sensors or strain gauges)) may be included in an instrument and / or in the repositionable assembly that supports the instrument (e.g., in a manipulator arm that supports the instrument). To foster an operator’s sense of immersion, realism, and / or intuitiveness while operating a repositionable assembly, a high degree of coordination between a user input system and the repositionableassembly is required, especially while operating in a following mode (leader-follower mode of teleoperation). For example, haptic feedback information can be provided to the operator (e.g., via a force feedback module in the user input system, visual indications of force, instrument logs for procedure analytics / machine-leaming).

[0036] To acquire accurate information from a force sensor, it must be calibrated based on a bias value (e.g., zero-offset) determined prior to execution of any algorithms that are based on the output of the force sensor. Typically, a force sensor is calibrated during manufacture or maintenance outside of a procedure. This “factory” calibration establishes a zero offset signal of the force sensor when no force is applied. However, the bias value can shift throughout the life of the instrument (e.g., positioning, transport or reprocessing), resulting in a non-zero output signal when no force is applied (i.e., in a free-space configuration). If the bias value is inaccurate, the coordination of the instrument and user input system may become non-intuitive to the operator and result in unintended movements.

[0037] One or more embodiments described herein are directed to a method of calibrating a force sensor system to improve functionality of a computer-assisted system and to reduce the occurrence or degree of unintended movements of an instrument of the computer-assisted system. In some embodiments, a control system is communicatively coupled to the repositionable assembly and a force sensor system coupled to an instrument. Based on one or more outputs from the force sensor system, the control system may determine and implement a control relationship of the computer-assisted system based on a bias result of the force sensor system. The control system may be configured with a plurality of calibration processes for determining a force sensor bias. Embodiments described herein are direct to a method of determining a bias result while the instrument is inside a cannula. Some embodiments may be applied while the instrument is outside of the cannula.

[0038] Specific embodiments of the disclosure will now be described in detail with reference to the accompanying figures. Like elements in the various figures are denoted by like reference numerals for consistency.

[0039] FIG. 1A shows an example computer-assisted system 100 in accordance with one or more embodiments.

[0040] In FIG. 1 A, the computer-assisted system 100 includes, without limitation, a manipulator structure comprising a repositionable assemblyl 10 and a user input system 140. In a teleoperation scenario, an operator (not shown) uses the user input system 140 to operate the repositionable assemblyl 10, such as in a leader-follower configuration (also often called teleoperation configuration or master-slave configuration in industry) of the computer-assisted system 100. In the leader-follower configuration, the user input system 140 is the leader, and the repositionable assembly 110 is the follower of the leader-follower configuration.

[0041] The repositionable assembly 110 can be used to introduce a set of one or more instruments to a work site through a port 130 (e.g., a gel port, a cannula, entry guide) inserted in an aperture (a cannula is shown in FIG. 1 A). In a medical scenario, the work site can be on or within a body cavity of a patient, and the aperture can be a minimally invasive incision or a natural body orifice. When used, the port 130 can be free-floating, held in place by a fixture separate from the repositionable assembly 110, or held by a drivable structure 122 (a linkage is shown in FIG. 1 A) or other part of the repositionable assemblyl 10. The drivable structure 122 is coupled to additional joints and links 114, 120 of the repositionable assemblyl 10, and these additional joints and links 114, 120 are mounted on a base 112. In some embodiments, the drivable structure 122 terminates in a manipulator-supporting link 124. In the example shown, the repositionable assemblyl 10 further comprises a set of manipulators 126 coupled to the manipulator-supporting link 124. Each of the manipulators 126 include a carriage (or other instrument-coupling link) configured to couple to an instrument, and each of the manipulators 126 include one or more joint(s) that can be driven to move the carriage. For example, a manipulator 126 can include a prismatic joint that, when driven, linearly moves the carriage and any instrument(s) coupled to the carriage. In some embodiments, this linear motion is along an insertion axis of the instrument. In this configuration, the elements of the repositionable assemblyl 10 that are proximal to the manipulators 126 may be understood as a proximal repositionable structure.

[0042] In some embodiments, the joints and links 114, 120 are used to position the port 130 at the aperture or another location. FIG. 1A illustrates a prismatic joint for vertical adjustment (as indicated by arrow “A”) and a rotary joint for horizontal adjustment (as indicated by arrow “B”). The drivable structure 122 is used to robotically pivot the port 130 (and the instruments disposed within it at the time) in yaw, pitch and roll angular rotations about a remote center of motion as indicated by arrows C, D and E, respectively. These joints may be considered part of the proximal repositionable structure.

[0043] In some embodiments, actuation of the degrees of freedom provided by joint(s) of the instrument(s) is provided by actuators disposed in, or whose motive force (e.g., linear force or rotary torque) is transmitted to, the instrument(s). Examples of actuators include rotary motors, linear motors, solenoids, and / or the like. The actuators drive transmission elements in the manipulators and / or in the instruments to control the degrees offreedom of the instrum ent(s). For example, the actuators can drive rotary discs of the manipulator that couple with rotary discs of the instrument(s), where driving the rotary discs of the instruments drives transmission elements in the instrument that couple to move the joint(s) of the instrument, or to move the end effector(s) of the instrument. Accordingly, the degrees of freedom of the instrument(s) are controlled by actuators that drive the instrument(s) in accordance with control signals determined based on inputs from the associated input devices (e.g., input devices 142 of the user input system 140). The control signals are determined in order to cause instrument motion or other actuation as indicated by movement of the input control devices or any other control signal. Furthermore, in some embodiments, appropriately positioned sensors (e.g., encoders, potentiometers, and / or the like) are provided to enable measurement of indications of the joint positions, or other data that can be used to derive joint position, such as joint velocity. The actuators and sensors are disposed in, transmit to, and / or receive signals from the manipulator(s) 126.

[0044] In many embodiments, the tool of an exemplary repositionable assembly 110 pivots about a pivot point adjacent to a minimally invasive aperture (e.g., port 130). In some embodiments, the repositionable assembly 110 may utilize a hardware remote center (HRC), such as the remote center kinematics described in U.S. Patent No. 6,786,896, the entire contents of which are incorporated herein in its entirety. Such systems may utilize a double parallelogram linkage which constrains the movement of the linkages such that the shaft of the instrument supported by the manipulator pivots about a remote center point. Alternative mechanically constrained remote center linkage systems are known and / or may be developed in the future. In particular, when a surgical robotic system has a linkage that allows pivotal motion about two axes intersecting at or near a minimally invasive surgical access site, the spherical pivotal motion may encompass the full extent of a desired range of motion within the patient, but may still suffer from avoidable deficiencies (such as being poorly conditioned, being susceptible to arm-to-arm or arm-to-patient contact outside the patient, and / or the like). At first, adding one or more additional degrees of freedom that are also mechanically constrained to pivotal motion at or near the access site may appear to offer few or any improvements in the range of motion. Nonetheless, such joints can provide significant advantages by allowing the overall system to extend the range of motion.

[0045] In the embodiments shown in FIG. 1 A, the user input system 140 includes one or more input devices 142 operated by the operator (not shown). The one or more input devices 142 are contacted and manipulated by the hands of the operator, with one input device for each hand. Examples of such hand-input-devices include any type of devicemanually operable by human operator e.g., joysticks, trackballs, button clusters, and / or other types of haptic devices typically equipped with multiple degrees of freedom). Additionally, in some embodiments, position, force, and / or tactile feedback devices (not shown) are employed to transmit position, force, and / or tactile sensations from the instruments back to the operator's hands through the input devices 142.

[0046] The input devices 142 are supported by the user input system 140 and are shown as mechanically grounded, and in other implementations may be mechanically ungrounded. An ergonomic support 146 is provided in some implementations. For example, FIG. 1A shows an ergonomic support 146 including forearm rests on which the operator may rest his or her forearms while manipulating the input devices 142. In some examples, the operator performs tasks at a work site near the repositionable assembly 110 during a medical procedure by controlling the repositionable assemblyl 10 using the input devices 142.

[0047] In one or more embodiments, the input device is configured to provide haptic feedback to the operator. Forces and / or torques experienced by the instrument 160 may be rendered to the user when interacting with the surrounding environment (e.g., when manipulating tissue in a surgical scenario). In such a configuration, the user may rely on the force-feedback at the input device to control movement of the instrument. For example, a force feedback module of the control system 170 and / or user input system 140 may be configured to apply a force and / or torque to the input device(s) 142. In some embodiments, haptic feedback may be provided to the user by other means (e.g., quantitative / qualitative displays to the user, audio / visual indicators, etc.). In some embodiments, the haptic feedback may be used to indicate and / or track evaluate user performance (e.g., monitoring adherence to steps or requirements of a procedure).

[0048] In some embodiments, the force feedback effect is proportional to a joint tracking error in the repositionable assemblyl 10. A joint tracking error could be a result of a contact condition (e.g., a manipulator arm 150 cannot execute a commanded motion because it is resisted or blocked by an obstruction or another manipulator arm 150). In some embodiments, the joint tracking error may be the result of a procedure-related force or torque (in absence of a contact condition). In other words, the force feedback module may be configured to make the user aware of the presence of a contact condition.

[0049] A display unit 144 is included in the user input system 140. The display unit 144 displays images for viewing by the operator. The display unit 144 provides the operator with a view of the worksite with which the repositionable assemblyl 10 interacts. The view can include, for example, stereoscopic images or three-dimensional images to provide a depthperception of the worksite and the instrum ent(s) of the repositionable assembly 110 in the worksite. The display unit 144 can be moved in various degrees of freedom to accommodate the operator’s viewing position and / or to provide control functions. Where a display unit (such as the display unit 144 is also used to provide control functions, such as to command the repositionable assembly, the display unit also includes an input device (e.g., another input device 142). One or more separate displays (not shown in FIG. 1A) (e.g., in an auxiliary system 180, described below) may also be used for local and / or remote display of images, such as images of the procedure site, or other related images.

[0050] When using the user input system 140, the operator can sit in a chair or other support in front of the user input system 140, position his or her eyes to see images displayed by the display unit 144, grasp and manipulate the input devices 142, and rest his or her forearms on the ergonomic support 146 as desired. In some implementations, the operator can stand at the workstation or assume other poses, and the display unit 144 and input devices 142 may differ in construction, be adjusted in position (e.g., height, depth), etc.

[0051] FIG. IB shows an example repositionable assembly 110 in accordance with one or more embodiments.

[0052] In some embodiments, a repositionable assembly 110 (e.g., a patient-side robotic device in a medical example) may include one or more manipulator arm(s) 150, each of which may support a removably coupled instrument 160 (also called tool 160). The computer-assisted system 100 may include a drivable cart (not shown) with a primary control interface and a support column that vertically extends from a drivable cart. In some embodiments, a boom extends from the support column with at least one manipulator arm 150 connected to the distal end of the boom. In the example of FIG. IB, the repositionable assembly 110 is depicted with four manipulator arms 150, namely, a first manipulator arm 150A, a second manipulator arm 150B, a third manipulator arm 150C, and a fourth manipulator arm 150D. Where a particular manipulator arm need not be referenced, a manipulator arm may be referenced generally as manipulator arm 150.

[0053] In this example, the repositionable assembly 110 is utilized for a diagnostic or therapeutic medical procedure performed on a patient P on an operating table. The instrument 160 may enter the work site through an entry location (e.g, enter the body of the patient P through a natural orifice such as the throat or anus, or through an incision), while an operator (not shown) views the worksite (e.g, a surgical site in the surgical scenario) through a user interface system (e.g., user input system 140).

[0054] In one or more embodiments, an image of the worksite may be obtained by an imaging device connected to the instrument 160 (c.g, an endoscope, an optical camera, an ultrasonic probe, etc. in a medical example). The instrument 160 may be manipulated by the repositionable assembly 110 so as to position and orient the instrument 160 to image the worksite from different perspectives.

[0055] The number of instruments 160 used at one time generally depends on the task and space constraints, among other factors. If it is appropriate to change, clean, inspect, or reload one or more of the instruments 160 being used during a procedure, an assistant (not shown) may remove the instrument 160 from the manipulator arm 150A-D, and replace it with the same instrument 160 or another instrument 160.

[0056] Various classes and types of instruments 160 can be used, or exchanged during a process or procedure, according to the needs of a procedure or process undertaken by one or more manipulator arms (e.g., 150A-D) of a computer-assisted system 100.Instruments 160 may include, but are not limited to: monopolar and bipolar instruments for dissection, coagulation, sealing, transection, and / or cutting of tissue; suction and irrigation instruments; clip appliers; and instruments for visualization of the procedure site (e.g., visual camera, infrared camera). Some instruments 160, such a monopolar and bipolar instruments, can be “energized” or apply electrical cortical stimulation in a tunable manner (e.g., “on” or “off’).

[0057] While FIGs. 1 A-1B show the computer-assisted system 100 as a medical system, the following description is applicable to other scenarios and systems (e.g, medical scenarios or systems that are non-surgical, non-medical scenarios or systems, etc.).

[0058] Furthermore, while example configurations of a computer-assisted system 100 including repositionable assemblies 110 are shown in FIGs. 1 A-1B, those skilled in the art will appreciate that embodiments of the disclosure can be used with any design of manipulator structure. For example, a repositionable assembly 110 can have any number and any types of degrees of freedom, may or may not be configured to couple to one or more ports 130, use a port 130 other than a cannula, and / or other configuration different from what is shown in FIGs. 1 A-1B.

[0059] In general, a repositionable assembly 110 of a computer-assisted system 100 may include a repositionable assembly 110 that includes a common proximal repositionable structure (i.e., proximal portion) and one or more distal repositionable structures (i.e., distal portion(s)) attached to the proximal repositionable structure. The one or more distal repositionable structures may each be configured to support one or more instruments 160.For example, in FIG. 1 A, the repositionable assemblyl 10 is a repositionable assembly with a proximal repositionable structure (e.g., the support column and boom) and a distal repositionable structure (e.g., the drivable structure 122 and the manipulator-supporting link 124). Alternatively, in FIG. IB, the repositionable assemblyl 10 is a repositionable assembly with a common proximal repositionable structure (e.g., the support column and boom) that supports a plurality of manipulator arms 150 as the distal repositionable structure.

[0060] While example configurations of repositionable assemblies are shown in FIGs.1 A-1B, those skilled in the art will appreciate that embodiments of the disclosure can be used with any design of repositionable assemblies. For instance, each distal repositionable structure of a repositionable assembly may include a prismatic joint, that when driven, linearly moves an instrument carriage and any instrument(s) coupled to the carriage along an insertion axis. In other examples, the repositionable assembly may include a single instrument manipulator and no serial coupling of manipulators. In additional examples, the repositionable assembly may include a single instrument manipulator coupled to a single base manipulator.

[0061] Furthermore, while the present disclosure show various configurations of components, other configurations may be used without departing from the scope of the disclosure. For example, various components may be combined to create a single component. As another example, the functionality performed by a single component may be performed by two or more components. While examples of particular manipulator assemblies, particular repositionable structures, instruments, input systems, and controller portions are shown, the disclosure generalizes to any type of manipulator assemblies, repositionable structures, instruments, input systems, and controller portions with any number of degrees of freedom. Further, while components are often described in context of medical scenarios such as surgical scenarios, embodiments of the disclosure are equally applicable to other domains that involve robotic manipulation (e.g., non-surgical scenarios or systems, non-medical scenarios or systems, and / or the like).

[0062] FIG. 2 illustrates an example control system 170 in accordance with one or more embodiments.

[0063] The illustration, partitioning, organization, and interaction of the components and / or modules of the control system 170 in FIG. 2 is intended to promote clear discussion and should not be considered fixed or limiting. For example, FIG. 2 depicts a display unit 174 as an independent entity, however, it is well understood that in practice the display unit 174 may be implemented as part of, for example, an auxiliary system 180.

[0064] The control system 170 corresponds to repositionable assembly of a computer-assisted system 100 and includes one or more computing systems 172. A computing system 172 includes a processing system and is used to process input provided by the user input system 140 (e.g., from the input device(s) 142 manipulated by an operator). In some embodiments, a computing system 172 is further used to provide an output (e.g., a video, an image) to the display unit 174. Examples of display unit 174 include LCDs, LEDs, organic LED displays, projectors, etc. In some embodiments, one or more computing systems 172 are used to control the repositionable assembly 110.

[0065] In many embodiments, the repositionable assembly will often comprise a surgical tool or instrument having a shaft extending between a mounting interface and an end effector. In a first operational mode, the control system 170 may be configured to derive the desired movement of the end effector within an internal surgical space so that the shaft passes through a minimally invasive aperture site (e.g., port 130). A leader-follower controller may, for example, comprise a velocity controller using a Jacobian pseudo-inverse matrix. In a second operational mode or clutch mode, the control system 170 may employ a projection of a clutch matrix with the inverse Jacobian matrix so as to provide combinations of joint velocities that are allowed in the clutch mode. In the clutch mode, the control system 170 may float a first set of joints within a joint velocity sub-space to allow manual articulation or movement of a first portion of the repositionable assembly (e.g., a remote center of motion, an end effector), while driving a second set of joints to offset the movement of the first set of joints.

[0066] The architecture of the control methods used for controlling the repositionable assembly can be of any appropriate form. As a specific example, the control architecture can be hierarchical, and could include a high-level controller and multiple joint controllers. A commanded movement is received by the high-level controller in, for example, a Cartesiancoordinate space (referred to herein as Cartesian-space). The commanded movement could be, for example, based on a movement command (e.g., in the form of a position and / or velocity) received from the user input system 140, or any other system that provides a movement command. The commanded movement is converted into commanded joint positions or joint velocities (e.g., linear or angular joint positions, linear or angular joint velocities). In some embodiments, the conversion is performed using an inverse kinematics algorithm. Subsequently, the joint controllers convert the received commanded joint positions or velocities into commanded currents to drive the actuators producing jointmovements. The joint movements together produce a repositionable assembly movement that reflects the commanded movement.

[0067] In some embodiments, a joint controller controls a joint position. In some embodiments, the joint controller controls other variables such as joint velocity and / or joint force (linear force or angular torque). A joint controller receives a feedback signal in the form of a sensed joint state from an associated joint sensor, which it can use for closed-loop control. The sensed joint state includes, for example and without limitation, a joint position, a joint velocity (or component of velocity such as speed or direction), a joint acceleration (or component of acceleration), and / or the like, representing the joint movement. The sensed joint state is derived from the signals obtained from the joint sensor. A joint sensor can be, for example, an encoder, a potentiometer, an accelerometer, a hall effect sensor, and / or the like. In some embodiments, a state observer or estimator (not shown) is used. Each joint controller can implement any appropriate control scheme, such as a proportional integral derivative (PID), proportional derivative (PD), full state feedback, sliding mode, and / or various other control schemes, without departing from the disclosure.

[0068] A computing system 172 may include, without limitation, one or more computer processors, non-persistent storage (e.g., volatile memory, such as random access memory (RAM), cache memory), persistent storage (e.g., a hard disk, an optical drive such as a compact disk (CD) drive or digital versatile disk (DVD) drive, a flash memory, etc.), a communication interface (e.g, Bluetooth interface, infrared interface, network interface, optical interface, etc.), and / or numerous other elements and functionalities. In some embodiments, a computer processor of a computing system 172 is an integrated circuit for processing instructions. For example, the computer processor can be one or more cores or micro-cores of a processor.

[0069] In some embodiments, a communication interface of a computing system 172 includes an integrated circuit for connecting the computing system 172 to a repositionable assembly, a network (not shown) (e.g, a local area network (LAN), a wide area network (WAN) such as the Internet, mobile network, or any other type of network), and / or to another device, such as another computing system 172.

[0070] Further, in some embodiments, the computing system 172 includes one or more output devices, such as a display unit 174, a printer, a speaker, external storage, or any other output device. A display unit 174 may be a liquid crystal display (LCD), a plasma display, projector, headset device, touchscreen, organic LED display (OLED), projector, or other display device. Output devices may include, but are not limited to, a printer, a speaker,external storage, or any other output device. One or more of the output devices may be the same or different from the input device(s). Many different types of computing systems 172 exist, and the aforementioned input and output device(s) may take other forms.

[0071] Software instructions in the form of computer readable program code to perform embodiments of the disclosure may be stored, in whole or in part, temporarily or permanently, on a non-transitory computer readable medium (machine-readable medium) such as a CD, DVD, storage device, a diskette, a tape, flash memory, physical memory, or any other computer readable storage medium. Specifically, the software instructions may correspond to computer readable program code that, when executed by a processor(s), is configured to perform one or more embodiments of the disclosure.

[0072] A computing system 172 may be connected to or be a part of a network. The network may include multiple nodes. Each node may correspond to a control system, or a group of nodes. By way of an example, embodiments of the disclosure may be implemented on a node of a distributed system that is connected to other nodes. By way of another example, embodiments of the disclosure may be implemented on a distributed computing system having multiple nodes, where each portion of the disclosure may be located on a different node within the distributed computing system. Further, one or more elements of the aforementioned computing systems 172 may be located at a remote location and connected to the other elements over a network.

[0073] In some embodiments, the control system 170 includes one or more auxiliary system(s) 180. An auxiliary system 180 may be any system that operates in coordination with the repositionable assembly. For example, an auxiliary system 180 may process captured images from an imaging instrument 160 that is posed by a repositionable assembly 110. This non-limiting example of the auxiliary system 180 may include in a variety of methods for processing captured images prior to any subsequent display. For example, the auxiliary system 180 may overlay the captured images with a virtual control interface prior to displaying the combined images to the operator via the user input system 140 or other display units 174 located locally or remotely from the procedure. One or more separate displays 174 may also be coupled with a computing system 172 and / or the auxiliary system 180 for local and / or remote display of images, such as images of the procedure site, or other related images.

[0074] FIG. 3 A shows an example of an instrument installed in a repositionable assembly, in accordance with one or more embodiments.

[0075] As described above, a repositionable structure (e.g., a manipulator arm 150) of the repositionable assembly 110 may support an instrument 360. The repositionable structure may correspond to a manipulator 126 in FIG. 1A, a manipulator arm 150 in FIG. IB, or any appropriate repositionable structure of the repositionable assembly 110. In one or more embodiments, during operation of the computer-assisted system 100, the repositionable assembly supports the instrument 360 and effects movements of the instrument 360.

[0076] In one or more embodiments, as shown in FIG. 3A, the instrument 360 may be releasably mounted on an instrument holder 314. The instrument holder 314 may translate along a linear guide formed by a prismatic joint of the manipulator arm 150. Thus, the instrument holder 314 may provide in / out movement of the instrument 360 along an insertion axis A. The manipulator arm 150 may further support a cannula 130 through which a shaft of the instrument 360 extends. Alternatively, the cannula 130 may be supported by another component of the repositionable assembly 110 or may not be supported at all.

[0077] The position and orientation (global or relative) of the instrument 360 in one or more degrees may be provided by actuators of the repositionable assembly 110. These actuators may be integrated in the instrument holder 314, may drive drivetrains in the instrument holder 314, and / or may actuate the instrument 360 via a transmission assembly 370 supported by the repositionable assemblyl 10 (e.g., supported by the above prismatic joint of the manipulator arm 150). While FIG. 3 A shows an external housing of the transmission assembly 370, additional components of the transmission assembly 370 are discussed below. Similarly, additional components of the instrument holder 314 are discussed below, including a detailed description of an example interfacing of the instrument 360 with the manipulator arm 150 at the instrument holder 314 and the transmission assembly 370.

[0078] FIG. 3B shows an example instrument 360, in accordance with one or more embodiments.

[0079] The instrument 360 includes a transmission assembly 370 at a proximal portion of the instrument 360, a shaft 380, and an end effector 392 (with or without a wrist assembly 390) at a distal portion of the instrument 360. Each of these components is described in further detail below.

[0080] The instrument 360 includes an end effector 392 such as forceps, graspers, a cutting tool, a cauterizing tool, a sensor (e.g., an imaging device, an endoscope, a detector). In some instances, an end effector 392 can be categorized as energy-emitting (e.g., used on a bipolar instrument) or non-energy-emitting. It will be appreciated that various tools and / orinstruments may be used as the end effector 390, and the present invention is not limited to the examples disclosed herein.

[0081] In one or more embodiments, the instrument 360 includes a wrist assembly 390 that moves and operates the end effector 392 during a desired procedure. The wrist assembly 390 is configured to provide one or more rotational degree of freedoms (e.g., a pitch rotation, a yaw rotation) of the end effector 392. For example, the end effector 392 may be configured with a yaw rotation degree of freedom that may further be used for opening and closing jaw elements of the end effector 392. Depending on the design of the end effector 392, one or more tension members may be used to control a degree of freedom of the end effector 392. In a non-limiting example, two unique tension members may be used to control each of a pitching, a yawing, and a jaw opening movement for a jawed instrument. In another non-limiting example, some of the tension members may be coupled to multiple degrees of freedom (e.g., four tension members are used in combination to control a pitching, a yawing, and a jaw opening movement for a jawed instrument).

[0082] The instrument 360 includes a shaft 380 that connects the end effector 392 and / or the wrist assembly 390 to the transmission assembly 370. The shaft 380 has a proximal portion 382 terminating at a chassis 372 of the transmission assembly 370 and a distal portion 384 terminating at the wrist assembly 390 and / or end effector 392 of the instrument 360. The shaft 380 may be any suitable shaft that couples the wrist assembly 390 and / or the end effector 392 to the transmission assembly 370.

[0083] In one or more embodiments, the shaft 380 defines at least one passageway through which one or more tensions members (e.g., cables, shown in FIG. 3C) or other transmission members suitable for the transmission of mechanical energy such as movement, force, or torque may be routed from the transmission assembly 370 towards the wrist assembly 390. In some embodiments, other components (e.g., electrical wires, push-rods, optical fibers, etc.) may also be routed through the shaft 380.

[0084] The instrument 360 includes a transmission assembly 370 that provides mechanical coupling of the one or more tension members (connected to the wrist assembly 390 and / or the end effector 392) to one or more actuators or motorized axes of the repositionable assemblyl 10. In one or more embodiments, the transmission elements 374 control movement and tension in the tension members to position, orient, and operate wrist assembly 390 and / or the end effector 392.

[0085] As shown in FIG. 3B, in one or more embodiments, the transmission elements 374 may include separate capstans for each tension member connected to the wrist assembly390 and / or the end effector 392. For example, four capstans may connect to four tension members that actuate the wrist assembly 390 and the end effector 392. Individual or coordinated operation of the four capstans may cause movement of the four tension members to produce a desired movement (e.g., pitch, yaw, and / or grip) of the end effector 392 and / or wrist assembly 390.

[0086] In a non-limiting example, a first capstan may move a first tension member in a proximal direction (pulling the tension member) by winding up the first tension member. Simultaneously, a second capstan may move a second tension member in a distal direction (releasing the tension member) by unwinding the second tension member when the first and the second tension members operate in an antagonistic manner. The second tension member may also be operated independently from the first tension member.

[0087] In FIG. 3B, the transmission elements 374 further include gears (e.g., spur gears) for rolling or rotation of the instrument shaft 380, the wrist assembly 390, and the end effector 392 about a roll axis of the instrument shaft 380. Accordingly, the transmission assembly 370 includes example five transmission elements 374 that are capstan and tension member-based, or gear-based. It will be appreciated that other types of transmission elements (e.g., metal bands, rubber belts, metal wires, pulleys, screw drives, chains and sprockets) may be used without departing from the disclosure.

[0088] In one or more embodiments, the transmission assembly 370 further includes receive couplings 378. In the example shown in FIG. 3B, one receive coupling 378 may be coupled with one of the transmission elements 374. Accordingly, the transmission assembly 370 shown in FIG. 3B includes five receive couplings 378. Each receive coupling 378 may be designed to engage with a corresponding drive coupling of the manipulator arm 150 or other repositionable structure. When a receive coupling 378 is engaged with a drive coupling, mechanical energy may be transmitted over the combination of the drive coupling and a receive coupling. For example, a torque or velocity may be transmitted from an electric motor (or any other type of actuator) to a transmission element 374 and subsequently used to drive or apply tension to one or more tension members.

[0089] The chassis 372 of the transmission assembly 370 may provide structural support for mounting and aligning the components (e.g., the transmission elements and the receive couplings) of the transmission assembly 370. The chassis 372 may further function as part of a housing of the transmission assembly 370. In one or more embodiments, the chassis 372 may also include external features (not shown) that interface with elements of a drive interface, which may be part of the instrument holder 314 to releasably lock theinstrument 360 to the instrument holder 314 or other repositionable structure. Recesses, protrusions, clips, fastening devices, or other elements may be included in the external features.

[0090] FIG. 3C shows a distal portion of an example instrument 360, in accordance with one or more embodiments.

[0091] A partial cutaway view of the example instrument 360 shows a set of tension members used to actuate the wrist assembly 390 and end effector 392. In this non-limiting example, the wrist assembly 390 includes a proximal clevis 420, a distal clevis 430, and the end effector 392. Tension members 451, 452, 453, 454 are attached to the end effector 392, extend along solid surfaces of guide channels in the end effector 392, the distal clevis 430, and the proximal clevis 420, and extend through the instrument shaft 380 to the transmission assembly 370.

[0092] The example end effector 392 includes a first jaw 442 and a second jaw 444 that each have a grip portion attached to a circular hub. A first pin 425 in the proximal clevis 420 attaches the distal clevis 430 to the proximal clevis 420 and allows the distal clevis 430 to rotate about a pivot axis defined by the first pin 425. A second pin 435 in the distal clevis 430 attaches the end effector 392 to the distal clevis 430 and allows part or all of the end effector 392 to rotate about a pivot axis defined by the second pin 435. The second pin 435 in the distal clevis 430 may be perpendicular to the first pin 425. Furthermore, the second pin 435 may be configured as a pivot axis for the entire end effector 392 or one or more individual jaws 442, 444.

[0093] The proximal clevis 420 includes guide channels 432 for tension members 451-454. The proximal clevis 420 further includes openings (e.g., opening 424) in the guide channels 432 to direct the tension members 451-454 into the guide channels 432 of the proximal clevis 420. Similarly, guide channels in distal clevis 430 define a radius about the second pin 435 at which the tension members 451-454 act on the distal clevis 430 when rotating the distal clevis 430 about the second pin 435.

[0094] In the illustrated example of FIG. 3C, the working tips of jaws 442, 444 have a surface for gripping and may be used, for example, in forceps or cautery applications.Alternatively, “gripping,” which closes the jaws 442, 444 can be a cutting action when the tips of the jaws 442, 444 are blades that cooperatively cut as scissors. Thus, gripping can perform different functions depending on the end effector 392 attached to or otherwise employed on - or as part of - the instrument 360.

[0095] It is noted that the wrist assembly 390 and end effector 392 depicted in FIG.3C uses a small number of parts. In particular, the low number of tension members 451, 452, 453, 454 used to actuate the wrist assembly 390 and the end effector 392 facilitate implementation of a small diameter for the wrist assembly 390 and the instrument shaft 380. For example, as described below with respect to FIG. 4A, a diameter of the wrist assembly 390 allows for insertion of the instrument 360 through a cannula 130.

[0096] FIG. 4A is a side view of a distal portion of an instrument 360 within a cannula 130, in accordance with one or more embodiments.

[0097] As shown in FIG. 4A, the instrument 360 may be connected to and / or may include a force sensor system 369 that provides information to the control system 170 of the computer-assisted system 100. In one or more embodiments, the force sensor system 369 may include one or more force sensors or electrical sensor elements (e.g., strain sensors or strain gauges) configured to detect forces acting on a portion of the instrument 360 (e.g., a distal portion of the instrument 360). For example, a set of force sensors may be configured to detect longitudinal forces acting along the insertion axis A of the instrument 360 (i.e., + / -z-axis forces) and / or transverse forces acting perpendicularly to the insertion axis A of the instrument 160 (i.e., + / - x-axis forces, + / - y-axis forces). In some embodiments, multiple sets of force sensors (e.g., redundant sensor sets) may measure one or more portions of the instrument 360. Operation of the instrument 360 may first require successful calibration of one or more force sensors of the force sensor system 369.

[0098] In one or more embodiments, calibrating the force sensor system 369 while the distal portion of the instrument 360 is inside the cannula 130 is desirable to reduce the time between connecting the instrument 360 to the repositionable assembly 110 and initiating operation of the instrument 360. As shown in FIGs. 3A and 4A, after positioning the distal portion of the instrument 360 in the cannula 130 and connecting the transmission assembly 370 to the instrument holder 314, the distal portion of the instrument 360 is positioned within the cannula 130. To confirm the operation and range of motion (ROM) of the instrument 360, the instrument may be instructed to execute various commanded movements. For example, a commanded movement may include a roll motion ARz about the insertion axis A of the instrument 360 (i.e., rotating about the z-axis).

[0099] The roll motion ARz may be implemented by rolling the entire instrument shaft 380 of the instrument 360, while the wrist assembly 390 and the end effector 392 are held in a straightened configuration (i.e., pivoting joints at pins 425, 435 are held at known“zero” positions). Ideally, in the straightened configuration, the insertion axis A of the instrument is aligned with the longitudinal axis C of the cannula 130 such that no portion of the instrument shaft 380, the wrist assembly 390 (e.g., proximal clevis 420, distal clevis 430), or the end effector 392 (e.g., 442, 444) contact the inner surface of the cannula 130 during the roll motion ARz. Without any physical contact between the instrument 360 and the cannula 130, the output of the force sensor system 369 will be constant during the roll motion ARz. In one or more embodiments, the output is determined to be constant based on a comparison of variability in the output to a predetermined threshold. Accordingly, accurate bias results Xo and Yo (i.e., true zero offset values) of the x-axis and y-axis forces sensors of the force sensor system 369 can be determined based on the constant output of the force sensor system 369 during the roll motion ARz (e.g., average output over a window during the roll motion ARz), as shown in the left side of FIG. 4B.

[0100] Realistically, the output of the force sensor system 369 will not be completely constant during the roll motion ARz. As shown in the right side of FIG. 4B, any external force acting on the instrument 360 during the roll motion ARz will perturb the output of the force sensor system 369 from the true bias results Xo and Yo. If the perturbation is significant, non-intuitive operation of the instrument 360 may occur due to the offset bias results Xi and Yi deviating from the true bias results Xo and Yo.

[0101] To avoid non-intuitive operation of the instrument 360, a conventional approach would be to invalidate the bias results if the output from the force sensor system 369 fails to satisfy predetermined criteria (e.g., amplitude exceeds a limit, variation exceeds a limit, failure to detect a large enough window of the output during the roll motion ARz with less than a predetermined amount of variation). An invalid bias result may prompt the control system 170 to reject the instrument 360 and require reinstallation and / or recalibration the instrument 360 and / or force sensor system 369, resulting in lost time and possible user frustration.

[0102] Embodiments described herein provide a method of calibrating the force sensor system 369 (e.g., finding one or more zero offsets for force sensors in the force sensor system 369 coupled to the instrument 360) regardless of whether the instrument 360 experiences external forces during the calibration period. By reducing the rate of calibration failure, embodiments of the present invention improve the reliability of the instrument 360 and the overall user experience with the computer-assisted system 100. For example, in a non-limiting medical example, a surgical procedure may require use of several different1instruments 360 that must each be interchanged (e.g., installed, operated, removed and replace with a different instrument 360) to access a surgical site. Accordingly, improving the calibration success rate when installing / switching between instruments 360 will reduce the time required for the surgical procedure and improve the efficiency of the surgical procedure.

[0103] FIG. 5A shows different contributions to a displacement based contact force, in accordance with one or more embodiments.

[0104] As discussed above, the ideal configuration during the roll motion ARz would include perfect alignment of the instrument 360 with the longitudinal axis C of the cannula 130. Realistically, one or more geometric factors that may cause deviation from the ideal straightened configuration. Non-limiting examples of these geometric factors are discussed in more detail below.

[0105] In one or more embodiments, an alignment offset 9 between the longitudinal axis C of the cannula 130 and the insertion axis A of the instrument 360 results in an alignment parameter T that increases with the insertion distance of the instrument 360. For example, the alignment offset 9 may result from imperfect alignment of the instrument shaft 380 relative to the transmission assembly 370.

[0106] The alignment parameter T may be the perpendicular projection (relative to the longitudinal axis C of the cannula 130) of an ideal straight instrument shaft 380 based on the alignment error 9 from the longitudinal axis C of the cannula 130. In one or more embodiments, the alignment parameter T may or may not include an inner radius of the cannula 130 and / or a radius of the instrument 360. In one or more embodiments, the alignment parameter T may include additional information such as an initial angle (e.g., phase / orientation of the alignment offset at a given roll orientation).

[0107] In one or more embodiments, a curvature K along the length of the instrument shaft 380 will deflect the distal portion of the instrument 360 from the insertion axis A by a precession parameter P. For example, the curvature K may be inherent in the stock material used to manufacture the instrument shaft 380 or may be caused by imperfect plastic deformation of the instrument shaft 380 due to improper handling.

[0108] The precession parameter P may be the perpendicular projection (relative to the insertion axis A of an ideal straight instrument shaft 380) of a curved instrument shaft 380 with curvature K. In one or more embodiments, the precession parameter P may or may not include account for the radius of the instrument 360. In one or more embodiments, theprecession parameter P may include additional information such as an initial angle (e.g., phase / orientation of the precession offset at a given roll orientation).

[0109] In one or more embodiments, an angular offset of one or more joints in the wrist assembly 390 and / or end effector 392 will deflect the tip of the instrument 360 from the insertion axis A (see FIG. 5B). For example, the programmed “zero” position of one or more joints may drift out of alignment with the insertion axis A over the life of an instrument 360 (e.g., after repeated installation, removal, transport, reprocessing).

[0110] While a limited number of geometric factors are described herein, it will be appreciated that other geometric factors (e.g., 2ndorder curvature of instrument shaft 380) may exist and be accounted for by one or more embodiments of the invention. Furthermore, embodiments of the invention may compensate for any number or combination of geometric factors in the analysis of the output from the force sensor system 369.

[0111] As shown in FIG. 5A, when the geometry of the instrument is not constrained (e.g., because the cannula 130 is not yet installed (while the instrument 360 may be installed)), there is no interaction between the instrument 360 or the end effector 392 with the cannula 130, and each of the above geometric factors, or any combination thereof, cause the distal portion of the instrument 360 to deviate from the ideal straightened configuration along the longitudinal axis C of the cannula 130. In order to insert the instrument 360 into the cannula 130, a force must be applied to align the instrument shaft 380 with the longitudinal axis C of the cannula 130. Similarly, once installed in the cannula 130 and secured to the repositionable assembly 110 (e.g., connection of the transmission assembly 370 to the instrument holder 314), the instrument 360 is constrained to the inner radius of the cannula 130 by a contact force Fi from the inner surface of the cannula 130.

[0112] As the instrument 360 is manipulated within the cannula 130, the influence of the various geometric factors on the contact force Fl may vary. For example, when the control system 170 commands the instrument 360 to perform a roll motion ARz about the insertion axis A, the total displacement of the distal portion of the instrument 360 from the longitudinal axis C of the cannula 130 (or to the inner surface of the cannula 130) will change as a function of the roll position cp as the phase of the precession parameter P adds or detracts from the alignment parament T. As discussed in further detail below with respect to FIG. 6, the interaction of the various geometric factors may be captured in a model that translates the kinematic configuration of the instrument 360 into model contact forces based on one ormore of the cannula 130, the instrument 360, and an interaction between the cannula 130 and the instrument 360.

[0113] FIG. 5B is a side view of a distal portion of an instrument 360 within a cannula 130, in accordance with one or more embodiments.

[0114] In view of the above geometric factors that deviate from the ideal straightened configuration, a more realistic side view of the distal portion of the instrument 360 during the roll motion ARz is shown in FIG. 5B. In this example (exaggerated for the sake visibility in the drawings), there is an alignment offset between the insertion axis A of the instrument 360 and the longitudinal axis C of the cannula 130 and the zero position of the wrist joint at first pin 425 has an offset from the insertion axis A. At roll position (pi of the roll motion ARz, the end effector 392 is deflected away from the inner surface of the cannula 130 and toward longitudinal axis C. As a result, the proximal clevis 420 of the wrist assembly 390 lightly contacts the inner surface of the cannula 130, resulting in a relatively minor contact force Fci. However, when the roll motion ARz advances to roll position (p2, the end effector 392 will be deflected away from the longitudinal axis C and will force the distal portion of the instrument (i.e., the end effector 392 in this example geometry) against the inner surface of the cannula 130 with a stronger contact force Fc2 that is greater than Fci. As shown in FIG. 5C, the x-axis and y-axis outputs of the force sensor system 369 vary as a function of the roll position (p of the roll motion ARz (i.e., the commanded movement).

[0115] The x-axis and y-axis outputs of the force sensor system 369 (e.g., Fmeas_x(cp), Fmeas y((p)) during the roll motion ARz include contributions from the contact force Fc (i.e., Fcx(cp), Fcy(cp)) and the true zero offset values (i.e., bias values Xo, Yo) of the corresponding force sensors of the force sensor system 369. As discussed in further detail below with respect to FIG. 6, the control system 170 may use a model to fit a portion of the output from the force sensor system 369 (e.g., a window corresponding to a portion of roll motion, the output during the entire roll motion, filtered or unfiltered output) to deconvolute the contributions from the contact force Fc and determine a bias result (e.g., one or more bias values) for the corresponding force sensor of the force sensor system 369.

[0116] FIG. 6 shows a model workflow, in accordance with one or more embodiments.

[0117] The control system 170 may be configured with a model 600 that outputs model contact forces FM as a function of position during the commanded movement. As shown in the non-limiting example shown in FIG. 6, the roll position (p (i.e., the rollmovement position) is transformed into a model contact force (e.g., FMX(<P), FMY(CP) are estimates of the forces for the x-axis and y-axis sensors of the force sensor system 369) by the model 600.

[0118] The control system 170 may be configured to fit the model contact force to the output (or portion thereof) of the force sensor system (e.g., Fmeas_x((p), Fmeas y((p)). In one or more embodiments, one or more non-linear optimization techniques (e.g., steepest descent, Newton’s method, Levenberg-Marquardt algorithm etc.) are used to fit the model contact force to the corresponding output of the force sensor system 369. In some embodiments, the model 600 may be parameterized with one or more parameters, including a bias variable (e.g., XM, YM) corresponding to a zero offset of the model contact force. Initial conditions of the parameters used in the fitting algorithm may be based on the cannula 130 and / or the instrument 360. One or more of the initial conditions may be predetermined based on knowledge of the system (e.g., geometry, instrument characteristics, etc.). In certain embodiments, initial conditions or other parameters used for modeling contact forces and / or determining the bias value(s) may depend on the particular instrument 360 or instrument type of the instrument 360. For instance, different instrument shaft stiffness parameters may be used to model different instrument types having different shaft materials or shaft thicknesses.

[0119] In some embodiments, one or more of the initial conditions may be actively determined by the control system 170 (e.g., reading and interpreting a configuration of the kinematic chain of the repositionable assembly 110, actively manipulating the instrument 360 and monitoring the force sensor system 369). For example, in one or more embodiments, an initial condition for a bias variable may be based on a portion of the output with variability less than a predetermined threshold during the commanded movement (e.g., a portion without any contact between the instrument 360 and the cannula).

[0120] In one or more embodiments, an initial condition for an alignment parameter T or an alignment offset, as described above with respect to FIG. 5 A, may be determined based on harmonic analysis of the output of the force sensor system 369 during a commanded movement.

[0121] While a limited number of exampled are described herein, it will be appreciated that other fitting techniques and methods of optimizing the fitting process may be used without departing from the gist of the invention.

[0122] Upon finding the optimal fit of the model contact force to the output of the forces sensor system 369, the parameters of the model may be correlated to the physical system. For example, a bias value of the force sensor that generated the output may bedetermined (i.e., fit results for XM, YM estimate true bias values Xo, Yo). The optimal fit may be selected based on one or more predetermined conditions (e.g., error / residual threshold, iteration threshold, convergence criterion).

[0123] In the non-limiting example shown in FIG. 6, the model 600 may be based on the cannula 130, the instrument 360, and an interaction between the cannula 130 and the instrument 360. As shown in the non-limiting example shown in FIG. 6, the model 600 may rely on known information (constants) based on the geometry of the instrument 360 (e.g., the instrument shaft 380, the end effector 392) and cannula 130. The model 600 includes one or more parameters that are varied to estimate model contact forces. In one or more embodiments, parameters of the model 600 are based on one or more of the cannula 130, the instrument 360, and an interaction between the cannula 130 and the instrument 360 (e.g., the geometric factors described above with respect to FIG. 5A).

[0124] For example, the model 600 may be based on Hooke’s Law and a spring constant k. In other words, a force is proportional to a displacement Ar of the distal portion of the instrument 360 from the inner surface of the cannula 130 if the instrument 360 were unconstrained by the geometry of the cannula 130, as shown in FIG. 5 A. The model 600 calculates the displacement Ar based on parameters corresponding to the configuration and properties of the instrument 360 and cannula 130 in the repositionable assembly 110. For example, the model 600 may calculate the displacement Ar as the sum of the x- / y-axis projections of each of the alignment parameter T and the precession parameter P (with or without accounting for inner radius of the cannula 130 and radius of the instrument 360) as a function of roll position cp during the roll motion ARz. The model includes a spring coefficient k (i.e., spring parameter) based on a stiffness K of the instrument shaft 380, to relate the displacement Ar to a force between the inner surface of the cannula 130 and the distal portion of the instrument 360.

[0125] Based on this model 600, the parameters of the model 600 may include: the alignment parameter T (i.e., perpendicular projection (relative to the longitudinal axis C of the cannula 130) of an ideal straight instrument shaft 380 with an alignment error 9 relative to the longitudinal axis C of the cannula 130 (with or without accounting for inner radius of the cannula 130 and radius of the instrument 360)); the precession parameter P (i.e., perpendicular projection (relative to the insertion axis A of an ideal straight instrument shaft 380) of a curved instrument shaft 380 with curvature K (with or without accounting for the radius of the instrument 360)); the initial angles of associated with the alignment parameter Tand the precession parameter P, respectively; a spring coefficient k (i.e., a variable spring parameter of Hooke’s Law); and one or more bias variables (i.e., a variable for the unbiased output of a force sensor or a moment sensor).

[0126] In one or more embodiments, the model 600 may include additional forces that may be modeled based on the instrument 360 (e.g., slop in joint movements) and / or cannula 130.

[0127] FIG. 7 is a flowchart of a method, in accordance with one or more embodiments.

[0128] As described above, the output from the force sensor system may be used by the control system 170 to determine a bias result of the force sensor system 369.Furthermore, embodiments of the invention provide a method to determine the bias result regardless of whether non-zero external forces act upon the instrument 360 within the cannula 130.

[0129] In view of the above, the following describes a method of calibrating the force sensor system 369 coupled to an instrument 360, in accordance with one or more embodiments of the invention. In particular, one or more embodiments of the invention provide improvements to calibration of a force sensor during the process of installing the instrument 360 in a cannula 130.

[0130] At 705, the control system 170 controls commands a movement (i.e., a commanded movement) of the instrument 360 within the cannula 130 (e.g., a movement of a distal portion of the instrument 360, a movement of the shaft of the instrument 360, a movement of two or more portions of the instrument 360, etc.). In one or more embodiments, the commanded movement of the instrument may include a roll motion of the distal portion of the instrument 360 about an insertion axis of the instrument 360, as shown in FIGs. 4A and 5 A. The roll motion may extend from a first range of motion limit to a second range of motion limit of the instrument 360. In some embodiments, the commanded movement includes straightening a wrist assembly 390 of the instrument 360 (e.g., pivot about pin 425 and / or pin 435) prior to the roll motion.

[0131] It will be appreciated that other motions or movements may be included in the commanded movement without departing from the invention. For example, the commanded movement may include a separate or compensating motion for a separate portion of the repositionable assembly 110.

[0132] At 710, the control system 170 receives an output generated by the force sensor system 369 during the commanded movement. The output from the force sensorsystem 369 may be an electrical signal (e.g., voltage, current resistance, pulse width modulated any appropriate signal) or a processed value(s) (e.g., a digitized or quantitative force measurement s)). In some embodiments, the output includes multiple components (e.g., multiple signals from a single multi-axis force sensor, multiple signals from multiple multi-axis force sensors, multiple signals from a number of single-axis sensors in different orientations, multiple signals from redundant single-axis sensors in a same orientations, any appropriate combination of signals based on the configuration of the force sensor system 369). In yet additional embodiments, the output may be a series of values or measurements (e.g., over time) during the commanded movement of the instrument 360. The control system 170 may be configured to determine, using the output, measured force as a function of the roll position such as the diagram illustrated in FIGs. 4B and 5C.

[0133] At 715, the control system 170 determines a bias result of the force sensor system 369 based on a portion of the output that corresponds to a force detected during the commanded movement. In some embodiments, the detected force in the portion of the output may or may not corresponds to the contact between the distal portion of the instrument 360 and a surface (e.g., the inner surface) of the cannula 130.

[0134] The control system 170 may process the output prior to determining the bias result. Processing may include any appropriate condition steps (e.g., signal filtering, transformation, data processing, calculations) that produces a quantitative measurement of force based on the output from the force sensor system 369. For example, filtering of the output may include selecting a portion of the output that satisfies one or more conditions.

[0135] The bias result may be one or more zero offset values (e.g., a plurality of bias values corresponding to one or more force sensors in the force sensor system 369) for the force sensor(s) of the sensor system. For example, the bias result may include two bias values corresponding to forces acting in two orthogonal directions (e.g., x-axis, y-axis) that are perpendicular to an insertion axis A of the instrument 360 (i.e., z-axis). In some embodiments, a bias value of the bias result may be an average of multiple offset values corresponding to different sensors (e.g., redundant sensors for a given axis).

[0136] As discussed above with respect to FIG. 6, the bias result may be determined using a model representing the cannula 130, the instrument 360, and an interaction between the cannula 130 and the instrument 360. The model may output a model contact force (e.g., FMX(<P), FMY((P)) between the distal portion of the instrument 360 and an inner surface of the cannula 130 during the commanded movement at 705. Parameters of the model may include: alignment parameter T based on a distance between a longitudinal axis C of the cannula 130and the insertion axis A of the instrument 360 (with or without accounting for radii of the cannula 130 and / or instrument 360); a precession parameter P based on a deflection of the distal end of the instrument 360 from the insertion axis A of the instrument 360 (e.g., caused by curvature of the instrument shaft 380); a spring parameter (e.g., variable spring constant k) based on a stiffness of the instrument 360; and one or more bias variables (e.g., XM, YM).

[0137] The control system 170 may use the model to fit the portion of the output as a function of the commanded movement (e.g., roll position cp or roll motion ARz). For example, the control system 170 may fit the model contact force to the portion of the output using a non-linear optimization technique that varies the parameters of the model, including the one or more bias variables (i.e., XM, YM). The bias result may be compiled based on the fit results (fit parameters of XM, YM estimate the true bias values Xo, Yo).

[0138] At 720, the control system 170 determines whether or not the bias result is valid.

[0139] In some embodiments, the validity of the bias result is determined based on satisfying one or more conditions. For example, the bias result (or individual components thereof (i.e., individual bias values)) may be compared with an acceptable range of values, one or more thresholds, difference in values for redundant sensors. In some embodiments, the determination may be based on a fit error of the output of the model exceeding an error threshold. In some embodiments, the determination may be based on the alignment parameter output by the model (e.g., the final fit parameter) exceeding an instrument deflection threshold (i.e., the known geometry and physical properties of the instrument 360 could not realistically match the final model fit). In some embodiments, the determination may be based on the precession parameter output by the model (e.g., the final fit parameter) exceeding an instrument deflection threshold (i.e., the known geometry and physical properties of the instrument shaft 380 could not realistically match the final model fit).

[0140] While a limited number of validation methods are described herein, it will be appreciated that other methods may be used without departing from the gist of the invention.

[0141] When the determination at 720 is NO (i.e., the bias result is invalid), the method 700 proceeds to 725. When the determination at 720 is YES (i.e., the bias result is valid), the method 700 proceeds to 730.

[0142] At 725, the control system 170 controls the computer-assisted system 100 to perform a backup calibration process.

[0143] In one or more embodiments, the control system 170 may restart method 700 (e.g., reposition instrument 360 and reattempt).

[0144] In some embodiments, the backup calibration process includes outputting a notification to remove and reinstall the instrument 360.

[0145] In some embodiments, the backup calibration process includes outputting a notification to replace the instrument 360 with a different instrument 360’ (e.g., indicate if bias result indicates faulty or unreliable operation of the instrument 360).

[0146] In some embodiments, the backup calibration process includes selecting a stored bias value from a memory of the computer-assisted system 100.

[0147] In one or more embodiments, the control system 170 may execute a different calibration method. For example, the backup calibration process may include an out-of-cannula commanded movement when the distal portion of the instrument 360 extends beyond a distal end 132 of the cannula 130.

[0148] In some embodiments, the control system 170 is configured to modify a function of the instrument 360 in response to the bias result being invalid. As discussed in further detail below with respect to FIG. 9, the control system 170 may reject the instrument 360 if no valid bias result can be determined.

[0149] In some embodiments, the control system 170 is configured to modify control of one or more joints of the repositionable assembly 110 in response to the bias result being invalid. For example, the control system may lock, limit, or otherwise change permissions for a portion of the repositionable assembly 110 (e.g., lock a prismatic joint to prevent further insertion of the instrument 360) when the bias result is not valid. In another example, the control system 170 may prevent activation of or modify operation of (e.g., load previous valid calibration settings, load default settings) a leader-follower control mode of teleoperation.

[0150] At 730, the control system 170 controls the computer-assisted system based on the bias result. For example, outputs of one or more individual sensors of the force sensor system 369 may be adjusted based on a corresponding bias value of the bias result. In some embodiments, the bias result is used in controlling haptic feedback provided by the user input system 140 (e.g., force feedback on input device 142).

[0151] In some embodiments, in response to determining the bias result is valid, the control system 170 may execute a user-facing action that improves operator workflows. For example, the control system 170 may generate a calibration notification. The calibration notification may be visual, audible, and / or tactile feedback provided by any portion of thecomputer-assisted system 100. For example, a calibration notification may be a user interface element or prompt on a display.

[0152] In one or more embodiments, in response to determining the bias result is valid, the control system 170 may be configured to enable a force feedback module of the user input system 140 and control the force feedback module. For example, the control system 170 may modify, based at least in part on the bias result, haptic feedback provided to an input device 142.

[0153] At 735, the control system 170 controls the computer-assisted system to operate the instrument 360 based on the bias result. For example, the control system 170 may adjust one or more control algorithms associated with the instrument 360. For example, kinematic parameters (e.g., range of motion limit, movement speed limits, sensitivity parameters (e.g., input scaling factor, dead zone), safety parameters (e.g., force threshold for triggering warnings) for controls associated with the instrument 360 may be adjusted or set based on the bias result.

[0154] One or more of the individual processes shown in the flowchart of FIG. 7 may be omitted, repeated (e.g., performed in parallel for multiple sensors in the force sensor system 369), combined, and / or performed in a different order than the order shown in this disclosure. Each process may be implemented by hardware (e.g., circuitry, physical components), software (e.g., machine code, programming on non-transitory computer readable media), or any combination thereof. Additional processes may be performed.Accordingly, the scope of the invention should not be limited by the specific arrangement as depicted in FIG. 7.

[0155] FIG. 8 is a flowchart of a method 800, in accordance with one or more embodiments.

[0156] The following describes another method of calibrating the force sensor system 369 coupled to an instrument 360, in accordance with one or more embodiments of the invention.

[0157] At 805, the control system 170 controls commands a movement (i.e., a commanded movement) of the instrument 360 within the cannula 130 (e.g., a movement of a distal portion of the instrument 360, a movement of the shaft of the instrument 360, a movement of two or more portions of the instrument 360, etc.). In one or more embodiments, the commanded movement of the instrument may include a roll motion about an insertion axis of the instrument, as shown in FIGs. 4A and 5A. It will be appreciated that other motions or movements may be included in the commanded movement without departingfrom the invention. For example, the commanded movement may include a separate or compensating motion for a separate portion of the repositionable assembly 110.

[0158] At 810, the control system 170 receives an output generated by the force sensor system 369 during the commanded movement. The output from the force sensor system 369 may be an electrical signal (e.g., voltage, current resistance, pulse width modulated any appropriate signal) or a processed value(s) (e.g., a digitized or quantitative force measurement s)). In some embodiments, the output includes multiple components (e.g., multiple signals from a single multi-axis force sensor, multiple signals from multiple multi-axis force sensors, multiple signals from a number of single-axis sensors in different orientations, multiple signals from redundant single-axis sensors in a same orientations, any appropriate combination of signals based on the configuration of the force sensor system 369). In yet additional embodiments, the output may be a series of values or measurements (e.g., over time) during the commanded movement of the instrument 360. The control system 170 may be configured to determine, using the output, measured force as a function of the roll position such as the diagram illustrated in FIGs. 4B and 5C.

[0159] At 815, the control system 170 identifies a first portion of the output that has variability less than a predetermined threshold. The first portion may correspond to a portion of the commanded movement in which the distal portion of the instrument 360 does not contact the cannula. Without a contact force acting on the instrument 360, the output of the force sensor system 369 will be constant, as shown on the left side of FIG. 4B.

[0160] In one or more embodiments, the variability is measured as a difference between the maximum and minimum values of the output in the first portion and the predetermined threshold is a difference threshold (e.g., uncertainty estimate of the corresponding force sensor). In some embodiments, the variability is a variance of the output in the first portion and the predetermined threshold is a variance threshold. While a limited number of examples are described herein, it will be appreciated that any criteria for delimiting the first portion of the output may be used without departing from the gist of the invention.

[0161] At 820, the control system 170 determines a first bias result of the force sensor system 369 based on the first portion of the output. The control system 170 may process the first portion prior to determining the first bias result. Processing may include any appropriate condition steps (e.g., signal filtering, transformation, data processing, calculations) that produces a quantitative measurement of force based on the first portion of the output from the force sensor system 369.

[0162] The first bias result may be one or more zero offset values (e.g., a plurality of bias values corresponding to one or more force sensors in the force sensor system 369) for the force sensor(s) of the sensor system. For example, the first bias result may include two bias values corresponding to forces acting in two orthogonal directions (e.g., x-axis, y-axis) that are perpendicular to an insertion axis A of the instrument 360 (i.e., z-axis). In some embodiments, a bias value of the first bias result may be an average of multiple offset values corresponding to different sensors (e.g., redundant sensors for a given axis).

[0163] In one or more embodiments, a component (e.g., a bias value) of the first bias result may be an average of the first portion of the output.

[0164] At 825, the control system 170 determines whether or not the first bias result is valid.

[0165] In some embodiments, the validity of the first bias result is determined based on satisfying one or more conditions. For example, the first bias result (or individual components thereof (i.e., individual bias values)) may be compared with an acceptable range of values, one or more thresholds, difference in values for redundant sensors. It will be appreciated that other methods of validating the first bias result may be used without departing from the gist of the invention.

[0166] When the determination at 825 is NO (i.e., the first bias result is invalid), the method 800 proceeds to 830. When the determination at 825 is YES (i.e., the first bias result is valid), the method 800 proceeds to 845.

[0167] At 830, the control system 170 identifies a second portion of the output.

[0168] In one or more embodiments, the second portion of the output has variability greater than or equal to the predetermined threshold. The second portion may correspond to a portion of the commanded movement in which the distal portion of the instrument 360 contacts the cannula 130, as shown in FIG. 5B. In some embodiments, the second portion of the output is mutually exclusive of the first portion of the output.

[0169] In one or more embodiments, the first portion and the second portion of the output may partially or fully overlap. For example, the second portion of the output may contain the entire first portion of the output because the model 600 can account for intermittent contact during the commanded movement. In other words, the model 600 can accurately determine the bias result if there is no contact, partial contact, or full contact between the instrument 360 and the cannula 130 during the commanded movement. In some embodiments, the second portion of the output includes the entire output during the commanded movement.

[0170] At 835, the control system 170 determines a second bias result of the force sensor system 369 based on the second portion of the output. The control system 170 may process the second portion prior to determining the first bias result. Processing may include any appropriate condition steps (e.g., signal filtering, transformation, data processing, calculations) that produces a quantitative measurement of force based on the second portion of the output from the force sensor system 369.

[0171] The second bias result may be one or more zero offset values (e.g., a plurality of bias values corresponding to one or more force sensors in the force sensor system 369) for the force sensor(s) of the sensor system. For example, the second bias result may include two bias values corresponding to forces acting in two orthogonal directions (e.g., x-axis, y-axis) that are perpendicular to an insertion axis A of the instrument 360 (i.e., z-axis). In some embodiments, a bias value of the second bias result may be an average of multiple values corresponding to different sensors (e.g., redundant sensors for a given axis).

[0172] As discussed above with respect to FIG. 6, the second bias result may be determined using a model representing the cannula 130, the instrument 360, and an interaction between the cannula 130 and the instrument 360.

[0173] In one or more embodiments, the control system 170 additionally determines whether or not the second bias result is valid. In some embodiments, the validity of the second bias result is determined based on satisfying one or more conditions. For example, the second bias result (or individual components thereof (i.e., individual bias values)) may be compared with an acceptable range of values, one or more thresholds, difference in values for redundant sensors. In some embodiments, the determination may be based on a fit error of the output of the model exceeding an error threshold. In some embodiments, the determination may be based on the alignment parameter output by the model (e.g., the final fit parameter) exceeding an instrument deflection threshold (i.e., the known geometry and physical properties of the instrument 360 could not realistically match the final model fit). In some embodiments, the determination may be based on the precession parameter output by the model (e.g., the final fit parameter) exceeding an instrument deflection threshold (i.e., the known geometry and physical properties of the instrument shaft 380 could not realistically match the final model fit).

[0174] At 840, the control system 170 controls the computer-assisted system based on the second bias result. For example, outputs of one or more individual sensors of the force sensor system 369 may be adjusted based on a corresponded bias value of the second biasresult. In some embodiments, the second bias result is used in controlling haptic feedback provided by the user input system 140 (e.g., force feedback on input device 142).

[0175] In some embodiments, the control system 170 may execute a user-facing action that improves operator workflows. For example, the control system 170 may generate a calibration notification. The calibration notification may be visual, audible, and / or tactile feedback provided by any portion of the computer-assisted system 100. For example, a calibration notification may be a user interface element or prompt on a display.

[0176] In one or more embodiments, the control system 170 may be configured to enable a force feedback module of the user input system 140 and control the force feedback module. For example, the control system 170 may modify, based at least in part on the second bias result, haptic feedback provided to an input device 142.

[0177] At 845, the control system 170 controls the computer-assisted system based on the first bias result. For example, outputs of one or more individual sensors of the force sensor system 369 may be adjusted based on a corresponded bias value of the first bias result. In some embodiments, the first bias result is used in controlling haptic feedback provided by the user input system 140 (e.g., force feedback on input device 142).

[0178] In some embodiments, in response to determining the first bias result is valid, the control system 170 may execute a user-facing action that improves operator workflows. For example, the control system 170 may generate a calibration notification. The calibration notification may be visual, audible, and / or tactile feedback provided by any portion of the computer-assisted system 100. For example, a calibration notification may be a user interface element or prompt on a display.

[0179] In one or more embodiments, in response to determining the first bias result is valid, the control system 170 may be configured to enable a force feedback module of the user input system 140 and control the force feedback module. For example, the control system 170 may modify, based at least in part on the first bias result, haptic feedback provided to an input device 142.

[0180] One or more of the individual processes shown in the flowchart of FIG. 8 may be omitted, repeated (e.g., performed in parallel for multiple sensors in the force sensor system 369), combined, and / or performed in a different order than the order shown in this disclosure. Each process may be implemented by hardware (e.g., circuitry, physical components), software (e.g., machine code, programming on non-transitory computer readable media), or any combination thereof. Additional processes may be performed.Accordingly, the scope of the invention should not be limited by the specific arrangement as depicted in FIG. 8.

[0181] FIG. 9 is a flowchart of a method 900, in accordance with one or more embodiments.

[0182] The following describes a method of controlling a computer-assisted system 100 based on one or more bias results. In one or more embodiments, the method 900 may be performed after method 700 or method 800.

[0183] At 905, the control system 170 controls the computer-assisted system 100 to perform a backup calibration process to determine a backup bias result.

[0184] In one or more embodiments, the backup calibration process may include an out-of-cannula commanded movement when the distal portion of the instrument 360 extends beyond a distal end 132 of the cannula 130.

[0185] At 910, the control system 170 determines whether or not all of the determined bias results (e.g., the first bias result and / or the second bias result, and the backup bias result) are invalid. Nonlimiting examples of the validation methods are described above with respect to methods 700, 800. It will be appreciated that other methods of validation and validation criteria may be used, and the invention is not limited to examples above.

[0186] When the determination at 910 is NO (i.e., at least one bias result is valid), the method 900 proceeds to 915. When the determination at 910 is YES (i.e., all bias results are invalid), the method 900 proceeds to 920.

[0187] At 915, the control system 170 controls the computer-assisted system 100 based a valid bias result.

[0188] In one or more embodiments, the control system 170 may be configured to use at least one of the first bias result, the second bias result, and the backup bias result. The control system 170 may prioritize which of the valid bias results to use. For example, the control system 170 may prioritize use of the first bias result described above with respect to method 700 (i.e., bias determined based on a constant portion of the output from the forces sensor system 369), followed by use of the second bias result described above with respect to method 700 (i.e., bias determined based on output from the forces sensor system 369 with a contact force), followed by the backup bias result determined at 905 (i.e., bias determined based on an out-of-cannula calibration technique). Any prioritized ordered of the bias results may be used (e.g., first bias result, backup bias result, second bias result; second bias result, first bias result, backup bias result; second bias result, backup bias result, first bias result;backup bias result, first bias result, second bias result; backup bias result, second bias result, first bias result).

[0189] In one or more embodiments, the control system 170 may be configured to use multiple of the valid bias results. For example, the control system 170 may average or otherwise combine different bias results (or individual components of different bias results).

[0190] At 920, the control system 170 controls the computer-assisted system 100 to reject the instrument 360.

[0191] Rejecting the instrument 360 may include locking or modifying one or more functions of the instrument 360 (e.g., movement of the instrument 260, actuation / activation of the end effector 392), prompting the operator to remove the instrument 360 (e.g., instruction to reinstall and reattempt calibration, instructions to replace the instrument 360 with a new instrument 360’, instructions to inspect a portion of the instrument 360 based on the cause of the invalid bias result), changing a user interface element related to the instrument 360 (e.g., disabling a control option on the user input system 140, providing notification on a display of the computer-assisted system 100), performing an action to render the instrument 360 safe, or any combination thereof.

[0192] In some embodiments, the control system 170 is configured to modify control of one or more joints of the repositionable assembly 110 in response to all of the bias results being invalid. For example, the control system 170 may lock, limit, or otherwise change permissions for a portion of the repositionable assembly 110 (e.g., lock a prismatic joint to prevent further insertion of the instrument 360) when the bias result is not valid. In another example, the control system 170 may prevent activation of or modify operation of (e.g., load previous valid calibration settings, load default settings) a leader-follower control mode of teleoperation.

[0193] One or more of the individual processes shown in the flowchart of FIG. 9 may be omitted, repeated (e.g., performed in parallel for multiple sensors in the force sensor system 369), combined, and / or performed in a different order than the order shown in this disclosure. Each process may be implemented by hardware (e.g., circuitry, physical components), software (e.g., machine code, programming on non-transitory computer readable media), or any combination thereof. Additional processes may be performed.Accordingly, the scope of the invention should not be limited by the specific arrangement as depicted in FIG. 9.

[0194] FIG. 10 is a diagram based on outputs from a force and moment sensor system, in accordance with one or more embodiments.

[0195] In one or more embodiments, the forces sensor system 369 may include sensors to detect both forces and torques acting of the instrument 360. Accordingly, in some embodiments, the bias result determined by the control system 170 may include one or more bias values corresponding to torque acting on the instrument 360.

[0196] In FIG. 10, the solid line is an output from the force sensor system 369 that corresponds a force acting along the x-axis (Fmeas x) of the instrument 360 during the roll motion ARz. The dashed line is an output from the force sensor system 369 that corresponds a torque acting along the y-axis (Tmeas Y) of the instrument 360 during the roll motion ARz. After the control system 170 determines the bias value Xo, bias values of the orthogonal moment can be identified without additional modelling. The roll position(s) cp at the intercepts of Fmeas x and Xo correspond to kinematic configurations in which no force is acting along the x-axis of the instrument 360. when no force is acting on along the x-axis, the torque in the orthogonal direction (along the y-axis) must be zero. Accordingly, the outputs for Tmeas Y corresponding to the roll positions at the intercepts of Fmeas x and Xo are candidates (i.e., TYI, TY2) for the bias value (i.e., zero offset) for torque measured along the y-axis.

[0197] In some embodiments, the bias result determined by the control system 170 may include one or more candidate bias values torque (e.g., two bias values corresponding to torques in the two orthogonal directions), an average of multiple candidate bias values, any combination of bias values described above.

[0198] While present disclosure is described with respect to determining a bias result during a roll motion of the instrument, it will be appreciated that the same techniques may be applied to any type of commanded movement. For example, in one or more embodiments, the output of the force sensor system may be captured during any movement of the instrument within the cannula when the model is suitably adapted to the appropriate geometry and contact forces.

[0199] Particular embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. For example, the actions recited in the claims can be performed in a different order and still achieve desirable results. As one example, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous.

[0200] Although a limited number of example embodiments have been described in detail above, those skilled in the art will readily appreciate that many modifications are possible in the example embodiments without materially departing from this invention. Accordingly, all such modifications are intended to be included within the scope of this disclosure as defined in the following claims.

Claims

CLAIMSWhat is claimed is:

1. A computer-assisted system comprising:a repositionable assembly configured to support an instrument; anda control system communicatively coupled to the repositionable assembly and a force sensor system coupled to the instrument, the control system being configured to:receive an output generated by the force sensor system during a commanded movement of a distal portion of the instrument within a cannula; determine a bias result of the force sensor system based on a portion of the output that corresponds to a force detected during the commanded movement; andcontrol the computer-assisted system based on the bias result.

2. The computer-assisted system of claim 1, whereinthe force in the portion of the output corresponds to a contact between the distal portion of the instrument and a surface of the cannula.

3. The computer-assisted system of claim 1, whereinthe bias result includes two bias values corresponding to forces acting in two orthogonal directions that are perpendicular to an insertion axis of the instrument.

4. The computer-assisted system of claim 3, whereinthe bias result includes two bias values corresponding to torques in the two orthogonal directions.

5. The computer-assisted system of claim 1, whereinthe bias result is determined using a model representing the cannula, the instrument, and an interaction between the cannula and the instrument.

6. The computer-assisted system of claim 5, whereinthe control system uses the model to fit the portion of the output, as a function of the commanded movement, based on parameters including:an alignment parameter based on a distance between a longitudinal axis of the cannula and an insertion axis of the instrument;a precession parameter based on a deflection of the distal portion of the instrument from the insertion axis of the instrument;a spring parameter based on a stiffness of the instrument;a bias variable corresponding to the output, andan output of the model is a model contact force between the distal portion of the instrument and an inner surface of the cannula during the commanded movement,the bias result is determined based on the model contact force output by the model.

7. The computer-assisted system of claim 6, whereinthe bias result is determined based on a non-linear optimization that fits the model contact force output to the portion of the output.

8. The computer-assisted system of claim 7, wherein,for the non-linear optimization, the control system determines an initial condition of the alignment parameter based on harmonic analysis of the output of the force sensor system.

9. The computer-assisted system of any of claims 1 to 8, whereinthe control system is configured to control the commanded movement of the distal portion of the instrument within the cannula.

10. The computer-assisted system of any of claims 1 to 8, whereinthe commanded movement includes a roll motion of the distal portion of the instrument about an insertion axis of the instrument.

11. The computer-assisted system of claim 10, whereinthe roll motion extends from a first range of motion limit to a second range of motion limit of the instrument.

12. The computer-assisted system of any of claim 10, whereinthe commanded movement includes straightening a wrist assembly of the instrument prior to the roll motion.

13. The computer-assisted system of any of claim 6, whereinthe control system is configured to determine that the bias result is invalid in response to at least one of:a fit error of the output of the model exceeds an error threshold;the alignment parameter output by the model exceeds an instrument deflection threshold; andthe precession parameter output by the model exceeds a shaft deflection threshold.

14. The computer-assisted system of claim 13, whereinin response to determining the bias result is invalid, the control system is configured to control the computer-assisted system to perform a backup calibration process, andin response to determining the bias result is valid, the control system is configured to control the computer-assisted system to operate the instrument based on the bias result.

15. The computer-assisted system of claim 14, whereinthe backup calibration process includes outputting a notification to remove and reinstall the instrument.

16. The computer-assisted system of claim 14, whereinthe backup calibration process includes outputting a notification to replace the instrument with a different instrument.

17. The computer-assisted system of claim 14, whereinthe backup calibration process includes selecting a stored bias value from a memory of the computer-assisted system.

18. The computer-assisted system of claim 14, whereinthe backup calibration process includes an out-of-cannula commanded movement when the distal portion of the instrument extends beyond a distal end of the cannula.

19. A method of operating a computer-assisted system including a repositionable assembly configured to support an instrument, and a control system communicatively coupled to therepositionable assembly and a force sensor system coupled to the instrument, the method comprising:receiving an output generated by the force sensor system during a commanded movement of a distal portion of the instrument within a cannula; determining a bias result of the force sensor system based on a portion of the output that corresponds to a force detected during the commanded movement; and controlling the computer-assisted system based on the bias result.

20. The method of claim 19, whereinthe force in the portion of the output corresponds to a contact between the distal portion of the instrument and a surface of the cannula.

21. The method of claim 19, whereinthe bias result includes two bias values corresponding to forces acting in two orthogonal directions that are perpendicular to an insertion axis of the instrument.

22. The method of claim 21, whereinthe bias result includes two bias values corresponding to torques in the two orthogonal directions.

23. The method of claim 19, whereinthe bias result is determined using a model representing the cannula, the instrument, and an interaction between the cannula and the instrument.

24. The method of claim 23, further comprising:using the model to fit the portion of the output, as a function of the commanded movement, based on parameters including:an alignment parameter based on a distance between a longitudinal axis of the cannula and an insertion axis of the instrument;a precession parameter based on a deflection of the distal portion of the instrument from the insertion axis of the instrument;a spring parameter based on a stiffness of the instrument;a bias variable corresponding to the output, andan output of the model is a model contact force between the distal portion of the instrument and an inner surface of the cannula during the commanded movement,the bias result is determined based on the model contact force output by the model.

25. The method of claim 24, whereinthe bias result is determined based on a non-linear optimization that fits the model contact force output to the portion of the output.

26. The method of claim 25, wherein,for the non-linear optimization, the control system determines an initial condition of the alignment parameter based on harmonic analysis of the output of the force sensor system.

27. The method of any of claims 19 to 26, further comprising:controlling the commanded movement of the distal portion of the instrument within the cannula.

28. The method of any of claims 19 to 26, whereinthe commanded movement includes a roll motion of the distal portion of the instrument about an insertion axis of the instrument.

29. The method of claim 28, whereinthe roll motion extends from a first range of motion limit to a second range of motion limit of the instrument.

30. The method of claim 28, whereinthe commanded movement includes straightening a wrist assembly of the instrument prior to the roll motion.

31. The method of claim 24, further comprising:determining that the bias result is invalid in response to at least one of:a fit error of the output of the model exceeds an error threshold;the alignment parameter output by the model exceeds an instrument deflection threshold; andthe precession parameter output by the model exceeds a shaft deflection threshold.

32. The method of claim 31, further comprising:in response to determining the bias result is invalid, controlling the computer-assisted system to perform a backup calibration process, andin response to determining the bias result is valid, controlling the computer-assisted system to operate the instrument based on the bias result.

33. The method of claim 32, whereinthe backup calibration process includes outputting a notification to remove and reinstall the instrument.

34. The method of claim 32, whereinthe backup calibration process includes outputting a notification to replace the instrument with a different instrument.

35. The method of claim 32, whereinthe backup calibration process includes selecting a stored bias value from a memory of the computer-assisted system.

36. The method of claim 32, whereinthe backup calibration process includes an out-of-cannula commanded movement when the distal portion of the instrument extends beyond a distal end of the cannula.

37. A non-transitory machine-readable medium comprising a plurality of machine-readable instructions executed by one or more processors associated with a computer-assisted system, the plurality of machine-readable instructions causing the one or more processors to perform the method of any of claims 19 to 36.

38. A computer-assisted system comprising:a repositionable assembly configured to support an instrument; anda control system communicatively coupled to the repositionable assembly and a force sensor system coupled to the instrument, the control system being configured to:receive an output generated by the force sensor system during a commanded roll movement of a distal portion of the instrument within a cannula;identify, within the output generated during the commanded roll movement, a first portion of the output that has variability less than a predetermined threshold;determine a first bias result of the force sensor system based on the first portion of the output;determine whether or not the first bias result is valid or invalid;in response to the first bias result being valid, control the computer-assisted system based on the first bias result; andin response to the first bias result being invalid:identify, within the output generated during the commanded roll movement, a second portion of the output;determine a second bias result of the force sensor system based on the second portion of the output; andcontrol the computer-assisted system based on the second bias result.

39. The computer-assisted system of claim 38, whereinthe control system is further configured to:perform a backup calibration process to determine a backup bias result; determine whether or not the first bias result, the second bias result, and the backup bias result are all invalid;in response to all bias results being invalid, control the computer-assisted system to reject the instrument; andin response to at least one of the first bias result, the second bias result, and the backup bias result being valid, control the computer-assisted system based on at least one of the first bias result, the second bias result, and the backup bias result.

40. The computer-assisted system of claim 39, whereinthe backup calibration process includes an out-of-cannula commanded movement when a portion of the distal portion of the instrument extends beyond a distal end of the cannula.

41. A method of operating a computer-assisted system including a repositionable assembly configured to support an instrument, and a control system communicatively coupled to therepositionable assembly and a force sensor system coupled to the instrument, the method comprising:receiving an output generated by the force sensor system during a commanded roll movement of a distal portion of the instrument within a cannula; identifying, within the output generated during the commanded roll movement, a first portion of the output that has variability less than a predetermined threshold; determining a first bias result of the force sensor system based on the first portion of the output;determining whether or not the first bias result is valid or invalid;in response to the first bias result being valid, controlling the computer-assisted system based on the first bias result; andin response to the first bias result being invalid:identifying, within the output generated during the commanded roll movement, a second portion of the output;determining a second bias result of the force sensor system based on the second portion of the output; andcontrolling the computer-assisted system based on the second bias result.

42. The method of claim 41, further comprising:performing a backup calibration process to determine a backup bias result; determining whether or not the first bias result, the second bias result, and the backup bias result are all invalid;in response to all bias results being invalid, controlling the computer-assisted system to reject the instrument; andin response to at least one of the first bias result, the second bias result, and the backup bias result being valid, controlling the computer-assisted system based on at least one of the first bias result, the second bias result, and the backup bias result.

43. The method of claim 42, whereinthe backup calibration process includes an out-of-cannula commanded movement when a portion of the distal portion of the instrument extends beyond a distal end of the cannula.

44. A non-transitory machine-readable medium comprising a plurality of machine-readable instructions executed by one or more processors associated with a computer-assistedsystem, the plurality of machine-readable instructions causing the one or more processors to perform the method of any of claims 41 to 43.