Setting and use of software remote center of motion for computer-aided systems
By using multi-joint repositionable structure and geometric relationship analysis of processing system in computer-aided systems, flexible manipulation of software remote movement center is realized, the problem of insufficient movement of hardware remote movement center is solved, and the system flexibility is improved and Accuracy.
Patent Information
- Application Number
- CN202380028249.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-28
- Filing Date
- 2023-03-27
- Publication Date
- 2024-11-01
AI Technical Summary
When setting and using software remote sports centers, existing computer-aided systems are difficult to effectively bypass the hardware remote sports center, resulting in insufficient motion flexibility, increasing operational complexity and energy consumption, and making it difficult to accurately in a small space. Control.
By introducing a multi-joint repositionable structure in a computer-aided system, where the first joint set is used to maintain the position of the hardware remote motion center and the second joint set is used to translate the position of the hardware remote motion center, in combination with the geometry of the processing system Relationship analysis determines the position of the software remote movement center and drives joint movement according to the expected motion indication to achieve flexible manipulation of the software remote movement center.
It improves the motion flexibility and accuracy of computer-aided systems, reduces energy consumption, enhances the flexibility and safety of operation in small spaces, and reduces operation complexity.
Smart Images

Figure CN118891019A_ABST
Abstract
Description
[0001] Related Applications
[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 324,587, filed on March 28, 2022, entitled “Setting and Using Software Remote Centers of Motion for Computer-Assisted Systems,” which is incorporated herein by reference. Technical Field
[0003] The present disclosure relates generally to computer-assisted systems, and more particularly, to the setup and use of a software remote motion center for computer-assisted systems. Background Art
[0004] Computer-assisted systems are often used to perform or assist procedures in a workplace. In an example computer-assisted system with teleoperation, an operator at a user input system manipulates a leader device (e.g., an input device configured to accept commands to a follower device) to cause movement of a follower device (e.g., a teleoperable manipulation assembly and including a repositionable structure of an instrument with or without support). In one example, movement of the leader device relative to an operator's reference frame is used to determine a corresponding movement command of the follower device relative to a field of view of an imaging device.
[0005] In some examples, a computer-assisted system includes a repositionable structure having a remote center of motion (RCM) that is implemented by the hardware design of the repositionable structure. That is, the "hardware" RCM experiences little or no motion during a task performed by the repositionable structure because the joints that are driven to enable the repositionable structure to perform the task are physically designed not to interfere with the hardware RCM.
[0006] In some cases, it may be desirable to drive a repositionable structure with a hardware RCM to move about an RCM that is not juxtaposed with the hardware RCM. For example, the ability to drive a repositionable structure to move about an RCM other than a fixed hardware RCM can help increase the range of movement, increase the flexibility and dexterity of the repositionable structure, save time, reduce the power or energy required to move the repositionable structure, etc.
[0007] Therefore, techniques for setting up and using a software remote motion center for a computer-assisted system are desired. Summary of the invention
[0008] In accordance with some embodiments, a computer-assisted system includes: an input control; a repositionable structure including a plurality of joints, wherein each joint of a first set of the plurality of joints is physically constrained to joint motion that maintains a position of a hardware remote center of motion (RCM) of the repositionable structure, and wherein each joint of a second set of the plurality of joints is physically configured to perform joint motion that is capable of translating a position of the hardware RCM; and a processing system communicatively coupled to the input control and the repositionable structure. The processing system is configured to: receive an indication of a suggested position of a software RCM of the repositionable structure, determine whether to accept the suggested position based on a geometric relationship between a position of the hardware RCM and the suggested position, in response to a determination to accept the suggested position, set a current position of the software RCM based on the suggested position, after setting the current position of the software RCM based on the suggested position, and in response to an indication to move the repositionable structure with a desired motion, determine a command motion of the plurality of joints to move the repositionable structure according to the desired motion while maintaining the current position of the software RCM, and drive the plurality of joints according to the command motion.
[0009] Consistent with some embodiments, a method performed by a processing system includes: receiving, by the processing system, an indication of a suggested position for a software remote center of motion (RCM) of a repositionable structure; determining, by the processing system, whether to accept the suggested position based on a geometric relationship between the suggested position and the position of a hardware RCM of the repositionable structure; in response to determining to accept the suggested position, setting, by the processing system, a current position of the software RCM based on the suggested position; after setting the current position of the software RCM based on the suggested position, and in response to an indication to move the repositionable structure with a desired motion, determining, by the processing system, a command motion of a plurality of joints to move the repositionable structure according to the desired motion while maintaining the current position of the software RCM; and driving, by the processing system, a plurality of joints according to the command motion, wherein each joint of a first set of joints of the plurality of joints is physically constrained to a joint motion that maintains the position of the hardware RCM of the repositionable structure, and wherein each joint of a second set of joints of the plurality of joints is physically configured to perform a joint motion capable of translating the position of the hardware RCM.
[0010] Consistent with some embodiments, one or more non-transitory machine-readable media include a plurality of machine-readable instructions that, when executed by one or more processors, are adapted to cause the one or more processors to perform any of the methods described herein. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Figure 1 is a diagram of a computer-assisted system according to one or more embodiments.
[0012] Figure 2 is a diagram of a computer-assisted system according to one or more embodiments.
[0013] Figures 3A-3C Various configurations of portions of a computer-assisted system (and / or instrument(s) supported by the computer-assisted system) in accordance with one or more embodiments are described.
[0014] Figure 4 Flowchart of method steps for controlling a repositionable structure relative to a software RCM according to one or more embodiments.
[0015] Figure 5 is a flow chart of method steps for setting a software RCM according to one or more embodiments.
[0016] Figure 6 is a flow chart of method steps for setting a software RCM according to one or more embodiments.
[0017] Figures 7A-7C Various geometric relationships between hardware RCMs and software RCMs of a repositionable structure in accordance with one or more embodiments are described.
[0018] In the drawings, elements with the same name have the same or similar functions. DETAILED DESCRIPTION
[0019] In this specification, the specific details of some embodiments consistent with the present disclosure are described. Many specific details are described to provide a comprehensive understanding of the embodiments. However, it is obvious to those skilled in the art that some embodiments may be practiced without some or all of these specific details. The specific embodiments disclosed herein are intended to be illustrative, rather than restrictive. Although not specifically described here, those skilled in the art may recognize other elements within the scope and spirit of the present disclosure. In addition, in order to avoid unnecessary repetition, unless specifically described otherwise or if one or more features will make the embodiments inoperative, one or more features shown and described in association with an embodiment may be incorporated into other embodiments.
[0020] In addition, the terms in this specification are not intended to limit the present invention. For example, spatially relative terms-such as "below", "below", "lower", "above", "upper", "near side", "distal side" etc. can be used to describe the relationship between an element or feature and another element or feature, as illustrated in the figure. In addition to the position and orientation shown in the figure, these spatially relative terms are also intended to cover the different positions (i.e. positioning) and orientations (i.e. rotation placement) of elements or their operations. For example, if the content of a figure is flipped, the elements described as "below" or "below" of other elements or features will be "above" or "above" of other elements or features. Therefore, the exemplary term "below" can cover the position and orientation of the upper and lower parts. The device can be oriented in other ways (rotated 90 degrees or other orientations), and the spatial relative descriptors used herein are interpreted accordingly. Similarly, the description of the movement along various axes and around it includes various special element positions and orientations. In addition, unless the context clearly indicates otherwise, the singular forms "a / an" and "the" are also intended to include plural forms. Furthermore, the terms "comprises," "comprising," "includes," etc. specify the presence of stated features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups. Components described as coupled may be coupled directly, electrically or mechanically, or indirectly via one or more intermediate components.
[0021] Whenever feasible, elements described in detail with reference to one embodiment, implementation or module may also be included in other embodiments, implementations or modules in which they are not specifically shown or described. For example, if an element is described in detail with reference to one embodiment, but not described with reference to a second embodiment, the element may still be claimed as being included in the second embodiment. Therefore, in order to avoid unnecessary repetition in the following description, unless otherwise specifically described, unless one or more elements will render an embodiment or implementation inoperative, or unless two or more elements provide conflicting functions, one or more elements shown and described in association with one embodiment, implementation or application may be incorporated into other embodiments, implementations or aspects.
[0022] In certain instances, well-known methods, procedures, components, and circuits have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
[0023] The present disclosure describes various devices, elements, computer-aided systems, and parts of elements according to their states in three-dimensional space. As used herein, the term "position" refers to the positioning of an element or a part of an element in three-dimensional space (e.g., three translational degrees of freedom along Cartesian x, y, and z coordinates). As used herein, the term "orientation" refers to the rotational placement of an element or a part of an element (three rotational degrees of freedom-e.g., roll, pitch, and yaw, axis angle, rotation matrix, quaternion representation, etc.). As used herein, the term "shape" refers to a set of positions or orientations measured along an element. As used herein, and for a device with a kinematic chain, such as a repositionable structure with a plurality of links connected by one or more joints, the term "proximal" refers to the direction toward the base of the kinematic chain, and "distal" refers to the direction away from the base along the kinematic chain.
[0024] As used herein, the term "pose" refers to the multi-degree-of-freedom (DOF) spatial position and orientation of a coordinate system of interest attached to a rigid body. Generally speaking, a pose includes pose variables for each DOF in the pose. For example, a complete 6-DOF pose will include 6 pose variables corresponding to 3 position DOFs (e.g., x, y, and z) and 3 orientation degrees of freedom (e.g., roll, pitch, and yaw). A 3-DOF position-only pose includes only pose variables for 3 position DOFs. Similarly, a 3-DOF orientation-only pose includes only pose variables for 3 rotational DOFs. In addition, the velocity of a pose captures the change of the pose over time (e.g., the first-order derivative of the pose). For a complete 6-DOF pose, the velocity will include 3 translational velocities and 3 rotational velocities. A pose with other numbers of DOFs will have a corresponding number of velocity translations and / or rotational velocities.
[0025] Aspects of the present disclosure are described with reference to computer-assisted systems, which may include remotely operated, externally manipulated, automated, semi-automated, etc. Additionally, in accordance with the use of a remotely operated surgical system such as the da Aspects of the present disclosure are described in terms of embodiments of surgical systems. However, those skilled in the art will appreciate that the inventive aspects disclosed herein may be embodied and implemented in a variety of ways (including teleoperation and non-teleoperation) and in medical and non-medical embodiments and implementations (e.g., medical and non-medical devices, apparatuses, or systems). The embodiments of the surgical system are merely exemplary and should not be considered to limit the scope of the invention disclosed herein. For example, the techniques described with reference to surgical instruments and surgical methods can be used in other situations. Therefore, the instruments, systems and methods described herein can be used for humans, animals, parts of human or animal anatomical structures, industrial systems, general robots or remote operating systems. As another example, the instruments, systems and methods described herein can be used for non-medical purposes, including industrial uses, general robot uses, sensing or manipulating non-tissue artifacts, cosmetic improvements, imaging of human or animal anatomical structures, collecting data from human or animal anatomical structures, setting up or disassembling systems, training medical or non-medical personnel, etc. Other example applications include procedures for tissues removed from human or animal anatomical structures (with or without returning to human or animal anatomical structures) and procedures for human or animal corpses. In addition, these technologies can also be used for medical treatment or diagnostic procedures that include or do not include surgical aspects.
[0026] Figure 1 FIG. 1 is a diagram of a computer-aided system 100 according to one or more embodiments. Figure 1 As shown in the example of FIG. 1 , the computer-assisted system 100 includes a manipulation assembly 110 having one or more repositionable structures 120. Figure 1 In some examples, the repositionable structure(s) are shown as manipulator arms including multiple links connected by one or more joints. Each of the one or more repositionable structures 120 may support one or more instruments 130. In some examples, the manipulation assembly 110 may include a computer-assisted surgical assembly. Examples of medical instruments include surgical instruments for interacting with tissue, imaging, sensing devices, etc. In some examples, the instrument 130 may include an end effector that is capable of, but is not limited to, actuating, grasping, retracting, cauterizing, ablating, suturing, cutting, stapling, fusing, sealing, etc. and / or combinations thereof.
[0027] In the teleoperation example, the manipulation assembly 110 may also be communicatively coupled to a user input system (not shown) via a wired or wireless connection. The user input system may include one or more input controls, also referred to herein as input devices, for operating the manipulation assembly 110, the one or more repositionable structures 120, and / or the instrument 130. In some examples, the one or more input controls may include a kinematic chain of links and one or more joints, one or more actuators for driving portions of the input control(s), a robotic manipulator, a lever, a pedal, a switch, a button, a knob, a trigger, and the like.
[0028] In an example of supporting external manipulation, the input control may be located at the repositionable structure. As a specific example, the input control may include a joint sensor that detects joint deflection, and the computer-assisted system is configured to process certain joint deflections into commands to move the joint.
[0029] Figure 1 The manipulation component 110 is connected to the control unit 140 via an interface. The interface may be wired and / or wireless, and may include one or more cables, optical fibers, connectors and / or buses, and may also include one or more networks with one or more network switches and / or routing devices. The operation of the control unit 140 is controlled by a processor 150. Although the control unit 140 is shown as having only one processor 150, it should be understood that the processor 150 represents one or more central processing units, multi-core processors, microprocessors, microcontrollers, digital signal processors, field programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), graphics processing units (GPUs), tensor processing units (TPUs), etc. in the control unit 140. The control unit 140 may be implemented as an independent subsystem and / or board added to a computing device, or as a virtual machine. In some embodiments, the control unit 140 may be included as part of the user input system and / or the manipulation component 110, and / or operate separately from the user input system and / or the manipulation component 110, and operate in conjunction with the user input system and / or the manipulation component 110.
[0030] As one example, the manipulation assembly 110, the user input system, and / or the control unit 140 may correspond to a patient side cart, a surgeon console, and a da Processing unit of surgical system and associated software. In some embodiments, manipulation of components having other configurations, such as fewer or more repositionable structures, different user input systems or input controls, different repositionable structure hardware, etc., may include computer-assisted system 100.
[0031] The memory 160 may be used to store software executed by the control unit 140 and / or one or more data structures used during operation of the control unit 140. The memory 160 may include one or more types of machine-readable media. Some common forms of machine-readable media may include floppy disks, flexible disks, hard disks, magnetic tapes, any other magnetic media, CD-ROMs, any other optical media, punch cards, paper tapes, any other physical media with a pattern of holes, RAM, PROMs, EPROMs, FLASH-EPROMs, any other memory chips or cassettes, and / or any other media suitable for reading by a processor or computer.
[0032] like Figure 1As shown in the example of FIG. 1 , the memory 160 includes a control module 170 that can be used to support automatic, semi-automatic, and / or remote operation control of the manipulation assembly 110. The control module 170 may include one or more application programming interfaces (APIs) for receiving position, motion, force, torque, and / or other sensor information from the manipulation assembly 110, the repositionable structure 120, and / or the instrument 130, for sharing position, motion, force, torque, and / or collision avoidance information with other control units related to other devices, and / or planning and / or assisting in planning the movement of the manipulation assembly 110 and / or the instrument 130 (such as the movement of the repositionable structure 120). In some examples, the control module 170 also supports automatic, semi-automatic, and / or remote operation control of the manipulation assembly 110 and / or the instrument 130 during the performance of various tasks. And although the control module 170 is depicted as a software application, the control module 170 may optionally be implemented using hardware, software, and / or a combination of hardware and software.
[0033] In the teleoperation example of the computer-assisted system 100, the input controls include a leader device (also referred to in the industry as a "master" device), and the manipulator assembly 110 or the repositionable structure 120 (supporting or not supporting the implement 130) includes a follower device (also referred to in the industry as a "slave" device). An operator may use one or more input controls to command movement of the manipulator assembly 110, such as by commanding movement of one or more repositionable structures 120 and / or implements 130 in a leader-follower configuration. A leader-follower configuration is one type of teleoperation configuration and is sometimes referred to in the industry as a master-slave configuration.
[0034] In some medical embodiments, the computer-assisted system 100 may be found in a clinic, a diagnostic facility, an operating room, an interventional suite, or other medical environment. Although the computer-assisted system 100 is shown to include a manipulator assembly 110 having two repositionable structures 120, each of which supports a corresponding instrument 130, a person of ordinary skill in the art will understand that the computer-assisted system 100 may include any number of manipulator assemblies, each of which may include one or more repositionable structures, and each of which may support one or more instruments, and all of which may be similar or different in design than specifically described in these figures. For example, in some examples, each of the manipulator assemblies may include fewer or more repositionable structures, and / or support fewer or more instruments than specifically depicted in these figures.
[0035] In some embodiments, each of the one or more repositionable structures 120 includes a plurality of joints, wherein the plurality of joints include a plurality of joint sets of drivable joints. The drivable joints can be driven by an actuator to move the joints, and thereby move the components physically connected to the joints. The joint set includes one or more joints of the plurality of joints. The (one or more) joints in the first joint set of the drivable joints are constrained by a mechanical configuration to produce a motion that causes a RCM-constrained link (e.g., a distal link) in a plurality of links of the repositionable assembly to pivot around a hardware RCM, or to translate an RCM-constrained link along a linear axis intersecting the hardware RCM. Therefore, when driven to move the repositionable structure, the (one or more) joints in the first joint set do not translate the hardware RCM, so that the first joint set of the drivable joints is physically designed not to move the hardware RCM.
[0036] The (one or more) joints in the second joint set of the drivable joints of the repositionable structure are configured by a mechanical device capable of translating the hardware RCM. In some operating situations, the first and second joint sets of the drivable joints are driven at different times so that when the first joint set of the drivable joints is driven, the second joint set of the drivable joints is not driven. For example, in an example in which the second joint set is used for setting and the first joint set is used for performing a task, the system may drive the second joint set before performing the task to move in space and then position the hardware RCM. In this example, during the procedure, the second joint set is then not driven to move the hardware RCM, and the first joint set is driven to enable the repositionable structure to perform the procedure. In this example, the computer-aided system uses the hardware RCM, and the position of the hardware RCM remains static during the procedure.
[0037] In some use cases, the hardware RCM may be placed at an entrance to a workspace, such as an opening into a chamber or device, a surgical incision, a natural orifice such as the mouth or throat, etc. The end effector of the instrument(s) or repositionable structure(s) positioned distally from the hardware RCM is translated and rotated by actuating the first joint set to produce pivotal motion about the hardware RCM.
[0038] In some cases, it is desirable to move the end effector(s) or repositionable structure(s) of an instrument in motion other than that readily accomplished with a static RCM. For example, some repositionable structures and / or instrument designs may limit the ability of the end effector to reach and interact with a particular area, such as an area that is too close or too far from the hardware RCM. In such an embodiment, this limitation may be overcome by repositioning the hardware RCM, such as by moving the hardware RCM to be further retracted from the entry (potentially to reach an area closer to the entry) or further inserted into the entry or workspace (potentially to reach an area further from the entry).
[0039] However, in some examples, positioning the hardware RCM away from the entrance of the workspace can cause undesirable movement of the repositionable structure (or an instrument supported by the repositionable structure) relative to the entrance. For example, in some cases, lateral movement of the repositionable structure (or instrument) relative to the entrance can cause undesirable collisions or applied forces with materials near the entrance. In medical examples, lateral movement of the instrument in a surgical incision can cause further tissue trauma. Additionally, in some examples, the ability to dynamically reposition the RCM can provide advantages such as greater end effector reach, greater overall range of motion, reduced movement relative to positions other than the position of the hardware RCM (such as to avoid collisions), etc.
[0040] Figure 2 FIG. 2 is a diagram of a computer-assisted system 200 according to one or more embodiments. Figure 2 In the example of FIG. 2 , the computer-assisted system 200 includes a repositionable structure shown as a manipulation assembly 210 and a user input system 250. In a teleoperation scenario, an operator 298 may use the user input system 250 to manipulate the manipulation assembly 210, such as in a leader-follower configuration. Figure 1 In an example leader-follower configuration, a component of the user input system 250 (e.g., an input control device) is the leader and a portion of the manipulation assembly 210 (e.g., a manipulation arm or other repositionable structure) is the follower.
[0041] In some examples, the repositionable structure includes a base manipulator and a plurality of instrument manipulators coupled to the base manipulator. In some examples, the repositionable structure includes a single instrument manipulator without serial coupling of the manipulators. In some examples, the repositionable structure includes a single instrument manipulator coupled to a single base manipulator. In some examples, the computer-assisted system may include a movable base mounted on a cart or mounted to an operating table, and one or more manipulators mounted to the movable base.
[0042] The manipulation assembly 210 can be used to introduce a set of instruments into a work site through a single port 230 inserted into a hole (e.g., using a cannula as shown). In a medical situation, the work site can be on or in the patient's body, and the hole can be a minimally invasive incision or a natural body orifice. The port 230 can be free floating, held in place by a clamp, or held by a linkage 222. The linkage 222 can be coupled to additional joints and links 214, 220 of the manipulation assembly 210, and these additional joints and links 214, 220 can be mounted on the base 212. The linkage 222 can also include a manipulator support link 224. A set of manipulators 226 can be coupled to the manipulator support link 224. The repositionable structure that can move to follow commands from the user input system 250 may include one or more of any of the following: a linkage 222, additional joints and links 214, 220, a base 212, a manipulator support link 224, and / or any additional links or joints coupled to the aforementioned joints or links. Each manipulator 226 may include a bracket (or other instrument coupling link) configured to be coupled to an instrument, and each manipulator 226 may include one or more joints and / or links that can be driven to move the bracket. For example, the manipulator 226 may include a prismatic joint that, when driven, linearly moves the bracket and any instrument(s) coupled to the bracket. The linear motion may be along (parallel to) an insertion axis extending through the port 230.
[0043] Additional joints and additional links 214 , 220 may be used to position the port 230 at a hole or another location. Figure 2 A prismatic joint for vertical adjustment (indicated by arrow "A") and a set of rotational joints for horizontal adjustment (indicated by arrows "B" and "C") are shown, which can be used to translate the position of the hardware RCM. The linkage mechanism 222 is used to rotate the port 230 (and the instrument then disposed therein) about the hardware RCM positioned adjacent the port 230 in yaw, pitch, and roll as indicated by arrows D, E, and F, respectively, without translating the hardware RCM.
[0044] The actuation of the degrees of freedom provided by the (one or more) joints of the (one or more) instruments may be provided by an actuator disposed in the instrument, or its power (e.g., linear force or rotational torque) is transmitted to the (one or more) instruments. Examples of actuators include rotary motors, linear motors, solenoids, etc. The actuator may drive the manipulation assembly 210 and / or the transmission element in the instrument to control the degrees of freedom of the (one or more) instruments. For example, the actuator may drive a rotating disk of a manipulator coupled to a driving element (e.g., a rotating disk, a linear slide) of the (one or more) instruments, wherein the driving element driving the instrument will drive the transmission element in the instrument, which is coupled to move the (one or more) joints of the instrument, or to actuate some other functions of the instrument, such as the degrees of freedom of the end effector. Therefore, the degrees of freedom of the (one or more) instruments may be controlled by an actuator that drives the (one or more) instruments according to a control signal. The control signal may be determined to cause an instrument movement or other actuation automatically determined by the system, as indicated by movement or other manipulation of an input control device or any other control signal command. In addition, appropriately positioned sensors, such as encoders, potentiometers, etc., may be provided to enable measurement of indications of joint positions, or other data that may be used to derive joint positions, such as joint velocity. Actuators and sensors may be housed in (one or more) manipulators 226, or transmit signals to (one or more) manipulators 226 or receive signals from (one or more) manipulators 226. Technology for manipulating multiple instruments in a computer-assisted system is more fully described in International Patent Application No. PCT / US2021 / 047374, filed on August 24, 2021 and entitled “METHOD AND SYSTEM FOR COORDINATED MULTIPLE-TOOL MOVEMENT USING ADRIVABLE ASSEMBLY,” which is incorporated herein by reference.
[0045] Although Figure 2 , but those skilled in the art will appreciate that embodiments of the present disclosure may be used with any design of a steering assembly or other repositionable structure. For example, the steering assembly may have any number and type of degrees of freedom, may be configured to be coupled or not coupled to an inlet port, may optionally use a port other than a cannula, such as a catheter, etc.
[0046] exist Figure 2 In the example shown, the user input system 250 includes one or more input devices 252 configured to be operated by an operator 298. Figure 2In the example shown, one or more input devices 252 are contacted and manipulated by the hands of the operator 298, one input device for each hand. Examples of such hand input devices include any type of device that can be manually manipulated by a human user, such as a joystick, trackball, button cluster, and / or other type of tactile device typically equipped with multiple degrees of freedom. Position, force, and / or tactile feedback devices (not shown) can be used to provide position, force, and / or tactile feedback from the instrument to the operator's 298 hands via the input devices 252.
[0047] Input device 252 is supported by user input system 250 and is shown as being mechanically grounded, but may be mechanically ungrounded in other embodiments. In some embodiments, an ergonomic support 256 may be provided; for example, Figure 2 An ergonomic support 256 is shown including a forearm rest on which an operator 298 may rest his or her forearms while manipulating input device 252. In some examples, operator 298 may control manipulation assembly 210 using input device 252 to perform tasks at a work site proximate to manipulation assembly 210 during a procedure.
[0048] Display unit 254 is included in user input system 250. Display unit 254 can display images for operator 298 to view. Display unit 254 can provide operator 298 with a view of the worksite with which manipulator assembly 210 interacts. The view may include stereoscopic or three-dimensional images to provide depth perception of the worksite and the (one or more) instruments of manipulator assembly 210 in the worksite. Display unit 254 can move with various degrees of freedom to accommodate the viewing position of operator 298 and / or to provide control functions. In the case of a display unit (e.g., display unit 254 is also used to provide control functions, such as commanding manipulator assembly 210), the display unit also includes an input device (e.g., another input device 252).
[0049] When using user input system 250, operator 298 may sit on a chair or other support, position his or her eyes to view the image displayed by display unit 254, grasp and manipulate input device 252, and, as needed, rest his or her forearms on ergonomic supports 256. In some embodiments, operator 298 may stand at a workstation or assume other postures, and display unit 254 and input device 252 may be structurally different, adjustable in position (height, depth, etc.), etc.
[0050] As described herein, the manipulation assembly 210 includes a first joint set of drivable joints, which are constrained by a mechanical configuration to produce motion that does not translate the hardware RCM, so that the first joint set of drivable joints is not designed to move the hardware RCM. The manipulation assembly 210 also includes a second joint set of drivable joints, which is capable of moving the hardware RCM by a mechanical configuration. In some examples, the operator 298 may want to move the RCM relative to a hardware RCM such as a position located proximal to 262 or distal to 264. In order to reduce the movement of a portion of the repositionable structure (or an instrument supported by the repositionable structure) at the entrance, and / or to address the need to move the RCM for other reasons, the disclosed embodiments allow a virtual (or software) RCM to be set at or near the entrance, wherein the software RCM is different from the hardware RCM. The disclosed embodiments appropriately utilize the motion in the second joint set in combination with the motion in the first joint set to keep the software RCM in the selected position of the RCM. In some cases, the operator 298 of the graphical user interface assists the computer-assisted system to set (register for the system) the position of the software RCM. The graphical user interface also assists the operator 298 in determining the status of the software RCM based on whether the software RCM has been set, whether conditions inhibit the ability of the relocatable structure to maintain the software RCM, and / or whether conditions affecting the software RCM have changed.
[0051] Figures 3A-3C Various configurations of portions of a computer-assisted system (and / or instrument(s) supported by the computer-assisted system) according to one or more embodiments are described. Figure 3A As shown, the first configuration includes a cannula 306 and a hardware RCM 302 placed at an entrance 304 to the workspace. Figure 3A The repositionable structure includes a sleeve seat 308 that helps support and move the sleeve 306. One or more instruments 310 are supported by the repositionable structure and extend through the sleeve 306 and enter the workspace through the entrance 304. During the operation without the software RCM offset from the hardware RCM, the movement of the sleeve 306 is usually constrained so that the sleeve 306 is constrained to pivot around the hardware RCM 302, and the effective RCM coincides with the hardware RCM302 and remains in a fixed position relative to the space (and if the entrance 304 does not move relative to the space, it remains in a fixed position relative to the entrance 304). In some embodiments, such as due to physical obstacles or mechanical design, the instrument cannot easily reach the "dead zone" extending a certain distance from the hardware RCM. As a result, the repositionable structure in such a configuration may not be easy to perform operations in the dead zone. In addition, in some embodiments, the fixed positioning of the RCM also increases the difficulty of the instrument reaching other areas or performing procedures in other areas (such as in a space away from the fixed RCM).
[0052] like Figure 3B As shown, the second configuration includes a cannula 316 including a hardware RCM 312 placed proximal to an entrance 314 of a workspace. The hardware RCM 312 and the entrance 314 of the workspace are separated by a distance 320. The repositionable structure includes a cannula seat 318 that helps support and move the cannula 316. One or more instruments ( Figure 3B 314 and 315. The axially coupled membrane (not shown) extends through the sleeve 316 and through the inlet 314 into the workspace. Figure 3B The configuration can be used for operations involving Figure 3A 314. In the medical example, such a configuration may be used for certain procedures involving transoral robotic surgery (TORS), urological surgery (URO), colorectal surgery (CR), thoracic surgery (THOR), nipple sparing mastectomy (NSM), etc. Figure 3B In the illustrated configuration, if cannula mount 318 moves cannula 316 such that cannula 316 pivots about hardware RCM 312, cannula 316 may move relative to inlet 314. Such large offsets between hardware RCM 312 and inlet 314 may result in various undesirable repositionable structures or instrument behaviors. Examples of less than desirable behaviors include collision of the instrument with material surrounding inlet 314, less intuitive instrument movement, more limited instrument movement, tactile and / or other feedback transmitted to operator 298 that operator 298 may find confusing and / or confusing, difficulty when swapping one instrument for another, etc.
[0053] like Figure 3C As shown, the third configuration includes an access port 332 that does not include a cannula. The technology for manipulating multiple instruments in a system equipped with an access port is more fully described in International Patent Application Publication No. WO 2021 / 067461, entitled "SINGLE PORT INSTRUMENT ACCESS DEVICE," which is incorporated herein by reference. Access port 332 allows one or more instruments 340 to be placed and manipulated very close to the entrance 334 of the working space or outside the entrance 334. Access port 332 is configured to maintain pressure within access port 332, which is useful for insufflating the working space. Similar to Figure 3B Configuration, Figure 3C The entry port 332 can be used for operations involving Figure 3AThe access port 332 allows one or more instruments 340 to pivot about the hardware RCM. However, in the case of a configuration with an access port 332, the position of the hardware RCM may be difficult for a human observer to determine. Additionally, in the case of a configuration with a hardware RCM offset from the access port 334, undesirable repositionable structures or instrument behaviors, such as in combination with Figure 3B described.
[0054] The disclosed embodiments provide an apparatus and method for setting a software RCM that is offset from a hardware RCM. In the event that the software RCM is offset from the hardware RCM, a computer-assisted system causes motion that keeps the software RCM (rather than the hardware RCM) fixed in space.
[0055] Figure 4 is a flow chart of method steps for controlling a repositionable structure relative to a software RCM according to one or more embodiments. Figure 1-3C 7A-7C describe the method steps, but it will be understood by those of ordinary skill in the art that any system configured to perform the method steps in any order is within the scope of the present disclosure. One or more of the processes 402-412 of method 400 may be implemented at least in part in the form of executable code stored on a non-transient, tangible, machine-readable medium. When the executable code is executed by one or more processors (e.g., the processor 150 in the control unit 140), the executable code may cause one or more processors to perform one or more of the processes 402-412. In some embodiments, method 400 may be executed by a module (such as a control module 170). In some embodiments, the repositionable structure of the computer-assisted system may use method 400 to adopt a software RCM different from a hardware RCM constrained by the mechanical configuration of the repositionable structure. Before and / or during the procedure, the operator 298 is able to select a software RCM, where the software RCM is a position in the workspace around which one or more instruments will pivot during remote operation.
[0056] Various aspects of method 400 are described with reference to Figures 7A-7C, these figures illustrate various geometric relationships between the hardware RCM and the software RCM of a repositionable structure according to one or more embodiments. As will be appreciated, the geometric relationship between RCM positions (e.g., hardware RCM positions, default RCM positions that are not hardware RCM positions, suggested software RCM positions, etc.) may include any suitable geometric relationship. For example, the geometric relationship between the hardware RCM and the suggested software RCM positions may include any one or more of the following: a minimum distance separating the positions, a separation distance between the positions along one or more axes (e.g., if a Cartesian coordinate system is used, then the X, Y, Z axes), directions pointed from the hardware RCM and the suggested software RCM, directions pointed from the suggested software RCM to the hardware RCM, the area of a circle or the volume of a sphere defined by rotating the suggested software RCM around the hardware RCM, etc.
[0057] As a specific example, in some cases, the geometric relationship includes a suggested distance between the hardware RCM and the suggested position. The suggested distance can be measured in any appropriate manner, such as along a direction parallel to the alignment axis associated with the repositionable structure, and / or along an offset axis perpendicular to the alignment axis. In some cases, when such a suggested distance is less than a threshold distance, the suggested position of the software RCM is acceptable. Such a threshold distance can be set at design time, manufacturing time, initialization time, during a procedure, etc. Such a threshold distance can be static, or vary with parameters, such as the type of procedure performed by the repositionable structure, the type of instrument installed (or to be installed) on the repositionable structure, the stage of the procedure, the position of the joints or connecting rods of the repositionable structure, etc.
[0058] In addition, it should be understood that Figures 7A-7C Examples and Figures 7A-7C Other values, shapes, behaviors, etc. depicted in may be different for different input devices, different repositionable structures, different follower instruments, different DOFs, different programs, etc.
[0059] In some examples, a control module, such as control module 170, may by default request or require operator 298 to set the software RCM. Control module 170 may by default request or require operator 298 to set the software RCM when certain specific accessories are employed or otherwise deployed for a computer-assisted system. As a specific example, control module 170 may request operator 298 to set the software RCM in response to one or more accessory ports being coupled to a computer-assisted system, such as Figure 3CAs shown. Additionally or alternatively, the control module 170 may by default request or require the operator 298 to set the software RCM before or when executing a particular procedure. Example procedures include those that access targets within the workspace that are closer and / or farther from the accessible area when the hardware RCM is employed. Such procedures include TORS, URO, CR, THOR, NSM, etc. As a specific example, the control module 170 may request the operator 298 to set the software RCM in response to an indication that such a procedure is to be executed by the computer-assisted system (e.g., a procedure is starting or in progress, a particular stage of such a procedure is starting or in progress, etc.).
[0060] In some examples, under certain conditions, such as when multiple instruments have been mounted on the repositionable structure, when multiple instruments are mounted in a cannula, when multiple instruments are inserted into the workspace, when a duration has elapsed since the last time the current position of the software RCM was set, etc., the control module 170 generates a request to the operator 298 to select or reselect the software RCM. Additionally or alternatively, when the repositionable structure and / or one or more instruments collide with material surrounding or near the entrance to the workspace of the repositionable structure, the control module 170 generates a request to the operator 298 to select or reselect the software RCM. The control module 170 can detect such collisions in any suitable manner, such as by ascertaining forces on the repositionable structure and / or one or more instruments, determining that the forces received by the instruments or cannula used with the instruments satisfy the RCM reset condition, detecting position errors of the repositionable structure and / or one or more instruments near the entrance to the workspace, etc. Additionally or alternatively, when the range of motion limits of one or more joints in the second joint set are reached or approached, the control module 170 generates a request to the operator 298 to select or reselect the software RCM. Additionally or alternatively, the control module 170 generates a request to the operator 298 to select or reselect the software RCM after the operator 298 has performed a port clutching that moves the hardware RCM beyond a nominal or threshold amount. Additionally or alternatively, the control module 170 generates a request to the operator 298 to select or reselect the software RCM at the operator's 298 command.
[0061] In some examples, the control module 170 determines that software RCM setting is optional. In such examples, if the operator 298 does not set the software RCM, the control module 170 defaults to using the hardware RCM (in which case the hardware RCM provides a "default position" or "default setting" for the RCM). In some examples, the control module 170 determines that the software RCM is not moved during the procedure. In such examples, after the operator 298 initially sets the software RCM, the control module 170 can remove the option to set the software RCM.
[0062] In process 402, the control module 170 receives an indication of a suggested position of the software RCM in response to manipulation by the operator 298, such as by detecting input from one or more input devices. For example, the input device may be contacted and manipulated by the hands of the operator 298, such as one input device for each hand. Examples of such hand input devices include any type of device that can be manually operated by a human user, such as a joystick, trackball, button cluster, and / or other types of tactile devices that are typically equipped with multiple degrees of freedom. The input device is supported by the user input system and may be mechanically grounded or mechanically ungrounded. Changes in the position and / or orientation (e.g., posture) of one or more input devices in the reference frame of the input device are detected and converted into one or more motion commands. Depending on the implementation, the posture of the input device and the current speed of the input device may include one or more posture variables corresponding to the position and / or orientation DOF of the input device.
[0063] In some examples, the control module 170 may receive an indication of a suggested position before the procedure begins, such as during the installation of one or more instruments to a cannula, an access port, etc. Additionally or alternatively, the control module 170 may receive an indication of a suggested position at any point during the procedure. The control module 170 may receive an indication of a suggested position via any one or more of a variety of technically feasible forms. In some examples, the operator 298 provides an indication of a suggested position by indicating the desired position of the software RCM using a portion of the instrument. In this way, the operator 298 can physically move the instrument by directly manipulating one or more joints of the manipulation assembly 210. Additionally or alternatively, the operator can remotely manipulate one or more joints of the manipulation assembly 210 via input controls located on the user input system 250 to move the instrument. In some examples, the operator 298 places a portion of the instrument in a static position about which one or more instruments will pivot during remote operation. When the instrument is in the desired position, the operator 298 generates a selection input associated with the instrument, such as by pressing a button, speaking an audio command, selecting a graphical control element on a graphical user interface (GUI) screen, etc. When the input is selected, the position of the portion of the instrument is the position about which one or more instruments pivot during teleoperation. In some examples, the operator 298 may select a position at the entrance to the workspace. In medical examples, the position may be at an incision in the body wall, at a natural orifice such as a mouth, etc. Additionally or alternatively, the operator 298 may select another position that is proximal or distal to the entrance to the workspace.
[0064] In some examples, the operator 298 dynamically tracks a portion of the instrument around an area where software RCM is needed. In this method, the operator 298 tracks a distal portion, such as the distal tip of the selected instrument and / or any other relevant portion, around the perimeter of an area of interest, such as the perimeter of an entrance to a workspace. As used herein, reference to a distal portion of an instrument refers to any relevant portion of the selected instrument, whether or not the relevant portion includes the distal tip of the instrument. In some examples, when the instrument used to determine the indication of the suggested position of the software RCM is straight or nearly straight, the operator 298 may more accurately indicate the suggested position and / or more accurately track around the perimeter of the area of interest. Thus, the control module 170 may determine whether the instrument is straight or nearly straight. If the instrument is not straight enough, the control module 170 optionally generates a prompt to the operator 298 to manually straighten the instrument being used to provide an indication of the suggested position of the software RCM. Additionally or alternatively, the control module 170 generates a command to cause the instrument to articulate until the instrument is straight or nearly straight. This additional step of straightening the instrument is employed to determine whether the instrument is straight or nearly straight in combination with the instrument. Figure 5 and / or Figure 6 The method is described in the context of software capable of performing RCM.
[0065] In some examples, the control module 170 determines the indication of the suggested position of the software RCM based on the position of the distal portion of the instrument installed in the sleeve, the entrance guide, the accessory port, etc., as described herein. If the sleeve, the entrance guide, the accessory port, etc. support multiple instruments, the control module 170 can select the distal portion of any installed instrument supported by the repositionable structure of the computer-aided system. More specifically, the control module 170 can select the distal portion of the first installed instrument based on any standard and / or select the distal portion of any subsequently installed instrument. In this way, the control module 170 can select the distal portion of a specific instrument based on the type of instrument and / or the geometry of the instrument. In some examples, the control module 170 can constrain the selection to the distal portion of the instrument that is not an imaging device. By applying this constraint, the control module 170 allows the imaging device to be available for the operator 298 to view the workspace when the operator 298 determines the indication of the suggested position of the software RCM.
[0066] In some examples, the control module 170 selects an instrument from a group of instruments supported by the repositionable structure to indicate a suggested position for the software RCM. The control module 170 selects the instrument based on the order of installation, such as selecting the first instrument installed in the group of instruments, selecting the first non-imaging instrument installed in the group of instruments, selecting the instrument installed in the group of instruments immediately after an imaging instrument in the group of instruments, etc.
[0067] In some examples, the operator 298 may indicate a suggested position for the software RCM based on various criteria other than the distal portion of the instrument. In some examples, the operator 298 indicates a suggested position for the software RCM based on the position of various markers associated with the workspace, such as natural fiducials present in the workspace or fiducial markers that have been applied and / or added to the workspace. The fiducial markers may be radio frequency identifiers (RFIDs), two-dimensional (2D) or three-dimensional (3D) bar codes, special instruments of a size and shape that extend to the entrance of the workspace at the distal end of the instrument, and the like.
[0068] In some examples, the operator 298 can indicate the suggested position of the software RCM by extending the probe from the repositionable structure or an accessory connected to the repositionable structure. The control module 170 commands the actuator system to extend the probe supported by the repositionable structure until the probe stops in response to reaching the extension limit, receiving an operator command, contacting a portion of the probe with an object in the workspace accessible by the instrument supported by the repositionable structure, etc. The position of the probe and / or the accessory provides an indication of the suggested position of the software RCM. The accessories connected to the repositionable structure may include a sleeve, an entry guide, an accessory port, etc.
[0069] In some examples, operator 298 manually enters an indication of a suggested position for the software RCM into an interface associated with the computer-assisted system.
[0070] At process 404, the processor determines an indication of a suggested location for the software RCM based on the indication received at process 402. The control module 170 may determine an indication of a suggested location for the software RCM based on the location of any technically feasible device or portion thereof associated with the computer-assisted system.
[0071] In some examples, when the indication of the suggested position is associated with the static position of the distal portion of the selected instrument during process 402, the control module 170 determines the indication of the suggested position of the software RCM based on the static position of the distal portion of the selected instrument. Additionally or alternatively, in some examples, the control module 170 may determine whether the operator 298 is tracking the distal portion of the selected instrument around the perimeter of the region of interest. This set of positions may define a two-dimensional shape (2D), a two-dimensional shape with depth information (2D+), a three-dimensional shape (3D), etc. The control module 170 makes this determination based on data received from various sensors, such as by analyzing images received from a camera aimed at the operator 298 to analyze the movement of the operator 298. When the indication of the suggested position is associated with a set of positions generated when tracking the distal portion of the selected instrument around the perimeter of the region of interest during process 402, the control module 170 determines the indication of the suggested position of the software RCM based on the dynamic position of the distal portion of the selected instrument. As the operator 298 tracks the distal portion of the selected instrument around the perimeter of the region of interest, the control module 170 detects data associated with the position of the distal portion of the selected instrument.
[0072] In some examples, the control module 170 analyzes the set of positions for consistency with an expected path of motion, an expected shape, an expected region of interest, and the like. In this regard, the set of positions may be consistent with a perimeter of a distal portion tracking area, a surface of a tracking volume, and the like. In some examples, the control module 170 does not analyze the set of positions for consistency with an expected path of motion, an expected shape, an expected region of interest, and the like. In this regard, the set of positions may be based on detecting the start of movement of the operator 298, and then detecting that the movement of the operator 298 has ceased. Additionally or alternatively, the set of positions may be based on detecting positions during a particular time period after receiving a corresponding instruction from the operator, and the like.
[0073] Based on this data, control module 170 determines an indication of a suggested position for the software RCM. In some examples, control module 170 determines an indication of a suggested position based on a set of positions of the distal portion of the selected instrument during tracking (such as by averaging the positions, determining a centroid of the tracked positions, etc.).
[0074] In some examples, the control module 170 determines the indication of the suggested position of the software RCM based on the position of the one or more natural or applied benchmarks when the indication of the suggested position is associated with one or more natural or applied benchmarks during process 402. In this regard, the workspace may include multiple natural or applied benchmarks, one of which is used to set the software RCM during initial setup of the program, and one or more additional benchmarks are used to change the software RCM at certain points during the program.
[0075] In some examples, when the indication of the suggested position is associated with a feature object, tissue, and / or object of other material during process 402, the control module 170 determines the distance or position to the feature object, tissue, and / or other material by using triangulation techniques. Such triangulation techniques can use various sensors and devices, including endoscopes and / or other imaging devices with stereoscopic vision, depth cameras, shape sensors, and / or other depth and / or position sensors. Via triangulation techniques, the control module 170 receives images of objects present in a workspace accessible to an instrument supported by a repositionable structure. The control module 170 receives images from multiple sensors and determines the triangulated position of the object based on the images. The control module 170 determines the indication of the suggested position of the software RCM based on the triangulated position.
[0076] In some examples, when the indication of the suggested position is associated with a probe extended into the workspace during process 402 , control module 170 determines the indication of the suggested position for the software RCM based on position data associated with the probe.
[0077] In some examples, the control module 170 determines an indication of a suggested position of the software RCM by additionally projecting the indication from process 402 (or a derivative of the indication, such as a time-based derivative) onto an alignment axis. The alignment axis may be collinear with a set of axes of a set of instruments supported by a set of instrument manipulators. Additionally or alternatively, the alignment axis may be collinear with a set of translation axes of the set of instrument manipulators, each translation axis being associated with an instrument insertion motion of a prismatic joint of an instrument manipulator in the set of instrument manipulators. Additionally or optionally, the alignment axis may be collinear with a central axis of a cannula mounted to the repositionable structure.
[0078] More specifically, in some examples, the alignment axis is an axis associated with a cannula, an entry guide, an accessory port, etc. The control module 170 determines the alignment axis via various techniques. In some examples, the control module 170 determines the alignment axis based on the translation axis of the prismatic joint of the manipulation assembly 210 used to insert an instrument, cannula, etc. through a hardware RCM. Additionally or alternatively, the control module 170 determines the alignment axis based on the position of the centerline and / or roll axis of the shaft of the instrument supported by the manipulation assembly 210, and is used to select the position for determining the software RCM. Additionally or alternatively, the control module 170 determines the alignment axis based on a collection of the centerlines and / or roll axes of multiple instruments and / or translation axes of multiple prismatic joints of the manipulation assembly 210. Additionally or alternatively, the control module 170 determines the alignment axis based on the position of the centerline and / or roll axis of the cannula, catheter, entry guide, etc. supported by the manipulation assembly 210, such as when multiple instruments pass through the cannula, catheter, entry guide, etc.
[0079] At process 406, control module 170 determines whether to accept the indication of the suggested position from processes 402 and 404. In some examples, control module 170 determines whether to accept the indication of the suggested position for the software RCM based on a geometric relationship between the indication of the suggested position for the hardware RCM and the software RCM.
[0080] In some examples, the control module 170 determines certain conditions that allow the operator 298 to set an initial software RCM and / or allow the operator 298 to move the software RCM based on a position selected by the operator. The control module 170 may allow the operator 298 to set the software RCM within an allowed setting range by limiting the distance between the software RCM and the hardware RCM along the alignment axis associated with the cannula, the entry guide, the accessory port, etc. In addition or alternatively, the control module 170 may allow the operator 298 to set the software RCM within an allowed setting range by limiting the software RCM within a certain safety range of the hardware RCM, such as when the software RCM is allowed to be laterally offset from the alignment axis. In addition or alternatively, when the instrument supported by the repositionable structure moves in a typical procedure performed by the instrument, when the control module 170 determines that the joint of the repositionable structure has sufficient range of motion to maintain the software RCM when the software RCM is set to the recommended position, the control module 170 may allow the operator 298 to set the software RCM (or the control module 170 accepts the recommended software RCM position).
[0081] If the operator 298 attempts to set the software RCM outside the allowed setting range, the control module 170 can perform various remedial actions. The control module 170 can determine that one or more joint sets limit the acceptable range of motion required to support the software RCM requested by the operator 298. If the control module 170 determines that the selected software RCM is unacceptable, the control module 170 can revert to the position of the hardware RCM, the default position (also referred to as "default setting"), the undefined position, etc. Additionally or alternatively, the processor can maintain the software RCM at the previously selected software RCM. In addition, the control module 170 can generate a notification to the operator 298, such as one or more visual, auditory and / or tactile alarms, that the control module 170 has performed one of these remedial actions. Additionally or alternatively, the control module 170 can prompt the operator 298 to override the current setting, thereby allowing the operator 298 to set the software RCM to a position outside the allowed setting range.
[0082] If at process 406, the control module 170 determines not to accept the indication of the suggested position, then the method returns to process 402. However, if the control module 170 determines to accept the indication of the suggested position, then the method proceeds to process 408, where the control module 170 sets the software RCM to the indication of the suggested position.
[0083] In process 410, the control module 170 determines a commanded motion of a joint of the repositionable structure. The commanded motion may affect movement so as to pivot the sleeve and / or one or more instruments about a hardware RCM or a software RCM. In this regard, Figures 7A-7C Various geometric relationships between the hardware RCM and the software RCM of a relocatable structure according to one or more embodiments are described. Fig. 7A In the example shown, a portion of the repositionable structure 702 is positioned so that the hardware RCM 704 is positioned near an entrance 712 of a workspace 714. In this example, the software RCM has not been set, or has not been set to be different from the hardware RCM. Therefore, the control module 170 determines a commanded motion to pivot the cannula and / or one or more instruments about the hardware RCM 704. The commanded motion provides access to a target 708 that is located a distance from the entrance 712 accessible by one or more instruments 706.
[0084] exist Figure 7B In the example shown, target 728 is located at Fig. 7A The one or more instruments 726 in the illustrated configuration are positioned closer to an entrance 730 of a workspace 732 for easy access. To perform a procedure involving such a target 728, a portion of the repositionable structure 722 is positioned so that the hardware RCM 724 is located proximal to the entrance 730 of the workspace 732. In this example, the operator 298 has set a software RCM 734, which is different from the hardware RCM 724, to a position closer to the entrance 730 of the workspace 732. A first portion of the one or more instruments 726 is located proximal to the entrance 730 of the workspace 732, and a second portion of the one or more instruments 726 is located distal to the entrance 730 of the workspace 732. The control module 170 determines a commanded motion of the first and second joint sets of the repositionable structure that causes a portion of the repositionable structure 722 and / or one or more instruments to pivot about the software RCM 734 while moving the hardware RCM 724 as needed. The commanded motion provides easier access to the target 728 relative to the software RCM 734. Fig. 7A Target 708 is positioned closer to entrance 730 .
[0085] exist Figure 7C In the example shown, target 748 is located at Fig. 7A Or one or more instruments 746 in the configuration shown in 7B can be easily accessed even closer to the entrance 752 of the workspace 754. In some examples, when one or more instruments 726 are Figure 7BWhen inserted into the workspace 732 as shown in the configuration, the target 748 is located in an inaccessible area. In order to perform a procedure involving such a target 748, a portion of the relocatable structure 742 is positioned so that the hardware RCM 744 is located proximal to the entrance 752 of the workspace 754. Figure 7C In the example of FIG. 7 , one or more instruments 746 are further retracted from the portal 752 so that the distal portion of the one or more instruments 746 is inserted into the working space 754. In this example, the operator has set a different hardware RCM 744 and combined with Figure 7B The software RCM 734 described is different from the software RCM 756. Specifically, in Figure 7C In the example of FIG. 7 , the software RCM 756 has been set proximate to the entrance 752 of the workspace 754. A first portion of the one or more instruments 746 is located proximal to the entrance 752 of the workspace 754, and a second portion of the one or more instruments 746 is located distal to the entrance 752 of the workspace 754. The control module 170 determines a command motion of the first and second joint sets of the repositionable structure that causes the one or more instruments to pivot about the software RCM 756 while moving the hardware RCM 744 as needed. The command motion provides a command motion relative to the software RCM 756. Fig. 7A Target 708 or Figure 7B Positioning target 728 closer to entrance 752 provides easier access to target 748 .
[0086] Generally speaking, the joint of the repositionable structure includes a first joint set, wherein each joint of the first joint set is physically constrained only to the joint motion that maintains the position of the hardware RCM. The joint of the repositionable structure also includes a second joint set, wherein each joint in the second joint set of multiple joints is physically configured to perform the joint motion that can translate the position of the hardware RCM. When the control module 170 determines the command motion of the joint relative to the software RCM, the command motion may include the motion of any combination of any one or more joints in the first joint set and / or any one or more joints in the second joint set. The command motion can move the hardware RCM, but maintain the position of the software RCM. In this regard, maintaining the position of the software RCM includes generating little or no movement of the repositionable structure and / or the instrument at the software RCM. In some examples, due to manufacturing tolerances, rounding errors in calculations, motor timing, etc., the command motion can generate some movements of the software RCM within a relatively small tolerance. The command motion may include moving one or more instruments and / or moving a part of the repositionable structure. Such command motion can move one or more instruments and / or the repositionable structure along the alignment axis passing through the software RCM. Additionally or alternatively, the commanded motion may pivot one or more instruments and / or repositionable structures about the software RCM.
[0087] In some examples, the joints of the repositionable structure may include additional joints that are not explicitly included in the first joint set or the second joint set, such as one or more joints for causing some other movements of the repositionable structure or any instrument supported by the repositionable structure (e.g., opening and closing the jaws of the instrument). In other words, the first joint set and / or the second joint set may be interspersed with intervening joints, wherein the intervening joints have properties different from the properties of the first joint set and / or the second joint set. At this point, the first joint set is constrained by a mechanical configuration to produce motion that does not translate the hardware RCM. However, in some examples, some configurations may include a drivable joint that can translate the hardware RCM, wherein the drivable joint may be located between two joints in the first joint set. Additionally or alternatively, the second joint set of the drivable joints is driven by a mechanical configuration that can translate the hardware RCM. However, in some examples, some configurations may include a drivable joint that is constrained to produce motion that does not translate the hardware RCM, wherein the drivable joint may be located between two joints in the second joint set.
[0088] At process 412, and upon determining the commanded motion, the control module 170 drives the joints of the repositionable structure in accordance with the commanded motion. The method 400 then proceeds to process 410 to determine additional commanded motions. Under various conditions, the method 400 may alternatively return to process 402 to receive an indication of a proposed new position for the software remote center. In some examples, when certain specific accessories are employed during a procedure, the control module 170 may request or require the operator 298 to indicate a new proposed position for the software RCM, such as an accessory port, such as Figure 3CAs shown. Additionally or alternatively, when the operator performs certain procedures to enter a target within the workspace (when the current software RCM is used, the target is more proximal and / or distal to the accessible area), the control module 170 may request or require the operator 298 to indicate a new suggested position for the software RCM. In some examples, the control module 170 may request or require the operator 298 to indicate a new suggested position for the software RCM when all instruments are installed in the sleeve, when all instruments are inserted into the workspace, when a defined time period has passed, etc. In some examples, when the repositionable structure and / or one or more instruments collide with materials surrounding or near the entrance to the workspace, the control module 170 may request or require the operator 298 to indicate a new suggested position for the software RCM. In some examples, when the range of motion limit of one or more joints in the second joint set is reached or approached, the control module 170 may request or require the operator 298 to indicate a new suggested position for the software RCM. In some examples, after the operator 298 has performed a port clutch that moves the hardware RCM greater than a nominal or threshold amount, the control module 170 may request or require the operator 298 to indicate a new suggested position for the software RCM. In some examples, the control module 170 may request or require the operator 298 to indicate a new suggested position for the software RCM at the operator's 298 command.
[0089] In some examples, the control module 170 is configured to request or require the operator 298 to indicate a new suggested position for the software RCM in response to one or more of the following events: the instrument used to provide the indication of the suggested position for the RCM has been unloaded from the repositionable structure, all instruments have been unloaded from the repositionable structure, a portion of the repositionable structure has reached or is near the limit of motion of the repositionable structure, or the computer-assisted system has undergone a mid-procedure restart. Alternatively, in some examples, the control module 170 may be configured to maintain the current position of the software RCM despite the occurrence of one or more of the following events: the instrument used to provide the indication of the suggested position for the RCM has been unloaded from the repositionable structure, all instruments have been unloaded from the repositionable structure, a portion of the repositionable structure has reached or is near the limit of motion of the repositionable structure, or the computer-assisted system has undergone a mid-procedure restart.
[0090] As discussed above and further emphasized here, Figure 4Only examples should not overly limit the scope of the claims. Those of ordinary skill in the art will recognize many changes, substitutions and modifications. In some embodiments, various conditions may cause the selected software RCM to be disabled. In some examples, when the operator 298 externally manipulates the repositionable structure, the control module 170 prohibits setting the current position of the software RCM. For example, when the first operator externally manipulates the repositionable structure (or the control module 170 is in a mode that facilitates external manipulation of the repositionable structure), the control module 170 may allow the current position of the software RCM to be set based on the input of the first operator, while prohibiting the current position of the software RCM to be set based on the input of the second operator. The input provided by the second operator may be through external manipulation of the repositionable structure, through input to the user input system, etc. As another example, when the first operator uses a user input system separated from the repositionable structure to command the repositionable structure to move (or the control module 170 is in a mode that facilitates external manipulation of the repositionable structure), the control module 170 may allow the current position of the software RCM to be set based on the input of the first operator, while prohibiting the current position of the software RCM to be set based on the input of the second operator. Input provided by such a second operator can be through external manipulation of the repositionable structure, through input to another portion of the user input system or another user input system, etc.
[0091] The following paragraphs describe examples where a hardware RCM provides a default position (also referred to as a "default setting") for an RCM. Similar techniques may also be used when the default position of an RCM is a position other than a hardware RCM. Such a default position that is not a hardware RCM may be a previously defined software RCM setting, such as an initial position of an RCM set at the start of a process, during a process, etc.
[0092] In some examples, the control module 170 may revert to using the position of the hardware RCM when the software RCM is set and activated. In such examples, the control module 170 may revert to using the position of the hardware RCM at the end of a procedure (e.g., in response to the completion of a procedure previously performed by the repositionable structure), when a cannula is removed from the computer-assisted system (e.g., in response to the cannula being removed from use with the repositionable structure), when an accessory port is removed from the computer-assisted system (e.g., in response to the removal of an accessory port previously mounted to the repositionable structure), when a remote center management setting is disabled or becomes disabled, if the operator 298 attempts to move the software RCM remote center outside of a safe range, etc. In such examples, the control module 170 may generate a prompt to the operator 298 to set the software RCM before proceeding.
[0093] In some examples, the control module 170 may avoid reverting to the hardware RCM under certain conditions, including when the operator 298 removes the instrument used to set the software RCM, when the operator 298 removes some but not all installed instruments, when the repositionable structure is not within the limits of motion, when the operator 298 restarts the program during execution of the program, etc.
[0094] In some examples, two or more operators 298 use a computer-assisted system to perform and / or assist in performing a procedure. In such examples, a first operator 298 may be located at the user input system 250, and a second operator 298 may be located at the steering assembly 210. To reduce confusion between the multiple operators, the control module 170 may prohibit the first operator 298 from setting the software RCM when the second operator 298 is performing a port clutch procedure.
[0095] In some examples, the control module 170 determines the manual range of motion and / or clearance of the repositionable structure after setting the software RCM. In such examples, the control module 170 may instruct the operator 298 to perform additional processes of clutching and manually rotating the repositionable structure and / or one or more instruments about the software RCM in order to establish the range of motion expected during the procedure.
[0096] In some examples, the repositionable structure does not have a hardware RCM. In such examples, the processor may set a default software RCM (also referred to as a "default position" or "default setting" of the RCM) that depends on the type of computer-assisted system, the type of one or more installed instruments, the type of procedure, the preferences of the operator 298, etc.
[0097] Figure 5 Flowchart of method steps for setting software RCM according to one or more embodiments. Figure 1-3C7A-7C describe the method steps, but it will be understood by those of ordinary skill in the art that any system configured to perform the method steps in any order is within the scope of the present disclosure. In particular, processes 502-506 are optional, and any one or more of processes 502-506 may be omitted within the scope of the present disclosure. One or more of processes 502-512 of method 500 may be implemented at least in part in the form of executable code stored on a non-transient, tangible, machine-readable medium. When the executable code is executed by one or more processors (e.g., the processor 150 in the control unit 140), the executable code may cause one or more processors to execute one or more of processes 502-512. In some embodiments, method 500 may be executed by a module (such as control module 170). In some embodiments, the repositionable structure of a computer-aided system may use method 500 to establish a software RCM that is different from a hardware RCM and has a geometric relationship with the hardware RCM, and the software RCM is constrained based on the mechanical configuration of the repositionable structure.
[0098] In process 502, the operator 298 communicates with a computer-assisted system (such as Figure 1 Computer-aided system 100 or Figure 2 The computer-assisted system 200 of the present invention locates the workspace. The operator 298 locates the workspace by moving a cannula, catheter, or entry guide supported by a repositionable structure of the computer-assisted system so that an entry to the workspace is accessible. In a medical example, the workspace is the patient's body, and the entry is an incision, a natural orifice (such as the patient's mouth), etc.
[0099] In optional process 504, operator 298 inserts an imaging device into a cannula, catheter, entry guide, entry location, etc. The imaging device can be a camera, endoscope, etc. In some examples, the imaging device enables operator 298 to view the workspace and the entrance to the workspace while selecting the software RCM. In some examples, operator 298 selects the software RCM without the help of the imaging device. For example, if the computer-assisted system is equipped with an entry port, the operator 298 standing near the repositionable structure can directly see the entrance to the workspace and the instrument. Operator 298 can position the instrument to identify the suggested position of the software RCM without using an imaging device.
[0100] In process 506, the operator 298 inserts one or more instruments into a cannula, catheter, or entry guide supported by a repositionable structure of the computer-assisted system. In some examples, the cannula, catheter, or entry guide supports a single instrument. In such examples, the operator 298 inserts a single instrument into the cannula, catheter, or entry guide. Alternatively, the cannula, catheter, or entry guide supports multiple instruments. In such examples, the operator 298 inserts any one or more instruments into the cannula, catheter, or entry guide, up to and including the number of instruments supported by the cannula, catheter, or entry guide.
[0101] At process 508, the operator 298 provides an indication of a suggested position for the software RCM. In some examples, the operator 298 places a portion of one of the mounted instruments (such as a distal portion of the instrument) at the entrance to the workspace. Alternatively, the operator 298 places a portion of one of the mounted instruments at a different position associated with the procedure being performed. Alternatively, the operator 298 may employ any of the techniques described with respect to process 402 for indicating a suggested position for the software RCM. When indicating a suggested position, the operator may employ a port clutching mode in which the joint set is allowed to move so that the operator can manually change the hardware RCM.
[0102] At process 510, a control module, such as control module 170, receives input from an operator 298 to register the suggested position of the software RCM. In some examples, the operator 298 generates instructions via a selection input associated with the instrument, such as by pressing a button, speaking an audio command, selecting a graphical control element on a GUI screen, etc.
[0103] At process 512, the control module 170 sets the software RCM to an indication of the recommended position, such as in conjunction with Figure 4 The control module 170 optionally generates one or more visual, auditory and / or tactile prompts to the operator 298 to indicate that the software RCM has been set. In some examples, to set the software RCM, the control module 170 projects the position of the distal portion of the instrument (or a derivative of the position, such as velocity or acceleration) onto an alignment axis associated with an instrument, cannula, catheter, or entry guide supported by the repositionable structure to determine the position of the software RCM. This process limits the software RCM to change from the hardware RCM in only a single degree of freedom (DOF).
[0104] In some examples, the control module 170 does not constrain the software RCM to be offset from the hardware RCM along only one axis (i.e., along only a single degree of freedom). Instead, the software RCM may be offset from the hardware RCM along multiple degrees of freedom, such as translation along the alignment axis and translation along an offset axis perpendicular to the alignment axis. In such examples, the control module 170 sets the software RCM to a suggested position determined according to the instructions received during process 508. As a result, the control module 170 allows the software RCM to be laterally offset from the alignment axis. In these examples, the control module 170 does not project the suggested position to a position located at the alignment axis.
[0105] Method 500 then proceeds to process 508, where operator 298 optionally provides a new indication of a suggested position for the software RCM. In this manner, operator 298 may select different software remote centers of motion as desired during different steps of the procedure.
[0106] Figure 6 Flowchart of method steps for setting software RCM according to one or more embodiments. Figure 1-3C 7A-7C describe the method steps, but it will be understood by those of ordinary skill in the art that any system configured to perform the method steps in any order is within the scope of the present disclosure. In particular, processes 602-606 are optional, and any one or more of processes 602-606 may be omitted within the scope of the present disclosure. One or more of processes 602-616 of method 600 may be implemented at least in part in the form of executable code stored on a non-transient, tangible, machine-readable medium. When the executable code is executed by one or more processors (e.g., the processor 150 in the control unit 140), the executable code may cause one or more processors to execute one or more of processes 602-616. In some embodiments, method 600 may be executed by a module (such as control module 170). In some embodiments, a relocatable structure may use method 600 to establish a software RCM that is different from a hardware RCM and has a geometric relationship with the hardware RCM, and the software RCM is constrained based on the mechanical configuration of the relocatable structure. In addition, method 600 may be used in applications where additional confirmation is required before setting the software RCM. Such applications include surgical applications where incorrectly setting the software RCM increases the risk of damage or injury to the patient or other applications where damage to the workspace could be significant, expensive, etc.
[0107] In process 602, the operator 298 communicates with a computer-assisted system (such as Figure 1 Computer-aided system 100 or Figure 2The computer-assisted system 200 of the present invention locates the workspace. The operator 298 locates the workspace by moving a cannula, catheter, or entry guide supported by a repositionable structure of the computer-assisted system so that an entry to the workspace is accessible. In a medical example, the workspace is the patient's body, and the entry is an incision, a natural orifice (such as the patient's mouth), etc.
[0108] In optional process 604, operator 298 inserts an imaging device into a cannula, catheter, or entry guide. The imaging device may be a camera, endoscope, or the like. In some examples, the imaging device enables operator 298 to view the workspace and the entrance to the workspace while selecting the software RCM. In some examples, operator 298 selects the software RCM without the assistance of the imaging device. For example, if the computer-assisted system is equipped with an entry port, an operator 298 standing near the repositionable structure may directly see the entrance to the workspace and the instrument. Operator 298 may position the instrument to identify the suggested position of the software RCM without the use of an imaging device.
[0109] In process 606, the operator 298 inserts one or more instruments into a cannula, catheter, or entry guide supported by a repositionable structure of the computer-assisted system. In some examples, the cannula, catheter, or entry guide supports a single instrument. In such examples, the operator 298 inserts a single instrument into the cannula, catheter, or entry guide. Alternatively, the cannula, catheter, or entry guide supports multiple instruments. In such examples, the operator 298 inserts any one or more instruments into the cannula, catheter, or entry guide, up to and including the number of instruments supported by the cannula, catheter, or entry guide.
[0110] At process 608, the operator 298 generates a request to set the software RCM position. In some examples, the operator 298 generates the request by activating a first input to enter a setting mode. The operator 298 generates the request via a selection input associated with the instrument, such as by pressing a button, speaking an audio command, selecting a graphical control element on a GUI screen, etc. A control module, such as the control module 170, receives the request from the operator 298.
[0111] At process 610, the control module 170 generates a prompt to the operator 298. The prompt to the operator 298 requests the operator 298 to provide an indication of a suggested location for the software RCM. In some examples, the prompt requests the operator 298 to place a portion of one of the mounted instruments (such as a distal portion of the instrument) at the entrance to the workspace. Alternatively, the prompt to the operator 298 requests the operator 298 to place a portion of one of the mounted instruments at a different location associated with the procedure being performed. Alternatively, the prompt to the operator 298 requests the operator 298 to indicate a suggested location via any of the techniques described with respect to process 402 for indicating a suggested location for the software RCM.
[0112] At process 612, the operator 298 provides an indication of a suggested position for the software RCM. In some examples, the operator 298 places a portion of one of the mounted instruments at the entrance to the workspace. Alternatively, the operator 298 places a portion of one of the mounted instruments at a different position associated with the procedure being performed. Alternatively, the operator 298 may employ any of the techniques described with respect to process 402 for indicating a suggested position for the software RCM. When indicating a suggested position, the operator may employ a port clutching mode in which the joint set is allowed to move so that the operator can manually change the hardware RCM.
[0113] At process 614, the control module 170 receives a request from the operator 298 to register the proposed position of the software RCM. In some examples, the operator 298 generates the request by activating the second input and / or by reactivating the first input. The operator 298 generates the instruction via a selection input associated with the instrument, such as by pressing a button, speaking an audio command, selecting a graphical control element on a GUI screen, etc.
[0114] At process 616, the control module 170 sets the software RCM to an indication of the recommended position, such as in conjunction with Figure 4 404-408. If the operator 298 is remotely located from the manipulation assembly 210, the control module 170 optionally requests a confirmation input (also referred to as "operator confirmation") from the operator 298 located at the user input system 250 before setting the position of a portion of one of the instruments mounted for registration. The control module 170 optionally generates one or more visual, auditory, and / or tactile prompts to the operator 298 to indicate that the software RCM has been set. In some examples, to set the software RCM, the control module 170 projects the position of the distal portion of the instrument onto an alignment axis associated with an instrument, cannula, catheter, or entry guide supported by the repositionable structure to determine the position of the software RCM. This process limits the software RCM to change from the hardware RCM in only one degree of freedom (DOF).
[0115] In some examples, the control module 170 does not constrain the software RCM to offset from the hardware RCM along only one axis (i.e., along only one degree of freedom). In such examples, the control module 170 sets the software RCM to a suggested position determined according to the instructions received during process 612. As a result, the control module 170 allows the software RCM to offset laterally from the alignment axis. In these examples, the control module 170 does not project the suggested position to be located on the alignment axis.
[0116] The method 600 then proceeds to process 608 where the operator 298 optionally provides a new indication of a suggested position for the software RCM. In this manner, the operator 298 can select different software remote centers of motion as desired during different steps of the procedure.
[0117] Some examples of control units (such as Figure 1 The control unit 140 of the embodiment may include a non-transitory tangible machine-readable medium including executable code that, when executed by one or more processors (e.g., Figure 1 When executed by the processor 150 of the computer, the executable code may cause one or more processors to perform the process of method 400. Some common forms of machine-readable media that may include the process of method 400 may include floppy disks, flexible disks, hard disks, magnetic tapes, any other magnetic media, CD-ROMs, any other optical media, punch cards, paper tapes, any other physical media with patterns of holes, RAM, PROM, EPROM, FLASH-EPROM, any other memory chip or tape cartridge, and / or any other media suitable for reading by a processor or computer.
[0118] Although illustrative embodiments have been shown and described, various modifications, variations, and substitutions are contemplated in the foregoing disclosure, and in some cases, some features of the embodiments may be employed without corresponding use of other features. Those of ordinary skill in the art will recognize many variations, substitutions, and modifications. Therefore, the scope of the present invention should be limited only by the appended claims, and the claims should be broadly interpreted in a manner consistent with the scope of the embodiments disclosed herein.
Claims
1. A computer-aided system comprising: Input controls; a repositionable structure comprising a plurality of joints, wherein each joint of a first set of joints of the plurality of joints is physically constrained to articulate motions that maintain a position of a hardware remote center of motion (RCM) of the repositionable structure, and wherein each joint of a second set of joints of the plurality of joints is physically configured to perform articulate motions that are capable of translating the position of the hardware RCM; as well as a processing system communicatively coupled to the input control and the repositionable structure, the processing system configured to: receiving an indication of a proposed position of the software RCM of the relocatable structure, determining whether to accept the suggested position based on a geometric relationship between the position of the hardware RCM and the suggested position, In response to determining to accept the suggested position, setting the current position of the software RCM based on the suggested position, After setting the current position of the software RCM based on the suggested position, and in response to an instruction to move the repositionable structure in a desired motion, determining commanded motions of the plurality of joints to move the repositionable structure in accordance with the desired motion while maintaining the current position of the software RCM, and The plurality of joints are driven according to the command motion.
2. The computer-aided system according to claim 1, wherein: To receive the indication of the suggested position, the processing system is configured to: detect a position of a distal portion of an instrument supported by the repositionable structure; and The processing system is further configured to determine the suggested position based on the position of the distal portion of the instrument.
3. The computer-aided system according to claim 1, wherein: To receive the indication of the suggested position, the processing system is configured to: detect a position of a portion of an instrument supported by the repositionable structure; and The processing system is further configured to select the instrument from a plurality of instruments supported by the repositionable structure based on an order in which the plurality of instruments are installed.
4. The computer-assisted system of claim 3, wherein the instruments are selected based on the installation order, the processing system being configured to: selecting a first installed instrument of the plurality of instruments; or selecting a first mounted non-imaging modality of the plurality of modalities; or An instrument of the plurality of instruments is selected that is installed immediately after an imaging instrument of the plurality of instruments.
5. The computer-aided system of claim 1, wherein: To receive the indication of the suggested position, the processing system is configured to: receive a plurality of positions of the distal portion of the instrument supported by the repositionable structure as the distal portion moves; and The processing system is also configured to determine the suggested location using the plurality of locations.
6. The computer-assisted system of claim 5, wherein to determine the suggested position using the plurality of positions, the processing system is configured to: The plurality of locations are determined to coincide with tracking the distal portion of the region of interest.
7. The computer-aided system of claim 1, wherein: The indication of the proposed position includes a fiducial present in a workspace into which an instrument supported by the repositionable structure is accessible, and the processing system is further configured to: determine the proposed position based on a position of the fiducial; or The indication of the suggested position includes one or more images of objects present in the workspace, and the processing system is further configured to determine the suggested position based on a position of the object determined using the one or more images.
8. The computer-assisted system of claim 1 , wherein to receive the indication of the suggested location, the processing system is configured to: commanding an actuator system to extend a probe supported by the repositionable structure until the probe stops in response to reaching an extension limit, receiving an operator command, or contacting an object in a workspace into which an instrument supported by the repositionable structure can enter; and The suggested position is determined based on a position of a portion of the probe when the probe is stopped.
9. A computer-aided system according to any one of claims 1 to 8, wherein in order to set the current position of the software RCM based on the recommended position, the processing system is configured to: set the current position of the software RCM to the recommended position.
10. The computer-aided system according to any one of claims 1 to 8, wherein the processing system is further configured to: The suggested position is determined by projecting the indication or a derivative of the indication onto an alignment axis associated with the repositionable structure.
11. The computer-assisted system of claim 10, wherein the alignment axis is parallel to an axis of an instrument supported by the repositionable structure.
12. The computer-assisted system of claim 10, wherein the repositionable structure comprises a base manipulator and a plurality of instrument manipulators coupled to the base manipulator, and wherein the alignment axis is collinear with: the set of axes of a plurality of instruments supported by the plurality of instrument manipulators; or a set of translation axes of the plurality of instrument manipulators, each translation axis associated with an instrument insertion motion of a prismatic joint of an instrument manipulator of the plurality of instrument manipulators; or A central axis of a sleeve, the sleeve being attached to the repositionable structure.
13. A computer-assisted system according to claim 10, wherein the repositionable structure includes a base manipulator and a plurality of instrument manipulators connected to the base manipulator, wherein the plurality of instrument manipulators are configured to: support a plurality of instruments including the instrument, and wherein the alignment axis is colinear with a central axis of the base manipulator.
14. The computer-aided system according to any one of claims 1 to 8, wherein in order to set the current position of the software RCM based on the suggested position, the processing system is configured to: The software RCM is determined to be offset from the hardware RCM along a single degree of freedom.
15. The computer-aided system according to any one of claims 1 to 8, wherein in order to set the current position of the software RCM based on the suggested position, the processing system is configured to: The software RCM is determined to be offset from the hardware RCM along a plurality of degrees of freedom.
16. The computer-assisted system of claim 15, wherein the repositionable structure is associated with an alignment axis, and wherein the plurality of degrees of freedom include translation along the alignment axis and translation along an offset axis perpendicular to the alignment axis.
17. The computer-aided system according to any one of claims 1 to 8, wherein in order to set the current position of the software RCM based on the suggested position, the processing system is configured to: requesting an operator to confirm registration of the proposed position; and The current position is set in response to receiving confirmation from the operator to register the proposed position.
18. A computer-aided system according to any one of claims 1 to 8, wherein: The geometric relationship includes a suggested distance between the hardware RCM and the suggested position; and To determine whether to accept the suggested location, the processing system is configured to determine whether the suggested distance is less than a threshold distance.
19. The computer-assisted system of claim 18, wherein the suggested distance is measured along a direction parallel to an alignment axis associated with the repositionable structure.
20. The computer-assisted system of claim 19, wherein the suggested distance is also measured along an offset axis that is perpendicular to the alignment axis.
21. The computer-assisted system according to any one of claims 1 to 8, wherein in order to determine whether to accept the suggested position, the processing system is configured to: If the software RCM is set to the recommended position, a determination is made as to whether the second joint set has a sufficient range of motion to maintain the software RCM when the instrument supported by the repositionable structure is moved in a manner typical of a procedure performed by the instrument.
22. The computer-aided system according to any one of claims 1 to 8, wherein the processing system is further configured to: In response to determining that the suggested position is not accepted, the current position of the software RCM is set to the hardware RCM, a default position, or an undefined position.
23. The computer-assisted system of any one of claims 1 to 8, wherein the processing system is further configured to: generate a request for the indication of the suggested location in response to: determining that a particular accessory is deployed for use with the computer-assisted system; or A specific procedure is determined to be performed by the computer-assisted system.
24. The computer-assisted system of any one of claims 1 to 8, wherein the processing system is further configured to: generate a request for the indication of the suggested location in response to: determining that a plurality of instruments have been mounted on the repositionable structure; or determining that a duration has elapsed since the current position was last set; or It is determined that the hardware RCM has moved greater than a threshold amount.
25. The computer-assisted system of any one of claims 1 to 8, wherein the processing system is further configured to: generate a request for the indication of the suggested location in response to: determining that a collision has occurred between material proximate an entrance to a workspace of the repositionable structure and the repositionable structure; or determining that a collision has occurred between material proximate the access port and an instrument supported by the repositionable structure; or A force received by the instrument or a cannula used with the instrument is determined to satisfy an RCM reset condition.
26. The computer-assisted system of any one of claims 1 to 8, wherein the processing system is further configured to: generate a request for the indication of the suggested location in response to: It is determined that one or more joints included in the second joint set are at or near a range of motion limit.
27. The computer-assisted system of any one of claims 1 to 8, wherein the processing system is further configured to: set the current position of the software RCM to a default position in response to determining that at least one event selected from the group consisting of: completing a procedure previously performed by said relocatable structure; removing a cannula used with the repositionable structure; and An accessory port previously attached to the repositionable structure is removed.
28. The computer-assisted system of claim 27, wherein the processing system is further configured to: After the current position of the software RCM is set as the default position, a request for the indication of the suggested position of the software RCM is generated.
29. The computer-assisted system of any one of claims 1 to 8, wherein the processing system is further configured to: maintain the current position of the software RCM even if at least one event selected from the group consisting of: an instrument for providing said indication of said proposed position has been unloaded from said repositionable structure; All instruments have been unloaded from the repositionable structure; a portion of the repositionable structure has reached or is near a limit of the range of motion of the repositionable structure; as well as The computer-assisted system has undergone a mid-procedure reboot.
30. The computer-assisted system according to any one of claims 1 to 8, wherein the processing system is further configured to: When a first operator is externally manipulating the repositionable structure, setting the current position of the software RCM based on input by a second operator is prohibited, but setting the current position of the software RCM based on input by the first operator is permitted.
31. The computer-assisted system of any one of claims 1 to 8, wherein the processing system is further configured to: Setting the current position of the software RCM is prohibited when the repositionable structure is manipulated externally.
32. The computer-assisted system of any one of claims 1 to 8, wherein the processing system is further configured to: After setting the current position of the software RCM based on the suggested position, the operator is prompted to observe the movement of the repositionable structure while maintaining the current position of the software RCM to assess the range of motion of the repositionable structure or the clearance of the repositionable structure.
33. The computer-assisted system of claim 32, wherein to prompt the operator to observe the movement of the repositionable structure, the computer-assisted system is configured to: The operator or actuator system causing the repositionable structure to rotate the repositionable structure about the current position of the software RCM.
34. The computer-assisted system of claim 1, wherein the computer-assisted system is a medical system.
35. A method comprising: receiving, by the processing system, an indication of a proposed position of a software remote center of motion (RCM) for the repositionable structure; determining, by the processing system, whether to accept the proposed position based on a geometric relationship between a position of the hardware RCM of the repositionable structure and the proposed position; In response to determining to accept the suggested position, setting, by the processing system, a current position of the software RCM based on the suggested position; after setting the current position of the software RCM based on the suggested position, and in response to an instruction to move the repositionable structure in a desired motion, determining, by the processing system, commanded motions of a plurality of joints to move the repositionable structure in accordance with the desired motion while maintaining the current position of the software RCM; as well as The processing system drives the plurality of joints according to the command motion, Wherein each joint of a first set of the plurality of joints is physically constrained to joint movement that maintains the position of the hardware RCM of the repositionable structure, and wherein each joint of a second set of the plurality of joints is physically configured to perform joint movement that is capable of translating the position of the hardware RCM.
36. The method of claim 35, wherein: Receiving the indication of the suggested position includes: detecting a position of a distal portion of an instrument supported by the repositionable structure; and Also included is determining, by the processing system, the suggested position based on the position of the distal portion of the instrument.
37. The method of claim 35, wherein: Receiving the indication of the suggested position includes: detecting a position of a portion of an instrument supported by the repositionable structure; and Also included is selecting, by the processing system, an instrument from a plurality of instruments supported by the repositionable structure based on the order in which the plurality of instruments are installed.
38. The method of claim 37, wherein selecting the instruments based on the installation order comprises: selecting a first installed instrument from the plurality of instruments; or selecting a first installed non-imaging instrument from the plurality of instruments; or An instrument of the plurality of instruments is selected that is installed immediately after an imaging instrument of the plurality of instruments.
39. The method of claim 35, wherein: Receiving the indication of the suggested position includes: receiving a plurality of positions of the distal portion of the instrument supported by the repositionable structure as the distal portion moves; and Also included is determining, by the processing system, the suggested location using the plurality of locations.
40. The method of claim 39, wherein using the plurality of locations to determine the suggested location comprises: The plurality of locations are determined to coincide with tracking the distal portion of the region of interest.
41. The method of claim 35, wherein: The indication of the proposed position includes a fiducial present in a workspace into which an implement supported by the repositionable structure is accessible, and the method further comprises: determining, by the processing system, the proposed position based on a position of the fiducial; or The indication of the suggested position includes one or more images of objects present in the workspace, and the method further includes determining, by the processing system, the suggested position based on a position of the object determined using the one or more images.
42. The method of claim 35, wherein receiving the indication of the suggested location comprises: commanding an actuator system to extend a probe supported by the repositionable structure until the probe stops in response to reaching a limit of extension, receiving an operator command, or contacting an object in a workspace into which an instrument supported by the repositionable structure can enter; as well as The suggested position is determined based on a position of a portion of the probe when the probe is stopped.
43. The method of claim 35, wherein setting the current position of the software RCM based on the suggested position comprises: The current position of the software RCM is set as the suggested position.
44. The method of claim 35, further comprising: The suggested position is determined by the processing system by projecting the indication or a derivative of the indication onto an alignment axis associated with the repositionable structure.
45. The method of claim 44, wherein the alignment axis is parallel to an axis of an instrument supported by the repositionable structure.
46. The method of claim 44, wherein the repositionable structure comprises a base manipulator and a plurality of instrument manipulators coupled to the base manipulator, and wherein the alignment axis is co-linear with: the set of axes of a plurality of instruments supported by the plurality of instrument manipulators; or a set of translation axes of the plurality of instrument manipulators, each translation axis associated with an instrument insertion motion of a prismatic joint of an instrument manipulator of the plurality of instrument manipulators; or A central axis of a sleeve, the sleeve being attached to the repositionable structure.
47. A method according to claim 44, wherein the repositionable structure includes a base manipulator and a plurality of instrument manipulators connected to the base manipulator, wherein the plurality of instrument manipulators are configured to: support a plurality of instruments including the instrument, and wherein the alignment axis is colinear with a central axis of the base manipulator.
48. The method of claim 35, wherein setting the current position of the software RCM based on the suggested position comprises: The software RCM is determined to be offset from the hardware RCM along a single degree of freedom.
49. The method of claim 35, wherein setting the current position of the software RCM based on the suggested position comprises: The software RCM is determined to be offset from the hardware RCM along a plurality of degrees of freedom.
50. The method of claim 49, wherein the repositionable structure is associated with an alignment axis, and wherein the plurality of degrees of freedom include translation along the alignment axis and translation along an offset axis perpendicular to the alignment axis.
51. The method of claim 35, wherein setting the current position of the software RCM based on the suggested position comprises: requesting an operator to confirm registration of the proposed position; as well as The current position is set in response to receiving confirmation from the operator to register the proposed position.
52. The method of claim 35, wherein: The geometric relationship includes a suggested distance between the hardware RCM and the suggested position; and Determining whether to accept the suggested location includes determining whether the suggested distance is less than a threshold distance.
53. The method of claim 52, wherein the suggested distance is measured along a direction parallel to an alignment axis associated with the repositionable structure.
54. The method of claim 53, wherein the suggested distance is also measured along an offset axis that is perpendicular to the alignment axis.
55. The method of claim 35, wherein determining whether to accept the suggested location comprises: If the software RCM is set to the recommended position, a determination is made as to whether the second joint set has a sufficient range of motion to maintain the software RCM when the instrument supported by the repositionable structure is moved in a manner typical of a procedure performed by the instrument.
56. The method of claim 35, further comprising: In response to determining that the suggested position is not accepted, setting, by the processing system, the current position of the software RCM to the hardware RCM, a default position, or an undefined position.
57. The method of claim 35, further comprising: The request for the indication of the suggested location to be generated by the processing system in response to: determining, by the processing system, that a particular accessory is deployed for use with a computer-assisted system; or A specific program is determined by the processing system to be executed by the computer-assisted system.
58. The method of claim 35, further comprising: The request for the indication of the suggested location to be generated by the processing system in response to: determining, by the processing system, that a plurality of instruments have been mounted on the repositionable structure; or determining, by the processing system, that a duration has elapsed since the current location was last set; or A determination is made by the processing system that the hardware RCM has moved greater than a threshold amount.
59. The method of claim 35, further comprising: The request for the indication of the suggested location to be generated by the processing system in response to: determining, by the processing system, that a collision has occurred between material proximate an entrance to a working space of the repositionable structure and the repositionable structure; or determining, by the processing system, that a collision has occurred between material proximate the inlet and an instrument supported by the repositionable structure; or A determination by the processing system that a force received by the instrument or by a cannula used with the instrument satisfies an RCM reset condition.
60. The method of claim 35, further comprising: The request for the indication of the suggested location to be generated by the processing system in response to: A determination is made by the processing system that one or more joints included in the second joint set are at or near a range of motion limit.
61. The method of claim 35, further comprising: In response to determining that at least one event selected from the group consisting of: completing a procedure previously performed by said relocatable structure; removing a cannula used with the repositionable structure; and An accessory port previously attached to the repositionable structure is removed.
62. The method of claim 61, further comprising: The request for the indication of the suggested position of the software RCM is generated by the processing system after the current position of the software RCM is set as the default position.
63. The method of claim 35, further comprising: The current position of the software RCM is maintained by the processing system even if at least one event selected from the group consisting of: an instrument for providing said indication of said proposed position has been unloaded from said repositionable structure; All instruments have been unloaded from the repositionable structure; a portion of the repositionable structure has reached or is near a limit of the range of motion of the repositionable structure; as well as The computer-assisted system has undergone a mid-procedure reboot.
64. The method of claim 35, further comprising: When a first operator is externally manipulating the repositionable structure, setting of the current position of the software RCM based on input by a second operator is prohibited by the processing system, but setting of the current position of the software RCM based on input by the first operator is permitted.
65. The method of claim 35, further comprising: Setting the current position of the software RCM is inhibited by the processing system when the repositionable structure is externally manipulated.
66. The method of claim 35, further comprising: After setting the current position of the software RCM based on the recommended position, the operator is prompted by the processing system to observe the movement of the repositionable structure while maintaining the current position of the software RCM to assess the range of motion of the repositionable structure or the clearance of the repositionable structure.
67. The method of claim 66, wherein prompting the operator to observe the movement of the repositionable structure comprises: The operator or actuator system causing the repositionable structure to rotate the repositionable structure about the current position of the software RCM.
68. The method of claim 35, wherein the plurality of joints are included in a computer-assisted system comprising a medical system.
69. One or more non-transitory machine-readable media comprising a plurality of machine-readable instructions which, when executed by one or more processors associated with a computer-assisted system, are adapted to cause the one or more processors to perform a method according to any one of claims 35-68.
