Apparatus, computer-implemented method and computer program product
Patent Information
- Application Number
- JP2023562330
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-04-14
- Filing Date
- 2022-04-12
- Publication Date
- 2025-03-14
- Estimated Expiration
- 2042-04-12
Smart Images

Figure 0007646026000001 
Figure 0007646026000002 
Figure 0007646026000003
Abstract
Description
[Technical field]
[0001] The present invention relates generally to remote-controlled robotic systems, and more particularly to an apparatus, associated method and computer program for recalibrating the tracking of a robotic instrument relative to a passive controller. [Background technology]
[0002] Remote-controlled robotic systems are used in a variety of applications, particularly those where human access, safety, or both are limited. For example, remote-controlled robotic systems are used in minimally invasive surgery, where access to the surgical site is limited to natural cavities and / or small incisions. Human hands may be too large to access such areas, so small robots controlled remotely by the surgeon may be used instead. Remote-controlled robotic systems are also used in military applications, such as bomb disposal, where the robot can be remotely operated from a safe distance.
[0003] In the following, the invention will be mainly described in relation to a surgical robotic system, however, this is for the purpose of example only and does not exclude the application of the invention in other fields.
[0004] A known remotely controlled surgical robotic system includes a controller and a robotic instrument that allows a user to issue commands to the robotic instrument by manipulating the controller. The known controller includes a base, an articulatable arm coupled to the base and having a number of joints (e.g., a rotatable joint or a prismatic joint), and a handle coupled to the articulatable arm and movable relative to the base by movement of the joint. The known robotic instrument includes a base, an actuatable arm coupled to the base and having a number of joints, and an end effector coupled to the actuatable arm and actuatable relative to the base by movement of the joint.
[0005] The controller and robotic instrument, specifically the handle and end effector, may each move freely within their respective control and instrument workspaces. Additionally, the handle and end effector may each have six degrees of freedom of movement within their respective workspaces, including translational motion along three axes and rotational motion about three axes. The handle and end effector may be considered to have a position within their respective workspace that depends on the translational motion, and an orientation relative to their respective workspace that depends on the rotational motion. Additionally, the position and orientation of the handle or end effector may be combined and considered to be the pose of the handle or end effector.
[0006] The user controls the position and orientation of the handle within the workspace of the controller. (In the following, this may mean "posture") can be manipulated, and the manipulation can be tracked by measuring the movement of each joint in the articulatable arm. The manipulation can be translated into commands for actuating the robotic instrument, and in particular the joints of the actuatable arm, to move in the instrument workspace corresponding to the manipulation of the handle within the controller workspace.
[0007] The known controller is an active controller, meaning that when the robotic system is used, the torque required to rotate each joint of the controller is actively changed by input from the user. For example, when the user releases the controller, the torque of each of the joints may be changed so that the handle is held in the position and orientation last manipulated by the user. In other words, the controller freezes unless the user provides further input, and thus the robotic instrument freezes.
[0008] Furthermore, if the movement of the robotic instrument is limited by its available workspace, corresponding limits can be enforced on the controller, for example by limiting the rotation of a joint beyond a certain point, thereby preventing the controller from becoming displaced from the robotic instrument.
[0009] However, actively varying the torque of each joint in the controller requires the controller to include expensive and bulky components such as servo motors. Thus, known active controllers are expensive to manufacture and lack portability. Furthermore, actively varying the torque at the joints of the controller can lead the user into undesirable and / or unnatural positions, which can frustrate the user and lead to errors.
[0010] The listing or discussion of a previously published document or any background in this specification should not necessarily be construed as an acknowledgement that the document or background is part of the state of the art or is common general knowledge. One or more aspects / embodiments of the present disclosure may or may not address one or more background problems. Summary of the Invention
[0011] According to a first aspect of the present invention, there is provided an apparatus comprising at least one processor and at least one memory containing computer program code, the at least one memory and the computer program code configuring the at least one processor to cause the apparatus to receive a recalibration command from a passive controller configured to remotely control a robotic instrument, the passive controller and the robotic instrument being free to move within respective control and instrument workspaces, the control workspace being mapped to the instrument workspace such that a position of the robotic instrument can track a position of the passive controller as the passive controller moves within the control workspace. and allowing issuance of a recalibration command from the passive controller when the position of the robotic instrument is not compatible with the passive controller. and recalibrating a mapping of the control workspace to the instrument workspace in response to the recalibration command such that a current position of the passive controller corresponds to a current position of the robotic instrument.
[0012] A passive controller is a controller with joints that are free to move without actively varying the torque required to rotate the joint as in active controllers. Passive controllers can have advantages over known active controllers in that they are less expensive to manufacture and smaller and lighter in weight because they do not require expensive, heavy, and / or bulky components such as servo motors. Furthermore, without active variation of joint torques, the user's movements are not biased towards uncomfortable or unnatural postures that may result in suboptimal or unintended commands being sent to an associated robotic instrument.
[0013] However, because a user of a passive controller is free to manipulate the passive controller without artificial constraints within the workspace, the passive controller may be moved to positions that cause it to be misaligned from its associated robotic instrument. For example, differences between the control workspace and the instrument workspace may cause the passive controller to be moved to positions within the control workspace that the robotic instrument cannot replicate in the instrument workspace. Also, the speed at which the robotic instrument can move within the workspace may be limited, such as for safety reasons, and a user of a passive controller may move the passive controller within the control workspace too quickly for the robotic instrument to mirror in the instrument workspace.
[0014] If the position of the passive controller is misaligned with the position of the robotic instrument, the user may have difficulty maintaining accurate control of the robotic instrument because movements of the passive controller in the control workspace may not be accurately mirrored by the robotic instrument in the instrument workspace. In other words, if the position of the passive controller is misaligned with respect to the position of the robotic instrument, control of the robotic instrument may become unintuitive.
[0015] In accordance with the present invention, the mapping of the control workspace to the instrument workspace may be recalibrated such that the current position of the passive controller corresponds to the current position of the robotic instrument. Thus, the position of the passive controller is realigned with the position of the robotic instrument, allowing the user to more easily and accurately control the robotic instrument.
[0016] In embodiments of the invention, the passive controller may include a clutch mechanism configured to allow the position of the passive controller within the control workspace to be changed without causing a corresponding change in the position of the robotic instrument within the instrument workspace, and a recalibration command may be received from the passive controller when the clutch mechanism is engaged or subsequently disengaged. That is, the recalibration command may be received from the passive controller when the robotic instrument and the passive controller become tethered, or later when the robotic instrument and the passive controller become untethered.
[0017] In such an embodiment of the invention, a user of the passive controller can engage a clutch mechanism to stop translational movement of the passive controller in the control workspace which causes a corresponding translational movement of the robotic instrument in the instrument workspace, In other words, while the clutch mechanism is engaged, the robotic instrument will hold the last position it was in prior to engagement of the clutch mechanism, even if the position of the passive controller has changed in the meantime.
[0018] This can be advantageous when a user of a passive controller wants to move the control to a more comfortable or easily accessible location in the control workspace, but wants to keep the robotic instrument in the same location in the instrument workspace. The clutch mechanism also allows a user to take a break from controlling the robotic instrument. For example, during a lengthy surgical procedure, a surgeon may want to take a break to relax muscles that are being used to perform very precise movements and to communicate information and instructions to other members of the surgical team.
[0019] Because the passive controller is movable within the control workspace while the robotic instrument is stationary within the instrument workspace, the passive controller will likely become misaligned with respect to the robotic instrument during engagement of the clutch mechanism. However, by recalibrating the mapping of the control workspace to the instrument workspace when the clutch mechanism is engaged / disengaged, the position of the passive controller is realigned with the position of the robotic instrument. This means that changes made by the user to the position of the passive controller while the clutch mechanism is engaged will have little effect on the precision or intuitiveness with which the user can control the robotic instrument once the clutch mechanism is disengaged.
[0020] In an embodiment of the invention, the passive controller may include an engagement mechanism configured to initiate tracking of the position of the robotic instrument relative to the position of the passive controller, and a recalibration command may be received from the passive controller upon activation of the engagement mechanism. That is, the device may receive a recalibration command from the passive controller once it begins tracking the position of the robotic instrument relative to the position of the passive controller.
[0021] In such an embodiment of the invention, when operation of the robotic instrument is first initiated by a user, the control workspace may be mapped to the instrument workspace such that the current position of the passive controller corresponds to the starting position of the robotic instrument. Thus, the engagement mechanism ensures that the passive controller and the robotic instrument are aligned when the user begins control of the robotic instrument, allowing the user to precisely and intuitively control the passive controller.
[0022] In an embodiment of the invention, the passive controller may include an unlocking mechanism configured to resume tracking of the position of the robotic instrument relative to the position of the passive controller after tracking has been interrupted, and a recalibration command may be received from the passive controller upon activation of the unlocking mechanism. That is, the device may receive a recalibration command from a passive controller when the tracking of the position of the robotic instrument relative to the position of the passive controller is resumed after the tracking has been interrupted.
[0023] In such an embodiment of the invention, when operation of the robotic instrument is interrupted and the user resumes operation, the passive controller and the robotic instrument may be aligned by an unlocking mechanism as well as an engagement mechanism.
[0024] In embodiments of the invention, the orientation of the robotic instrument may track the orientation of the passive controller, and the device may be configured to automatically control the orientation of the robotic instrument to match the orientation of the passive controller upon activation of the engagement or unlocking mechanism. That is, the pose of the robotic instrument tracks the pose of the passive controller, and the device may be configured to automatically control the pose of the robotic instrument such that it is aligned with the pose of the passive controller when the tracking of the position of the robotic instrument relative to the position of the passive controller is initiated or when tracking of the position of the robotic instrument relative to the position of the passive controller is resumed after the tracking has been interrupted.
[0025] When a robotic instrument operation is first initiated or resumed after an interruption in a robotic instrument tracking a passive controller, the orientation of the robotic instrument relative to the instrument workspace will likely be misaligned with the orientation of the passive controller relative to the control workspace. To address this, upon activation of the engagement or unlocking mechanism, the device can automatically control the orientation of the robotic instrument to align it with the current orientation of the passive controller.
[0026] Combined with recalibrating the mapping of the control workspace to the instrument workspace so that the position of the passive controller corresponds to the position of the robotic instrument, both the passive controller and the robotic instrument can be aligned in position and orientation, so that whenever a user starts or resumes manipulation of the robotic instrument, they can start with the position and orientation of the robotic instrument aligned to the position and orientation of the passive controller, ensuring that the user can control the robotic instrument in a comfortable and intuitive manner.
[0027] In an embodiment of the invention, the apparatus may be configured to determine a trajectory of movement of the robotic instrument within the instrument workspace base based on a current orientation of the passive controller to enable said automatic control.
[0028] In such an embodiment of the invention, a trajectory can be determined for moving the robotic instrument such that the orientation of the robotic instrument corresponds as closely as possible to the orientation of the passive controller. Based on the trajectory of movement, commands can be issued to motors that drive the actuation of the robotic instrument, causing the robotic instrument to follow the trajectory of movement.
[0029] In an embodiment of the present invention, the device may be configured to redetermine the trajectory of movement as the current orientation of the passive controller changes.
[0030] In such an embodiment of the invention, the movement trajectory is updated based on the current orientation of the passive controller to make the orientation of the robotic instrument match the current orientation of the passive controller instead of the old and inaccurate orientation of the passive controller, thus preventing misalignment of the orientation due to the movement of the passive controller while the robotic instrument is moving automatically.
[0031] In embodiments of the invention, the robotic instrument may be configured to be repositioned between an initial position and one or more further positions, and the apparatus may be configured to automatically control the positioning of the robotic instrument from the one or more further positions back to the initial position upon activation of the reforming mechanism.
[0032] In such an embodiment of the invention, the initial pose of the robotic instrument may be a combination of rotational positions of each joint that forms a part of the robotic instrument that is held when the robotic instrument is inactive. For example, the initial pose may correspond to a straight arrangement of the joints that is advantageous for inserting and removing the robotic instrument into and from a surgical site. The initial pose may also correspond to a neutral arrangement of the joints that allows the robotic instrument to be easily moved to any position and orientation within the instrument workspace.
[0033] The reforming mechanism provides a means to automatically return the robotic instrument to an initial position from any position that the robotic instrument may have been moved to during use. This may be useful, for example, when a surgeon has completed a surgical procedure and is ready to withdraw the robotic instrument from the surgical site, or when a surgeon has completed a portion of a surgical procedure and wishes to begin the next phase of the procedure with the robotic instrument in a neutral position.
[0034] In an embodiment of the present invention, the alignment of the robotic instrument or During placement, the device may be configured to limit the speed of movement of the robotic instrument to a predetermined magnitude.
[0035] In such embodiments of the invention, automated movements of the robotic instrument may be limited to a speed that allows for proper monitoring of movements by the user and reduces the risk that unsafe movements are made.
[0036] In an embodiment of the invention, an apparatus comprises: Stop the automatic control When an override command is received or alignment or Once placement is complete, the robotic instrument The above It may be configured to disable the automatic control.
[0037] In such an embodiment of the invention, the user may monitor the automatic control until the robotic instrument reaches a desired orientation or posture, at which point the automatic control stops and the user may resume control. If the user believes that the trajectory along which the robotic instrument is moving during automatic control may be unsafe, the user may trigger an override command received by the device. For example, the trajectory of the robotic instrument's movement as determined by the device may bring the robotic instrument too close to the patient's soft tissue. The override command stops the automatic control and allows the user to resume control of the robotic instrument. This allows, for example, the user to navigate the robotic instrument away from the observed hazard, and once the robotic instrument appears to be in a safe position, the interrupted alignment or positioning process can be resumed by the user.
[0038] In an embodiment of the present invention, Passive Controller The device may include a proximity sensor configured to detect the presence or absence of a user, and the device may determine the location of the robotic instrument relative to the location of the passive controller only if the proximity sensor detects the presence of a user. The above It may be configured to initiate tracking.
[0039] In such embodiments of the invention, the proximity sensor may be any suitable type of proximity sensor suitably configured to detect the presence or absence of a user. For example, the passive controller may comprise a hand that is held by a user when manipulating the passive controller. The proximity sensor may form part of a handle and may be configured to detect when the handle is held by a user. An apparatus configured to begin tracking the robotic instrument relative to the passive controller only if the proximity sensor detects the presence of a user may reduce the risk of accidental movement of the passive controller causing a potentially dangerous corresponding movement of the robotic instrument.
[0040] In an embodiment of the invention, the device may be configured to stop the robotic instrument from tracking the position of the passive controller when the proximity sensor detects the absence of the user.
[0041] In such an embodiment of the invention, the movement of the passive controller after the absence of the user is detected is not tracked by the robotic instrument. This is particularly useful, for example, if the user accidentally drops the passive controller. Because the passive controller is passive rather than active, it moves due to gravity when dropped by the user. When used during a surgical procedure, the corresponding movement of the robotic instrument may be harmful to the patient. Thus, a device configured to stop tracking the robotic instrument relative to the passive controller when detecting the absence of the user may improve the safety of the robotic instrument.
[0042] In an embodiment of the invention, the passive controller may be provided with an electronic display screen configured to display a representation of the instrument workspace and the control workspace, and the apparatus may be configured to control the electronic display screen such that the current positions and / or orientations of the robotic instrument and the passive controller are shown within the representations of the respective instrument workspace and control workspace.
[0043] In such an embodiment of the invention, a user can monitor the current positions and / or orientations of the robotic instrument and passive controller within their respective instrument and control workspaces, as well as how the control workspace maps to the instrument workspace. This helps the user understand the degrees of freedom and limitations of movement that the robotic instrument can operate that can inform the user when it would be beneficial to initiate an unlocking or rehoming mechanism. This can also help the user understand, for example, when a passive controller has become misaligned with the robotic instrument or when a clutch mechanism may need to be engaged.
[0044] In an embodiment of the invention, the device may be configured to control an electronic display screen such that the current position and / or orientation is shown in two or three dimensions.
[0045] In such embodiments of the invention, a two-dimensional representation of the current position and / or orientation may be easier for a user to understand and may be particularly useful where the robotic instrument is substantially limited to movement in only two dimensions, whereas a three-dimensional representation of the current position and / or orientation may be more beneficial to a user, particularly where the robotic instrument is free to move in three dimensions.
[0046] The positions (e.g., on an xy coordinate plane) of the robotic instruments and passive controllers may be indicated by points in a two-dimensional representation of the respective instrument and control workspaces, and the orientations may be indicated by arrows radiating from the two-dimensional or three-dimensional points. Additionally, a translation slider bar may be used to indicate the translational position (z) perpendicular to the xy coordinate plane.
[0047] In an embodiment of the invention, the current position and / or orientation of the passive controller and the robotic instrument are determined by the last known position and / or orientation of the passive controller and the robotic instrument relative to the device, respectively. (That is, the most recent period going back from the present) It may be a known position and / or orientation.
[0048] In an embodiment of the invention, the robotic instrument may include an end effector, and the current position of the robotic instrument may be Place , the current position of the end effector and / or the current pose of the robotic instrument is the current pose of the end effector. may be also possible.
[0049] In an embodiment of the invention, the robotic instrument may be a surgical robotic instrument.
[0050] In embodiments of the invention, the device may include a passive controller and / or a robotic instrument.
[0051] According to a second aspect of the invention, there is provided a computer-implemented method comprising receiving a recalibration command from a passive controller configured to remotely control a robotic instrument, the passive controller and the robotic instrument being free to move within respective control and instrument workspaces, the control workspace being mapped to the instrument workspace so as to enable a position of the robotic instrument to track a position of the passive controller as the passive controller moves within the control workspace. and allowing issuance of a recalibration command from the passive controller when the position of the robotic instrument is not compatible with the passive controller. and recalibrating a mapping of the control workspace to the instrument workspace in response to the recalibration command such that a current position of the passive controller corresponds to a current position of the robotic instrument.
[0052] The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated or understood by one of ordinary skill in the art.
[0053] According to a third aspect of the present invention there is provided a computer program (which may or may not be recorded on a carrier) comprising computer code configured to perform the method according to the second aspect of the present invention.
[0054] The present disclosure includes one or more corresponding aspects, example embodiments, or features, whether specifically described (including claimed) in that combination or alone, alone or in various combinations. Corresponding means for carrying out one or more of the discussed functions are also within the scope of the present disclosure.
[0055] The above summary is illustrative only and is not intended to be limiting. [Brief description of the drawings]
[0056] Embodiments of the present invention will now be described, by way of example only, with reference to the accompanying drawings, in which: [Figure 1]FIG. 1 is a schematic diagram of an apparatus according to a first embodiment of the present invention in use; [Diagram 2] FIG. 2 is a schematic diagram of a passive controller forming part of the apparatus shown in FIG. 1; [Diagram 3] FIG. 2 is a schematic diagram of a robotic instrument forming part of FIG. 1. [Figure 4] FIG. 1 is a schematic diagram of the control workspace mapped to the instrument workspace before recalibration. [Diagram 5] FIG. 13 is a schematic diagram of the control workspace mapped to the instrument workspace after recalibration. [Figure 6] 2 is a schematic diagram of a clutch operation that can be performed by the device shown in FIG. 1. [Figure 7] 2A-2C are schematic diagrams of engagement operations that can be performed by the device shown in FIG. 1; [Figure 8] 2A-2C are schematic diagrams of unlocking operations that can be performed by the device shown in FIG. 1; [Figure 9] FIG. 1 is a graph of a global solution to an arbitrary function. [Figure 10] FIG. 10 is a graphical representation of a local solution to the arbitrary function shown in FIG. [Figure 11] FIG. 13 is a graphical illustration of constrained and unconstrained solutions for different arbitrary functions. [Figure 12] FIG. 13 is a graphical illustration of constrained and unconstrained solutions for different arbitrary functions. [Figure 13] FIG. 13 is a graphical illustration of constrained and unconstrained solutions for different arbitrary functions. [Figure 14] FIG. 2 is a schematic diagram of a reforming operation that can be performed by the apparatus shown in FIG. 1. [Figure 15] FIG. 15 is a schematic diagram of a combination of operations shown in FIGS. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0057] Referring initially to Figure 1, an apparatus according to a first aspect of the present invention is generally designated by the reference numeral 2. The apparatus 2 comprises at least one processor and at least one memory containing computer program code. The apparatus 2 is shown being used by a user 4 in an operating room 6 to perform a surgical procedure on a patient 8. The user 4 may thus be a surgeon.
[0058] In this embodiment of the invention, device 2 further comprises a control station 10 including a pair of passive controllers 12 (shown in more detail in FIG. 2), a viewport 14, and a pedal control 16. Each of the passive controllers 12 may be manipulated by a user 4 within a respective control workspace.
[0059] The apparatus includes a monitor 18 and a surgical robot 20 that includes a pair of robotic instruments 22 (one of which is shown in more detail in FIG. 3), a robotic platform 24, and a robotic motor 26. The robotic instruments are mounted to the robotic platform 24, which is positioned to position the robotic instruments within the patient 8. The robotic motor 26 is also mounted to the robotic platform 24 and operably coupled to the robotic instruments to drive movement of the robotic instruments within their respective instrument workspaces.
[0060] The viewport 14 comprises an electronic display screen configured to display a representation of the instrument workspace and the control workspace. The device 2 is further configured to control the electronic display screen 18 such that the current positions and / or orientations of the robotic instrument and the passive controller 12 are shown within the representations of the respective instrument workspace and control workspace. The device 2 is further configured to control the electronic display screen 18 such that the current positions and / or orientations are shown in two or three dimensions.
[0061] The current positions and / or orientations of the passive controller 12 and robotic instrument are the last known positions and / or orientations of the passive controller 12 and robotic instrument, respectively, relative to the apparatus.
[0062] An endoscope 28 is also attached to the robotic platform 24 and inserted into the patient 9. The endoscope 28 can record images of the surgical site including the robotic instruments in use, which can be transmitted via the control station 10 to the viewport 14 and displayed on an electronic display screen. The recorded images can be shown side-by-side with representations of the control and instrument workspaces, or the workspaces can be overlaid on the recorded images. The monitor 18 can display the recorded images, the representations of the control and instrument workspaces, information regarding the status of the apparatus 2, or any suitable combination thereof.
[0063] 2, each passive controller 12 comprises a controller base 30, an articulatable arm 32 coupled to the controller base 30 and comprising a number of controller joints 34, and a handle 36 coupled to the articulatable arm 32 and comprising a gripper 38. Each of the controller joints 34 is freely rotatable, i.e. there is no means to actively vary the torque required to rotate each joint, as there is in known active controllers. The handles 36 are thereby freely movable within their respective control workspaces by the user 4 (as shown in FIG. 1). Furthermore, each passive controller 12, and in particular each handle 36, can be considered to have a position within and an orientation relative to their respective control workspaces.
[0064] Below, embodiments of the invention are described with respect to a single passive controller 12 and corresponding robotic instrument, however, it should be understood that the device may include two or more passive controllers and a corresponding number of robotic instruments.
[0065] Referring now to FIG. 3, a robotic instrument 22 , which is equivalent to the robotic instrument positioned within the patient 8 of FIG. 1, includes an instrument base 40 , an actuatable arm 42 , and an end effector 46 .
[0066] In this embodiment of the invention, the instrument base 40 is a shaft that extends from the robotic platform 24 shown in FIG. 1 and can facilitate proper positioning of the actuatable arm 42 and end effector 46 relative to the patient 8. The actuatable arm 42 is coupled to the instrument base 40 and includes a number of instrument joints 44. Each instrument joint 44 is rotatable and the rotation can be driven by a motor forming part of the robot motor 26 shown in FIG. 1 via tendons that extend from the instrument platform 24 through the instrument base 40 and are attached to the associated instrument joint 44. The end effector 46 is coupled to the actuatable arm 42 and is movable within the instrument workspace by rotation of one or more instrument joints 44. The current position and / or orientation of the robotic instrument 22 includes the current position and / or orientation of the end effector 46.
[0067] The end effector 46 also includes a pair of jaws 48 that are movable between an open and a closed configuration (shown in FIG. 3). The opening and closing of the jaws 48 can be controlled by the user 4 by manipulating the grippers 38 of the corresponding passive controller 12 shown in FIG.
[0068] The instrument workspace in which the end effector 46 is movable is typically very different in scale than the control workspace in which the handle 36 is movable. Furthermore, the location of the instrument joint 44 on the actuatable arm 42 is typically very different from the location of the controller joint 34 on the articulatable arm 32. This means that the shape of the instrument workspace is often different from the shape of the control workspace.
[0069] In use, the control workspace is mapped to the instrument workspace, allowing the position of the robotic instrument 22 to track the position of the passive controller 12 as it is moved by the user within the control workspace. However, due to the differences mentioned above, it is not always possible to perfectly map the control workspace to the instrument workspace. This means that it is possible for the user 4 to move the handle 36 to a position in the control workspace that cannot be replicated by the end effector 46 moving within the instrument workspace.
[0070] 4 shows a two-dimensional representation of the control workspace 50 mapped to the instrument workspace 60. In this example, the passive controller's current position 52 in the control workspace 50 is outside the instrument workspace 60, and the robotic instrument's current position 62 in the instrument workspace 60 is as close as possible to the current controller position 52 while still being within the limits of the instrument workspace 60.
[0071] In this situation, the user may move the controller position 52 to the right, as shown by arrow 53, towards the current instrument position 62, but the instrument remains in the same position. Thus, to the user 4, the robotic instrument 22 may appear to be frozen.
[0072] The device 2, and in particular the at least one processor, memory and computer program code, are configured to receive a recalibration command from a user 4 via the passive controller 12, and in response to the recalibration command, recalibrate the mapping of the control workspace 50 to the instrument workspace 60 such that the current position 52 of the passive controller 12 corresponds to the current position 12 of the robotic instrument.
[0073] 5 shows the mapping of the control workspace 50 to the recalibrated instrument workspace, where the controller position 52 corresponds to the current instrument position 62. Now, if the user 4 moves the passive controller 12 to the right as indicated by arrow 54, a new instrument position can be calculated that corresponds to the new controller position and trajectory of the robotic instrument 22, such that the robotic instrument 22 moves towards the new instrument position, thereby tracking the controller position.
[0074] 6 illustrates how recalibration of the control workspace 50 relative to the instrument workspace 60 can be incorporated into a clutch procedure 104 of the device 2. Normal control 102 represents the device 2 in normal use when the robotic instrument 22 is tracking the position and orientation of the passive controller 12. The clutch procedure 104 can be initiated by the user 4 by pressing the clutch pedal.
[0075] 1, the pedal control 16 includes a clutch mechanism (not shown). The user 4 can engage the clutch mechanism to allow the position of the passive controller 12 within the control workspace to be changed without causing a corresponding change in the position of the robotic instrument 22 (shown in FIG. 3) within the instrument workspace. Engagement of the clutch mechanism thus disengages the robotic instrument 22 from tracking the position, but not necessarily the orientation, of the passive controller 12. During clutched control, the orientation of the robotic instrument 22 can still change depending on the orientation of the passive controller 12.
[0076] In this embodiment of the invention, the clutch mechanism comprises a clutch pedal that is pressed by user 4 to engage the clutch mechanism and then released to disengage the latch mechanism, however, in other embodiments of the invention the clutch mechanism may comprise any suitable means for engagement and disengagement by the user, such as a button, trigger, lever, or voice command system.
[0077] In FIG. 6, when the clutch pedal is pressed, a recalibration command 106 is received and the mapping of the control workspace 50 is recalibrated to the instrument workspace 60 as shown in FIGS. 4 and 5. This ensures that the controller position 52 is aligned with the instrument position 62 before the passive controller 12 moves while the apparatus 2 is in clutched control 108. The initial alignment of the controller position 52 and the instrument position 62 improves the quality of the orientation tracking during clutched control 108. This is because the commands that cause the robotic instrument to move to track the passive controller are calculated to minimize the sum of the squares of the position and orientation tracking errors. In cases where the position tracking error is significant (i.e., a gap between the controller position 52 and the instrument position 62), the orientation tracking error may become irrelevant to the overall tracking error. Thus, the algorithm for calculating the commands to be issued to the robotic instrument is focused on minimizing / maintaining the position tracking error even if the orientation tracking error increases as a result. However, since the positions are now aligned, recalibration reduces the position tracking error to zero by definition. Therefore, the orientation tracking error is the only thing to be minimized, and the algorithm has no incentive to allow the orientation tracking error to increase.
[0078] During clutched control 108, the instrument position 62 (shown in FIGS. 4 and 5) is no longer updated based on changes in the controller position 52, and therefore the instrument position remains stationary. Meanwhile, the user 4 is free to move the passive controller 12, which will change the control position 52 accordingly, likely causing the control position 52 to become misaligned with the instrument position 62.
[0079] When the clutched control 108 is terminated by the user 4 releasing the clutch pedal to disengage the clutch mechanism, another recalibration command 110 is received such that the mapping of the control workspace 50 is again recalibrated to the instrument workspace 60, as shown in Figures 4 and 5. In response, the apparatus 2 returns to normal control 102 and the user 4 can resume position control of the robotic instrument 22 after disengagement of the clutch mechanism, as well as orientation control that was maintained through the clutch operation 104. Furthermore, the new (post-clutch) control position 52 is aligned with the last known instrument position 62 that was determined before engaging the clutch mechanism. This avoids the user 4 from suffering misalignment after the clutch procedure 104, and also prevents the robotic instrument from jerking or jumping to align with the control position 52 immediately after the clutch mechanism is disengaged.
[0080] During engagement of the clutch procedure 104, the user 4 maintains control over the orientation of the robotic instrument 22, and in particular the end effector 46, by manipulating the orientation of the passive controller 12, and in particular the handle 36. However, there are many situations in which the user 4 does not have full control over the orientation of the robotic instrument 22, at least temporarily. For example, when the user 4 begins using the device 2, the initial orientation of the robotic instrument 22 is likely to be different from the orientation of the passive controller 12 being held by the user 4. In such situations, the device 2 is configured to automatically control the orientation of the robotic instrument 22 such that the orientation of the robotic instrument 22 matches the orientation of the passive controller 12.
[0081] During automatic control, the apparatus 2 determines a trajectory of movement of the robotic instrument 22 within the instrument workspace to move the robotic instrument 22 from its current pose to a desired pose. However, since automatic control is subject to recalibration, the main objective of automatic control can be considered to be to move the robotic instrument 22 from its current orientation to a desired orientation. The generated trajectory is transmitted to the robot motors 26 (shown in FIG. 1 ) which actuate the robotic instrument 22 as required. The apparatus 2 is configured to stop automatic control of the robotic instrument 22 when the current pose reaches the desired pose, when the required alignment of the robotic instrument 22 is completed, or when an override command is received. An override command can be initiated by the user 4 at any time during automatic control if the user 4 considers the current trajectory of the robotic instrument 22 to be potentially unsafe.
[0082] The apparatus 2 is configured to limit the speed of the movement of the robotic instrument 22 to a predetermined magnitude during automatic control for alignment of the robotic instrument 22. For example, the speed can be limited to a speed that allows the user 4 to monitor the trajectory of the robotic instrument 22 and verify that the trajectory is not potentially unsafe.
[0083] Because the speed at which the robotic instrument 22 moves during automatic control is limited, the automatic control may not be completed instantaneously. Thus, while the robotic instrument 22 is under automatic control, the user has the opportunity to manually change the position and orientation of the passive controller 12. To help avoid misalignment of the robotic instrument 22, the device may be configured to re-determine the trajectory of movement as the position and orientation of the passive controller 12 change.
[0084] One example of when automatic control may be required is when the user 4 initially takes control of the robotic instrument 22. In Figure 7, when the device 2 is powered up it enters a first state of no control 112, where there is no tracking of the position or orientation of the robotic instrument 22 relative to the position or orientation of the passive controller 12. In this embodiment of the invention, in order for the user 4 to take control of the robotic instrument 22, the user must initiate an engagement procedure 116.
[0085] The passive controller 12 includes an engagement mechanism (not shown) that includes a gripper 38 (shown in FIG. 2) and a proximity sensor (not shown). The engagement mechanism, upon activation by the user 4, begins tracking the position and orientation of the robotic instrument relative to the position and orientation of the passive controller. Let It is configured to:
[0086] The proximity sensor is configured to detect the presence or absence of a user, and the device 2 is configured to begin tracking the position of the robotic instrument relative to the position of the passive controller only if the proximity sensor detects the presence of a user. Thus, the first step for a user to activate the engagement mechanism is to engage the proximity sensor, thereby placing the device 2 in the second state of uncontrolled 114.
[0087] In this embodiment of the invention, the proximity sensor forms part of the handle 36 (shown in FIG. 2) and is configured to detect when the handle 36 is being held by a user 4. However, in other embodiments of the invention, the proximity sensor may be any suitable type of proximity sensor suitably configured to detect the presence or absence of a user.
[0088] The second step by the user 4 to actuate the engagement mechanism is to pinch (i.e., push and release) the gripper 38, thereby initiating the engagement procedure 116. This action indicates that the user 4 has full and intentional control over the passive controller 12.
[0089] In other embodiments of the invention, the engagement mechanism may comprise any suitable means for a user to initiate tracking of the robotic instrument relative to the passive controller, such as, for example, a button, trigger, lever, pedal, or voice command system. Additionally, the engagement mechanism may require a sequence of actions to initiate tracking of the robotic instrument relative to the passive controller, such as, for example, a double tap or triple tap.
[0090] At the start of the engagement procedure 116, a recalibration command 118 is received from the passive controller 12 to align the position of the passive controller 12 with the position of the robotic instrument 22. The device 2 then enters a state of automatic control 120. In this state, the device 2 automatically controls the robotic instrument 22 to align its orientation with that of the passive controller, as described above. Once the automatic control 120 is completed or the user 4 triggers an override command, the device 2 switches from automatic control 120 by the device 2 to normal (manual) control 102 by the user.
[0091] The device 2 is configured to stop the robotic instrument 22 from tracking the position and orientation of the passive controller 12 when the proximity sensor detects the absence of the user 4. Thus, the engagement procedure 116 may be interrupted when the user 4 disengages the proximity sensor, either during the second state of no control 114 or during automatic control 120. Also, during normal control, when the user 4 disengages the proximity sensor, the device 2 exits normal control 102. When the proximity sensor is disengaged, the device 2 returns to the first state of no control 112 until the proximity sensor is re-engaged to restart the engagement procedure 116.
[0092] 8 shows an unlocking procedure that may be used to resume tracking of the position and / or orientation of the robotic instrument relative to the position and / or orientation of the passive controller after tracking has been interrupted. The user 4 may initiate the unlocking procedure 122 for a variety of reasons. For example, the robotic instrument 22 may have frozen because the user 4 is moving the passive controller 12 faster than the limited speed of the robotic instrument. On the other hand, the user may feel that the robotic instrument in a given configuration is out of control because the device 2 has limited the allowed poses of the robotic instrument.
[0093] 1 may include an unlocking mechanism (e.g., an unlocking pedal) that the user 4 can press / engage to trigger the unlocking procedure and then release / disengage to terminate the unlocking procedure. However, in other embodiments of the invention, the unlocking mechanism may include any suitable means for engagement and disengagement by the user, such as a button, trigger, lever, or voice command system.
[0094] In Fig. 8, the user 4 can initiate an unlock procedure 122 by pressing an unlock pedal while the device 2 is in normal control 102. When the unlock pedal is pressed, a recalibration command 124 is received from the passive controller 12 to align the position of the passive controller 12 with that of the robotic instrument 22, as previously described. The device 2 then enters a state of automatic control 126. During automatic control 126, the device 2 generates a trajectory that aligns the pose of the robotic instrument 22 as closely as possible with that of the passive controller 12. Although the positions of the robotic instrument 22 and the passive controller 12 are aligned by a previous recalibration, the determined trajectory may include modifying the position of the robotic instrument 22 if the accuracy of the orientation of the robotic instrument 22 relative to the orientation of the passive controller 12 improves such that the overall pose of the robotic instrument is as close as possible to that of the passive controller.
[0095] In an embodiment of the invention, device 2 uses an inverse kinematics (IK) algorithm to generate commands that cause the robotic instrument to track the pose of the passive controller.
[0096] Numerical IK algorithms can be divided into two subsets: global optimization algorithms and local optimization algorithms. The first explore the entire search space and provide the best possible solution (global solution), while the latter use knowledge of mathematical functions to find an optimal solution close to the initial conditions of the algorithm, i.e. the initial state that is the basis for further calculations.
[0097] An example of a global solution 202 that can be found using the global algorithm is shown in Figure 9 for an arbitrary function 200. This is the global minimum of the function.
[0098] The local algorithm compares the current value of the function with its neighboring values and moves the solution towards smaller values. Furthermore, the local algorithm terminates when all nearby values are higher than the current solution. Figure 10 shows two possible local solutions 204, 206 for the same function 200 based on two different initial conditions 208, 210. One local solution 204 is equivalent to the global solution 202 (shown in Figure 9), while the other local solution 206 is different.
[0099] If the device 2 (shown in FIG. 1) uses a local algorithm when the robotic instrument 22 is already in a local minimum for the desired robotic instrument pose set by the user 4 with the passive controller 12, the local algorithm will continue to return the same local solution (e.g., 206 in FIG. 10) even if a better solution (e.g., 204 in FIG. 10) is possible. As a result, no robotic instrument motions will be executed and the robotic instrument 22 will appear unresponsive to the user 4.
[0100] Although global algorithms appear to be superior to local algorithms because they provide an objectively best answer, local algorithms are often preferred because they are faster, finish within a finite time, and have better smoothness properties, which for purposes of this disclosure may be loosely interpreted as preventing the robotic instrument 22 from jumping or moving in a jerky manner.
[0101] An embodiment of the present invention finds a global solution while benefiting from the effectiveness of the local algorithm by implementing a random shooting approach on the initial conditions of the local algorithm. The local algorithm is restarted multiple times with randomly selected initial conditions. Finally, only the best local solution found is returned from the algorithm.
[0102] During use, various limitations are imposed on the device 2, and in particular the robotic instrument 22. In particular, the position of the end effector 46 is restricted to the instrument workspace. Also, the speed at which the end effector 46 can move may be restricted based on the physical limitations of the robotic instrument 22 or a maximum speed considered safe for a particular application. Taking these limitations into account, constraints are added to the optimization problem that restrict the IK algorithm to a set of feasible solutions. In FIG. 11, a solution is calculated for an arbitrary function 300 based on the current state 301. The feasible solutions are restricted to a constrained region 304 of the arbitrary function 300 by constraints 302. An unconstrained global solution 306 lies outside the constrained region 304 and is therefore infeasible. Meanwhile, a local solution 308 lies within the constrained region 304 and is therefore feasible. There is also a constrained global solution 310 that is within the constrained region 304 and is therefore feasible and is better than the unconstrained local solution 308.
[0103] In Figure 12, based on the same current state 301 and applying the same constraints 302, a solution is calculated for a new arbitrary function 400 to provide a constrained region 404. In this example, an unconstrained global solution 406, similar to that shown in Figure 11, exists outside the constrained region 404 and is therefore infeasible. However, for the arbitrary function 400, a local solution 408 exists, which is the best solution available within the constrained region 404 and is therefore a constrained global solution.
[0104] In Figure 13, a solution is calculated for a further arbitrary function 500 based on the same current state 301, but applying new constraints 502, to provide a constrained region 504. An unconstrained global solution 506, similar to that shown in Figures 11 and 12, lies outside the constrained region 504 and is therefore infeasible. In this case, an unconstrained local solution 508 also lies outside the constrained region 504. A constrained local solution 510 lies within the constrained region 504 and is the best solution available within the constrained region 504, and is therefore a constrained global solution as well as a constrained local solution.
[0105] In an embodiment of the present invention, the IK algorithm includes predefined positional constraints to allow for the computation of partially constrained poses of the robotic instrument 22 that satisfy the positional constraints. The positional constraints may be based on the instrument workspace, which is based on the physical limitations of the robotic instrument 22 ( FIG. 3 ), such as the length of the robotic instrument 22, the feasible range achievable by each joint 44, and the location of each joint 44 along the length of the robotic instrument 22. To ensure that any solution computed by the IK algorithm is physically possible, positional constraints may be constantly applied during use of the apparatus 2, such that all solutions are partially constrained.
[0106] The IK algorithm may further include predefined speed limits to allow for the computation of constrained poses of the robotic instrument 22 that satisfy both position and velocity constraints. The predefined speed limits may be based on a maximum speed of the robotic instrument 22 that is deemed safe and allows the user to have the ability to monitor the movement, measure the trajectory, and override the movement if potentially unsafe.
[0107] Under normal conditions, when the apparatus 2 is in use, the robotic instrument 22 is limited to constrained poses that satisfy both position and velocity constraints. Under such conditions, the IK algorithm is used to calculate a constrained global solution, i.e., the best possible solution with the constraints applied. However, the IK algorithm may simultaneously calculate a partially constrained global solution that is limited only with respect to the position constraints.
[0108] Activation of the unlocking mechanism allows the device 2 to check whether the current constrained pose of the robotic instrument, based on the constrained global solution calculated by the IK algorithm, is equivalent to the simultaneously calculated partially constrained global solution, i.e., a partially constrained pose based on the best available solution within the position constraints of the robotic instrument. If not, the device moves the robotic instrument to the partially constrained pose.
[0109] To avoid sudden and unexpected movement of the robotic instrument 22 when the unlocking mechanism is activated, the automatic control may be limited as described above. Once the determined trajectory is completed, the device 2 returns to normal control 102.
[0110] As the unlock procedure 122 is being performed while the user is manipulating the passive controller 12, it is likely that the passive controller will move while the automatic control 126 is taking place. To avoid mismatches in the position and / or orientation of the passive controller 12 and the robotic instrument 22, the determined trajectory is updated throughout the unlock procedure, as previously described. Furthermore, if the unlock pedal is released at any point before the device 2 returns to normal control 102, the device 2 immediately returns to normal (manual) control 102. Thus, releasing the unlock pedal is equivalent to triggering an override command, as shown in FIG. 7.
[0111] In an embodiment of the invention, the robotic instrument 22 may be configured to be repositioned between an initial position and one or more further positions, and the apparatus 2 may be configured to automatically control the positioning of the robotic instrument 22 from the one or more further positions back to the initial position upon activation of the rehoming mechanism.
[0112] In such an embodiment, the initial pose of the robotic instrument 22 may be a combination of rotational positions of each joint 44 that forms a part of the robotic instrument 22 that is held when the robotic instrument 22 is inactive. For example, the initial pose may correspond to a straight arrangement of the joints 44 (as shown in FIG. 3 ) that is advantageous for inserting and removing the robotic instrument 22 into and from a surgical site. The initial pose may also correspond to a neutral arrangement of the joints 44 in which the robotic instrument 22 is easily movable to any position and orientation within the instrument workspace.
[0113] The rehoming mechanism provides a means for automatically returning the robotic instrument 22 to an initial position from any position that the robotic instrument 22 may have moved to during use. This may be useful, for example, when a surgeon has completed a surgical procedure and is ready to withdraw the robotic instrument 22 from the surgical site, or when a surgeon has completed a portion of a surgical procedure and wishes to begin the next phase of the procedure with the robotic instrument 22 in a neutral position.
[0114] The rehoming mechanism may include a clutch pedal and an unlock pedal, and may be activated by pressing the clutch pedal and the unlock pedal in a predetermined sequence. In FIG. 14, the user 4 may initiate the rehoming procedure 130 by first pressing the clutch pedal. According to the clutch procedure 104 shown in FIG. 6, pressing the clutch pedal causes a recalibration command 106 to be received and the mapping of the control workspace 50 to the instrument workspace 60 is recalibrated as shown in FIGS. 4 and 5. The device 2 then enters the clutched control 108. While the clutched control 108 is active, the user 4 may press, release, and press the unlock pedal again within three seconds to initiate the rehoming procedure 130.
[0115] In other embodiments of the invention, the rehoming mechanism comprises any suitable means for user activation, such as a separate pedal, button, trigger, lever, or voice command, etc. Also, different combinations or sequences of user interactions with other means, such as a clutch pedal and unlock pedal, can be used to initiate the rehoming procedure 130, and different time periods can be provided for the combination or sequence of actions taken.
[0116] Once the rehoming procedure 130 is initiated, the apparatus 2 initiates automatic control 132 similar to the automatic controls 120, 126 shown in Figures 7 and 8, except that a movement trajectory for the robotic instrument 22 is determined to move the robotic instrument 22 to the initial pose. Additionally, the apparatus 2 may be configured to limit the speed of movement of the robotic instrument 22 to a predetermined magnitude when returning the robotic instrument 22 to the initial pose.
[0117] In contrast to the automatic control 120 shown in Fig. 7, once the trajectory ends or the user 4 triggers an override command by releasing the clutch or unlock pedal, the device 2 enters a second state of no control 114 shown in Fig. 7. In order for the user 4 to regain control of the robotic instrument, he or she needs to pinch the gripper 38 to initiate an engagement procedure 116 shown in Fig. 7. This is because the robotic instrument 22 may have been significantly misaligned from the passive controller 12 when positioning the robotic instrument for its initial pose.
[0118] FIG. 15 illustrates one possible process flow that enables the device 2 to perform each of the operations illustrated in FIGS. 6-8 and 14. According to FIG. 7, the device 2 is configured to stop the robotic instrument 22 from tracking the position and orientation of the passive controller 12 when the proximity sensor detects the absence of the user 4. Thus, either during the second state of no control 114 or during automatic control 120 / 126, the engagement procedure 116 / unlock procedure 122 may be interrupted when the user 4 disengages the proximity sensor. Also, during normal control, when the user 4 disengages the proximity sensor, the device 2 exits normal control 102. Furthermore, during the rehoming procedure 130, when the user disengages the proximity sensor, the device 2 exits automatic control 132. In either case, when the proximity sensor is disengaged, the device 2 returns to the first state of no control 112 until the proximity sensor is reengaged to start the engagement procedure 116 again.
[0119] The applicant discloses each individual feature described herein alone, and any combination of two or more such features, regardless of whether such feature or combination of features solves the problems disclosed herein, and to the extent that such feature or combination can be implemented based on the present specification as a whole in light of the common general knowledge of those skilled in the art, without limiting the scope of the claims. The applicant suggests that the disclosed aspects / embodiments can be composed of any such feature or combination of features. In view of the foregoing description, it will be apparent to those skilled in the art that various modifications can be made within the scope of the present disclosure.
Claims
1. An apparatus comprising: At least one processor; and at least one memory containing computer program code, the at least one memory and the computer program code being configured by the at least one processor to cause the device to: receiving a recalibration command from a passive controller configured to remotely control a robotic instrument, the passive controller and robotic instrument being free to move within respective control and instrument workspaces, the control workspace being mapped to the instrument workspace to enable a position of the robotic instrument to track a position of the passive controller as the passive controller moves within the control workspace, and allowing issuance of a recalibration command from the passive controller when the position of the robotic instrument cannot correspond to the passive controller; and configured to cause, in response to the recalibration command, to recalibrate a mapping of the control workspace to the instrument workspace such that a current position of the passive controller corresponds to a current position of the robotic instrument.
2. 2. The apparatus of claim 1, wherein the passive controller is selectively capable of being in a tethered state between the robotic instrument and the passive controller and a untethered state between the robotic instrument and the passive controller, and is configured to allow a position of the passive controller to change within the control workspace without causing a corresponding change in a position of the robotic instrument within the instrument workspace when the robotic instrument and the passive controller are in a tethered state or when the robotic instrument and the passive controller are subsequently in an untethered state, and the recalibration command is received from the passive controller when the robotic instrument and the passive controller are in a tethered state or when the robotic instrument and the passive controller are in an untethered state.
3. The apparatus of claim 1, characterized in that the apparatus receives the recalibration command from the passive controller when tracking of the position of the robotic instrument relative to the position of the passive controller begins.
4. The apparatus of claim 3, characterized in that the apparatus receives the recalibration command from the passive controller when tracking of the position of the robotic instrument relative to the position of the passive controller is resumed after the tracking is interrupted.
5. 5. The apparatus of claim 4, wherein the pose of the robotic instrument tracks the pose of the passive controller, and the apparatus is configured to automatically control the pose of the robotic instrument such that the pose of the robotic instrument is aligned with the pose of the passive controller when the tracking of the position of the robotic instrument relative to the position of the passive controller is started or when tracking of the position of the robotic instrument relative to the position of the passive controller is resumed after the tracking has been interrupted.
6. 6. The apparatus of claim 5, wherein the apparatus is configured to determine a trajectory of movement of the robotic instrument within the instrument workspace based on a current pose of the passive controller to enable the automatic control.
7. The apparatus of claim 6 , wherein the apparatus is configured to redetermine the trajectory of movement when a current pose of the passive controller changes.
8. 2. The apparatus of claim 1, wherein the robotic instrument is configured to reposition between an initial posture and one or more further postures, and the apparatus is configured to automatically control a configuration of the robotic instrument such that the configuration of the robotic instrument reverts from the one or more further postures to the initial posture upon activation of a rehoming mechanism.
9. 6. The apparatus of claim 5, wherein the apparatus is configured to limit a speed of movement of the robotic instrument to a predetermined magnitude during alignment or positioning of the robotic instrument.
10. 6. The apparatus of claim 5, wherein the apparatus is configured to stop the automated control of the robotic instrument upon receiving an override command to stop the automated control or upon completion of alignment or positioning.
11. The apparatus of claim 3, wherein the passive controller includes a proximity sensor configured to detect the presence or absence of a user, and the apparatus is configured to begin tracking the position of the robotic instrument relative to the position of the passive controller only if the proximity sensor detects the presence of a user.
12. 12. The apparatus of claim 11, wherein the apparatus is configured to stop the robotic instrument from tracking the position of the passive controller when the proximity sensor detects the absence of a user.
13. 13. Apparatus according to any one of claims 1 to 12, characterized in that the passive controller comprises an electronic display screen configured to display a representation of an instrument workspace and a control workspace, the apparatus being configured to control the electronic display screen such that the current positions and / or poses of the robotic instrument and passive controller are shown within the representations of the respective instrument workspace and control workspace.
14. 14. Apparatus according to claim 13, characterized in that the apparatus is configured to control an electronic display screen such that the current position and / or orientation is shown in two or three dimensions.
15. 13. The apparatus of any one of claims 1 to 12, wherein the current positions and / or orientations of the passive controller and robotic instrument are the most recently known positions and / or orientations, respectively, of the passive controller and robotic instrument relative to the apparatus in a time period preceding the current.
16. the robotic instrument comprises an end effector; The apparatus according to any one of claims 1 to 12, characterized in that the current position of the robotic instrument is a current position of the end effector and / or the current pose of the robotic instrument is a current pose of the end effector.
17. The apparatus of any one of claims 1 to 12, wherein the robotic instrument is a surgical robotic instrument.
18. Apparatus according to any one of claims 1 to 12, characterized in that the apparatus comprises a passive controller and / or a robotic instrument.
19. 1. A computer-implemented method comprising: receiving a recalibration command from a passive controller configured to remotely control a robotic instrument, the passive controller and robotic instrument being free to move within respective control and instrument workspaces, the control workspace being mapped to the instrument workspace to enable a position of the robotic instrument to track a position of the passive controller as the passive controller moves within the control workspace, and allowing issuance of a recalibration command from the passive controller when the position of the robotic instrument cannot correspond to the passive controller; and recalibrating a mapping of the control workspace to the instrument workspace in response to the recalibration command such that a current position of the passive controller corresponds to a current position of the robotic instrument.
20. 20. A computer program comprising computer code configured to perform the method of claim 19.
Citation Information
Patent Citations
Manipulator controller
JP2001145638A
Master-slave manipulator system
JP2008228967A
Manipulator calibration method, manipulator, and manipulator system
JP2015163413A
System and method for re-centering imaging devices and input controls
JP2020022806A
Surgery system and display method
JP2020048708A