Display system for a robotic surgical system - Patents.com
The display system for robotic surgical systems addresses the lack of advanced GUIs in conventional systems by providing comprehensive real-time monitoring and control of medical devices, enhancing surgical efficiency and safety through intuitive graphical indicators.
Patent Information
- Application Number
- JP2024519495
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-11-30
- Filing Date
- 2022-11-29
- Publication Date
- 2024-11-19
AI Technical Summary
Conventional robotic surgical systems, particularly for endoluminal and single-site procedures, lack advanced display systems that provide comprehensive and intuitive graphical user interfaces (GUIs) to enhance the control and monitoring of medical devices, leading to potential inefficiencies and risks during minimally invasive surgeries.
A display system for robotic surgical systems that includes a GUI displaying information on medical devices, featuring indicators for equipment status, position, and orientation, along with simulated representations and real-time feedback, enhancing user control and safety.
The GUI provides real-time monitoring and control of medical devices, reducing the risk of errors and improving the efficiency and safety of minimally invasive surgeries by offering clear visual feedback on device positions and orientations.
Smart Images

Figure 2024542925000001_ABST
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to and the benefit of U.S. Provisional Application No. 63 / 284,125, filed November 30, 2021, the entire contents of which are incorporated herein by reference in their entirety.
[0002] Field The present disclosure relates to robotic surgical systems for minimally invasive surgery, including, for example, without limitation, endoluminal and single site surgery. [Background technology]
[0003] background Minimally invasive surgical procedures, such as intraluminal and single-site robotic surgery, offer significant advantages over traditional robotic surgery. For example, intraluminal robotic surgery does not require incisions to access difficult to access locations within the patient's native cavity. This dramatically reduces and / or eliminates recovery time and improves procedural safety. Single-site systems reduce incisions to a minimal, single site, thereby reducing otherwise numerous access incisions during a particular procedure.
[0004] Certain intraluminal and single-site robotic surgical systems have been proposed. Examples of such systems and related components can be found in U.S. Patent No. 10,881,422, as well as U.S. Patent Application Publication Nos. 20210322046, 20210322045, 20190117247, 20210275266, 20210267702, 20200107898, 20200397457, 202000397456, 20200315645, and 201962914226, all of which are incorporated herein by reference in their entirety.
[0005] Conventional surgical robots and systems have generally been considered satisfactory for their intended purposes. However, there remains a need in the art for improved robotic surgical systems, devices, methods, controls, and components, particularly those configured for intraluminal and single-site surgery. The present disclosure, for example, provides improvements in such areas. Summary of the Invention
[0006] overview According to at least one aspect of the present disclosure, a display system for a robotic surgical system can include a display module configured to display a graphical user interface (GUI) on a display to provide information regarding one or more medical instruments. The GUI can include an image display area for displaying an image from a videoscope extending from the overtube, a first instrument simulator configured to present a first simulated representation of the one or more medical instruments extending from the overtube from a first elevation, and a second instrument simulator configured to present a second simulated representation of the one or more medical instruments extending from the overtube from a second elevation different from the first elevation.
[0007] The GUI can include instrument control indicators including at least one of an instrument name indicator, a connection status indicator for indicating connection of the instrument to the hub, an attachment status indicator for indicating attachment of the instrument to the robotic instrument controller, an instrument life indicator, and / or one or more instrument specific actuation indicators. The GUI can include a system clutch indicator for indicating whether a clutch of the system is active for disengagement actuation of one or more medical instruments, videoscopes, and / or overtubes of the system. The GUI can include a finger clutch indicator for indicating whether a finger clutch is pressed for disengagement actuation of one or more medical instruments associated with the finger clutch. The GUI can include notification indicators for displaying notifications to a user, the notification indicators being at a center and bottom of the display.
[0008] The GUI can include an overtube translation indicator configured to indicate an amount the overtube has translated and / or whether the translation is within one or more overtube translation limits. The GUI can include an overtube roll indicator for the overtube configured to indicate an amount of roll of the overtube and / or whether the roll of the overtube is within one or more overtube roll limits. The GUI can include an overtube deflection indicator for the overtube configured to indicate an amount of deflection of the overtube in a horizontal and / or vertical plane and / or whether the deflection of the overtube is within one or more overtube deflection limits. The GUI can include a videoscope deflection indicator for the videoscope configured to indicate an amount of deflection of the videoscope in a horizontal and / or vertical plane and / or whether the deflection of the videoscope is within one or more videoscope deflection limits. The GUI can include a videoscope shape indicator for the videoscope that can be configured to indicate an amount of deflection of a distal segment and an amount of deflection of a proximal segment of the videoscope.
[0009] The GUI can include an instrument roll indicator for each medical instrument configured to indicate an amount of instrument roll and / or whether the instrument roll is within one or more limits. The GUI can include an instrument translation indicator for each medical instrument configured to indicate an amount of instrument translation and / or whether the instrument translation is within one or more instrument translation limits.
[0010] In accordance with at least one aspect of the present disclosure, a robotic surgical system can include a user console including a display and one or more input devices. The robotic surgical system can include any suitable embodiment of a display system disclosed herein, such as those described above.
[0011] In accordance with at least one aspect of the present disclosure, the method may include calculating a position and / or orientation of a robotically controlled elongated surgical device and generating one or more manifestation images of the elongated surgical device indicative of the position and / or orientation of the elongated surgical device relative to a neutral position. Calculating the position and / or orientation may include estimating the position and / or orientation of the elongated surgical device using equipment controller information. In certain embodiments, generating the one or more manifestation images may include generating a plurality of two-dimensional indicators configured to indicate one or more of pitch, yaw, and roll.
[0012] In certain embodiments, the method may further include generating a color indicator that changes color based on a position of the one or more manifestation images relative to one or more limits away from a neutral position. The color indicator may be associated with the manifestation image of the elongated device. The color indicator may be located adjacent to or around the manifestation image.
[0013] These and other features of the embodiments of the present disclosure will become more readily apparent to those skilled in the art from the following detailed description taken in conjunction with the drawings. [Brief description of the drawings]
[0014] In order that those skilled in the art to which this disclosure pertains may readily understand how to make and use the disclosed apparatus and method without undue experimentation, embodiments thereof will be described in detail below with reference to certain figures. [Figure 1] FIG. 1 is a perspective view of an embodiment of a system according to the present disclosure. [Figure 2A] 1 illustrates an embodiment of a graphical user interface according to the present disclosure. [Figure 2B] 1 illustrates an embodiment of a graphical user interface according to the present disclosure. [Diagram 3]FIG. 3A illustrates a first instrument simulator embodiment according to the present disclosure, and FIG. 3B illustrates a second instrument simulator embodiment according to the present disclosure. [Figure 4] 1 illustrates an embodiment of an equipment control indicator according to the present disclosure. [Figure 5A] 1 illustrates an embodiment of one or more device control indicators in various states according to the present disclosure. [Figure 5B] 1 illustrates an embodiment of one or more device control indicators in various states according to the present disclosure. [Figure 5C] 1 illustrates an embodiment of one or more device control indicators in various states according to the present disclosure. [Figure 5D] 1 illustrates an embodiment of one or more device control indicators in various states according to the present disclosure. [Figure 6] 1 illustrates an embodiment of a finger clutch indicator according to the present disclosure. [Figure 7] 1 illustrates an embodiment of a clutch indicator for a system according to the present disclosure. [Figure 8] 1 illustrates an embodiment of a notification indicator according to the present disclosure, indicating various states. [Figure 9A] 1 illustrates an embodiment of an overtube translation indicator according to the present disclosure. [Figure 9B] 9A in the context of an embodiment of a user input and system output according to the present disclosure. [Figure 10A] 1 illustrates an embodiment of an overtube roll indicator according to the present disclosure. [Figure 10B] 10B illustrates the embodiment of FIG. 10A in the context of a clockwise user input and system output embodiment according to the present disclosure. [Figure 10C] 10B illustrates the embodiment of FIG. 10A in the context of a counterclockwise user input and system output embodiment according to the present disclosure. [Figure 11A] 1 illustrates an embodiment of an overtube deflection indicator according to the present disclosure, showing various conditions. [Figure 11B]11A in the context of an embodiment of a user input and system output according to the present disclosure. [Figure 11C] 11A in the context of an embodiment of a user input and system output according to the present disclosure. [Figure 12A] 1 illustrates an embodiment of a videoscope deflection indicator according to the present disclosure, showing various conditions. [Figure 12B] 12A in the context of an embodiment of a user input and system output according to the present disclosure. [Figure 12C] 12A in the context of an embodiment of a user input and system output according to the present disclosure. [Figure 13] 1 illustrates an embodiment of an instrument roll indicator according to the present disclosure, showing various states. [Figure 14] 1 illustrates an embodiment of a videoscope shape indicator according to the present disclosure, showing various states. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] Detailed Description Reference is now made to the drawings, in which like reference numerals identify like structural features or aspects of the present disclosure. For purposes of explanation and illustration, and not limitation, an illustrative diagram of an embodiment of a graphical user interface (GUI) according to the present disclosure is shown in Figure 1 and generally designated by the reference numeral 100. Other embodiments and / or aspects of the present disclosure are shown in Figures 2A through 14.
[0016] According to at least one aspect of the present disclosure, and with reference to FIGS. 1-14, a display system 100 for a robotic surgical system (e.g., an endoluminal robotic system) can include a display module 101 configured to display a graphical user interface (GUI) 200 on a display 103 to provide information regarding one or more medical instruments 105 (e.g., a robotically controlled endoscopic tool). FIG. 1 is a perspective view of an embodiment of a system according to the present disclosure. The display module 101 can be operatively connected to any suitable feedback system, control module, input, and / or output of the robotic surgical system to receive any data related to the GUI 200 and / or indicators disclosed herein (e.g., as described below). Any module disclosed herein can be or include any suitable hardware and / or software module configured to perform any suitable function (e.g., as disclosed herein).
[0017] 2A and 2B show an embodiment of a graphical user interface according to the present disclosure. GUI 200 can include an image display area 201 for displaying images from a videoscope 1200 extending from an overtube 1100 (e.g., depicted as a surgical scene in FIG. 2A or a video stream in FIG. 2B), which can include a flexible, elongated insertion tube having one or more instrument channels for advancing / retracting medical devices therein (e.g., as shown in FIG. 11B and 11C).
[0018] 2A-3B, the GUI 200 may also include a first instrument simulator 31 configured to present a first simulated representation of one or more medical devices 105 extending from the overtube 1100 from a first elevation (e.g., a left view instrument simulator as shown in FIG. 3A) and a second instrument simulator 32 configured to present a second simulated representation of one or more medical devices 105 extending from the overtube 1100 from a second elevation different from the first elevation (e.g., an orthogonal view such as the right view instrument simulator of FIG. 3B). Any suitable relative views are contemplated herein.
[0019] With further reference to FIGS. 4-5D, the GUI 200 may include instrument control indicators 1 including, for example, at least one of an instrument name indicator, a connection status indicator to indicate the instrument's connection to a hub, an attachment status indicator to indicate the instrument's attachment to a robotic instrument controller, an instrument life indicator, and / or one or more instrument specific operation indicators (e.g., primary and secondary energy operation as shown). Any suitable instrument control indicators are contemplated herein. In certain embodiments, the instrument life may be fixed (e.g., a fixed number of objectively determined uses of the device). In certain embodiments, the instrument life may be variable, for example, depending on one or more physical factors (e.g., actual / objectively determined wear) and / or manufacturer requirements.
[0020] With further reference to Figure 6, the GUI 200 can include a finger clutch indicator 2 for indicating whether a finger clutch is pressed for disengagement actuation of one or more medical instruments 105 associated with the finger clutch. With further reference to Figure 7, the GUI 200 can include a system clutch indicator 4 for indicating whether a system clutch is active for disengagement actuation of one or more medical instruments 105, the overtube 1100, and / or the videoscope 1200 of the system.
[0021] 8, the GUI 200 may include a notification indicator 5 for displaying notifications to the user, the notification indicator being at the center and bottom of the display. The notification indicator 5 may include less than full opacity and / or may change color depending on the message content, for example as shown.
[0022] 9A and 9B, the GUI 200 can include an overtube translation indicator 6 configured to indicate the amount that the overtube 1100 (shown attached to the mobile patient cart / console 902) has translated (e.g., axial limit) and / or whether the translation is within one or more overtube translation limits (e.g., limits shown as depicted). Any suitable color-coded change in the indicator depending on proximity to the limits is contemplated herein.
[0023] 10A-10C, GUI 200 can include an overtube roll indicator 7 for overtube 1100 configured to indicate the amount of roll of overtube 1100 and / or whether the roll of overtube 1100 is within one or more overtube roll limits (e.g., color coded according to percentages of minimum and maximum rolls). In certain embodiments, image display area 201 can include an auxiliary roll indicator 7A at the edge of the image, for example as shown.
[0024] 11A-11C, GUI 200 can include an overtube deflection indicator 8 for overtube 1100 configured to indicate an amount of deflection of overtube 1100 in a horizontal and / or vertical plane (e.g., both as shown) and / or whether the deflection of overtube 1100 is within one or more overtube deflection limits (e.g., color coded according to percentages of minimum and maximum deflection). With further reference to FIGS. 12A-12C, GUI 200 can include a videoscope deflection indicator 9 for videoscope 1200 configured to indicate an amount of deflection of videoscope 1200 in a horizontal and / or vertical plane (e.g., both as shown) and / or whether the deflection of videoscope 1200 is within one or more videoscope deflection limits (e.g., color coded according to percentages of minimum and maximum deflection).
[0025] 13, the GUI 200 can include an instrument roll indicator 10 for each medical instrument 105 configured to indicate the amount of instrument roll and / or whether the instrument roll is within one or more limits (e.g., color-coded according to a percentage of minimum and maximum roll). The instrument roll indicator 10 can be a line surrounding an image (simulated or actual) of the attached medical instrument 105. For example, the line can gradually fill with more rolls present and can change color (e.g., blue, yellow, orange, red) depending on the fill rate. The GUI 200 can include an instrument translation indicator 11 for each medical instrument configured to indicate the amount the instrument has translated and / or whether the instrument translation is within one or more instrument translation limits (e.g., color-coded according to a percentage of minimum and maximum translation).
[0026] 14, the GUI 200 may include a videoscope shape indicator 13 for the videoscope 1200, which may also be configured to indicate an amount of deflection of the distal segment 1200b and an amount of deflection of the proximal segment 1200a of the videoscope 1200. In certain embodiments, the videoscope indicator 13 may be integrated with, for example, the first instrument simulator 31 and / or the second instrument simulator 32 (e.g., as shown). In certain embodiments, the videoscope indicator 13 may be separate from, for example, the first instrument simulator 31 and / or the second instrument simulator 32. In certain embodiments, the videoscope shape indicator 13 may be configured to present a simulated representation of the videoscope in a deflected state (e.g., a cobra shape as shown), as well as to present a simulated line indicating an amount of deflection of the distal segment and an amount of deflection of the proximal segment of the videoscope 1200.
[0027] In accordance with at least one aspect of the present disclosure, a robotic surgical system (e.g., an endoluminal robotic surgical system) can include a user console 99 with a display and one or more input devices 97a, 97b (e.g., a left hand controller and / or a right hand controller). The robotic surgical system can include any suitable embodiment of the display systems disclosed herein, such as system 100 described above.
[0028] In accordance with at least one aspect of the present disclosure, the method may include calculating a position and / or orientation of a robotically controlled elongated surgical device and generating one or more manifestation images of the elongated surgical device indicative of the position and / or orientation of the elongated surgical device relative to a neutral position. Calculating the position and / or orientation may include estimating the position and / or orientation of the elongated surgical device using equipment controller information. In certain embodiments, generating the one or more manifestation images may include generating a plurality of two-dimensional indicators configured to indicate one or more of pitch, yaw, and roll.
[0029] In certain embodiments, the method may further include generating a color indicator that changes color based on a position of the one or more manifestation images relative to one or more limits away from a neutral position. The color indicator may be associated with the manifestation image of the elongated device. The color indicator may be located adjacent to or around the manifestation image.
[0030] An embodiment of the GUI 200 may include relative positions of the illustrated indicators that have advantageous ergonomic positions. An embodiment of the GUI 200 may include shapes of each illustrated indicator that may have functional advantages. Any suitable combinations and / or other arrangements and / or shapes of indicators are contemplated herein.
[0031] Particular embodiments of the GUI and / or indicators are disclosed above. Any other suitable GUI and / or indicators therefor are contemplated herein.
[0032] As will be appreciated by those skilled in the art, aspects of the present disclosure may be embodied as a system, method, or computer program product. Accordingly, aspects of the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects, all possibilities of which may be referred to herein as a "circuit," "module," or "system." A "circuit," "module," or "system" may include one or more portions of one or more separate physical hardware and / or software components that together may perform the disclosed functions of the "circuit," "module," or "system," or a "circuit," "module," or "system" may be a single self-contained unit (e.g., of hardware and / or software). Additionally, aspects of the present disclosure may take the form of a computer program product embodied in one or more computer-readable medium(s) having computer-readable program code embodied therein.
[0033] Any combination of one or more computer readable media may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof. More specific examples (non-exhaustive list) of computer readable storage media include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the context of this specification, a computer readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.
[0034] A computer-readable signal medium may include a propagated data signal having computer-readable program code embodied therein, for example in baseband or as part of a carrier wave. Such a carrier signal may take any of a variety of forms, including but not limited to electromagnetic, optical, or any suitable combination thereof. A computer-readable signal medium is not a computer-readable storage medium, but may be any computer-readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
[0035] The program code embodied in the computer readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, fiber optic cable, RF, etc., or any suitable combination thereof.
[0036] Computer program code for carrying out operations for aspects of the present disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as the "C" programming language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer, partially on a remote computer, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).
[0037] Aspects of the present disclosure may be described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. It will be understood that each block of any flowchart illustration and / or block diagram, and combinations of blocks in any flowchart illustration and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided in a processor of a general purpose computer, a special purpose computer, or other programmable data processing device to produce a machine, such that the instructions, executed via a processor of the computer or other programmable data processing device, create means for performing the functions / acts specified in one or more blocks of any flowchart and / or block diagram.
[0038] These computer program instructions may also be stored on a computer-readable medium that can direct a computer, other programmable data processing apparatus, or other device to function in a particular manner, such that the instructions stored on the computer-readable medium produce an article of manufacture that includes instructions that implement the functions / acts specified in one or more blocks of the flowcharts and / or block diagrams.
[0039] The computer program instructions may also be loaded into a computer, other programmable data processing apparatus, or other device to cause the computer, other programmable apparatus, or other device to perform a series of operational steps to realize a computer-implemented process, such that the instructions executing on the computer or other programmable apparatus perform a process for performing the functions / operations described herein.
[0040] Those skilled in the art will understand that any numerical value disclosed herein may be an exact value or may be within a range of values. In addition, any approximation term used in this disclosure (e.g., "about," "approximately," "around") may mean a stated value within a range. For example, in certain embodiments, the range may be within 20% (plus or minus), or within 10%, or within 5%, or within 2%, or within any other suitable percentage or number as understood by those skilled in the art (e.g., for known acceptable limits or margins of error).
[0041] As used in this specification and the appended claims, the articles "a," "an," and "the" are used herein to refer to one or to more than one (i.e., to at least one) of the grammatical object of the article, unless the context clearly dictates otherwise. By way of example, "an element" means one or more elements.
[0042] The phrase "and / or" as used herein and in the claims should be understood to mean "either or both" of the elements so conjoined, i.e., elements that are present conjunctively in some cases and disjunctively in other cases. Multiple elements listed with "and / or" should be construed in the same manner, i.e., "one or more" of the elements so conjoined. Other elements, whether related or unrelated to the elements specifically identified, may optionally be present other than the elements specifically identified by the "and / or" clause. Thus, as a non-limiting example, a reference to "A and / or B," when used in conjunction with open-ended language such as "comprising," can refer in one embodiment to only A (optionally including elements other than B), in another embodiment to only B (optionally including elements other than A), in yet another embodiment to both A and B (optionally including other elements), and so forth.
[0043] "Or" as used in this specification and claims should be understood to have the same meaning as "and / or" defined above. For example, when separating items in a list, "or" or "and / or" should be interpreted as inclusive, i.e., including at least one of, but also including more than one of, and optionally including additional unlisted items. Only terms that are clearly denoted as not having the same, such as "only one of" or "exactly one of," or "consisting of" when used in the claims, refer to the inclusion of exactly one element of a plurality of elements or a list of elements. In general, the term "or" as used herein, when preceded by an exclusive term such as "either," "one of," "only one of," or "exactly one of," should be interpreted as indicating exclusive alternatives (i.e., "one or the other, but not both").
[0044] Any suitable combination of any of the disclosed embodiments and / or any suitable portions thereof, as would be understood by one of ordinary skill in the art in light of the present disclosure, is contemplated herein.
[0045] The embodiments of the present disclosure, as described above and illustrated in the drawings, provide improvements upon the art to which they pertain. Although the present disclosure includes reference to specific embodiments, those skilled in the art will readily appreciate that changes and / or modifications can be made without departing from the spirit and scope of the present disclosure.
Claims
1. 1. A display system for a robotic surgical system, comprising: a display module configured to display a graphical user interface (GUI) on a display to provide information regarding one or more medical devices, the GUI comprising: an image display area extending from the overtube for displaying an image from the videoscope; a first instrument simulator configured to present a first simulated representation of one or more medical instruments extending from the overtube from a first elevational view; and a second instrument simulator configured to present a second simulated representation of the one or more medical devices extending from the overtube from a second elevation view different from the first elevation view. A display module comprising: A system comprising:
2. The system of claim 1 , wherein the GUI includes instrument control indicators including at least one of an instrument name indicator, an instrument life indicator, and / or one or more instrument specific operation indicators.
3. The system of claim 1 , wherein the GUI includes a system clutch indicator for indicating whether a system clutch is active for disengagement actuation of the one or more medical instruments, the videoscope, and / or the overtube of the system.
4. The system of claim 1 , wherein the GUI includes a finger clutch indicator for indicating whether the finger clutch is pressed for actuation of disengagement of the one or more medical devices associated with the finger clutch.
5. The system of claim 1 , wherein the GUI includes a notification indicator for displaying notifications to the user, the notification indicator being at a center and a bottom of the display.
6. The system of claim 1 , wherein the GUI includes an overtube translation indicator configured to indicate an amount the overtube has translated and / or whether the translation is within one or more overtube translation limits.
7. The system of claim 1 , wherein the GUI includes an overtube roll indicator for the overtube configured to indicate an amount of roll of the overtube and / or whether the roll of the overtube is within one or more overtube roll limits.
8. The system of claim 1, wherein the GUI includes an overtube deflection indicator for the overtube configured to indicate the amount of deflection of the overtube in horizontal and / or vertical planes and / or whether the deflection of the overtube is within one or more overtube deflection limits.
9. 2. The system of claim 1, wherein the GUI includes a videoscope deflection indicator for the videoscope configured to indicate an amount of deflection of the videoscope in the horizontal and / or vertical planes and / or whether the deflection of the videoscope is within one or more videoscope deflection limits.
10. The system of claim 1 , wherein the GUI includes a videoscope shape indicator for the videoscope configured to indicate an amount of deflection of a distal segment and an amount of deflection of a proximal segment of the videoscope.
11. 2. The system of claim 1, wherein the GUI includes an instrument roll indicator for each medical device configured to indicate an amount of instrument roll and / or whether the instrument roll is within one or more instrument roll limits.
12. The system of claim 1 , wherein the GUI includes an instrument translation indicator for each medical instrument configured to indicate an amount of instrument translation and / or whether the instrument translation is within one or more instrument translation limits.
13. 1. A robotic surgical system comprising: a user console having a display and one or more input devices; and 1. A display system for a robotic surgical system, comprising: a display module configured to display a graphical user interface (GUI) on the display to provide information regarding one or more medical devices, the GUI comprising: an image display area extending from the overtube for displaying an image from the videoscope; a first instrument simulator configured to present a first simulated representation of one or more medical instruments extending from the overtube from a first elevational view; and a second instrument simulator configured to present a second simulated representation of the one or more medical devices extending from the overtube from a second elevation view different from the first elevation view. A display module comprising: A display system comprising: A robotic surgical system comprising:
14. 13. The system of claim 12, wherein the GUI includes instrument control indicators including at least one of an instrument name indicator, a connection status indicator to indicate connection of the instrument to a hub, an attachment status indicator to indicate attachment of the instrument to a robotic instrument controller, an instrument life indicator, and / or one or more instrument specific operation indicators.
15. The system of claim 12 , wherein the GUI includes a system clutch indicator for indicating whether a system clutch is active for disengagement actuation of all medical devices of the system.
16. The system of claim 12 , wherein the GUI includes a finger clutch indicator for indicating whether a finger clutch is pressed for actuation of disengagement of the one or more medical devices associated with the finger clutch.
17. The system of claim 12 , wherein the GUI includes a notification indicator for displaying notifications to the user, the notification indicator being at a center and a bottom of the display.
18. The system of claim 12, wherein the GUI includes an overtube translation indicator configured to indicate an amount the overtube has translated and / or whether the translation is within one or more overtube translation limits.
19. The system of claim 12, wherein the GUI includes an overtube roll indicator for the overtube configured to indicate the amount of roll of the overtube and / or whether the roll of the overtube is within one or more overtube roll limits.
20. 1. A method for controlling a robotic surgical system, comprising: Calculating the position and / or orientation of a robotically controlled elongated surgical instrument; and generating one or more representational images of the elongated surgical device indicative of a position and / or orientation of the elongated surgical device relative to a neutral position; A method comprising:
21. The method of claim 19, wherein calculating the position and / or orientation comprises using equipment controller information to estimate the position and / or orientation of the elongated surgical device.
22. 21. The method of claim 20, wherein generating one or more representational images includes generating a plurality of two-dimensional indicators configured to indicate one or more of pitch, yaw, and roll.
23. 22. The method of claim 21, further comprising generating a color indicator that changes color based on the position of the one or more manifestation images relative to one or more limits away from a neutral position.
24. The method of claim 22 , wherein the color indicator is associated with the visual image of the elongate device.
25. 24. The method of claim 23, wherein the color indicator is a location adjacent to or around the revealed image.
Citation Information
Patent Citations
A medical robotic system that provides an auxiliary field of view for articulated devices extending from the distal end of an access guide.
JP2011525845A
Graphical User Interface for Monitoring Image-Guided Procedures
JP2020518326A
Systems and methods for onscreen menus in teleoperational medical system
JP2021168956A
Systems and methods for displaying an instrument navigator in a teleoperational system
US20190151032A1
Systems and methods for localization based on machine learning
US20200297444A1
Cited By
Enabling / disabling HARQ feedback for multiple transport blocks scheduled by a single DCI
JP2026501062A
