Surgical Hub Spatial Awareness for Determining Devices in the Operating Room

Through the surgical hub, the connection status of the surgical device is detected and coordinated, control signals and data are transmitted, and the interaction between multiple energy modules is achieved, which solves the problems of pipeline tangles and disconnection in the operation, and improves surgical efficiency and safety.

CN111602204BActive Publication Date: 2024-11-15ETHICON INC
View PDF 28 Cites 0 Cited by

Patent Information

Application Number
CN201880084540.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-03-29
Filing Date
2018-07-30
Publication Date
2024-11-15
Estimated Expiration
2038-07-30

AI Technical Summary

Technical Problem

In surgical procedures, it is difficult for the prior art to effectively manage and coordinate the interaction between a variety of surgical devices and energy application modules, resulting in problems of pipeline tangles and disconnection during the operation, affecting surgical efficiency and safety.

Method used

Provides a surgical hub, including processor, memory and control circuit, capable of detecting the connection status of surgical devices, transmitting control signals, receiving and displaying image and parameter data, and implementing a variety of energy generator modules through a modular housing and communication bus Fast interaction and communication between.

Benefits of technology

Reduces the frequency of pipeline tangles in surgical procedures, improves surgical efficiency and safety, allows rapid replacement and removal of different energy application modules, and enhances controllability of the surgical process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111602204B_ABST
    Figure CN111602204B_ABST
Patent Text Reader

Abstract

The present invention discloses a surgical hub. The surgical hub includes a processor and a memory coupled to the processor. The memory stores instructions that can be executed by the processor to perform the following operations: receiving first image data from a first image sensor, the first image data representing a first field of view, receiving second image data from a second image sensor, wherein the second image data represents a second field of view, and displaying a first image rendered from the first image data corresponding to the first field of view and a second image rendered from the second image data corresponding to the second field of view on a display coupled to the processor.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This patent application claims the benefit of priority under 35 U.S.C. 119(e) to U.S. Provisional Patent Application Serial No. 62 / 649,309, filed on March 28, 2018, entitled “SURGICAL HUB SPATIAL AWARENESS TO DETERMINE DEVICES IN OPERATING THEATER,” the disclosure of which is incorporated herein by reference in its entirety.

[0003] This application also claims the benefit of priority under 35 U.S.C. 119(e) to U.S. Provisional Patent Application Serial No. 62 / 611,341, filed on December 28, 2017, entitled “INTERACTIVE SURGICAL PLATFORM,” U.S. Provisional Patent Application Serial No. 62 / 611,340, filed on December 28, 2017, entitled “CLOUD-BASED MEDICAL ANALYTICS,” and U.S. Provisional Patent Application Serial No. 62 / 611,339, filed on December 28, 2017, entitled “ROBOT ASSISTED SURGICAL PLATFORM,” the disclosure of each of which is incorporated herein by reference in its entirety. Background Art

[0004] The present disclosure relates to various surgical systems. Surgical procedures are typically performed in operating theaters or rooms in a medical facility, such as, for example, a hospital. A sterile field is typically created around the patient. The sterile field may include a properly dressed scrubbed team member, as well as all furniture and fixtures in the area. Various surgical devices and systems are utilized in performing surgical procedures. Summary of the invention

[0005] In one general aspect, a surgical hub is provided. The general hub includes a processor; and a memory coupled to the processor, the memory storing instructions executable by the processor to: receive first image data from a first image sensor, wherein the first image data represents a first field of view; receive second image data from a second image sensor, wherein the second image data represents a second field of view; and display a first image rendered from the first image data corresponding to the first field of view and a second image rendered from the second image data corresponding to the second field of view on a display coupled to the processor.

[0006] In another general aspect, a surgical hub is provided. The surgical hub includes a processor; and a memory coupled to the processor, the memory storing instructions executable by the processor to: detect connection of a surgical device to the surgical hub; transmit a control signal to the detected surgical device to transmit surgical parameter data associated with the detected surgical device to the surgical hub; receive the surgical parameter data from the detected surgical device; receive image data from an image sensor; and display an image rendered based on the image data received from the image sensor together with the surgical parameter data received from the surgical device on a display coupled to the surgical hub.

[0007] In another general aspect, a surgical hub is provided. The surgical hub includes control circuitry configured to: detect connection of a surgical device to the surgical hub; transmit a control signal to the detected surgical device to transmit surgical parameter data associated with the detected surgical device to the surgical hub; receive the surgical parameter data from the detected surgical device; receive image data from an image sensor; and display an image received from the image sensor together with the surgical parameter data received from the surgical device on a display coupled to the surgical hub.

[0008] In another general aspect, a non-transitory computer-readable medium is provided. The non-transitory computer-readable medium stores computer-readable instructions that, when executed, cause a machine to: detect connection of a surgical device to the surgical hub; transmit a control signal to the detected surgical device to transmit surgical parameter data associated with the detected surgical device to the surgical hub; receive the surgical parameter data from the detected surgical device; receive image data from an image sensor; and display an image received from the image sensor together with the surgical parameter data received from the surgical device on a display coupled to the surgical hub.

[0009] In another general aspect, a non-transitory computer-readable medium is provided. The non-transitory computer-readable medium stores computer-readable instructions that, when executed, cause a machine to: receive first image data from a first image sensor, wherein the first image data represents a first field of view; receive second image data from a second image sensor, wherein the second image data represents a second field of view; and display a first image corresponding to the first field of view and a second image corresponding to the second field of view on a display coupled to the surgical hub. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The features of the various aspects are particularly described in the appended claims. However, the various aspects (relating to surgical organizations and methods) and further objects and advantages thereof may best be understood by reference to the following description taken in conjunction with the following drawings.

[0011] Figure 1 is a block diagram of a computer-implemented interactive surgical system according to at least one aspect of the present disclosure.

[0012] Figure 2 A surgical system for performing a surgical procedure in an operating room according to at least one aspect of the present disclosure.

[0013] Figure 3 A surgical hub is paired with a visualization system, a robotic system, and a smart instrument according to at least one aspect of the present disclosure.

[0014] Figure 4 A partial perspective view of a surgical hub housing and a combination generator module slidably received in a drawer of the surgical hub housing according to at least one aspect of the present disclosure.

[0015] Figure 5 is a perspective view of a combination generator module having bipolar, ultrasonic and monopolar contacts and a smoke evacuation device according to at least one aspect of the present disclosure.

[0016] Figure 6 A single power bus attachment for multiple lateral docking ports of a lateral modular housing configured to accommodate multiple modules is shown in accordance with at least one aspect of the present disclosure.

[0017] Figure 7 A vertical modular housing configured to accommodate a plurality of modules according to at least one aspect of the present disclosure is shown.

[0018] Figure 8 A surgical data network including a modular communication hub configured to enable connecting modular devices located in one or more operating rooms of a medical facility or any room in a medical facility dedicated to surgical operations to a cloud is shown in accordance with at least one aspect of the present disclosure.

[0019] Fig. 9 A computer-implemented interactive surgical system according to at least one aspect of the present disclosure.

[0020] Fig.10 A surgical hub comprising multiple modules coupled to a modular control tower is shown in accordance with at least one aspect of the present disclosure.

[0021] Fig.11An aspect of a universal serial bus (USB) hub device in accordance with at least one aspect of the present disclosure is shown.

[0022] Fig.12 A logic diagram of a control system for a surgical instrument or tool according to at least one aspect of the present disclosure is shown.

[0023] Fig.13 Control circuitry configured to control various aspects of a surgical instrument or tool in accordance with at least one aspect of the present disclosure is shown.

[0024] Fig.14 Combinatorial logic circuits configured to control various aspects of a surgical instrument or tool in accordance with at least one aspect of the present disclosure are shown.

[0025] Fig.15 A sequential logic circuit configured to control various aspects of a surgical instrument or tool according to at least one aspect of the present disclosure is shown.

[0026] Fig.16 A surgical instrument or tool including multiple motors that can be activated to perform various functions in accordance with at least one aspect of the present disclosure is shown.

[0027] Fig.17 is a schematic diagram of a robotic surgical instrument configured to operate the surgical tools described herein according to at least one aspect of the present disclosure.

[0028] Fig.18 A block diagram of a surgical instrument programmed to control distal translation of a displacement member in accordance with at least one aspect of the present disclosure is shown.

[0029] Fig.19 is a schematic diagram of a surgical instrument configured to control various functions according to at least one aspect of the present disclosure.

[0030] Fig. 20 A simplified block diagram of a generator configured to provide inductorless tuning and other benefits in accordance with at least one aspect of the present disclosure is provided.

[0031] Fig.21 An example of a generator according to at least one aspect of the present disclosure is shown, which is Fig. 20 A form of generator.

[0032] Fig. 22 A schematic diagram of a surgical instrument according to at least one aspect of the present disclosure is shown, the surgical instrument using a combination of Figure 23 to Figure 3 5 The benefits of the centering tools and techniques described are centered around the linear nail transect line.

[0033] Figure 23 to Figure 25A method of aligning an anvil sleeve needle of a circular stapler with a staple overlap portion of a linear staple line produced by a double stapling technique is shown according to at least one aspect of the present disclosure, wherein:

[0034] Fig.23 An anvil trocar of a circular stapler is shown that is not aligned with the staple overlap portion of a linear staple line created by a double stapling technique;

[0035] Fig.24 An anvil trocar of a circular stapler is shown aligned with the center of the staple overlap portion of a linear staple line created by a double stapling technique; and

[0036] Fig.25 A centering tool is shown displayed on a surgical hub display showing a staple overlap portion of a linear staple line formed by a double suturing technique to be removed by a circular stapler, wherein the anvil trocar is not aligned with the staple overlap portion of the double staple line, as shown in FIG. Fig.23 shown.

[0037] Fig.26 and Fig. 27 Before and after images of a centering tool according to at least one aspect of the present disclosure are shown, wherein:

[0038] Fig.26 showing an image of a projected cutting path of an anvil trocar and circular knife prior to alignment, wherein a target alignment ring surrounds an image of a linear staple line on an image of a staple overlap presented on a surgical hub display; and

[0039] Fig. 27 An image of the projected cutting path of the anvil trocar and circular knife after alignment is shown, with a target alignment ring surrounding an image of the linear staple line on an image of the staple overlap presented on the surgical hub display.

[0040] Figures 28 to 30 A method of aligning an anvil sleeve of a circular stapler with the center of a linear staple line according to at least one aspect of the present disclosure is shown, wherein:

[0041] Fig.28 The anvil trocar is shown misaligned with the center of the linear staple line;

[0042] Fig.29 Anvil trocar is shown aligned with the center of the linear staple line; and

[0043] Fig.30 The centering tool is shown on a surgical hub display showing a linear staple line where the anvil trocar is not aligned with the staple overlap portion of the double staple line, as shown in FIG. Fig.28 shown.

[0044] Fig.31An image of a standard reticle field of view of a linear staple line transection of a surgical procedure displayed on a surgical hub display as viewed through a laparoscope in accordance with at least one aspect of the present disclosure.

[0045] Fig.32 According to at least one aspect of the present disclosure, before the anvil trocar and the circular knife of the circular stapler are aligned with the center of the linear staple line, Fig.31 Image of the laser-assisted marking field of view of the surgical site shown.

[0046] Fig.33 According to at least one aspect of the present disclosure, after the anvil trocar and the circular knife of the circular stapler are aligned with the center of the linear staple line, Fig.32 Image of the laser-assisted marking field of view of the surgical site shown.

[0047] Fig.34 A contactless inductive sensor embodiment of a contactless sensor for determining a position of an anvil trocar relative to a center of staple line transection in accordance with at least one aspect of the present disclosure is shown.

[0048] Fig.35A and Fig.35B An aspect of a non-contact capacitive sensor embodiment of a non-contact sensor for determining a position of an anvil trocar relative to a center of staple line transection according to at least one aspect of the present disclosure is shown, wherein:

[0049] Fig.35A A contactless capacitive sensor is shown with no nearby metal target; and

[0050] Fig.35B Shown is a contactless capacitive sensor near a metal target.

[0051] Fig.36 A logic flow diagram is provided that depicts a method of a control program or logic configuration for aligning a surgical instrument in accordance with at least one aspect of the present disclosure.

[0052] Fig.37 A main display of a surgical hub including a global display and a local display according to at least one aspect of the present disclosure is shown.

[0053] Fig.38 A primary display of a surgical hub is shown in accordance with at least one aspect of the present disclosure.

[0054] Fig.39 A clamp stabilization sequence over a five second period is shown in accordance with at least one aspect of the present disclosure.

[0055] Fig.40A schematic diagram showing four separate wide-angle view images of a surgical site at four separate times during surgery in accordance with at least one aspect of the present disclosure.

[0056] Fig.41 is a graph of tissue creep clamping stabilization curves for two tissue types according to at least one aspect of the present disclosure.

[0057] Fig.42 A graph of a time-dependent proportional fill of a clamping force stabilization curve according to at least one aspect of the present disclosure.

[0058] Fig.43 is a graph illustrating the role of tissue creep in a clamping force stabilization curve according to at least one aspect of the present disclosure.

[0059] Fig.44A and Fig.44B Two graphs are shown for determining when a clamped tissue reaches creep stability in accordance with at least one aspect of the present disclosure, wherein:

[0060] Fig.44A shows a curve representing the vector tangent angle dθ as a function of time; and

[0061] Fig.44B A curve is shown which represents the variation of the closing force (ΔFTC) as a function of time.

[0062] Fig.45 An example of an enhanced video image of a pre-operative video image enhanced with data identifying display elements in accordance with at least one aspect of the present disclosure is shown.

[0063] Fig.46 A logic flow diagram is a method depicting a control program or logic configuration for displaying an image according to at least one aspect of the present disclosure.

[0064] Fig.47 A communication system according to at least one aspect of the present disclosure is shown, the communication system including an intermediate signal combiner positioned in a communication path between an imaging module and a surgical hub display.

[0065] Fig.48 A standalone interactive headset worn by a surgeon to communicate data to a surgical hub is shown in accordance with one aspect of the present disclosure.

[0066] Fig.49 A method for controlling use of a device according to at least one aspect of the present disclosure is shown.

[0067] Fig.50A surgical system according to at least one aspect of the present disclosure is shown, the surgical system including a handle having a controller and a motor, an adapter releasably coupled to the handle, and a loading unit releasably coupled to the adapter.

[0068] Fig.51 An Automated Endoscopic System for Optimal Positioning (AESOP) camera positioning system is shown in accordance with at least one aspect of the present disclosure.

[0069] Fig.52 A multifunctional surgical control system and switching interface for virtual operating room integration according to at least one aspect of the present disclosure is shown.

[0070] Fig.53 A schematic diagram of a beam source and combined beam detector system for use as a device control mechanism in an operating room in accordance with at least one aspect of the present disclosure is shown.

[0071] FIG. 54A to FIG. 54E Various types of sterile field control and data input consoles according to at least one aspect of the present disclosure are shown, wherein:

[0072] Fig.54A A single-area sterile field control and data entry console is shown;

[0073] Fig.54B A multi-zone sterile field control and data entry console is shown;

[0074] Fig.54C A tethered sterile field control and data entry console is shown;

[0075] Fig.54D A battery operated sterile field control and data entry console is shown; and

[0076] Fig.54E Shown is a battery operated sterile field control and data entry console.

[0077] FIG. 55A to FIG. 55B A sterile field console for use in a sterile field during a surgical procedure according to at least one aspect of the present disclosure is shown, wherein:

[0078] Fig.55A A sterile field console is shown located in the sterile field adjacent to two surgeons performing an operation; and

[0079] Fig.55B One of the surgeons is shown tapping the touch screen of the sterile field console.

[0080] Fig.56 A method for accepting a consultation feed from another operating room in accordance with at least one aspect of the present disclosure is shown.

[0081] Fig.57 Standard techniques for estimating vascular path and depth, as well as device trajectory, in accordance with at least one aspect of the present disclosure are shown.

[0082] FIG. 58A to FIG. 58D A plurality of real-time views of an image of virtual anatomical detail for dissection according to at least one aspect of the present disclosure are shown, wherein:

[0083] Fig.58A It is a perspective view of virtual anatomical details;

[0084] Fig.58C is a side view of virtual anatomical detail;

[0085] Fig.58B is a perspective view of virtual anatomical details; and

[0086] Fig.58D is a side view of virtual anatomical detail.

[0087] FIG. 59A to FIG. 59B A touch screen display that can be used in a sterile field according to at least one aspect of the present disclosure is shown, wherein:

[0088] Fig.59A showing an image of a surgical site displayed on a touch screen display in portrait mode;

[0089] Fig.59B The touch screen display is shown rotated in landscape mode, with the surgeon using his index finger to scroll the image in the direction of the arrow;

[0090] Fig.59C The surgeon is shown pinching the image in the direction of the arrow using his index finger and thumb to zoom in;

[0091] Fig.59D The surgeon is shown pinching the image in the direction of the arrow using his index finger and thumb to zoom out; and

[0092] Fig.59E The touch screen display is shown rotating in two directions indicated by arrows to enable the surgeon to view the image in different orientations.

[0093] Fig.60 A surgical site employing a smart retractor including direct interface control to a surgical hub in accordance with at least one aspect of the present disclosure is shown.

[0094] Fig.61 A surgical site with a smart flexible patch display attached to a patient's body is shown in accordance with at least one aspect of the present disclosure.

[0095] Fig.62 is a logic flow diagram depicting a method of a control program or logic configuration to communicate from within a sterile field with a device located outside the sterile field in accordance with at least one aspect of the present disclosure.

[0096] Fig.63 A system for performing a procedure in accordance with at least one aspect of the present disclosure is shown.

[0097] Fig.64 A second information layer overlying a first information layer according to at least one aspect of the present disclosure is shown.

[0098] Fig.65 Depicted is a perspective view of a surgeon using a surgical instrument including a handle assembly housing and a wireless circuit board during a surgical procedure, wherein the surgeon is wearing a pair of safety glasses, in accordance with at least one aspect of the present disclosure.

[0099] Fig.66 is a schematic diagram of a feedback control system for controlling a surgical instrument according to at least one aspect of the present disclosure.

[0100] Fig.67 A feedback controller according to at least one aspect of the present disclosure is shown, the feedback controller including a screen display module and a head-up display (HUD) module.

[0101] Fig.68 A timeline depicting situational awareness of a surgical hub according to at least one aspect of the present disclosure. DETAILED DESCRIPTION

[0102] The applicant of the present patent application owns the following U.S. Provisional Patent Applications filed on March 28, 2018, each of which is incorporated herein by reference in its entirety:

[0103] U.S. Provisional Patent Application Serial No. 62 / 649,302, entitled “INTERACTIVE SURGICAL SYSTEMS WITH ENCRYPTED COMMUNICATION CAPABILITIES”;

[0104] U.S. Provisional Patent Application Serial No. 62 / 649,294, entitled “DATA STRIPPINGMETHOD TO INTERROGATE PATIENT RECORDS AND CREATE ANONYMIZED RECORD”;

[0105] U.S. Provisional Patent Application Serial No. 62 / 649,300, entitled “SURGICAL HUBSITUATIONAL AWARENESS”;

[0106] U.S. Provisional Patent Application Serial No. 62 / 649,309, entitled “SURGICAL HUBSPATIAL AWARENESS TO DETERMINE DEVICES INOPERATING THEATER”;

[0107] U.S. Provisional Patent Application Serial No. 62 / 649,310, entitled “COMPUTER IMPLEMENTED INTERACTIVE SURGICAL SYSTEMS”;

[0108] U.S. Provisional Patent Application Serial No. 62 / 649,291, entitled “USE OF LASERLIGHT AND RED-GREEN-BLUE COLORATION TO DETERMINE PROPERTIES OF BACK SCATTERED LIGHT”;

[0109] U.S. Provisional Patent Application Serial No. 62 / 649,296, entitled “ADAPTIVE CONTROL PROGRAM UPDATES FOR SURGICAL DEVICES”;

[0110] U.S. Provisional Patent Application Serial No. 62 / 649,333, entitled “CLOUD-BASED MEDICAL ANALYTICS FOR CUSTOMIZATION AND RECOMMENDATIONS TO A USER”;

[0111] U.S. Provisional Patent Application Serial No. 62 / 649,327, entitled “CLOUD-BASED MEDICAL ANALYTICS FOR SECURITY AND AUTHENTICATION TRENDS AND REACTIVE MEASURES”;

[0112] U.S. Provisional Patent Application Serial No. 62 / 649,315, entitled “DATA HANDLING AND PRIORITIZATION IN A CLOUD ANALYTICS NETWORK”;

[0113] U.S. Provisional Patent Application Serial No. 62 / 649,313, entitled “CLOUD INTERFACE FOR COUPLED SURGICAL DEVICES”;

[0114] U.S. Provisional Patent Application Serial No. 62 / 649,320, entitled “DRIVE ARRANGEMENTS FOR ROBOT-ASSISTED SURGICALPLATFORMS”;

[0115] U.S. Provisional Patent Application Serial No. 62 / 649,307, entitled “AUTOMATIC TOOL ADJUSTMENTS FOR ROBOT-ASSISTED SURGICALPLATFORMS”; and

[0116] • U.S. Provisional Patent Application Serial No. 62 / 649,323, entitled “SENSING ARRANGEMENTS FOR ROBOT-ASSISTED SURGICALPLATFORMS.”

[0117] The applicant of the present application owns the following U.S. patent applications filed on March 29, 2018, each of which is incorporated herein by reference in its entirety:

[0118] U.S. Patent Application Serial No. 170766, entitled “INTERACTIVE SURGICAL SYSTEMS WITH ENCRYPTED COMMUNICATION CAPABILITIES”; Attorney Docket No. END8499USNP / 170766;

[0119] · U.S. Patent Application Serial No., entitled “INTERACTIVE SURGICAL SYSTEMS WITH CONDITION HANDLING OF DEVICES AND DATA CAPABILITIES”; Attorney Docket No. END8499USNP1 / 170766-1; · U.S. Patent Application Serial No. _ , entitled “SURGICAL HUBCOORDINATION OF CONTROLAND COMMUNICATION OF OPERATING ROOM DEVICES”; Attorney Docket No. END8499USNP2 / 170766-2;

[0120] US patent application serial number _ , entitled “SPATIAL AWARENESS OF SURGICAL HUBS INOPERATING ROOMS”; attorney docket number END8499USNP3 / 170766-3;

[0121] US patent application serial number _, entitled “COOPERATIVE UTILIZATION OF DATA DERIVEDFROM SECONDARY SOURCES BY INTELLIGENT SURGICAL HUBS”; Attorney Docket No. END8499USNP4 / 170766-4;

[0122] US patent application serial number __ , entitled “SURGICAL HUB CONTROLARRANGEMENTS”; attorney docket number END8499USNP5 / 170766-5; U.S. Patent Application Serial No. _ , entitled “DATA STRIPPINGMETHOD TO INTERROGATE PATIENT RECORDS AND CREATE ANONYMIZED RECORD”; attorney docket number END8500USNP / 170767; U.S. Patent Application Serial No. _ , entitled “COMMUNICATION HUBAND STORAGE DEVICE FOR STORING PARAMETERS AND STATUS OF A SURGICAL DEVICE TO BESHARED WITH CLOUD BASED ANALYTICS SYSTEMS”; attorney docket number END8500USNP1 / 170767-1; U.S. Patent Application Serial No. _ , which is entitled "SELF DESCRIBING DATAPACKETS GENERATED AT ANISSUING INSTRUMENT"; Attorney Docket No. END8500USNP2 / 170767-2;

[0123] US patent application serial number _ , which is entitled "DATA PAIRING TO INTERCONNECT A DEVICEMEASURED PARAMETER WITH ANOUTCOME"; attorney docket number END8500USNP3 / 170767-3;

[0124] U.S. patent application serial number, entitled “SURGICAL HUB SITUATIONAL AWARENESS”; attorney docket number END8501USNP / 170768;

[0125] U.S. Patent Application Serial No. _, entitled “SURGICAL SYSTEM DISTRIBUTED PROCESSING”; Attorney Docket No. END8501USNP1 / 170768-1;

[0126] US patent application serial number _ , entitled “AGGREGATION AND REPORTING OF SURGICALHUB DATA”; Attorney Docket No. END8501USNP2 / 170768-2;

[0127] U.S. patent application serial number, entitled “DISPLAY OF ALIGNMENT OF STAPLE CARTRIDGETO PRIOR LINEAR STAPLE LINE”; attorney docket number END8502USNP1 / 170769-1;

[0128] U.S. Patent Application Serial No. _, entitled “STERILE FIELD INTERACTIVE CONTROLDISPLAYS”; Attorney Docket No. END8502USNP2 / 170769-2;

[0129] US patent application serial number _ , entitled “COMPUTER IMPLEMENTED INTERACTIVE SURGICAL SYSTEMS”; Attorney Docket No. END8503USNP / 170770;

[0130] U.S. Patent Application Serial No. _, entitled “USE OF LASER LIGHT AND RED-GREEN-BLUE COLORATION TO DETERMINE PROPERTIES OF BACK SCATTERED LIGHT”; Attorney Docket No. END8504USNP / 170771;

[0131] U.S. Patent Application Serial No. _, entitled “CHARACTERIZATION OF TISSUEIRREGULARITIES THROUGH THE USE OF MONO-CHROMATIC LIGHT REFRACTIVITY”; Attorney Docket No. END8504USNP1 / 170771-1; and

[0132] US patent application serial number __, entitled “DUAL CMOS ARRAYIMAGING”; attorney docket number END8504USNP2 / 170771-2.

[0133] The applicant of the present patent application owns the following U.S. patent applications filed on March 29, 2018, each of which is incorporated herein by reference in its entirety:

[0134] US patent application serial number _ , entitled “ADAPTIVE CONTROLPROGRAM UPDATES FOR SURGICAL DEVICES”; Attorney Docket No. END8506USNP / 170773;

[0135] U.S. Patent Application Serial No. 170773-1, entitled “ADAPTIVE CONTROL PROGRAM UPDATES FOR SURGICAL HUBS”; Attorney Docket No. END8506USNP1 / 170773-1;

[0136] U.S. Patent Application Serial No., entitled “CLOUD-BASED MEDICALANALYTICS FORCUSTOMIZATION AND RECOMMENDATIONS TO A USER”; Attorney Docket No. END8507USNP / 170774;

[0137] US patent application serial number _ , entitled “CLOUD-BASED MEDICALANALYTICS FORLINKING OF LOCAL USAGE TRENDS WITH THE RESOURCE ACQUISITION BEHAVIORS OF LARGE DATASET”; Attorney Docket No. END8507USNP1 / 170774-1;

[0138] US patent application serial number _ , entitled “CLOUD-BASED MEDICALANALYTICS FORMEDICAL FACILITY SEGMENTEDINDIVIDUALIZATION OF INSTRUMENT FUNCTION”; Attorney Docket No. END8507USNP2 / 170774-2;

[0139] U.S. Patent Application Serial No. 170775, entitled “CLOUD-BASED MEDICALANALYTICS FORSECURITY AND AUTHENTICATION TRENDS AND REACTIVE MEASURES”; Attorney Docket No. END8508USNP / 170775;

[0140] US patent application serial number _ , entitled “DATA HANDLING AND PRIORITIZATION IN ACLOUD ANALYTICS NETWORK”; Attorney Docket No. END8509USNP / 170776; and

[0141] US patent application serial number _ , entitled “CLOUD INTERFACE FORCOUPLED SURGICALDEVICES”; attorney docket number END8510USNP / 170777.

[0142] The applicant of the present patent application owns the following U.S. patent applications filed on March 29, 2018, each of which is incorporated herein by reference in its entirety:

[0143] US patent application serial number _ , entitled “DRIVE ARRANGEMENTS FORROBOT-ASSISTED SURGICAL PLATFORMS”; attorney docket number END8511USNP / 170778;

[0144] US patent application serial number _ , entitled “COMMUNICATIONARRANGEMENTS FOR ROBOT-ASSISTED SURGICALPLATFORMS”; Attorney Docket No. END8511USNP1 / 170778-1;

[0145] · U.S. Patent Application Serial No., entitled “CONTROLS FOR ROBOT-

[0146] ASSISTED SURGICAL PLATFORMS”; Attorney Docket No. END8511USNP2 / 170778-2;

[0147] U.S. Patent Application Serial No., entitled “AUTOMATIC TOOLADJUSTMENTS FOR ROBOT-ASSISTED SURGICALPLATFORMS”; Attorney Docket No. END8512USNP / 170779;

[0148] US patent application serial number _ , which is entitled “CONTROLLERS FORROBOT-ASSISTED SURGICALPLATFORMS”; attorney docket number END8512USNP1 / 170779-1;

[0149] U.S. Patent Application Serial No. 170779-2, entitled “COOPERATIVE SURGICALACTIONS FOR ROBOT-ASSISTED SURGICAL PLATFORMS”; Attorney Docket No. END8512USNP2 / 170779-2;

[0150] U.S. Patent Application Serial No. _, entitled “DISPLAY ARRANGEMENTSFOR ROBOT-ASSISTED SURGICAL PLATFORMS”; Attorney Docket No. END8512USNP3 / 170779-3; and

[0151] US patent application serial number _ , entitled “SENSING ARRANGEMENTSFOR ROBOT-ASSISTED SURGICAL PLATFORMS”; attorney docket number END8513USNP / 170780.

[0152] Before describing in detail various aspects of the surgical device and generator, it should be noted that the application or use of the exemplary examples is not limited to the details of the configuration and arrangement of the components shown in the drawings and detailed description. The exemplary examples may be implemented alone or in combination with other aspects, variations and modifications, and may be practiced or performed in a variety of ways. In addition, unless otherwise indicated, the terms and expressions used herein are selected for the convenience of the reader to describe the exemplary embodiments and are not for limiting purposes. Moreover, it should be understood that one or more of the aspects, expressions of aspects and / or examples described below may be combined with any one or more of the other aspects, expressions of aspects and / or examples described below.

[0153] See also Figure 1, the computer-implemented interactive surgical system 100 includes one or more surgical systems 102 and a cloud-based system (e.g., a cloud 104 that may include a remote server 113 coupled to a storage device 105). Each surgical system 102 includes at least one surgical hub 106 in communication with the cloud 104 that may include the remote server 113. In one example, as Figure 1 As shown in , the surgical system 102 includes a visualization system 108, a robotic system 110, and a handheld intelligent surgical instrument 112, which are configured to communicate with each other and / or with the hub 106. In some aspects, the surgical system 102 may include M number of hubs 106, N number of visualization systems 108, O number of robotic systems 110, and P number of handheld intelligent surgical instruments 112, where M, N, O, and P are integers greater than or equal to one.

[0154] Figure 3 An example of a surgical system 102 is shown for performing a surgical procedure on a patient lying flat on an operating table 114 in a surgical room 116. A robotic system 110 is used as part of the surgical system 102 during a surgical procedure. The robotic system 110 includes a surgeon's console 118, a patient side cart 120 (surgical robot), and a surgical robotic hub 122. While the surgeon views the surgical site through the surgeon's console 120, the patient side cart 117 can manipulate at least one removably coupled surgical tool 118 through a minimally invasive incision in the patient's body. Images of the surgical site can be obtained through a medical imaging device 124, which can be manipulated by the patient side cart 120 to orient the imaging device 124. The robotic hub 122 can be used to process images of the surgical site for subsequent display to the surgeon through the surgeon's console 118.

[0155] Other types of robotic systems may be readily adapted for use with the surgical system 102. Various examples of robotic systems and surgical tools suitable for use with the present disclosure are described in U.S. Provisional Patent Application Serial No. 62 / 611,339, filed on December 28, 2017, entitled ROBOT ASSISTED SURGICAL PLATFORM, the disclosure of which is incorporated herein by reference in its entirety.

[0156] Various examples of cloud-based analytics performed by cloud 104 and suitable for use in the present disclosure are described in U.S. Provisional Patent Application Serial No. 62 / 611,340, filed on December 28, 2017, entitled “CLOUD-BASED MEDICAL ANALYTICS,” the disclosure of which is incorporated herein by reference in its entirety.

[0157] In various aspects, imaging device 124 includes at least one image sensor and one or more optical components. Suitable image sensors include, but are not limited to, charge coupled device (CCD) sensors and complementary metal oxide semiconductor (CMOS) sensors.

[0158] The optics of imaging device 124 may include one or more illumination sources and / or one or more lenses. The one or more illumination sources may be directed to illuminate portions of the surgical field. The one or more image sensors may receive light reflected or refracted from the surgical field, including light reflected or refracted from tissue and / or surgical instruments.

[0159] One or more illumination sources may be configured to radiate electromagnetic energy in the visible spectrum as well as in the invisible spectrum. The visible spectrum (sometimes referred to as the optical spectrum or the luminescence spectrum) is that portion of the electromagnetic spectrum that is visible to (i.e., detectable by) the human eye and may be referred to as visible light or simply light. A typical human eye will respond to wavelengths in the range of about 380 nm to about 750 nm in air.

[0160] The invisible spectrum (i.e., non-luminescent spectrum) is the portion of the electromagnetic spectrum below and above the visible spectrum (i.e., wavelengths below about 380 nm and above about 750 nm). The invisible spectrum is not detectable by the human eye. Wavelengths greater than about 750 nm are longer than the red visible spectrum, and they become invisible infrared (IR), microwaves, and radio electromagnetic radiation. Wavelengths less than about 380 nm are shorter than the violet spectrum, and they become invisible ultraviolet, x-ray, and gamma-ray electromagnetic radiation.

[0161] In various aspects, the imaging device 124 is configured to be used in minimally invasive surgery. Examples of imaging devices suitable for the present disclosure include, but are not limited to, arthroscopes, angioscopes, bronchoscopes, choledochoscopes, colonoscopes, cytoscopes, duodenoscopes, enteroscopes, esophago-duodenoscopes (gastroscopes), endoscopes, laryngoscopes, nasopharyngeal-renal endoscopes, sigmoidoscopes, thoracoscopes, and hysteroscopes.

[0162] In one aspect, the imaging device uses multispectral monitoring to distinguish topography and underlying structure. Multispectral images are images that capture image data within a specific wavelength range across the electromagnetic spectrum. The wavelengths can be separated by filters or by using instruments that are sensitive to specific wavelengths, including light from frequencies outside the visible light range, such as IR and ultraviolet. Spectral imaging allows the extraction of additional information that the human eye fails to capture with its red, green, and blue receptors. The use of multispectral imaging is described in more detail under the title "Advanced Imaging Acquisition Module" of U.S. Provisional Patent Application Serial No. 62 / 611,341, entitled "INTERACTIVE SURGICALPLATFORM", filed on December 28, 2017, the disclosure of which is incorporated herein by reference in its entirety. After completing the surgical task to perform one or more of the previously described tests on the treated tissue, multispectral monitoring can be a useful tool for repositioning the surgical site.

[0163] It is self-evident that during any surgical procedure, the operating room and surgical equipment need to be strictly sterilized. The strict sanitary and sterile conditions required in a "surgical room" (i.e., an operating room or treatment room) require the highest possible sterility of all medical devices and equipment. Part of this sterilization process is the need to sterilize any material that contacts the patient or penetrates the sterile field, including the imaging device 124 and its attachments and devices. It should be understood that the sterile field can be considered to be a designated area that is considered to be free of microorganisms, such as within a tray or sterile towels, or the sterile field can be considered to be the area around the patient that has been prepared for surgical procedures. The sterile field can include a properly dressed scrubbed team member, as well as all furniture and fixtures in the area.

[0164] In various aspects, the visualization system 108 includes one or more imaging sensors, one or more image processing units, one or more storage arrays, and one or more displays strategically arranged relative to the sterile field, such as Figure 2 . In one aspect, the visualization system 108 includes interfaces for HL7, PACS, and EMR. Various components of the visualization system 108 are described under the title “Advanced Imaging Acquisition Module” in U.S. Provisional Patent Application Serial No. 62 / 611,341, entitled “INTERACTIVE SURGICAL PLATFORM,” filed on December 28, 2017, the disclosure of which is incorporated herein by reference in its entirety.

[0165] like Figure 2, the main display 119 is positioned in the sterile field to be visible to the operator at the operating table 114. In addition, the visualization tower 111 is positioned outside the sterile field. The visualization tower 111 includes a first non-sterile display 107 and a second non-sterile display 109 that are separated from each other. The visualization system 108 guided by the hub 106 is configured to be able to coordinate the flow of information to operators inside and outside the sterile field using the displays 107, 109 and 119. For example, the hub 106 can enable the visualization system 108 to display a snapshot of the surgical site recorded by the imaging device 124 on the non-sterile display 107 or 109, while maintaining a real-time feed of the surgical site on the main display 119. The snapshot on the non-sterile display 107 or 109 can allow the non-sterile operator to perform diagnostic steps related to the surgical procedure, for example.

[0166] In one aspect, the hub 106 is also configured to be able to route diagnostic input or feedback entered by a non-sterile operator at the visualization tower 111 to the primary display 119 within the sterile field, where it can be viewed by a sterile operator at the operating table. In one example, the input can be a modified form of a snapshot displayed on the non-sterile display 107 or 109, which can be routed to the primary display 119 via the hub 106.

[0167] See also Figure 2 , surgical instruments 112 are used in surgical procedures as part of the surgical system 102. The hub 106 is also configured to coordinate the flow of information to the display of the surgical instruments 112. For example, U.S. Provisional Patent Application Serial No. 62 / 611,341, entitled "INTERACTIVE SURGICAL PLATFORM," filed on December 28, 2017, the disclosure of which is incorporated herein by reference in its entirety. Diagnostic input or feedback entered by a non-sterile operator at the visualization tower 111 can be routed by the hub 106 to the surgical instrument display 115 within the sterile field, where the operator of the surgical instrument 112 can observe the input or feedback. Exemplary surgical instruments suitable for use with surgical system 102 are described under the title “Surgical Instrument Hardware” in U.S. provisional patent application serial number 62 / 611,341, entitled “INTERACTIVE SURGICAL PLATFORM,” filed on December 28, 2017, the disclosure of which is incorporated herein by reference in its entirety.

[0168] See now Figure 3, the hub 106 is depicted as communicating with the visualization system 108, the robotic system 110, and the handheld intelligent surgical instrument 112. The hub 106 includes a hub display 135, an imaging module 138, a generator module 140, a communication module 130, a processor module 132, and a storage array 134. In certain aspects, as Figure 3 As shown in , the hub 106 also includes a smoke evacuation module 126 and / or a suction / rinsing module 128.

[0169] During surgery, energy application to tissue for sealing and / or cutting is usually associated with smoke evacuation, suction of excess fluid and / or flushing of tissue. Fluid lines, power lines and / or data lines from different sources are usually tangled during surgery. Valuable time can be lost in solving this problem during surgery. Disconnecting a line may require disconnecting the line from its corresponding module, which may require resetting the module. The hub modular housing 136 provides a unified environment for managing power lines, data lines and fluid lines, which reduces the frequency of tangling between such lines.

[0170] Aspects of the present disclosure provide a surgical hub for a surgical procedure involving the application of energy to tissue at a surgical site. The surgical hub includes a hub housing and a combination generator module slidably accommodated in a docking base of the hub housing. The docking base includes data contacts and power contacts. The combination generator module includes two or more of an ultrasonic energy generator device, a bipolar RF energy generator device, and a monopolar RF energy generator device seated in a single unit. In one aspect, the combination generator module also includes a smoke exhaust device for connecting the combination generator module to at least one energy delivery cable of a surgical instrument, at least one smoke exhaust device configured to be able to exhaust smoke, fluids and / or particles generated by applying therapeutic energy to tissue, and a fluid line extending from a remote surgical site to the smoke exhaust device.

[0171] In one aspect, the fluid line is a first fluid line and the second fluid line extends from the remote surgical site to an aspiration and irrigation module slidably received in the hub housing. In one aspect, the hub housing includes a fluid interface.

[0172] Certain surgical procedures may require more than one energy type to be applied to tissue. One energy type may be more conducive to cutting tissue, while another different energy type may be more conducive to sealing tissue. For example, a bipolar generator may be used to seal tissue, while an ultrasonic generator may be used to cut sealed tissue. Aspects of the present disclosure provide a solution in which the hub modular housing 136 is configured to accommodate different generators and facilitate interactive communication between them. One of the advantages of the hub modular housing 136 is the ability to quickly remove and / or replace various modules.

[0173] Aspects of the present disclosure provide a modular surgical housing for use in a surgical procedure involving application of energy to tissue. The modular surgical housing includes a first energy generator module configured to generate a first energy for application to tissue, and a first docking base including a first docking port including first data and power contacts, wherein the first energy generator module is slidably movable into electrical engagement with the power and data contacts, and wherein the first energy generator module is slidably movable out of electrical engagement with the first power and data contacts.

[0174] Further describing the above, the modular surgical shell also includes a second energy generator module, which is configured to generate a second energy different from the first energy for application to tissue, and a second docking base, which includes a second docking port, the second docking port including second data and power contacts, wherein the second energy generator module is slidably movable into electrical engagement with the power and data contacts, and wherein the second energy generator is slidably movable out of electrical engagement with the second power and data contacts.

[0175] Additionally, the modular surgical housing further includes a communication bus between the first docking port and the second docking port that is configured to facilitate communication between the first energy generator module and the second energy generator module.

[0176] See also Figure 3-7 , aspects of the present disclosure are presented as a hub modular housing 136 that allows modular integration of the generator module 140, the smoke evacuation module 126, and the suction / irrigation module 128. The hub modular housing 136 also facilitates interactive communication between the modules 140, 126, 128. Figure 5 As shown in , the generator module 140 may be a generator module having integrated monopolar devices, bipolar devices, and ultrasonic devices supported in a single housing unit 139 that is slidably inserted into the hub modular housing 136. Figure 5 As shown in , the generator module 140 can be configured to be connected to a monopolar device 146, a bipolar device 147, and an ultrasonic device 148. Alternatively, the generator module 140 can include a series of monopolar generator modules, bipolar generator modules, and / or ultrasonic generator modules that interact through the hub modular housing 136. The hub modular housing 136 can be configured to facilitate the insertion of multiple generators and interactive communication between the generators docked into the hub modular housing 136 so that the generators will act as a single generator.

[0177] In one aspect, the hub modular housing 136 includes a modular power and communications backplane 149 with external and wireless communications connectors to enable removable attachment of the modules 140, 126, 128 and interactive communications therebetween.

[0178] In one aspect, the hub modular housing 136 includes a docking base or drawer 151 (also referred to herein as a drawer) that is configured to slidably accommodate the modules 140, 126, 128. Figure 4 A partial perspective view of a surgical hub housing 136 and a combination generator module 145 slidably received in a docking station 151 of the surgical hub housing 136 is shown. A docking port 152 having power and data contacts on the back of the combination generator module 145 is configured to engage the corresponding docking port 150 with the power and data contacts of the corresponding docking station 151 of the hub modular housing 136 when the combination generator module 145 is slid into place within the corresponding docking station 151 of the hub modular housing 136. In one aspect, the combination generator module 145 includes bipolar, ultrasonic and monopolar modules and a smoke evacuation module integrated together into a single housing unit 139, such as Figure 5 as shown in .

[0179] In various aspects, the smoke evacuation module 126 includes a fluid line 154 that delivers captured / collected smoke and / or fluid from the surgical site to, for example, the smoke evacuation module 126. Vacuum suction from the smoke evacuation module 126 can draw smoke into an opening of a common conduit at the surgical site. The common conduit coupled to the fluid line can be in the form of a flexible tube that terminates at the smoke evacuation module 126. The common conduit and the fluid line define a fluid path that extends toward the smoke evacuation module 126 housed in the hub housing 136.

[0180] In various aspects, the suction / irrigation module 128 is coupled to a surgical tool including an aspiration fluid line and a suction fluid line. In one example, the aspiration fluid line and the suction fluid line are in the form of flexible tubes extending from the surgical site toward the suction / irrigation module 128. One or more drive systems can be configured to be able to flush fluid to the surgical site and to aspirate fluid from the surgical site.

[0181] In one aspect, the surgical tool comprises a shaft having an end effector at its distal end and at least one energy treatment associated with the end effector, a suction tube, and a flushing tube. The suction tube may have an inlet at its distal end, and the suction tube extends through the shaft. Similarly, the suction tube may extend through the shaft and may have an inlet adjacent to an energy delivery tool. The energy delivery tool is configured to be able to deliver ultrasonic energy and / or RF energy to a surgical site, and is coupled to a generator module 140 by a cable initially extending through the shaft.

[0182] The irrigation tube may be in fluid communication with a fluid source, and the aspiration tube may be in fluid communication with a vacuum source. The fluid source and / or vacuum source may be seated in the suction / irrigation module 128. In one example, the fluid source and / or vacuum source may be seated in the hub housing 136 independently of the suction / irrigation module 128. In such examples, a fluid interface is capable of connecting the suction / irrigation module 128 to the fluid source and / or vacuum source.

[0183] In one aspect, the modules 140, 126, 128 and / or their corresponding docking stations on the hub modular housing 136 may include alignment features configured to align the docking ports of the modules to engage with their corresponding ports in the docking stations of the hub modular housing 136. For example, Figure 4 As shown in , the combination generator module 145 includes a side bracket 155, which is configured to be slidably engaged with a corresponding bracket 156 of a corresponding docking base 151 of the hub modular housing 136. The bracket cooperates to guide the docking port contacts of the combination generator module 145 to electrically engage with the docking port contacts of the hub modular housing 136.

[0184] In some aspects, the drawers 151 of the hub modular housing 136 are the same or substantially the same size, and the size of the module is adjusted to be accommodated in the drawer 151. For example, the side brackets 155 and / or 156 can be larger or smaller depending on the size of the module. In other aspects, the drawers 151 are different sizes and each is designed to accommodate a specific module.

[0185] Additionally, the contacts of a particular module may be keyed to engage the contacts of a particular drawer to avoid inserting a module into a drawer with mismatched contacts.

[0186] like Figure 4 As shown in , the docking port 150 of one drawer 151 can be coupled to the docking port 150 of another drawer 151 via a communication link 157 to facilitate interactive communication between modules seated in the hub modular housing 136. Alternatively or additionally, the docking port 150 of the hub modular housing 136 can facilitate wireless interactive communication between modules seated in the hub modular housing 136. Any suitable wireless communication can be employed, such as, for example, Air Titan-Bluetooth.

[0187] Figure 6A single power bus attachment is shown for multiple lateral docking ports of a lateral modular housing 160 that is configured to accommodate multiple modules of a surgical hub 206. The lateral modular housing 160 is configured to accommodate and interconnect modules 161 laterally. The modules 161 are slidably inserted into docking bases 162 of the lateral modular housing 160 that include a bottom plate for interconnecting the modules 161. Figure 6 As shown in FIG, the modules 161 are arranged transversely in the transverse modular housing 160. Alternatively, the modules 161 may be arranged vertically in the transverse modular housing.

[0188] Figure 7 A vertical modular housing 164 is shown that is configured to accommodate multiple modules 165 of the surgical hub 106. The modules 165 can be slidably inserted into a docking base or drawer 167 of the vertical modular housing 164, which includes a bottom plate for interconnecting the modules 165. Although the drawers 167 of the vertical modular housing 164 are arranged vertically, in some cases, the vertical modular housing 164 may include drawers arranged horizontally. In addition, the modules 165 can interact with each other through the docking port of the vertical modular housing 164. Figure 7 In the example of FIG. 1 , a display 177 is provided for displaying data related to the operation of the module 165. In addition, the vertical modular housing 164 includes a main module 178 that seats a plurality of sub-modules that are slidably received in the main module 178.

[0189] In various aspects, the imaging module 138 includes an integrated video processor and a modular light source, and is suitable for use with various imaging devices. In one aspect, the imaging device is composed of a modular housing that can be equipped with a light source module and a camera module. The housing can be a disposable housing. In at least one example, the disposable housing is removably coupled to a reusable controller, light source module, and camera module. The light source module and / or camera module can be selectively selected according to the type of surgical procedure. In one aspect, the camera module includes a CCD sensor. On the other hand, the camera module includes a CMOS sensor. On the other hand, the camera module is configured for scanning beam imaging. Similarly, the light source module can be configured to deliver white light or different light, depending on the surgical procedure.

[0190] During a surgical procedure, it may be inefficient to remove a surgical device from the surgical field and replace it with another surgical device that includes a different camera or a different light source. Temporarily losing sight of the surgical field may lead to undesirable consequences. The modular imaging device of the present disclosure is configured to allow for mid-stream replacement of a light source module or a camera module during a surgical procedure without having to remove the imaging device from the surgical field.

[0191] In one aspect, an imaging device includes a tubular housing including a plurality of channels. A first channel is configured to slidably receive a camera module, which can be configured to snap-fit ​​into engagement with the first channel. A second channel is configured to slidably receive a light source module, which can be configured to snap-fit ​​into engagement with the second channel. In another example, the camera module and / or the light source module can be rotated into a final position within their respective channels. A threaded engagement can be used in place of a snap-fit ​​engagement.

[0192] In various examples, multiple imaging devices are placed at different locations in the surgical field to provide multiple views. The imaging module 138 can be configured to switch between imaging devices to provide the best view. In various aspects, the imaging module 138 can be configured to integrate images from different imaging devices.

[0193] Various image processors and imaging devices suitable for use with the present disclosure are described in U.S. Pat. No. 7,995,045, entitled “COMBINED SBI AND CONVENTIONAL IMAGE PROCESSOR”, issued on August 9, 2011, which is incorporated herein by reference in its entirety. In addition, U.S. Pat. No. 7,982,776, entitled SBI MOTION ARTIFACT REMOVAL APPARATUS AND METHOD, issued on July 19, 2011, describes various systems for removing motion artifacts from image data, which is incorporated herein by reference in its entirety. Such systems may be integrated with imaging module 138. In addition, U.S. patent application publication number 2011 / 0306840, entitled CONTROLLABLE MAGNETIC SOURCE TO FIXTURE INTRACORPOREAL APPARATUS, published on December 15, 2011, and U.S. patent application publication number 2014 / 0243597, entitled SYSTEM FOR PERFORMING A MINIMALLY INVASIVE SURGICAL PROCEDURE, published on August 28, 2014, each of the above patents is incorporated herein by reference in its entirety.

[0194] Figure 8A surgical data network 201 is shown that includes a modular communication hub 203 that is configured to connect modular devices located in one or more operating rooms of a medical facility or any room in a medical facility that is specifically equipped for surgical operations to a cloud-based system (e.g., a cloud 204 that may include a remote server 213 coupled to a storage device 205). In one aspect, the modular communication hub 203 includes a network hub 207 and / or a network switch 209 that communicates with a network router. The modular communication hub 203 may also be coupled to a local computer system 210 to provide local computer processing and data manipulation. The surgical data network 201 may be configured as passive, intelligent, or switched. A passive surgical data network acts as a conduit for data, enabling it to be transferred from one device (or segment) to another device (or segment) and to cloud computing resources. An intelligent surgical data network includes additional features to enable monitoring of traffic through the surgical data network and configuration of each port in the network hub 207 or network switch 209. The intelligent surgical data network may be referred to as a manageable hub or switch. The switching hub reads the destination address of each packet and then forwards the packet to the correct port.

[0195] Modular devices 1a-1n located in an operating room may be coupled to a modular communication hub 203. A network hub 207 and / or a network switch 209 may be coupled to a network router 211 to connect devices 1a-1n to a cloud 204 or a local computer system 210. Data associated with devices 1a-1n may be transmitted to a cloud-based computer via a router for remote data processing and manipulation. Data associated with devices 1a-1n may also be transmitted to a local computer system 210 for local data processing and manipulation. Modular devices 2a-2m located in the same operating room may also be coupled to a network switch 209. A network switch 209 may be coupled to a network hub 207 and / or a network router 211 to connect devices 2a-2m to a cloud 204. Data associated with devices 2a-2n may be transmitted to a cloud 204 via a network router 211 for data processing and manipulation. Data associated with devices 2a-2m may also be transmitted to a local computer system 210 for local data processing and manipulation.

[0196] It should be understood that the surgical data network 201 can be expanded by interconnecting multiple network hubs 207 and / or multiple network switches 209 with multiple network routers 211. The modular communication hub 203 can be included in a modular control tower that is configured to accommodate multiple devices 1a-1n / 2a-2m. A local computer system 210 can also be included in the modular control tower. The modular communication hub 203 is connected to a display 212 to display images obtained by some of the devices 1a-1n / 2a-2m during a surgical procedure, for example. In various aspects, devices 1a-1n / 2a-2m may include, for example, various modules, such as an imaging module 138 coupled to an endoscope, a generator module 140 coupled to an energy-based surgical device, a smoke evacuation module 126, a suction / irrigation module 128, a communication module 130, a processor module 132, a storage array 134, a surgical device connected to a display, and / or a non-contact sensor module in other modular devices that can be connected to a modular communication hub 203 of a surgical data network 201.

[0197] In one aspect, the surgical data network 201 may include a combination of (one or more) network hubs, (one or more) network switches, and (one or more) network routers that connect the devices 1a-1n / 2a-2m to the cloud. Any or all of the devices 1a-1n / 2a-2m coupled to the network hub or network switch can collect data in real time and transmit the data to a cloud computer for data processing and manipulation. It should be understood that cloud computing relies on shared computing resources rather than using local servers or personal devices to process software applications. The term "cloud" can be used as a metaphor for "Internet", although the term is not limited to this. Therefore, the term "cloud computing" can be used herein to refer to "a type of Internet-based computing", in which different services (such as servers, storage devices, and applications) are delivered to a modular communication hub 203 and / or a computer system 210 located in a surgical room (e.g., a fixed, mobile, temporary, or on-site operating room or space), and devices connected to the modular communication hub 203 and / or the computer system 210 via the Internet. The cloud infrastructure can be maintained by a cloud service provider. In this case, the cloud service provider may be an entity that coordinates the use and control of devices 1a-1n / 2a-2m located in one or more operating rooms. Cloud computing services may perform a large number of calculations based on data collected by smart surgical instruments, robots, and other computerized devices located in the operating room. Hub hardware enables multiple devices or connections to connect to a computer that communicates with cloud computing resources and storage.

[0198] Applying cloud computer data processing technology to the data collected by the devices 1a-1n / 2a-2m, the surgical data network provides improved surgical results, reduced costs and improved patient satisfaction. At least some of the devices 1a-1n / 2a-2m can be used to observe tissue status to evaluate leakage or perfusion of sealed tissue after tissue sealing and cutting procedures. At least some of the devices 1a-1n / 2a-2m can be used to identify pathology, such as the effects of disease, using cloud-based computing to examine data including images of body tissue samples for diagnostic purposes. This includes positioning and edge confirmation of tissue and phenotype. At least some of the devices 1a-1n / 2a-2m can be used to identify the anatomical structure of the body using various sensors integrated with imaging devices and technologies (such as overlapping images captured by multiple imaging devices). The data (including image data) collected by the devices 1a-1n / 2a-2m can be transmitted to the cloud 204 or the local computer system 210 or both for data processing and manipulation, including image processing and manipulation. The data can be analyzed to improve surgical outcomes by determining whether further treatment can be pursued, such as endoscopic interventions, emerging technologies, targeted radiation, targeted interventions, and precision robotic applications to tissue-specific sites and conditions. Such data analysis can be further processed using outcome analysis, and using standardized methods can provide helpful feedback to confirm surgical treatments and surgeon behavior, or suggest modifications to surgical treatments and surgeon behavior.

[0199] In one specific implementation, operating room devices 1a-1n may be connected to the modular communication hub 203 via a wired channel or a wireless channel, depending on the configuration of the devices 1a-1n to the network hub. In one aspect, the network hub 207 may be implemented as a local network broadcast device that operates on the physical layer of the open system interconnection (OSI) model. The network hub provides connections to devices 1a-1n located in the same operating room network. The network hub 207 collects data in the form of packets and sends it to a router in half-duplex mode. The network hub 207 does not store any media access control / internet protocol (MAC / IP) for transmitting device data. Only one of the devices 1a-1n can send data through the network hub 207 at a time. The network hub 207 has no knowledge of where to send information and broadcasts all network data on each connection and to the remote server 213 ( Fig. 9 ) Routing tables or intelligence that broadcasts all network data. The network hub 207 can detect basic network errors such as collisions, but broadcasting all information to multiple ports can pose security risks and cause bottlenecks.

[0200] In another specific implementation, the operating room devices 2a-2m can be connected to the network switch 209 through a wired channel or a wireless channel. The network switch 209 operates in the data link layer of the OSI model. The network switch 209 is a multicast device for connecting the devices 2a-2m located in the same operating room to the network. The network switch 209 sends data to the network router 211 in the form of a frame and operates in full-duplex mode. Multiple devices 2a-2m can send data simultaneously through the network switch 209. The network switch 209 stores and uses the MAC addresses of the devices 2a-2m to transmit data.

[0201] The network hub 207 and / or the network switch 209 are coupled to a network router 211 to connect to the cloud 204. The network router 211 operates in the network layer of the OSI model. The network router 211 creates a route for transmitting data packets received from the network hub 207 and / or the network switch 211 to cloud-based computer resources to further process and manipulate data collected by any or all of the devices 1a-1n / 2a-2m. The network router 211 can be used to connect two or more different networks located in different locations, such as, for example, different operating rooms in the same medical facility or different networks located in different operating rooms in different medical facilities. The network router 211 sends data to the cloud 204 in the form of packets and operates in full-duplex mode. Multiple devices can send data simultaneously. The network router 211 uses IP addresses to transmit data.

[0202] In one example, the network hub 207 may be implemented as a USB hub that allows multiple USB devices to be connected to a host computer. The USB hub may expand a single USB port to multiple levels so that more ports are available to connect devices to a host system computer. The network hub 207 may include wired or wireless capabilities for receiving information through a wired channel or a wireless channel. In one aspect, a wireless USB short-range, high-bandwidth wireless radio communication protocol may be used for communication between devices 1a-1n and devices 2a-2m located in an operating room.

[0203] In other examples, the operating room devices 1a-1n / 2a-2m can communicate with the modular communication hub 203 via the Bluetooth wireless technology standard for exchanging data from fixed and mobile devices over short distances (using short wavelength UHF radio waves in the ISM band of 2.4 to 2.485 GHz) and building a personal area network (PAN). In other aspects, the operating room devices 1a-1n / 2a-2m can communicate with the modular communication hub 203 via a variety of wireless or wired communication standards or protocols, including but not limited to Wi-Fi (IEEE 802.11 series), WiMAX (IEEE 802.16 series), IEEE 802.20, Long Term Evolution (LTE) and Ev-DO, HSPA+, HSDPA+, HSUPA+, EDGE, GSM, GPRS, CDMA, TDMA, DECT, and Ethernet derivatives thereof, and any other wireless and wired protocols designated as 3G, 4G, 5G and above. The computing module may include multiple communication modules. For example, the first communication module may be dedicated to shorter-range wireless communications such as Wi-Fi and Bluetooth, and the second communication module may be dedicated to longer-range wireless communications such as GPS, EDGE, GPRS, CDMA, WiMAX, LTE, Ev-DO, etc.

[0204] The modular communication hub 203 can serve as a central connection for one or all of the operating room devices 1a-1n / 2a-2m and handles data types called frames. The frames carry data generated by the devices 1a-1n / 2a-2m. When the modular communication hub 203 receives a frame, it is amplified and transmitted to the network router 211, which transmits the data to the cloud computing resources using multiple wireless or wired communication standards or protocols as described herein.

[0205] Modular communication hub 203 can be used as a standalone device or connected to compatible network hubs and network switches to form a larger network. Modular communication hub 203 is generally easy to install, configure and maintain, making it a good option for networking operating room devices 1a-1n / 2a-2m.

[0206] Fig. 9A computer-implemented interactive surgical system 200 is shown. The computer-implemented interactive surgical system 200 is similar in many respects to the computer-implemented interactive surgical system 100. For example, the computer-implemented interactive surgical system 200 includes one or more surgical systems 202 that are similar in many respects to the surgical system 102. Each surgical system 202 includes at least one surgical hub 206 in communication with a cloud 204, which may include a remote server 213. In one aspect, the computer-implemented interactive surgical system 200 includes a modular control tower 236 that is connected to a plurality of operating room devices, such as, for example, smart surgical instruments, robots, and other computerized devices located in the operating room. Fig.10 As shown in FIG, modular control tower 236 includes modular communication hub 203 coupled to computer system 210. Fig. 9 As shown in the example of , the modular control tower 236 is coupled to an imaging module 238 coupled to an endoscope 239, a generator module 240 coupled to an energy device 241, a smoke evacuator module 226, a suction / irrigation module 228, a communication module 230, a processor module 232, a storage array 234, a smart device / instrument 235 optionally coupled to a display 237, and a non-contact sensor module 242. The operating room devices are coupled to cloud computing resources and data storage via the modular control tower 236. The robotic hub 222 can also be connected to the modular control tower 236 and cloud computing resources. The devices / instruments 235, the visualization system 208, etc. can be coupled to the modular control tower 236 via wired or wireless communication standards or protocols, as described herein. The modular control tower 236 can be coupled to a hub display 215 (e.g., monitor, screen) to display and overlay images received from the imaging module, device / instrument display, and / or other visualization system 208. The hub display may also display data received from devices connected to the modular control tower along with images and overlays.

[0207] Fig.10 A surgical hub 206 is shown comprising a plurality of modules coupled to a modular control tower 236. The modular control tower 236 comprises a modular communication hub 203 (e.g., network connectivity means) and a computer system 210 to provide, for example, local processing, visualization, and imaging. Fig.10 As shown in , the modular communication hub 203 can be hierarchically configured to expand the number of modules (e.g., devices) that can be connected to the modular communication hub 203 and transmit data associated with the modules to the computer system 210, cloud computing resources, or both. Fig.10As shown in , each of the network hubs / switches in the modular communication hub 203 includes three downstream ports and one upstream port. The upstream network hub / switch is connected to the processor to provide communication connections with cloud computing resources and local display 217. Communication with the cloud 204 can be carried out through wired or wireless communication channels.

[0208] The surgical hub 206 employs a non-contact sensor module 242 to measure the size of the operating room and generates a map of the surgical room using an ultrasound or laser-based non-contact measurement device. The ultrasound-based non-contact sensor module scans the operating room by transmitting a burst of ultrasound waves and receiving an echo as it bounces off the walls of the operating room, as described in U.S. Provisional Patent Application Serial No. 62 / 611,341, entitled “INTERACTIVE SURGICAL PLATFORM,” filed on December 28, 2017, under the title “Surgical Hub Spatial Awareness Within an Operating Room,” which is incorporated herein by reference in its entirety, wherein the sensor module is configured to determine the size of the operating room and adjust the Bluetooth pairing distance limit. The laser-based non-contact sensor module scans the operating room by transmitting laser pulses, receiving laser pulses that bounce off the walls of the operating room, and comparing the phase of the transmitted pulses with the received pulses to determine the size of the operating room and adjust the Bluetooth pairing distance limit.

[0209] The computer system 210 includes a processor 244 and a network interface 245. The processor 244 is coupled to a communication module 247, a storage device 248, a memory 249, a non-volatile memory 250, and an input / output interface 251 via a system bus. The system bus may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus or external bus, and / or a local bus using any of a variety of available bus architectures including, but not limited to, a 9-bit bus, Industry Standard Architecture (ISA), Micro Charmel Architecture (MSA), Extended ISA (EISA), Intelligent Drive Electronics (IDE), VESA Local Bus (VLB), Peripheral Component Interconnect (PCI), USB, Advanced Graphics Port (AGP), Personal Computer Memory Card International Association bus (PCMCIA), Small Computer System Interface (SCSI), or any other peripheral bus.

[0210] Controller 244 may be any single-core or multi-core processor, such as those offered by Texas Instruments under the trade name ARM Cortex. In one aspect, the processor may be a commercially available ARM Cortex-M4F processor core, such as the Texas Instruments LM4F230H5QR, which includes 256KB of single-cycle flash or other non-volatile memory (up to 40 MHz) on-chip memory, a pre-fetch buffer for improved performance above 40 MHz, 32KB of single-cycle sequential random access memory (SRAM), a 32KB MCU loaded with Internal read-only memory (ROM) for software, 2KB electrically erasable programmable read-only memory (EEPROM), and / or one or more pulse width modulation (PWM) modules, one or more quadrature encoder input (QEI) simulations, one or more 12-bit analog-to-digital converters (ADCs) with 12 analog input channels, details of which can be found in the product data sheet.

[0211] In one aspect, the processor 244 may include a safety controller including two families based on controllers such as TMS570 and RM4x, known under the trade name Hercules ARM Cortex R4 also produced by Texas Instruments. The safety controller may be configured to be specialized for IEC 61508 and ISO26262 safety critical applications, among others, to provide advanced integrated safety features while delivering scalable performance, connectivity, and memory options.

[0212] System memory includes volatile memory and non-volatile memory. The basic input / output system (BIOS), which contains basic routines such as transferring information between elements within the computer system during startup, is stored in non-volatile memory. For example, non-volatile memory may include ROM, programmable ROM (PROM), electrically programmable ROM (EPROM), EEPROM, or flash memory. Volatile memory includes random access memory (RAM) that acts as external cache memory. In addition, RAM is available in a variety of forms, such as SRAM, dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM) enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM) and direct Rambus RAM (DRRAM).

[0213] Computer system 210 also includes removable / non-removable, volatile / non-volatile computer storage media, such as, for example, disk storage. Disk storage includes, but is not limited to, devices such as disk drives, floppy disk drives, tape drives, Jaz drives, Zip drives, LS-60 drives, flash memory cards, or memory sticks. In addition, disk storage may include storage media individually or in combination with other storage media, including but not limited to optical disk drives such as optical disk ROM devices (CD-ROM), optical disk recordable drives (CD-R drives), optical disk rewritable drives (CD-RW drives), or digital universal disk ROM drives (DVD-ROM). In order to facilitate the connection of the disk storage device to the system bus, a removable or non-removable interface may be used.

[0214] It should be understood that the computer system 210 includes software that acts as an intermediary between a user and the basic computer resources described in a suitable operating environment. Such software includes an operating system. An operating system that can be stored on a disk storage device is used to control and allocate the resources of the computer system. System applications use the operating system to manage resources through program modules and program data stored in system memory or disk storage devices. It should be understood that the various devices described herein can be implemented with various operating systems or combinations of operating systems.

[0215] The user inputs commands or information into the computer system 210 through (one or more) input devices coupled to the I / O interface 251. Input devices include, but are not limited to, pointing devices such as a mouse, a touch ball, a stylus, a touch pad, a keyboard, a microphone, a joystick, a game pad, a satellite dish, a scanner, a TV tuner card, a digital camera, a digital video camera, a web camera, etc. These and other input devices are connected to the processor through the system bus via (one or more) interface ports. (One or more) interface ports include, for example, serial ports, parallel ports, game ports, and USB. (One or more) output devices use the same type of port as (one or more) input devices. Thus, for example, a USB port can be used to provide input to the computer system and output information from the computer system to an output device. Output adapters are provided to illustrate that there are some output devices (such as monitors, displays, speakers, and printers) that require special adapters among other output devices. Output adapters include, by way of example, but are not limited to, video and sound cards that provide connection means between output devices and the system bus. It should be noted that other devices or systems of devices such as (one or more) remote computers provide both input capabilities and output capabilities.

[0216] Computer system 210 can operate in a networked environment using a logical connection with one or more remote computers (such as (one or more) cloud computers) or local computers. Remote cloud computers can be personal computers, servers, routers, network PCs, workstations, microprocessor-based appliances, peer devices or other public network nodes, etc., and generally include many or all of the elements described relative to the computer system. For simplicity, only a memory storage device with (one or more) remote computers is shown. (One or more) remote computers are logically connected to the computer system through a network interface, and then physically connected via a communication connection. The network interface covers communication networks such as local area networks (LANs) and wide area networks (WANs). LAN technologies include fiber distributed data interfaces (FDDI), copper distributed data interfaces (CDDI), Ethernet / IEEE 802.3, token ring / IEEE 802.5, etc. WAN technologies include, but are not limited to, point-to-point links, circuit switching networks such as integrated services digital networks (ISDN) and their variants, packet switching networks, and digital subscriber lines (DSL).

[0217] In various aspects, Fig.10 computer system 210, imaging module 238 and / or visualization system 208, and / or Figures 9 and 10 The processor module 232 may include an image processor, an image processing engine, a media processor, or any dedicated digital signal processor (DSP) for processing digital images. The image processor may employ parallel computing with single instruction, multiple data (SIMD) or multiple instructions, multiple data (MIMD) techniques to improve speed and efficiency. The digital image processing engine may perform a range of tasks. The image processor may be a system on a chip with a multi-core processor architecture.

[0218] The communication connection(s) refers to the hardware / software used to connect the network interface to the bus. Although the communication connections are shown for exemplary clarification within the computer system, they may also be located external to the computer system 210. The hardware / software necessary to connect to the network interface includes internal and external technologies such as modems, including conventional telephone grade modems, cable modems and DSL modems, ISDN adapters, and Ethernet cards for exemplary purposes only.

[0219] Fig.11A functional block diagram of one aspect of a USB network hub 300 device according to one aspect of the present disclosure is shown. In the illustrated aspect, the USB network hub device 300 employs a TUSB2036 integrated circuit hub from Texas Instruments. The USB network hub 300 is a CMOS device that provides an upstream USB transceiver port 302 and up to three downstream USB transceiver ports 304, 306, 308 according to the USB 2.0 specification. The upstream USB transceiver port 302 is a differential root data port that includes a differential data negative (DP0) input paired with a differential data positive (DM0) input. The three downstream USB transceiver ports 304, 306, 308 are differential data ports, each of which includes a differential data positive (DP1-DP3) output paired with a differential data negative (DM1-DM3) output.

[0220] The USB network hub 300 device is implemented with a digital state machine rather than a microcontroller, and does not require firmware programming. A fully compatible USB transceiver is integrated into the circuit for the upstream USB transceiver port 302 and all downstream USB transceiver ports 304, 306, 308. The downstream USB transceiver ports 304, 306, 308 support both full-speed devices and low-speed devices by automatically setting the conversion rate according to the speed of the device attached to the port. The USB network hub 300 device can be configured to be in bus-powered mode or self-powered mode, and includes a hub power logic 312 for managing power.

[0221] The USB network hub 300 device includes a serial interface engine 310 (SIE). The SIE 310 is the front end of the USB network hub 300 hardware and handles most of the protocols described in Chapter 8 of the USB specification. The SIE 310 generally includes up to transaction-level signaling. The functions it handles may include: packet identification, transaction ordering, SOP, EOP, RESET and RESUME signal detection / generation, clock / data separation, non-return to zero inversion (NRZI) data encoding / decoding and digit filling, CRC generation and verification (token and data), packet ID (PID) generation and verification / decoding, and / or serial-to-parallel / parallel-to-serial conversion. The 310 receives a clock input 314 and is coupled to a pause / resume logic and frame timer 316 circuit and a hub repeater circuit 318 to control the communication between the upstream USB transceiver port 302 and the downstream USB transceiver port 304, 306, 308 through the port logic circuit 320, 322, 324. SIE 310 is coupled to command decoder 326 via interface logic to control commands from the serial EEPROM via serial EEPROM interface 330 .

[0222] In various aspects, the USB network hub 300 can connect 127 functions configured in up to six logical layers (hierarchies) to a single computer. In addition, the USB network hub 300 can be connected to all external devices using a standardized four-wire cable that provides both communication and power distribution. The power is configured as a bus-powered mode and a self-powered mode. The USB network hub 300 can be configured to support four power management modes: a bus-powered hub with individual port power management or a complete set of port power management, and a self-powered hub with individual port power management or a complete set of port power management. In one aspect, using a USB cable, the USB network hub 300 inserts the upstream USB transceiver port 302 into the USB host controller, and exposes the downstream USB transceiver ports 304, 306, 308 for connecting USB compatible devices, etc.

[0223] Surgical Instrument Hardware

[0224] Fig.12 A logic diagram of a control system 470 of a surgical instrument or tool according to one or more aspects of the present disclosure is shown. The system 470 includes a control circuit. The control circuit includes a microcontroller 461, which includes a processor 462 and a memory 468. For example, one or more of the sensors 472, 474, 476 provide real-time feedback to the processor 462. A motor 482 driven by a motor driver 492 is operably coupled to a displacement member capable of longitudinal movement to drive an I-beam blade element. The tracking system 480 is configured to determine the position of the displacement member capable of longitudinal movement. The position information is provided to the processor 462, which can be programmed or configured to determine the position of the drive member capable of longitudinal movement and the position of the firing member, the firing rod, and the I-beam blade element. Additional motors may be provided at the tool driver interface to control I-beam firing, closure tube travel, shaft rotation, and joint movement. The display 473 displays a variety of operating conditions of the instrument and may include a touch screen function for data input. The information displayed on the display 473 may be superimposed with an image acquired via an endoscopic imaging module.

[0225] In one aspect, the microprocessor 461 can be any single-core or multi-core processor, such as those known under the trade name ARM Cortex produced by Texas Instruments. In one aspect, the microcontroller 461 can be a LM4F230H5QR ARM Cortex-M4F processor core available from, for example, Texas Instruments, which includes 256KB of single-cycle flash or other non-volatile memory (up to 40 MHz) on-chip memory, a pre-fetch buffer for improved performance above 40 MHz, 32KB of single-cycle SRAM, a 32-bit MCU, and a 32-bit MCU. Internal ROM for software, 2KB electrical EEPROM, one or more PWM modules, one or more QEI analog, one or more 12-bit ADC with 12 analog input channels, details of which can be found in the product data sheet.

[0226] In one aspect, the microcontroller 461 may include a safety controller including two families based on controllers such as TMS570 and RM4x, known under the trade name Hercules ARM Cortex R4 also produced by Texas Instruments. The safety controller may be configured to be specialized for IEC 61508 and ISO26262 safety critical applications, among others, to provide advanced integrated safety features while delivering scalable performance, connectivity, and memory options.

[0227] The microcontroller 461 can be programmed to perform various functions, such as precise control of the speed and position of the knife and articulation system. In one aspect, the microcontroller 461 includes a processor 462 and a memory 468. The electric motor 482 can be a brushed DC (DC) motor having a gear box and a mechanical link to the articulation or knife system. In one aspect, the motor driver 492 can be an A3941 available from Allegro Microsystems, Inc. Other motor drivers can be easily replaced for use in the tracking system 480 including an absolute positioning system. A detailed description of the absolute positioning system is described in U.S. Patent Application Publication No. 2017 / 0296213 entitled SYSTEMS AND METHODS FOR CONTROLLING A SURGICAL STAPLING AND CUTTING INSTRUMENT published on October 19, 2017, which is incorporated herein by reference in its entirety.

[0228] The microcontroller 461 can be programmed to provide precise control of the speed and position of the displacement member and articulation system. The microcontroller 461 can be configured to be able to calculate the response in the software of the microcontroller 461. The calculated response is compared with the measured response of the actual system to obtain the "observed" response, which is used for actual feedback decisions. The observed response is a favorable tuning value that balances the smooth continuous nature of the simulated response with the measured response, which can detect external influences on the system.

[0229] In one aspect, the motor 482 can be controlled by a motor driver 492 and can be adopted by the firing system of a surgical instrument or tool. In various forms, the motor 482 can be a brushed DC drive motor with a maximum rotation speed of about 25,000 RPM. In other arrangements, the motor 482 may include a brushless motor, a cordless motor, a synchronous motor, a stepper motor, or any other suitable electric motor. The motor driver 492 may include, for example, an H-bridge driver including a field effect transistor (FET). The motor 482 can be powered by a power assembly that can be releasably mounted to a handle assembly or a tool housing for supplying control power to a surgical instrument or tool. The power assembly may include a battery that may include a plurality of battery cells connected in series that can be used as a power source to provide power to a surgical instrument or tool. In some cases, the battery cells of the power assembly may be replaceable and / or rechargeable. In at least one example, the battery cell may be a lithium-ion battery that can be coupled to the power assembly and can be separated from the power assembly.

[0230] The motor driver 492 may be an A3941 available from Allegro Microsystems, Inc. The A3941492 is a full-bridge controller for use with an external N-channel power metal oxide semiconductor field effect transistor (MOSFET) specifically designed for inductive loads such as brushed DC motors. The driver 492 includes a unique charge pump regulator that provides full (>10V) gate drive for battery voltages as low as 7V and allows the A3941 to operate at a reduced gate drive as low as 5.5V. A bootstrap capacitor may be used to provide the above-mentioned battery supply voltage required for the N-channel MOSFET. The internal charge pump of the high-side driver allows DC (100% duty cycle) operation. The full bridge may be driven in fast decay mode or slow decay mode using diodes or synchronous rectification. In slow decay mode, current recirculation may pass through the high-side or low-side FET. The power FET is protected from breakdown by a resistor-adjustable dead time. Overall diagnostics provide indications of undervoltage, overheating, and power bridge faults, and may be configured to protect the power MOSFET under most short circuit conditions. Other motor drives may be easily substituted for use in tracking system 480 including an absolute positioning system.

[0231] The tracking system 480 includes a controlled motor drive circuit arrangement including a position sensor 472 according to one aspect of the present disclosure. The position sensor 472 for the absolute positioning system provides a unique position signal corresponding to the position of the displacement member. In one aspect, the displacement member represents a drive member capable of longitudinal movement, which includes a rack of drive teeth for meshing engagement with a corresponding drive gear of the gear reducer assembly. In other aspects, the displacement member represents a firing member, which can be adapted and configured to include a rack of drive teeth. In another aspect, the displacement member represents a firing rod or an I-beam, each of which can be adapted and configured to include a rack of drive teeth. Therefore, as used herein, the term displacement member is generally used to refer to any movable member of a surgical instrument or tool such as a driving member, a firing member, a firing rod, an I-beam, or any element that can be displaced. In one aspect, the drive member capable of longitudinal movement is coupled to the firing member, the firing rod, and the I-beam. Therefore, the absolute positioning system can actually track the linear displacement of the I-beam by tracking the linear displacement of the drive member capable of longitudinal movement. In various other aspects, the displacement member may be coupled to any position sensor 472 suitable for measuring linear displacement. Thus, the longitudinally movable drive member, firing member, firing rod or I-beam or a combination thereof may be coupled to any suitable linear displacement sensor. The linear displacement sensor may include a contact displacement sensor or a non-contact displacement sensor. The linear displacement sensor may include a linear variable differential transformer (LVDT), a differential variable reluctance transducer (DVRT), a slide potentiometer, a magnetic sensing system including a movable magnet and a series of linearly arranged Hall effect sensors, a magnetic sensing system including a fixed magnet and a series of movable linearly arranged Hall effect sensors, an optical sensing system including a movable light source and a series of linearly arranged photodiodes or photodetectors, an optical sensing system including a fixed light source and a series of movable linearly arranged photodiodes or photodetectors, or any combination thereof.

[0232] The electric motor 482 may include a rotatable shaft operably interfacing with a gear assembly that is mounted on the displacement member in meshing engagement with a group or rack of drive teeth. The sensor element may be operably coupled to the gear assembly so that a single rotation of the position sensor 472 element corresponds to some linear longitudinal translation of the displacement member. The arrangement of the gear transmission and the sensor may be connected to a linear actuator via a rack and pinion arrangement, or to a rotary actuator via a spur gear or other connection. The power source supplies power to the absolute positioning system, and the output indicator may display the output of the absolute positioning system. The displacement member represents a drive member capable of longitudinal movement, the drive member capable of longitudinal movement including a rack of drive teeth formed thereon for meshing engagement with a corresponding drive gear of the gear reducer assembly. The displacement member represents a firing member, a firing rod, an I-beam, or a combination thereof capable of longitudinal movement.

[0233] A single rotation of the sensor element associated with the position sensor 472 is equivalent to a longitudinal linear displacement of the displacement member d1, where d1 is the longitudinal linear distance the displacement member moves from point "a" to point "b" after a single rotation of the sensor element coupled to the displacement member. The sensor arrangement may be connected via a gear reduction that enables the position sensor 472 to complete only one or more rotations for a full stroke of the displacement member. The position sensor 472 may complete multiple rotations for a full stroke of the displacement member.

[0234] A series of switches (where n is an integer greater than one) may be employed alone or in combination with gear reduction to provide unique position signals for more than one rotation of the position sensor 472. The state of the switches is fed back to the microcontroller 461, which applies logic to determine a unique position signal corresponding to the longitudinal linear displacement d1+d2+...dn of the displacement member. The output of the position sensor 472 is provided to the microcontroller 461. The position sensor 472 of this sensor arrangement may include a magnetic sensor, an analog rotation sensor (such as a potentiometer), an array of analog Hall effect elements that output a unique combination of position signals or values.

[0235] Position sensor 472 may include any number of magnetic sensing elements, such as, for example, magnetic sensors classified according to whether they measure the total magnetic field or the vector component of the magnetic field. The technologies used to produce the above two types of magnetic sensors cover many aspects of physics and electronics. Technologies for magnetic field sensing include probe coils, fluxgates, optical pumps, nuclear spins, superconducting quantum interference devices (SQUIDs), Hall effects, anisotropic magnetoresistance, giant magnetoresistance, magnetic tunnel junctions, giant magnetoimpedance, magnetostrictive / piezoelectric composites, magnetosensitive diodes, magnetosensitive transistors, optical fibers, magneto-optics, and magnetic sensors based on micro-electromechanical systems, among others.

[0236] In one aspect, the position sensor 472 for the tracking system 480 including the absolute positioning system includes a magnetic rotation absolute positioning system. The position sensor 472 can be implemented as an AS5055EQFT monolithic magnetic rotation position sensor, which can be purchased from Austria Microsystems, AG. The position sensor 472 interfaces with the microcontroller 461 to provide an absolute positioning system. The position sensor 472 is a low voltage and low power device and includes four Hall effect elements in the area of ​​the position sensor 472 located on the magnet. A high resolution ADC and an intelligent power management controller are also provided on the chip. A coordinate rotation digital computer (CORDIC) processor (also known as the bitwise method and Volder algorithm) is provided to perform a simple and efficient algorithm to calculate hyperbolic and trigonometric functions, which only requires addition, subtraction, digit shift and table lookup operations. The angular position, alarm bit and magnetic field information are transmitted to the microcontroller 461 via a standard serial communication interface (such as a serial peripheral interface (SPI) interface). The position sensor 472 provides 12 or 14 bit resolution. The position sensor 472 may be an AS5055 chip provided in a small QFN 16-pin 4×4×0.85 mm package.

[0237] The tracking system 480 including the absolute positioning system may include and / or may be programmed to implement a feedback controller such as a PID, state feedback, and an adaptive controller. The power source converts the signal from the feedback controller into a physical input to the system: in this case, a voltage. Other examples include PWM of voltage, current, and force. In addition to the position measured by the position sensor 472, other sensor(s) may be provided to measure physical parameters of the physical system. In some aspects, the other sensor(s) may include sensor arrangements such as those described in U.S. Patent No. 9,345,481, entitled STAPLE CARTRIDGE TISSUE THICKNESS, issued on May 24, 2016, which is incorporated herein by reference in its entirety; U.S. Patent Application Publication No. 2014 / 0263552, entitled STAPLE CARTRIDGE TISSUE THICKNESS, issued on September 18, 2014, which is incorporated herein by reference in its entirety; and U.S. Patent Application Serial No. 15 / 628,175, entitled TECHNIQUES FOR ADAPTIVE CONTROL OF MOTOR VELOCITY OF A SURGICAL STAPLING AND CUTTING INSTRUMENT, filed on June 20, 2017, which is incorporated herein by reference in its entirety. In a digital signal processing system, the absolute positioning system is coupled to a digital data acquisition system, where the output of the absolute positioning system will have a finite resolution and sampling frequency. The absolute positioning system may include comparison and combination circuits to combine the calculated response with the measured response using an algorithm (such as weighted average and theoretical control loop) that drives the calculated response toward the measured response. The calculated response of the physical system takes into account characteristics such as mass, inertia, viscous friction, inductance and resistance to predict the state and output of the physical system by knowing the input.

[0238] Thus, the absolute positioning system provides the absolute position of the displacement member when the instrument is powered on, and does not retract or advance the displacement member to a reset (zero or home) position as may be required with conventional rotary encoders, which simply count the number of forward or backward steps taken by the motor 482 to infer the position of the device actuator, drive rod, knife, etc.

[0239] The sensor 474 (such as, for example, a strain gauge or a micro strain gauge) is configured to measure one or more parameters of the end effector, such as, for example, the amplitude of the strain applied to the anvil during the clamping operation, which can indicate the closing force applied to the anvil. The measured strain is converted into a digital signal and provided to the processor 462. Alternatively or in addition to the sensor 474, the sensor 476 (such as, for example, a load sensor) can measure the closing force applied to the anvil by the closed drive system. The sensor 476 (such as, for example, a load sensor) can measure the firing force applied to the I-beam during the firing stroke of the surgical instrument or tool. The I-beam is configured to engage a wedge-shaped sliding member, which is configured to enable the nail driver to cam upward to push the nail out to contact with the deformation of the anvil. The I-beam also includes a sharp cutting edge, which can be used to cut off tissue when the I-beam is pushed distally by the firing rod. Alternatively, a current sensor 478 can be used to measure the current consumed by the motor 482. The force required to advance the firing member may correspond to, for example, the current consumed by the motor 482. The measured force is converted into a digital signal and provided to the processor 462.

[0240] In one form, a strain gauge sensor 474 can be used to measure the force applied to the tissue by the end effector. A strain gauge can be coupled to the end effector to measure the force on the tissue processed by the end effector. A system for measuring the force applied to the tissue grasped by the end effector includes a strain gauge sensor 474, such as, for example, a micro strain gauge, which is configured to measure, for example, one or more parameters of the end effector. In one aspect, the strain gauge sensor 474 can measure the amplitude or magnitude of the strain applied to the jaw member of the end effector during the clamping operation, which can indicate tissue compression. The measured strain is converted into a digital signal and provided to the processor 462 of the microcontroller 461. The load sensor 476 can measure the force used to operate the knife element, for example, to cut the tissue captured between the anvil and the nail magazine. A magnetic field sensor can be used to measure the thickness of the captured tissue. The measurement value of the magnetic field sensor can also be converted into a digital signal and provided to the processor 462.

[0241] The microcontroller 461 can characterize the corresponding values ​​of the selected position of the firing member and / or the velocity of the firing member using the measurements of tissue compression, tissue thickness, and / or the force required to close the end effector measured by the sensors 474, 476, respectively. In one example, the memory 468 can store techniques, formulas, and / or lookup tables that can be used by the microcontroller 461 in the evaluation.

[0242] The control system 470 of the surgical instrument or tool may also include wired or wireless communication circuitry to communicate with the modular communication hub, such as Figure 8-11 as shown in .

[0243] Fig.13 A control circuit 500 is shown, which is configured to control various aspects of a surgical instrument or tool according to one aspect of the present disclosure. The control circuit 500 may be configured to implement the various methods described herein. The circuit 500 may include a microcontroller, which includes one or more processors 502 (e.g., microprocessors, microcontrollers) coupled to at least one memory circuit 504. The memory circuit 504 stores machine executable instructions that cause the processor 502 to execute machine instructions to implement the various processes described herein when executed by the processor 502. The processor 502 may be any of a variety of single-core or multi-core processors known in the art. The memory circuit 504 may include a volatile storage medium and a non-volatile storage medium. The processor 502 may include an instruction processing unit 506 and an operation unit 508. The instruction processing unit may be configured to receive instructions from the memory circuit 504 of the present disclosure.

[0244] Fig.14 Combinatorial logic circuit 510 is shown, which is configured to control various aspects of a surgical instrument or tool according to one aspect of the present disclosure. Combinatorial logic circuit 510 can be configured to implement various methods described herein. Combinatorial logic circuit 510 may include a finite state machine that includes combinatorial logic 512 that is configured to receive data associated with a surgical instrument or tool at input 514, process the data through combinatorial logic 512, and provide output 516.

[0245] Fig.15 A sequential logic circuit 520 configured to control various aspects of a surgical instrument or tool is shown according to one aspect of the present disclosure. The sequential logic circuit 520 or the combinatorial logic 522 may be configured to implement the various methods described herein. The sequential logic circuit 520 may include a finite state machine. The sequential logic circuit 520 may include, for example, the combinatorial logic 522, at least one memory circuit 524, and a clock 529. The at least one memory circuit 524 may store the current state of the finite state machine. In some cases, the sequential logic circuit 520 may be synchronous or asynchronous. The combinatorial logic 522 is configured to receive data associated with a surgical instrument or tool from an input 526, process the data through the combinatorial logic 522, and provide an output 528. In other aspects, the circuit may include a processor (e.g., the processor 502, Fig.13 ) and a finite state machine to implement the various processes herein. In other embodiments, the finite state machine may include a combinational logic circuit (e.g., combinational logic circuit 510, Fig.14 ) and a sequential logic circuit 520.

[0246] Fig.16A surgical instrument or tool is shown that includes multiple motors that can be activated to perform various functions. In some cases, a first motor can be activated to perform a first function, a second motor can be activated to perform a second function, and a third motor can be activated to perform a third function. In some cases, multiple motors of the robotic surgical instrument 600 can be individually activated to cause a firing motion, a closing motion, and / or an articulation motion in an end effector. The firing motion, the closing motion, and / or the articulation motion can be transmitted to the end effector, for example, via a shaft assembly.

[0247] In some cases, the surgical instrument system or tool may include a firing motor 602. The firing motor 602 may be operably coupled to a firing motor drive assembly 604, which may be configured to transmit the firing motion generated by the motor 602 to the end effector, specifically for displacing the I-shaped beam element. In some cases, the firing motion generated by the motor 602 may cause, for example, a nail to be deployed from a nail magazine into tissue captured by the end effector and / or cause the cutting edge of the I-shaped beam element to be advanced to cut the captured tissue. The I-shaped beam element may be retracted by reversing the direction of the motor 602.

[0248] In some cases, the surgical instrument or tool may include a closing motor 603. The closing motor 603 may be operably coupled to a closing motor drive assembly 605, which is configured to transmit the closing motion generated by the motor 603 to the end effector, specifically for displacing the closing tube to close the anvil and compressing the tissue between the anvil and the staple cartridge. The closing motion may cause, for example, the end effector to transition from an open configuration to a close configuration to capture tissue. The end effector may be transitioned to an open position by reversing the direction of the motor 603.

[0249] In some cases, the surgical instrument or tool may include, for example, one or more articulation motors 606a, 606b. The motors 606a, 606b may be operably coupled to respective articulation motor drive assemblies 608a, 608b, which may be configured to transmit the articulation generated by the motors 606a, 606b to the end effector. In some cases, the articulation may cause the end effector to articulate relative to an axis, for example.

[0250] As described above, the surgical instrument or tool may include multiple motors that may be configured to perform various independent functions. In some cases, multiple motors of the surgical instrument or tool may be individually or independently activated to perform one or more functions, while other motors remain inactive. For example, articulation motors 606a, 606b may be activated to articulate the end effector, while firing motor 602 remains inactive. Alternatively, firing motor 602 may be activated to fire multiple nails and / or advance cutting edges, while articulation motor 606 remains inactive. In addition, closing motor 603 may be activated simultaneously with firing motor 602 to advance the closing tube and I-beam element toward the distal side, as described in more detail below.

[0251] In some cases, a surgical instrument or tool may include a common control module 610 that can be used with multiple motors of the surgical instrument or tool. In some cases, the common control module 610 can adjust one of the multiple motors at a time. For example, the common control module 610 can be individually coupled to multiple motors of the surgical instrument and can be separated from the multiple motors of the surgical instrument. In some cases, multiple motors of the surgical instrument or tool can share one or more common control modules such as the common control module 610. In some cases, multiple motors of the surgical instrument or tool can independently and selectively engage the common control module 610. In some cases, the common control module 610 can switch from interfacing with one of the multiple motors of the surgical instrument or tool to interfacing with another of the multiple motors of the surgical instrument or tool.

[0252] In at least one example, the common control module 610 can selectively switch between operably engaging the articulation motors 606a, 606b and operably engaging the firing motor 602 or the closing motor 603. Fig.16 As shown in , the switch 614 can move or change between multiple positions and / or states. In the first position 616, the switch 614 can electrically couple the common control module 610 to the firing motor 602; in the second position 617, the switch 614 can electrically couple the common control module 610 to the closing motor 603; in the third position 618a, the switch 614 can electrically couple the common control module 610 to the first joint motion motor 606a; and in the fourth position 618b, the switch 614 can electrically couple the common control module 610 to, for example, the second joint motion motor 606b. In some cases, a separate common control module 610 can be electrically coupled to the firing motor 602, the closing motor 603, and the joint motion motors 606a, 606b at the same time. In some cases, the switch 614 can be a mechanical switch, an electromechanical switch, a solid-state switch, or any suitable switch mechanism.

[0253] Each of the motors 602, 603, 606a, 606b may include a torque sensor to measure the output torque on the shaft of the motor. The force on the end effector may be sensed in any conventional manner, such as by a force sensor on the outside of the jaws or by a torque sensor of the motor used to actuate the jaws.

[0254] In various cases, such as Fig.16 As shown in , the common control module 610 may include a motor driver 626, which may include one or more H-bridge field effect FETs. The motor driver 626 may regulate the power transmitted from a power source 628 to a motor coupled to the common control module 610, for example, based on input from a microcontroller 620 ("controller"). In some cases, when a motor is coupled to the common control module 610, the microcontroller 620 may be used, for example, to determine the current consumed by the motor, as described above.

[0255] In some cases, microcontroller 620 may include a microprocessor 622 ("processor") and one or more non-transitory computer-readable media or storage units 624 ("memory"). In some cases, memory 624 may store various program instructions that, when executed, may cause processor 622 to perform a number of functions and / or calculations described herein. In some cases, one or more of memory units 624 may be coupled to processor 622, for example.

[0256] In some cases, the power source 628 can be used, for example, to power the microcontroller 620. In some cases, the power source 628 can include a battery (or "battery pack" or "power pack"), such as a lithium-ion battery, for example. In some cases, the battery pack can be configured to be releasably mounted to the handle for powering the surgical instrument 600. A plurality of battery cells connected in series can be used as the power source 628. In some cases, the power source 628 can be, for example, replaceable and / or rechargeable.

[0257] In various cases, the processor 622 may control the motor driver 626 to control the position, rotation direction, and / or speed of the motor coupled to the common controller 610. In some cases, the processor 622 may signal the motor driver 626 to stop and / or deactivate the motor coupled to the common controller 610. It should be understood that the term "processor" as used herein includes any suitable microprocessor, microcontroller, or other basic computing device that combines the functions of the central processing unit (CPU) of a computer on one integrated circuit or at most several integrated circuits. A processor is a multi-purpose programmable device that receives digital data as input, processes the input according to instructions stored in its memory, and then provides a result as output. Because the processor has internal memory, it is an example of sequential digital logic. The operating objects of the processor are numbers and symbols represented in the binary number system.

[0258] In one example, processor 622 may be any single-core or multi-core processor, such as those known under the trade name ARM Cortex produced by Texas Instruments. In some cases, microcontroller 620 may be, for example, LM 4F230H5QR available from Texas Instruments. In at least one example, Texas Instruments LM4F230H5QR is an ARM Cortex-M4F processor core, which includes: 256KB of single-cycle flash or other non-volatile memory (up to 40MHz) on-chip memory, a pre-fetch buffer for improved performance above 40MHz, 32KB of single-cycle SRAM, a CPU loaded with The 4410 includes an internal ROM for software, 2KB of EEPROM, one or more PWM modules, one or more QEI simulations, one or more 12-bit ADCs with 12 analog input channels, and other features readily available from product data sheets. Other microcontrollers can be easily substituted for use with module 4410. Therefore, the present disclosure should not be limited to this context.

[0259] In some cases, the memory 624 may include program instructions for controlling each of the motors of the surgical instrument 600 that may be coupled to the common controller 610. For example, the memory 624 may include program instructions for controlling the firing motor 602, the closing motor 603, and the articulation motors 606a, 606b. Such program instructions may cause the processor 622 to control the firing, closing, and articulation functions based on input from an algorithm or control program of the surgical instrument or tool.

[0260] In some cases, one or more mechanisms and / or sensors (such as, for example, sensor 630) can be used to alert the processor 622 to program instructions that should be used in a particular setting. For example, the sensor 630 can alert the processor 622 to use program instructions associated with firing, closing, and articulating the end effector. In some cases, the sensor 630 can include, for example, a position sensor that can be used to sense the position of the switch 614. Thus, the processor 622 can use program instructions associated with firing the I-beam of the end effector when, for example, the sensor 630 detects that the switch 614 is in the first position 616; the processor 622 can use program instructions associated with closing the anvil when, for example, the sensor 630 detects that the switch 614 is in the second position 617; and the processor 622 can use program instructions associated with articulating the end effector when, for example, the sensor 630 detects that the switch 614 is in the third position 618a or the fourth position 618b.

[0261] Fig.17 7 is a schematic diagram of a robotic surgical instrument 700 configured to operate the surgical tools described herein according to one aspect of the present disclosure. The robotic surgical instrument 700 can be programmed or configured to control distal / proximal translation of a displacement member, distal / proximal displacement of a closure tube, shaft rotation, and articulation with a single or multiple articulation drive links. In one aspect, the surgical instrument 700 can be programmed or configured to individually control a firing member, a closure member, an axis member, and / or one or more articulation members. The surgical instrument 700 includes a control circuit 710 that is configured to control a motor-driven firing member, a closure member, an axis member, and / or one or more articulation members.

[0262] In one aspect, the robotic surgical instrument 700 includes a control circuit 710 configured to control the anvil 716 and I-beam 714 (including sharp cutting edges) portions of the end effector 702 via a plurality of motors 704a to 704e, a removable staple cartridge 718, an axis 740, and one or more articulation members 742a, 742b. A position sensor 734 may be configured to provide position feedback of the I-beam 714 to the control circuit 710. Other sensors 738 may be configured to provide feedback to the control circuit 710. A timer / counter 731 provides timing and counting information to the control circuit 710. An energy source 712 may be provided to operate the motors 704a-704e, and a current sensor 736 provides motor current feedback to the control circuit 710. The motors 704a to 704e may be individually operated by the control circuit 710 in open-loop or closed-loop feedback control.

[0263] In one aspect, the control circuit 710 may include one or more microcontrollers, microprocessors, or other suitable processors for executing instructions that cause the one or more processors to perform one or more tasks. In one aspect, the timer / counter 731 provides an output signal, such as an elapsed time or a digital count, to the control circuit 710 to correlate the position of the I-beam 714 as determined by the position sensor 734 with the output of the timer / counter 731 so that the control circuit 710 can determine the position of the I-beam 714 at a particular time (t) relative to a starting position or a time (t) when the I-beam 714 is at a particular position relative to a starting position. The timer / counter 731 can be configured to be able to measure elapsed time, count external events, or time external events.

[0264] In one aspect, the control circuit 710 can be programmed to control the function of the end effector 702 based on one or more tissue conditions. The control circuit 710 can be programmed to sense tissue conditions, such as thickness, directly or indirectly, as described herein. The control circuit 710 can be programmed to select a firing control program or a closing control program based on the tissue conditions. The firing control program can describe the distal movement of the displacement member. Different firing control programs can be selected to better handle different tissue conditions. For example, the control circuit 710 can be programmed to translate the displacement member at a lower speed and / or at a lower power when thicker tissue is present. The control circuit 710 can be programmed to translate the displacement member at a higher speed and / or at a higher power when thinner tissue is present. The closing control program can control the closing force applied to the tissue by the anvil 716. Other control programs control the rotation of the shaft 740 and the articulation members 742a, 742b.

[0265] In one aspect, the control circuit 710 may generate a motor set point signal. The motor set point signal may be provided to various motor controllers 708a-708e. The motor controllers 708a-708e may include one or more circuits configured to provide motor drive signals to the motors 704a-704e to drive the motors 704a-704e as described herein. In some examples, the motors 704a-704e may be brushed DC electric motors. For example, the speed of the motors 704a-704e may be proportional to the corresponding motor drive signals. In some examples, the motors 704a-704e may be brushless DC motors, and the corresponding motor drive signals may include PWM signals provided to one or more stator windings of the motors 704a-704e. Moreover, in some examples, the motor controllers 708a-708e may be omitted, and the control circuit 710 may directly generate the motor drive signals.

[0266] In one aspect, the control circuit 710 can initially operate each of the motors 704a-704e in an open-loop configuration for a first open-loop portion of the travel of the displacement member. Based on the response of the robotic surgical instrument 700 during the open-loop portion of the travel, the control circuit 710 can select a firing control program in a closed-loop configuration. The response of the instrument can include the translation distance of the displacement member during the open-loop portion, the time consumed during the open-loop portion, the energy provided to one of the motors 704a-704e during the open-loop portion, the sum of the pulse widths of the motor drive signal, etc. After the open-loop portion, the control circuit 710 can implement the selected firing control program for a second portion of the travel of the displacement member. For example, during the closed-loop portion of the travel, the control circuit 710 can modulate one of the motors 704a-704e based on the translation data describing the position of the displacement member in a closed-loop manner to cause the displacement member to translate at a constant speed.

[0267] In one aspect, the motors 704a-704e may receive power from the energy source 712. The energy source 712 may be a DC power source driven by a main AC power source, a battery, a supercapacitor, or any other suitable energy source. The motors 704a-704e may be mechanically coupled to separate movable mechanical elements, such as the I-beam 714, the anvil 716, the shaft 740, the articulation 742a, and the articulation 742b, via corresponding transmission devices 706a-706e. The transmission devices 706a-706e may include one or more gears or other linkage devices to couple the motors 704a-704e to the movable mechanical elements. The position sensor 734 may sense the position of the I-beam 714. The position sensor 734 may be or include any type of sensor capable of generating position data indicating the position of the I-beam 714. In some examples, the position sensor 734 may include an encoder configured to provide a series of pulses to the control circuit 710 when the I-beam 714 is translated toward the distal side and toward the proximal side. The control circuit 710 can track the pulses to determine the position of the I-beam 714. Other suitable position sensors can be used, including, for example, proximity sensors. Other types of position sensors can provide other signals indicating the movement of the I-beam 714. Moreover, in some examples, the position sensor 734 can be omitted. In the case where any of the motors 704a to 704e is a stepper motor, the control circuit 710 can track the position of the I-beam 714 by summing up the number and direction of steps that the motor 704 has been commanded to perform. The position sensor 734 can be located in the end effector 702 or at any other part of the instrument. The output of each of the motors 704a-704e includes a torque sensor 744a-744e for sensing force, and has an encoder for sensing the rotation of the drive shaft.

[0268] In one aspect, the control circuit 710 is configured to drive a firing member such as an I-beam 714 portion of the end effector 702. The control circuit 710 provides a motor set point to a motor control 708a, which provides a drive signal to the motor 704a. The output shaft of the motor 704a is coupled to a torque sensor 744a. The torque sensor 744a is coupled to a transmission device 706a, which is coupled to the I-beam 714. The transmission device 706a includes a movable mechanical element such as a rotating element and a firing member to control the movement of the I-beam 714 along the longitudinal axis of the end effector 702 toward the distal side and toward the proximal side. In one aspect, the motor 704a can be coupled to a knife gear assembly, which includes a knife gear reduction group, and the knife gear reduction group includes a first knife drive gear and a second knife drive gear. The torque sensor 744a provides a firing force feedback signal to the control circuit 710. The firing force signal represents the force required to fire or displace the I-beam 714. The position sensor 734 can be configured to provide the position of the I-beam 714 along the firing stroke or the position of the firing member as a feedback signal to the control circuit 710. The end actuator 702 may include an additional sensor 738 configured to provide a feedback signal to the control circuit 710. When ready for use, the control circuit 710 can provide a firing signal to the motor control 708a. In response to the firing signal, the motor 704a can drive the firing member from the proximal stroke start position to the distal end of the stroke start position along the longitudinal axis of the end actuator 702. When the firing member is translated toward the distal side, the I-beam 714 with the cutting element positioned at the distal end is advanced toward the distal side to cut the tissue between the nail magazine 718 and the anvil 716.

[0269] In one aspect, the control circuit 710 is configured to drive a closing member, such as the anvil 716 portion of the end effector 702. The control circuit 710 provides a motor set point to the motor control 708b, which provides a drive signal to the motor 704b. The output shaft of the motor 704b is coupled to the torque sensor 744b. The torque sensor 744b is coupled to the transmission device 706b, which is coupled to the anvil 716. The transmission device 706b includes a movable mechanical element such as a rotating element and a closing member to control the movement of the anvil 716 from an open position and a closed position. In one aspect, the motor 704b is coupled to a closing gear assembly, which includes a closing reduction gear set supported to mesh with a closing spur gear. The torque sensor 744b provides a closing force feedback signal to the control circuit 710. The closing force feedback signal represents the closing force applied to the anvil 716. The position sensor 734 can be configured to provide the position of the closing member as a feedback signal to the control circuit 710. The additional sensor 738 in the end effector 702 can provide a closing force feedback signal to the control circuit 710. The pivotable anvil 716 is positioned opposite the staple cartridge 718. When ready for use, the control circuit 710 can provide a closing signal to the motor control 708b. In response to the closing signal, the motor 704b advances the closing member to grasp the tissue between the anvil 716 and the staple cartridge 718.

[0270] In one aspect, the control circuit 710 is configured to enable a shaft member such as shaft 740 to rotate so that the end effector 702 rotates. The control circuit 710 provides a motor set point to a motor control 708c, which provides a drive signal to the motor 704c. The output shaft of the motor 704c is coupled to a torque sensor 744c. The torque sensor 744c is coupled to a transmission device 706c coupled to the shaft 740. The transmission device 706c includes a movable mechanical element such as a rotating element to control the shaft 740 to rotate more than 360° clockwise or counterclockwise. In one aspect, the motor 704c is coupled to a rotating transmission device assembly, which includes a tube gear segment formed on (or attached to) the proximal end of the proximal closure tube to be operably engaged by a rotating gear assembly operably supported on a tool mounting plate. The torque sensor 744c provides a rotational force feedback signal to the control circuit 710. The rotational force feedback signal represents the rotational force applied to the shaft 740. The position sensor 734 may be configured to provide the position of the closure member as a feedback signal to the control circuit 710. An additional sensor 738, such as a shaft encoder, may provide the rotational position of the shaft 740 to the control circuit 710.

[0271] In one aspect, the control circuit 710 is configured to enable the end effector 702 to articulate. The control circuit 710 provides a motor set point to a motor control 708d, which provides a drive signal to a motor 704d. The output shaft of the motor 704d is coupled to a torque sensor 744d. The torque sensor 744d is coupled to a transmission device 706d coupled to the articulation member 742a. ​​The transmission device 706d includes a movable mechanical element such as an articulation element to control the articulation of the end effector 702 ± 65°. In one aspect, the motor 704d is coupled to an articulation nut that is rotatably journaled on the proximal end portion of the distal spine and rotatably driven thereon by an articulation gear assembly. The torque sensor 744d provides an articulation force feedback signal to the control circuit 710. The articulation force feedback signal represents the articulation force applied to the end effector 702. A sensor 738 , such as an articulation encoder, may provide the articulation position of the end effector 702 to the control circuit 710 .

[0272] On the other hand, the joint motion function of the robotic surgical system 700 may include two joint motion components or connecting rods 742a, 742b. These joint motion components 742a, 742b are driven by a separate disk on the robot interface (rack), and the separate disk is driven by two motors 708d, 708e. When a separate firing motor 704a is provided, each of the joint motion connecting rods 742a, 742b can be driven in an antagonistic manner relative to another connecting rod so as to provide resistance to the head to maintain motion and load when the head is not moving, and to provide joint motion when the head is articulated. When the head rotates, the joint motion components 742a, 742b are attached to the head with a fixed radius. Therefore, when the head rotates, the mechanical advantage of the push-pull connecting rod changes. This change in mechanical advantage can be more obvious for other joint motion connecting rod drive systems.

[0273] In one aspect, one or more motors 704a-704e may include a brushed DC motor with a gearbox and a mechanical link with a firing member, a closing member, or an articulation member. Another example includes an electric motor 704a-704e that operates a movable mechanical element such as a displacement member, an articulation link, a closing tube, and an axis. External influences are unmeasured, unpredictable effects of things such as tissue, surrounding body, and friction on a physical system. Such external influences may be referred to as drag, which acts relative to one of the electric motors 704a-704e. External influences such as drag may cause the operation of a physical system to deviate from the desired operation of the physical system.

[0274] In one aspect, the position sensor 734 can be implemented as an absolute positioning system. In one aspect, the position sensor 734 can include a magnetic rotation absolute positioning system implemented as an AS5055EQFT monolithic magnetic rotation position sensor available from AustriaMicrosystems, AG. The position sensor 734 can interact with the control circuit 710 to provide an absolute positioning system. The position can include a Hall effect element located above a magnet and coupled to a CORDIC processor, which is also known as a bitwise method and Volder algorithm, which is provided to implement a simple and efficient algorithm for calculating hyperbolic and trigonometric functions, which only require addition operations, subtraction operations, bit shift operations, and table lookup operations.

[0275] In one aspect, the control circuit 710 may communicate with one or more sensors 738. The sensor 738 may be positioned on the end effector 702 and adapted to operate with the robotic surgical instrument 700 to measure various derived parameters, such as gap distance versus time, tissue compression versus time, and anvil strain versus time. The sensor 738 may include a magnetic sensor, a magnetic field sensor, a strain gauge, a load sensor, a pressure sensor, a force sensor, a torque sensor, an inductive sensor (such as an eddy current sensor), a resistive sensor, a capacitive sensor, an optical sensor, and / or any other suitable sensor for measuring one or more parameters of the end effector 702. The sensor 738 may include one or more sensors. The sensor 738 may be located on the nail magazine 718 platform to determine tissue position using segmented electrodes. The torque sensors 744a-744e may be configured to sense forces such as firing forces, closing forces, and / or joint motion forces. Thus, the control circuit 710 can sense (1) the closure load experienced by the distal closure tube and its position, (2) the firing member at the rack and its position, (3) the portion of the staple cartridge 718 having tissue thereon, and (4) the loads and positions on the two articulation rods.

[0276] In one aspect, one or more sensors 738 may include a strain gauge, such as a micro strain gauge, which is configured to measure the magnitude of the strain in the anvil 716 during the clamping condition. The strain gauge provides an electrical signal whose amplitude varies with the magnitude of the strain. The sensor 738 may include a pressure sensor configured to detect the pressure generated by the presence of compressed tissue between the anvil 716 and the staple cartridge 718. The sensor 738 may be configured to detect the impedance of the tissue section between the anvil 716 and the staple cartridge 718, which indicates the thickness and / or completeness of the tissue located therebetween.

[0277] In one aspect, the sensor 738 may be implemented as one or more limit switches, electromechanical devices, solid-state switches, Hall effect devices, magnetoresistive (MR) devices, giant magnetoresistive (GMR) devices, magnetometers, and the like. In other implementations, the sensor 738 may be implemented as a solid-state switch that operates under the influence of light, such as an optical sensor, an IR sensor, an ultraviolet sensor, and the like. Likewise, the switch may be a solid-state device, such as a transistor (e.g., a FET, a junction FET, a MOSFET, a bipolar transistor, and the like). In other implementations, the sensor 738 may include a non-electrical conductor switch, an ultrasonic switch, an accelerometer, an inertial sensor, and the like.

[0278] In one aspect, the sensor 738 may be configured to measure the force applied to the anvil 716 by the closure drive system. For example, one or more sensors 738 may be located at the interaction point between the closure tube and the anvil 716 to detect the closing force applied to the anvil 716 by the closure tube. The force applied to the anvil 716 may represent the tissue compression experienced by the tissue segment captured between the anvil 716 and the staple cartridge 718. One or more sensors 738 may be positioned at various interaction points along the closure drive system to detect the closing force applied to the anvil 716 by the closure drive system. One or more sensors 738 may be sampled in real time by the processor of the control circuit 710 during the clamping operation. The control circuit 710 receives real-time sample measurements to provide and analyze time-based information and evaluate the closing force applied to the anvil 716 in real time.

[0279] In one aspect, the current sensor 736 can be used to measure the current consumed by each of the motors 704a-704e. The force required to propel any of the movable mechanical elements (such as the I-beam 714) corresponds to the current consumed by one of the motors 704a to 704e. The force is converted into a digital signal and provided to the control circuit 710. The control circuit 710 can be configured to simulate the response of the actual system of the instrument in the software of the controller. The displacement member can be actuated to move the I-beam 714 in the end effector 702 at a target speed or close to the target speed. The robotic surgical system 700 may include a feedback controller, which may be one of any feedback controllers, including but not limited to, for example, PID, state feedback, linear square (LQR) and / or adaptive controllers. The robotic surgical instrument 700 may include a power source to, for example, convert a signal from the feedback controller into a physical input, such as a housing voltage, a PWM voltage, a frequency modulated voltage, a current, a torque and / or a force. Additional details are disclosed in U.S. patent application serial number 15 / 636,829, filed on June 29, 2017, entitled CLOSED LOOP VELOCITY CONTROL TECHNIQUES FOR ROBOTIC SURGICAL INSTRUMENT, which is incorporated herein by reference in its entirety.

[0280] Fig.18 A block diagram of a surgical instrument 750 programmed to control distal translation of a displacement member is shown according to one aspect of the present disclosure. In one aspect, the surgical instrument 750 is programmed to control distal translation of a displacement member such as an I-beam 764. The surgical instrument 750 includes an end effector 752, which may include an anvil 766, an I-beam 764 (including a sharp cutting edge), and a removable staple cartridge 768.

[0281] The position, movement, displacement and / or translation of a linear displacement member such as the I-beam 764 can be measured by an absolute positioning system, a sensor arrangement, and a position sensor 784. Since the I-beam 764 is coupled to a drive member capable of longitudinal movement, the position of the I-beam 764 can be determined by measuring the position of the drive member capable of longitudinal movement using the position sensor 784. Therefore, in the following description, the position, displacement and / or translation of the I-beam 764 can be achieved by the position sensor 784 as described herein. The control circuit 760 can be programmed to control the translation of a displacement member such as the I-beam 764. In some examples, the control circuit 760 may include one or more microcontrollers, microprocessors, or other suitable processors for executing instructions that cause the one or more processors to control the displacement member (e.g., the I-beam 764) in the manner described. In one aspect, the timer / counter 781 provides an output signal, such as an elapsed time or a digital count, to the control circuit 760 to correlate the position of the I-beam 764 as determined by the position sensor 784 with the output of the timer / counter 781 so that the control circuit 760 can determine the position of the I-beam 764 at a particular time (t) relative to the starting position. The timer / counter 781 can be configured to be able to measure elapsed time, count external events, or time external events.

[0282] The control circuit 760 may generate a motor set point signal 772. The motor set point signal 772 may be provided to the motor controller 758. The motor controller 758 may include one or more circuits configured to provide a motor drive signal 774 to the motor 754 to drive the motor 754 as described herein. In some examples, the motor 754 may be a brushed DC electric motor. For example, the speed of the motor 754 may be proportional to the motor drive signal 774. In some examples, the motor 754 may be a brushless DC electric motor, and the motor drive signal 774 may include a PWM signal provided to one or more stator windings of the motor 754. Moreover, in some examples, the motor controller 758 may be omitted, and the control circuit 760 may directly generate the motor drive signal 774.

[0283] The motor 754 may receive power from the energy source 762. The energy source 762 may be or include a battery, a supercapacitor, or any other suitable energy source. The motor 754 may be mechanically coupled to the I-beam 764 via the transmission device 756. The transmission device 756 may include one or more gears or other connecting rod components to couple the motor 754 to the I-beam 764. The position sensor 784 may sense the position of the I-beam 764. The position sensor 784 may be or include any type of sensor capable of generating position data indicating the position of the I-beam 764. In some examples, the position sensor 784 may include an encoder configured to provide a series of pulses to the control circuit 760 when the I-beam 764 is translated toward the distal side and toward the proximal side. The control circuit 760 may track the pulses to determine the position of the I-beam 764. Other suitable position sensors may be used, including, for example, proximity sensors. Other types of position sensors may provide other signals indicating the movement of the I-beam 764. Moreover, in some examples, the position sensor 784 may be omitted. Where motor 754 is a stepper motor, control circuit 760 may track the position of I-beam 764 by summing the number and direction of steps that motor 754 has been instructed to perform. Position sensor 784 may be located in end effector 752 or at any other portion of the instrument.

[0284] The control circuit 760 may communicate with one or more sensors 788. The sensor 788 may be positioned on the end effector 752 and adapted to operate with the surgical instrument 750 to measure various derived parameters, such as gap distance versus time, tissue compression versus time, and anvil strain versus time. The sensor 788 may include, for example, a magnetic sensor, a magnetic field sensor, a strain gauge, a pressure sensor, a force sensor, an inductive sensor (such as an eddy current sensor), a resistive sensor, a capacitive sensor, an optical sensor, and / or any other suitable sensor for measuring one or more parameters of the end effector 752. The sensor 788 may include one or more sensors.

[0285] One or more sensors 788 may include a strain gauge, such as a micro strain gauge, configured to measure the magnitude of the strain in the anvil 766 during the clamping condition. The strain gauge provides an electrical signal whose amplitude varies with the magnitude of the strain. The sensor 788 may include a pressure sensor configured to detect the pressure generated by the presence of compressed tissue between the anvil 766 and the staple cartridge 768. The sensor 788 may be configured to detect the impedance of the tissue section between the anvil 766 and the staple cartridge 768, which indicates the thickness and / or completeness of the tissue located therebetween.

[0286] The sensor 788 may be configured to measure the force applied to the anvil 766 by the closure drive system. For example, one or more sensors 788 may be located at the interaction point between the closure tube and the anvil 766 to detect the closing force applied to the anvil 766 by the closure tube. The force applied to the anvil 766 may represent the tissue compression experienced by the tissue segment captured between the anvil 766 and the staple cartridge 768. One or more sensors 788 may be positioned at various interaction points along the closure drive system to detect the closing force applied to the anvil 766 by the closure drive system. One or more sensors 788 may be sampled in real time by the processor of the control circuit 760 during the clamping operation. The control circuit 760 receives real-time sample measurements to provide and analyze time-based information and evaluate the closing force applied to the anvil 766 in real time.

[0287] A current sensor 786 may be employed to measure the current consumed by the motor 754. The force required to advance the I-beam 764 corresponds to the current consumed by the motor 754. The force is converted into a digital signal and provided to the control circuit 760.

[0288] The control circuit 760 can be configured to simulate the response of the actual system of the instrument in the software of the controller. The displacement member can be actuated to move the I-beam 764 in the end effector 752 at a target speed or close to the target speed. The surgical instrument 750 may include a feedback controller, which can be one of any feedback controllers, including but not limited to, for example, PID, state feedback, LQR and / or adaptive controllers. The surgical instrument 750 may include a power source to, for example, convert a signal from the feedback controller into a physical input, such as a housing voltage, a PWM voltage, a frequency modulated voltage, a current, a torque and / or a force.

[0289] The actual drive system of the surgical instrument 750 is configured to be able to drive the displacement member, cutting member or I-beam 764 through a brushed DC motor with a gear box and mechanical connections to the articulation and / or knife system. Another example is an electric motor 754 that operates the displacement member and articulation drive of, for example, an interchangeable shaft assembly. External influences are the unmeasured, unpredictable effects of things such as tissue, surrounding body, and friction on the physical system. Such external influences may be referred to as drag forces that act in opposition to the electric motor 754. External influences such as drag forces may cause the operation of the physical system to deviate from the desired operation of the physical system.

[0290] Various exemplary aspects relate to a surgical instrument 750, which includes an end effector 752 with a motor-driven surgical stapling and cutting tool. For example, a motor 754 can drive a displacement member distally and proximally along the longitudinal axis of the end effector 752. The end effector 752 can include a pivotable anvil 766, and when configured for use, a staple cartridge 768 is positioned relative to the anvil 766. The clinician can hold tissue between the anvil 766 and the staple cartridge 768, as described herein. When the instrument 750 is ready to be used, the clinician can provide a firing signal, for example, by pressing a trigger of the instrument 750. In response to the firing signal, the motor 754 can drive the displacement member distally from a proximal stroke start position to a stroke end position distal to the stroke start position along the longitudinal axis of the end effector 752. When the displacement member is translated distally, an I-beam 764 with a cutting element positioned at the distal end can cut tissue between the staple cartridge 768 and the anvil 766.

[0291] In various examples, the surgical instrument 750 may include a control circuit 760 that is programmed to control the distal translation of a displacement member, such as an I-beam 764, based on one or more tissue conditions, for example. The control circuit 760 may be programmed to sense tissue conditions, such as thickness, directly or indirectly, as described herein. The control circuit 760 may be programmed to select a firing control program based on the tissue conditions. The firing control program may describe the distal movement of the displacement member. Different firing control programs may be selected to better handle different tissue conditions. For example, the control circuit 760 may be programmed to translate the displacement member at a lower speed and / or at a lower power when thicker tissue is present. The control circuit 760 may be programmed to translate the displacement member at a higher speed and / or at a higher power when thinner tissue is present.

[0292] In some examples, the control circuit 760 may initially operate the motor 754 in an open-loop configuration for a first open-loop portion of the displacement member's travel. Based on the response of the instrument 750 during the open-loop portion of the travel, the control circuit 760 may select a firing control program. The response of the instrument may include the distance the displacement member was translated during the open-loop portion, the time elapsed during the open-loop portion, the energy provided to the motor 754 during the open-loop portion, the sum of the pulse widths of the motor drive signal, etc. After the open-loop portion, the control circuit 760 may implement the selected firing control program for a second portion of the displacement member's travel. For example, during the closed-loop portion of the travel, the control circuit 760 may adjust the motor 754 based on the translation data describing the position of the displacement member in a closed-loop manner so that the displacement member translates at a constant speed. Additional details are disclosed in U.S. patent application serial number 15 / 720,852, filed on September 29, 2017, entitled SYSTEM AND METHODS FOR CONTROLLINGA DISPLAY OF ASURGICAL INSTRUMENT, which is incorporated herein by reference in its entirety.

[0293] Fig.19 is a schematic diagram of a surgical instrument 790 configured to control various functions according to one aspect of the present disclosure. In one aspect, the surgical instrument 790 is programmed to control the distal translation of a displacement member such as an I-beam 764. The surgical instrument 790 includes an end effector 792, which may include an anvil 766, an I-beam 764, and a removable staple cartridge 768 that may be interchangeable with an RF cartridge 796 (shown in phantom).

[0294] In one aspect, the sensor 788 may be implemented as a limit switch, an electromechanical device, a solid-state switch, a Hall effect device, an MR device, a GMR device, a magnetometer, and the like. In other implementations, the sensor 638 may be implemented as a solid-state switch that operates under the influence of light, such as an optical sensor, an IR sensor, an ultraviolet sensor, and the like. Likewise, the switch may be a solid-state device, such as a transistor (e.g., a FET, a junction FET, a MOSFET, a bipolar transistor, and the like). In other implementations, the sensor 788 may include a non-electric conductor switch, an ultrasonic switch, an accelerometer, an inertial sensor, and the like.

[0295] In one aspect, the position sensor 784 can be implemented as an absolute positioning system including a magnetic rotary absolute positioning system implemented as an AS5055EQFT monolithic magnetic rotary position sensor available from Austria Microsystems, AG. The position sensor 784 can interact with the control circuit 760 to provide an absolute positioning system. The position can include a Hall effect element located above a magnet and coupled to a CORDIC processor, which is also known as the bitwise method and Volder algorithm, which is provided to implement a simple and efficient algorithm for calculating hyperbolic and trigonometric functions, which only require addition operations, subtraction operations, bit shift operations, and table lookup operations.

[0296] In one aspect, the I-beam 764 can be implemented as a knife member including a knife body that operably supports the tissue cutting blade thereon, and the I-beam can also include an anvil engagement tab or feature and a channel engagement feature or foot. In one aspect, the staple cartridge 768 can be implemented as a standard (mechanical) surgical fastener cartridge. In one aspect, the RF cartridge 796 can be implemented as an RF cartridge. These and other sensor arrangements are described in co-owned U.S. patent application serial number 15 / 628,175, entitled "TECHNIQUESFOR ADAPTIVE CONTROL OF MOTOR VELOCITY OF A SURGICAL STAPLING AND CUTTING INSTRUMENT," filed on June 20, 2017, which is incorporated herein by reference in its entirety.

[0297] The position, movement, displacement and / or translation of a linear displacement member such as the I-beam 764 can be measured by an absolute positioning system, a sensor arrangement, and a position sensor, represented as position sensor 784. Since the I-beam 764 is coupled to a drive member capable of longitudinal movement, the position of the I-beam 764 can be determined by measuring the position of the drive member capable of longitudinal movement using the position sensor 784. Therefore, in the following description, the position, displacement and / or translation of the I-beam 764 can be achieved by the position sensor 784 as described herein. As described herein, the control circuit 760 can be programmed to control the translation of a displacement member such as the I-beam 764. In some examples, the control circuit 760 may include one or more microcontrollers, microprocessors, or other suitable processors for executing instructions that cause the one or more processors to control the displacement member (e.g., the I-beam 764) in the manner described. In one aspect, the timer / counter 781 provides an output signal, such as an elapsed time or a digital count, to the control circuit 760 to correlate the position of the I-beam 764 as determined by the position sensor 784 with the output of the timer / counter 781 so that the control circuit 760 can determine the position of the I-beam 764 at a particular time (t) relative to the starting position. The timer / counter 781 can be configured to be able to measure elapsed time, count external events, or time external events.

[0298] The control circuit 760 may generate a motor set point signal 772. The motor set point signal 772 may be provided to the motor controller 758. The motor controller 758 may include one or more circuits configured to provide a motor drive signal 774 to the motor 754 to drive the motor 754 as described herein. In some examples, the motor 754 may be a brushed DC electric motor. For example, the speed of the motor 754 may be proportional to the motor drive signal 774. In some examples, the motor 754 may be a brushless DC electric motor, and the motor drive signal 774 may include a PWM signal provided to one or more stator windings of the motor 754. Moreover, in some examples, the motor controller 758 may be omitted, and the control circuit 760 may directly generate the motor drive signal 774.

[0299] The motor 754 may receive power from the energy source 762. The energy source 762 may be or include a battery, a supercapacitor, or any other suitable energy source. The motor 754 may be mechanically coupled to the I-beam 764 via the transmission device 756. The transmission device 756 may include one or more gears or other connecting rod components to couple the motor 754 to the I-beam 764. The position sensor 784 may sense the position of the I-beam 764. The position sensor 784 may be or include any type of sensor capable of generating position data indicating the position of the I-beam 764. In some examples, the position sensor 784 may include an encoder configured to provide a series of pulses to the control circuit 760 when the I-beam 764 is translated toward the distal side and toward the proximal side. The control circuit 760 may track the pulses to determine the position of the I-beam 764. Other suitable position sensors may be used, including, for example, proximity sensors. Other types of position sensors may provide other signals indicating the movement of the I-beam 764. Moreover, in some examples, the position sensor 784 may be omitted. Where motor 754 is a stepper motor, control circuit 760 may track the position of I-beam 764 by summing the number and direction of steps the motor has been instructed to perform. Position sensor 784 may be located in end effector 792 or at any other portion of the instrument.

[0300] The control circuit 760 may communicate with one or more sensors 788. The sensor 788 may be positioned on the end effector 792 and adapted to operate with the surgical instrument 790 to measure various derived parameters, such as gap distance versus time, tissue compression versus time, and anvil strain versus time. The sensor 788 may include, for example, a magnetic sensor, a magnetic field sensor, a strain gauge, a pressure sensor, a force sensor, an inductive sensor (such as an eddy current sensor), a resistive sensor, a capacitive sensor, an optical sensor, and / or any other suitable sensor for measuring one or more parameters of the end effector 792. The sensor 788 may include one or more sensors.

[0301] One or more sensors 788 may include a strain gauge, such as a micro strain gauge, configured to measure the magnitude of the strain in the anvil 766 during the clamping condition. The strain gauge provides an electrical signal whose amplitude varies with the magnitude of the strain. The sensor 788 may include a pressure sensor configured to detect the pressure generated by the presence of compressed tissue between the anvil 766 and the staple cartridge 768. The sensor 788 may be configured to detect the impedance of the tissue section between the anvil 766 and the staple cartridge 768, which indicates the thickness and / or completeness of the tissue located therebetween.

[0302] The sensor 788 may be configured to measure the force applied to the anvil 766 by the closure drive system. For example, one or more sensors 788 may be located at the interaction point between the closure tube and the anvil 766 to detect the closing force applied to the anvil 766 by the closure tube. The force applied to the anvil 766 may represent the tissue compression experienced by the tissue segment captured between the anvil 766 and the staple cartridge 768. One or more sensors 788 may be positioned at various interaction points along the closure drive system to detect the closing force applied to the anvil 766 by the closure drive system. One or more sensors 788 may be sampled in real time by the processor portion of the control circuit 760 during the clamping operation. The control circuit 760 receives real-time sample measurements to provide and analyze time-based information and evaluate the closing force applied to the anvil 766 in real time.

[0303] A current sensor 786 may be employed to measure the current consumed by the motor 754. The force required to advance the I-beam 764 corresponds to the current consumed by the motor 754. The force is converted into a digital signal and provided to the control circuit 760.

[0304] When the RF cartridge 796 is loaded in the end effector 792 in place of the staple cartridge 768, the RF energy source 794 is coupled to the end effector 792 and applied to the RF cartridge 796. The control circuit 760 controls the delivery of RF energy to the RF cartridge 796.

[0305] Additional details are disclosed in U.S. patent application serial number 15 / 636,096 filed on June 28, 2017, entitled SURGICAL SYSTEM COUPLABLE WITH STAPLE CARTRIDGE AND RADIO FREQUENCY CARTRIDGE, AND METHOD OF USING SAME, which is incorporated herein by reference in its entirety.

[0306] Generator Hardware

[0307] Fig. 20is a simplified block diagram of a generator 800 configured to provide inductor-free tuning and other benefits. Additional details of the generator 800 are described in U.S. Patent No. 9,060,775, entitled “SURGICAL GENERATOR FOR ULTRASONIC AND ELECTROSURGICAL DEVICES,” issued on June 23, 2015, which is incorporated herein by reference in its entirety. The generator 800 may include a patient isolation stage 802 that communicates with a non-isolated stage 804 via a power transformer 806. A secondary winding 808 of the power transformer 806 is housed in the isolation stage 802 and may include a tap configuration (e.g., a center tap or a non-center tap configuration) to define drive signal outputs 810a, 810b, 810c to deliver drive signals to different surgical instruments, such as, for example, ultrasonic surgical instruments, RF electrosurgical instruments, and multi-function surgical instruments including ultrasonic energy modes and RF energy modes that can be delivered separately or simultaneously. Specifically, the drive signal output terminals 810a, 810c can output ultrasonic drive signals (e.g., 420V root mean square (RMS) drive signals) to the ultrasonic surgical instrument, and the drive signal output terminals 810b, 810c can output RF electrosurgical drive signals (e.g., 100V RMS drive signals) to the RF electrosurgical instrument, wherein the drive signal output terminal 810b corresponds to the center tap of the power transformer 806.

[0308] In some forms, the ultrasonic drive signal and the electrosurgical drive signal can be provided to different surgical instruments and / or to a single surgical instrument such as a multifunctional surgical instrument having the ability to transmit both ultrasonic energy and electrosurgical energy to tissue. It should be understood that the electrosurgical signal provided to a dedicated electrosurgical instrument and / or a combined multifunctional ultrasonic / electrosurgical instrument can be a therapeutic or sub-therapeutic level signal, wherein the sub-therapeutic signal can be used, for example, to monitor tissue or instrument conditions and provide feedback to the generator. For example, an ultrasonic signal and an RF signal can be delivered separately or simultaneously from a generator having a single output port to provide a desired output signal to the surgical instrument, as will be discussed in more detail below. Therefore, the generator can combine ultrasonic energy and electrosurgical RF energy and deliver the combined energy to the multifunctional ultrasonic / electrosurgical instrument. A bipolar electrode can be placed on one or both jaws of the end effector. In addition to electrosurgical RF energy, one jaw can be driven simultaneously by ultrasonic energy. Ultrasonic energy can be used to dissect tissue, while electrosurgical RF energy can be used for vessel sealing.

[0309] The non-isolated stage 804 may include a power amplifier 812 having an output connected to a primary winding 814 of a power transformer 806. In some forms, the power amplifier 812 may include a push-pull amplifier. For example, the non-isolated stage 804 may also include a logic device 816 for supplying a digital output to a digital-to-analog converter (DAC) circuit 818, which in turn supplies a corresponding analog signal to an input of the power amplifier 812. In some forms, the logic device 816 may include a programmable gate array (PGA), an FPGA, a programmable logic device (PLD), for example, in addition to other logic circuits. Thus, by controlling the input of the power amplifier 812 via the DAC circuit 818, the logic device 816 may control any one of a plurality of parameters (e.g., frequency, waveform shape, waveform amplitude) of the drive signal appearing at the drive signal outputs 810a, 810b, 810c. In certain forms, as described below, the logic device 816 in conjunction with a processor (e.g., a DSP described below) may implement a plurality of DSP-based algorithms and / or other control algorithms to control parameters of the drive signal output by the generator 800.

[0310] Power may be supplied to the power rail of the power amplifier 812 by a switch-mode regulator 820 (e.g., a power converter). In certain forms, the switch-mode regulator 820 may, for example, comprise an adjustable buck regulator. For example, the non-isolated stage 804 may also comprise a first processor 822, which in one form may comprise a DSP processor, such as, for example, an Analog Devices ADSP-21469 SHARC DSP available from Analog Devices (Norwood, MA), although any suitable processor may be employed in various forms. In certain forms, the DSP processor 822 may control operation of the switch-mode regulator 820 in response to voltage feedback data received by the DSP processor 822 from the power amplifier 812 via an ADC circuit 824. In one form, for example, the DSP processor 822 may receive as input a waveform envelope of a signal (e.g., an RF signal) amplified by the power amplifier 812 via the ADC circuit 824. Subsequently, the DSP processor 822 may control the switch mode regulator 820 (e.g., via a PWM output) such that the rail voltage provided to the power amplifier 812 tracks the waveform envelope of the amplified signal. By dynamically adjusting the rail voltage of the power amplifier 812 based on the waveform envelope, the efficiency of the power amplifier 812 may be significantly increased relative to a fixed rail voltage amplifier solution.

[0311] In certain forms, the logic device 816, in conjunction with the DSP processor 822, may implement a digital synthesis circuit such as a direct digital synthesizer control scheme to control the waveform shape, frequency and / or amplitude of the drive signal output by the generator 800. In one form, for example, the logic device 816 may implement a DDS control algorithm by calling waveform samples stored in a dynamically updated lookup table (LUT), such as a RAM LUT, which may be embedded in an FPGA. The control algorithm is particularly useful for ultrasound applications where an ultrasonic transducer, such as an ultrasonic transducer, may be driven by a pure sinusoidal current at its resonant frequency. Because other frequencies may excite parasitic resonances, minimizing or reducing the overall distortion of the motional branch current may correspondingly minimize or reduce adverse resonance effects. Because the waveform shape of the drive signal output by the generator 800 is affected by various sources of distortion present in the output drive circuit (e.g., power transformer 806, power amplifier 812), voltage and current feedback data based on the drive signal can be input into an algorithm, such as an error control algorithm implemented by the DSP processor 822, which compensates for distortion by appropriately pre-distorting or modifying the waveform samples stored in the LUT on a dynamic, ongoing basis (e.g., in real time). In one form, the amount or degree of pre-distortion applied to the LUT samples can be based on the error between the calculated motional branch current and the desired current waveform shape, where the error can be determined on a sample-by-sample basis. In this way, the pre-distorted LUT samples, when processed by the drive circuit, can cause the motional branch drive signal to have a desired waveform shape (e.g., a sinusoidal shape) to optimally drive the ultrasonic transducer. Therefore, in such forms, when the distortion effects are taken into account, the LUT waveform samples will not exhibit the desired waveform shape of the drive signal, but rather will exhibit the waveform shape required to ultimately produce the desired waveform shape of the motional branch drive signal.

[0312] The non-isolated stage 804 may also include a first ADC circuit 826 and a second ADC circuit 828 coupled to the output of the power transformer 806 via respective isolation transformers 830, 832 for respectively sampling the voltage and current of the drive signal output by the generator 800. In certain forms, the ADC circuits 826, 828 may be configured to be capable of sampling at a high speed (e.g., 80 megasamples per second (MSPS)) to allow oversampling of the drive signal. In one form, for example, the sampling speed of the ADC circuits 826, 828 may allow for approximately 200x (depending on the frequency) oversampling of the drive signal. In certain forms, the sampling operations of the ADC circuits 826, 828 may be performed by a single ADC circuit that receives the input voltage and current signals via a two-way multiplexer circuit. By using high speed sampling in the form of the generator 800, among other things, calculation of complex currents flowing through the dynamic branch (which in some forms can be used to implement the above-mentioned DDS-based waveform shape control), accurate digital filtering of the sampled signals, and calculation of actual power consumption with high accuracy can be achieved. The voltage and current feedback data output by the ADC circuits 826, 828 can be received and processed by the logic device 816 (e.g., first-in-first-out (FIFO) buffer, multiplexer) and stored in a data memory for subsequent retrieval by, for example, the DSP processor 822. As described above, the voltage and current feedback data can be used as input to an algorithm for pre-distorting or modifying LUT waveform samples in a dynamic and ongoing manner. In some forms, this may require indexing each stored voltage and current feedback data pair based on the corresponding LUT sample output by the logic device 816 when the voltage and current feedback data pair was acquired, or otherwise associated with the corresponding LUT sample. Synchronizing the LUT samples and the voltage and current feedback data in this manner facilitates accurate timing and stability of the pre-distortion algorithm.

[0313] In certain forms, the voltage and current feedback data may be used to control the frequency and / or amplitude (e.g., current amplitude) of the drive signal. In one form, for example, the voltage and current feedback data may be used to determine the impedance phase. The frequency of the drive signal may then be controlled to minimize or reduce the difference between the determined impedance phase and the impedance phase set point (e.g., 0°), thereby minimizing or reducing the effects of harmonic distortion and correspondingly improving the impedance phase measurement accuracy. The determination of the phase impedance and frequency control signal may be implemented in the DSP processor 822, for example, where the frequency control signal is provided as an input to a DDS control algorithm implemented by the logic device 816.

[0314] In another form, for example, current feedback data may be monitored to maintain the current amplitude of the drive signal at a current amplitude set point. The current amplitude set point may be specified directly or determined indirectly based on a specific voltage amplitude and power set point. In certain forms, control of the current amplitude may be achieved through a control algorithm in the DSP processor 822, such as, for example, a proportional integral derivative (PID) control algorithm. Variables controlled by the control algorithm to appropriately control the current amplitude of the drive signal may include, for example, scaling of LUT waveform samples stored in the logic device 816 and / or a maximum scaled output voltage of the DAC circuit 818 (which provides input to the power amplifier 812) via the DAC circuit 834.

[0315] The non-isolated stage 804 may also include a second processor 836 for providing, among other things, user interface (UI) functions. In one form, the UI processor 836 may include, for example, an Atmel AT91SAM9263 processor with an ARM 926EJ-S core purchased from Atmel Corporation, San Jose, California. Examples of UI functions supported by the UI processor 836 may include audible and visual user feedback, communication with peripheral devices (e.g., via a USB interface), communication with a foot switch, communication with an input device (e.g., a touch screen display), and communication with an output device (e.g., a speaker). The UI processor 836 may communicate with the DSP processor 822 and the logic device 816 (e.g., via an SPI bus). Although the UI processor 836 may primarily support UI functions, in some forms, it may also cooperate with the DSP processor 822 to mitigate risks. For example, the UI processor 836 may be programmed to monitor various aspects of user input and / or other input (e.g., touch screen input, foot switch input, temperature sensor input) and may disable the drive output of the generator 800 when an error condition is detected.

[0316] In certain forms, for example, both the DSP processor 822 and the UI processor 836 may determine and monitor the operating state of the generator 800. For the DSP processor 822, the operating state of the generator 800 may indicate, for example, which control and / or diagnostic processes the DSP processor 822 implements. For the UI processor 836, the operating state of the generator 800 may indicate, for example, which elements of the UI (e.g., display screen, sound) are presented to the user. The respective DSP processor 822 and UI processor 836 may independently maintain the current operating state of the generator 800 and identify and evaluate possible transitions of the current operating state. The DSP processor 822 may serve as the principal in this relationship and determine when a transition between operating states will occur. The UI processor 836 may note valid transitions between operating states and may verify whether a particular transition is appropriate. For example, when the DSP processor 822 commands the UI processor 836 to transition to a particular state, the UI processor 836 may verify that the requested transition is valid. If the requested transition between states is determined by the UI processor 836 to be invalid, the UI processor 836 may cause the generator 800 to enter a failure mode.

[0317] The non-isolated stage 804 may also include a controller 838 for monitoring input devices (e.g., capacitive touch sensors, capacitive touch screens for turning the generator 800 on and off). In certain forms, the controller 838 may include at least one processor and / or other controller device in communication with the UI processor 836. In one form, for example, the controller 838 may include a processor (e.g., a Meg168 8-bit controller available from Atmel) configured to monitor user input provided via one or more capacitive touch sensors. In one form, the controller 838 may include a touch screen controller (e.g., a QT5480 touch screen controller available from Atmel) to control and manage the collection of touch data from the capacitive touch screen.

[0318] In certain forms, when the generator 800 is in the "power off" state, the controller 838 may continue to receive operating power (e.g., via a line from a power source of the generator 800, such as the power source 854 described below). In this manner, the controller 838 may continue to monitor an input device (e.g., a capacitive touch sensor located on a front panel of the generator 800) for turning the generator 800 on and off. When the generator 800 is in the power off state, if activation of a user "on / off" input device is detected, the controller 838 may wake up the power source (e.g., enable operation of one or more DC / DC voltage converters 856 of the power source 854). The controller 838 may thus begin a sequence to transition the generator 800 to the "power on" state. Conversely, when the generator 800 is in the power on state, if activation of the "on / off" input device is detected, the controller 838 may begin a sequence to transition the generator 800 to the power off state. In certain forms, for example, the controller 838 may report activation of an "on / off" input device to the UI processor 836, which in turn implements the required sequence of processes to transition the generator 800 to the power-off state. In such forms, the controller 838 may not have an independent ability to remove power from the generator 800 after the power-on state is established.

[0319] In some forms, the controller 838 may cause the generator 800 to provide audible or other sensory feedback to alert the user that a power-on or power-off sequence has begun. Such an alert may be provided when a power-on or power-off sequence begins and before other processes associated with the sequence begin.

[0320] In certain forms, the isolation stage 802 may include an instrument interface circuit 840, e.g., to provide a communication interface between the control circuitry of the surgical instrument (e.g., control circuitry including a handpiece switch) and components of the non-isolated stage 804, such as, for example, the logic device 816, the DSP processor 822, and / or the UI processor 836. The instrument interface circuit 840 may exchange information with components of the non-isolated stage 804 via a communication link (such as, for example, an IR-based communication link) that maintains a suitable degree of electrical isolation between the isolation stage 802 and the non-isolated stage 804. For example, the instrument interface circuit 840 may be powered using a low-dropout voltage regulator powered by an isolation transformer, which is driven from the non-isolated stage 804.

[0321] In one form, the instrument interface circuit 840 may include a logic circuit 842 (e.g., a logic circuit, a programmable logic circuit, a PGA, an FPGA, a PLD) in communication with a signal conditioning circuit 844. The signal conditioning circuit 844 may be configured to receive a periodic signal (e.g., a 2kHz square wave) from the logic circuit 842 to generate a bipolar interrogation signal having the same frequency. For example, the interrogation signal may be generated using a bipolar current source fed by a differential amplifier. The interrogation signal may be transmitted to a surgical instrument control circuit (e.g., by using a conductive pair in a cable connecting the generator 800 to the surgical instrument) and monitored to determine the state or configuration of the control circuit. The control circuit may include a plurality of switches, resistors, and / or diodes to modify one or more characteristics of the interrogation signal (e.g., amplitude, rectification) so that the state or configuration of the control circuit can be uniquely discerned based on the one or more characteristics. In one form, for example, the signal conditioning circuit 844 may include an ADC circuit for generating a sample of a voltage signal appearing at the input of the control circuit due to the interrogation signal passing through the control circuit. Subsequently, logic circuit 842 (or a component of non-isolated stage 804) may determine a state or configuration of the control circuit based on the ADC circuit samples.

[0322] In one form, the instrument interface circuit 840 may include a first data circuit interface 846 to enable information exchange between the logic circuit 842 (or other elements of the instrument interface circuit 840) and the first data circuit disposed in the surgical instrument or otherwise associated with the surgical instrument. In some forms, for example, the first data circuit may be disposed in a cable integrally attached to the surgical instrument handpiece, or in an adapter for interfacing a specific surgical instrument type or model with the generator 800. The first data circuit may be implemented in any suitable manner and may communicate with the generator according to any suitable protocol including, for example, any of the protocols described herein with respect to the first data circuit. In some forms, the first data circuit may include a non-volatile storage device such as an EEPROM device. In some forms, the first data circuit interface 846 may be implemented separately from the logic circuit 842 and include suitable circuits (e.g., discrete logic devices, processors) to enable communication between the logic circuit 842 and the first data circuit. In other forms, the first data circuit interface 846 may be integrally formed with the logic circuit 842.

[0323] In some forms, the first data circuit may store information related to the associated specific surgical instrument. Such information may include, for example, a model number, a serial number, a number of operations in which the surgical instrument has been used, and / or any other type of information. Such information may be read by the instrument interface circuit 840 (e.g., via the logic circuit 842), transmitted to the components of the non-isolated stage 804 (e.g., to the logic device 816, the DSP processor 822 and / or the UI processor 836) to be presented to the user via an output device and / or to control the function or operation of the generator 800. In addition, any type of information may be transmitted to the first data circuit via the first data circuit interface 846 (e.g., using the logic circuit 842) to be stored therein. Such information may include, for example, an updated number of operations in which the surgical instrument has been used and / or the date and / or time of its use.

[0324] As previously described, surgical instruments may be detachable from handpieces (e.g., multifunctional surgical instruments may be detachable from handpieces) to facilitate instrument interchangeability and / or disposability. In such cases, the ability of conventional generators to identify the specific instrument configuration being used and to optimize control and diagnostic processes accordingly may be limited. However, addressing this issue by adding readable data circuits to surgical instruments is problematic from a compatibility perspective. For example, designing surgical instruments to maintain backward compatibility with generators that lack the requisite data reading functionality may be impractical due to, for example, different signaling schemes, design complexity, and cost. The form of the instrument described herein addresses these issues by using a data circuit that can be economically implemented in existing surgical instruments with minimal design changes to maintain compatibility of the surgical instrument with current generator platforms.

[0325] In addition, the form of the generator 800 can realize communication with the data circuit based on the instrument. For example, the generator 800 can be configured to communicate with the second data circuit contained in the instrument (e.g., a multifunctional surgical instrument). In some forms, the second data circuit can be implemented in a manner similar to the first data circuit described herein. The instrument interface circuit 840 may include a second data circuit interface 848 for realizing the communication. In one form, the second data circuit interface 848 may include a tri-state digital interface, but other interfaces may also be used. In some forms, the second data circuit may generally be any circuit for transmitting and / or receiving data. In one form, for example, the second data circuit may store information related to the associated specific surgical instrument. Such information may include, for example, a model number, a serial number, a plurality of operations in which the surgical instrument has been used, and / or any other type of information.

[0326] In some forms, the second data circuit may store information about the electrical and / or ultrasonic performance of the associated ultrasonic transducer, end effector, or ultrasonic drive system. For example, the first data circuit may indicate an aging frequency slope, as described herein. Additionally or alternatively, any type of information may be transmitted to the second data circuit via the second data circuit interface 848 (e.g., using the logic circuit 842) for storage therein. Such information may, for example, include an updated number of operations in which a surgical instrument is used and / or the date and / or time of its use. In certain forms, the second data circuit may transmit data collected by one or more sensors (e.g., an instrument-based temperature sensor). In certain forms, the second data circuit may receive data from the generator 800 and provide an indication to the user based on the received data (e.g., an LED indication or other visual indication).

[0327] In certain forms, the second data circuit and the second data circuit interface 848 may be configured to enable communication between the logic circuit 842 and the second data circuit without providing additional conductors for this purpose (e.g., dedicated conductors of a cable connecting the hand piece to the generator 800). In one form, for example, information may be communicated to and from the second data circuit using a single bus communication scheme implemented on an existing cable (such as one of the conductors used to transmit an interrogation signal from the signal conditioning circuit 844 to the control circuit in the hand piece). In this manner, design changes or modifications to the surgical instrument that may otherwise be necessary may be minimized or reduced. In addition, because the different types of communications implemented on a common physical channel may be frequency-band separated, the presence of the second data circuit may be "invisible" to generators that do not have the requisite data reading functionality, thereby enabling backward compatibility of surgical instruments.

[0328] In some forms, the isolation stage 802 may include at least one blocking capacitor 850-1, which is connected to the drive signal output terminal 810b to prevent DC current from flowing to the patient. For example, the signal blocking capacitor may be required to comply with medical regulations or standards. Although errors are relatively rare in single capacitor designs, such errors may have adverse consequences. In one form, a second blocking capacitor 850-2 may be provided in series with the blocking capacitor 850-1, wherein current leakage from a point between the blocking capacitors 850-1 and 850-2 is monitored, for example, by an ADC circuit 852 to sample the voltage induced by the leakage current. These samples may be received, for example, by a logic circuit 842. Based on changes in the leakage current (as indicated by the voltage samples), the generator 800 can determine when at least one of the blocking capacitors 850-1 and 850-2 fails, thereby providing benefits over a single capacitor design with a single failure point.

[0329] In certain forms, the non-isolated stage 804 may include a power source 854 for delivering DC power at an appropriate voltage and current. The power source may include, for example, a 400W power source for delivering a system voltage of 48VDC. The power source 854 may also include one or more DC / DC voltage converters 856 for receiving the output of the power source to generate a DC output at the voltage and current required by the various components of the generator 800. As described above in conjunction with the controller 838, one or more of the DC / DC voltage converters 856 may receive input from the controller 838 when the controller 838 detects that a user activates an "on / off" input device to enable operation of the DC / DC voltage converter 856 or wake up the DC / DC voltage converter.

[0330] Fig.21 An example of a generator 900 is shown, which is a generator 800 ( Fig. 20 ) is a form of a surgical instrument. Generator 900 is configured to be capable of delivering multiple energy modalities to a surgical instrument. Generator 900 provides RF signals and ultrasonic signals for independently or simultaneously delivering energy to a surgical instrument. The RF signal and the ultrasonic signal may be provided separately or in combination, and may be provided simultaneously. As described above, at least one generator output may deliver multiple energy modalities (e.g., ultrasound, bipolar or monopolar RF, irreversible and / or reversible electroporation and / or microwave energy, etc.) through a single port, and these signals may be delivered separately or simultaneously to an end effector to treat tissue.

[0331] The generator 900 includes a processor 902 coupled to a waveform generator 904. The processor 902 and the waveform generator 904 are configured to generate various signal waveforms based on information stored in a memory coupled to the processor 902, which is not shown for clarity of the present disclosure. Digital information associated with the waveform is provided to the waveform generator 904, which includes one or more DAC circuits to convert digital inputs into analog outputs. The analog output is fed to the amplifier 1106 for signal conditioning and amplification. The conditioned and amplified output of the amplifier 906 is coupled to the power transformer 908. The signal is coupled to the secondary side in the patient isolation side through the power transformer 908. The first signal of the first energy mode is provided to the surgical instrument between the terminals marked as ENERGY1 and RETURN. The second signal of the second energy mode is coupled across the capacitor 910 and provided to the surgical instrument between the terminals marked as ENERGY2 and RETURN. It should be understood that more than two energy modes may be output, and thus the subscript "n" may be used to specify that up to n ENERGYn terminals may be provided, where n is a positive integer greater than 1. It should also be understood that up to "n" return paths RETURNn may be provided without departing from the scope of the present disclosure.

[0332] The first voltage sensing circuit 912 is coupled to both ends of the terminals marked as ENERGY1 and RETURN paths to measure the output voltage therebetween. The second voltage sensing circuit 924 is coupled to both ends of the terminals marked as ENERGY2 and RETURN paths to measure the output voltage therebetween. As shown, the current sensing circuit 914 is arranged in series with the RETURN branch on the secondary side of the power transformer 908 to measure the output current of any energy mode. If a different return path is provided for each energy mode, a separate current sensing circuit should be provided in each return branch. The outputs of the first voltage sensing circuit 912 and the second voltage sensing circuit 924 are provided to the corresponding isolation transformers 916, 922, and the output of the current sensing circuit 914 is provided to another isolation transformer 918. The outputs of the isolation transformers 916, 928, 922 on the primary side of the power transformer 908 (non-patient isolation side) are provided to one or more ADC circuits 926. The digitized output of the ADC circuit 926 is provided to the processor 902 for further processing and calculation. The output voltage and output current feedback information can be used to adjust the output voltage and current provided to the surgical instrument and calculate parameters such as output impedance. Input / output communication between the processor 902 and the patient isolation circuit is provided through the interface circuit 920. The sensor can also be in electrical communication with the processor 902 through the interface 920.

[0333] In one aspect, the impedance may be determined by the processor 902 by dividing the output of a first voltage sensing circuit 912 coupled across terminals labeled ENERGY1 / RETURN or a second voltage sensing circuit 924 coupled across terminals labeled ENERGY2 / RETURN by the output of a current sensing circuit 914 arranged in series with the RETURN branch on the secondary side of the power transformer 908. The outputs of the first voltage sensing circuit 912 and the second voltage sensing circuit 924 are provided to separate isolation transformers 916, 922, and the output of the current sensing circuit 914 is provided to another isolation transformer 916. The digitized voltage and current sense measurements from the ADC circuit 926 are provided to the processor 902 for calculating the impedance. For example, the first energy modality ENERGY1 may be ultrasonic energy, and the second energy modality ENERGY2 may be RF energy. However, in addition to ultrasonic and bipolar or monopolar RF energy modalities, other energy modalities include irreversible and / or reversible electroporation and / or microwave energy, etc. Moreover, although Fig.21The illustrated example shows that a single return path RETURN may be provided for two or more energy modalities, but in other aspects, multiple return paths RETURNn may be provided for each energy modality ENERGYn. Thus, as described herein, the ultrasonic transducer impedance may be measured by dividing the output of the first voltage sensing circuit 912 by the output of the current sensing circuit 914, and the tissue impedance may be measured by dividing the output of the second voltage sensing circuit 924 by the output of the current sensing circuit 914.

[0334] like Fig.21 As shown in , a generator 900 including at least one output port may include a power transformer 908 having a single output and multiple taps to provide power to an end effector in the form of one or more energy modalities (such as ultrasound, bipolar or monopolar RF, irreversible and / or reversible electroporation, and / or microwave energy, etc.), for example, depending on the type of tissue treatment being performed. For example, the generator 900 may deliver energy with a higher voltage and lower current to drive an ultrasonic transducer, deliver energy with a lower voltage and higher current to drive an RF electrode for sealing tissue, or deliver energy with a coagulation waveform for use with monopolar or bipolar RF electrosurgical electrodes. The output waveform from the generator 900 may be manipulated, switched, or filtered to provide a frequency to the end effector of the surgical instrument. The connection of the ultrasonic transducer to the output of the generator 900 will preferably be located between the outputs labeled ENERGY1 and RETURN, as shown in FIG. Fig.21 In one example, the connection of the RF bipolar electrode to the generator 900 output will preferably be between the outputs labeled ENERGY2 and RETURN. In the case of a monopolar output, the preferred connection would be an active electrode (e.g., a pencil or other probe) at the ENERGY2 output and a suitable return pad connected to the RETURN output.

[0335] Additional details are disclosed in U.S. patent application publication No. 2017 / 0086914, published on March 30, 2017, entitled TECHNIQUES FOR OPERATING GENERATOR FOR DIGITALLY GENERATING ELECTRICAL SIGNAL WAVEFORMS AND SURGICAL INSTRUMENTS, which is incorporated herein by reference in its entirety.

[0336] As used throughout this specification, the term "wireless" and its derivatives may be used to describe circuits, devices, systems, methods, techniques, communication channels, etc. that can transmit data through a non-solid medium using modulated electromagnetic radiation. The term does not mean that the associated organization does not contain any wires, although in some aspects they may not. The communication module may implement any of a variety of wireless or wired communication standards or protocols, including but not limited to Wi-Fi (IEEE 802.11 series), WiMAX (IEEE 802.16 series), IEEE 802.20, Long Term Evolution (LTE), Ev-DO, HSPA+, HSDPA+, HSUPA+, EDGE, GSM, GPRS, CDMA, TDMA, DECT, Bluetooth, and its Ethernet derivatives, and any other wireless and wired protocols designated as 3G, 4G, 5G and above. The computing module may include multiple communication modules. For example, the first communication module may be dedicated to shorter-range wireless communications such as Wi-Fi and Bluetooth, and the second communication module may be dedicated to longer-range wireless communications such as GPS, EDGE, GPRS, CDMA, WiMAX, LTE, Ev-DO, etc.

[0337] As used herein, a processor or processing unit is an electronic circuit that performs operations on some external data source (usually a memory or some other data stream). The term is used herein to refer to a central processing unit (Central Processing Unit) in one or more systems (especially System on Chip (SoC)) that combine multiple specialized "processors".

[0338] As used herein, a system on a chip or system on a chip (SoC or SOC) is an integrated circuit (also referred to as an "IC" or "chip") that integrates all the components of a computer or other electronic system. It can contain digital, analog, mixed signal, and often radio frequency functions - all on a single substrate. A SoC integrates a microcontroller (or microprocessor) with advanced peripherals such as a graphics processing unit (GPU), a Wi-Fi module, or a coprocessor. A SoC may or may not include built-in memory.

[0339] As used herein, a microcontroller or controller is a system that integrates a microprocessor with peripheral circuits and memory. A microcontroller (or MCU for a microcontroller unit) can be implemented as a small computer on a single integrated circuit. It can be similar to a SoC; an SoC may include a microcontroller as one of its devices. A microcontroller may include one or more core processing units (CPUs) as well as memory and programmable input / output peripherals. Program memory in the form of ferroelectric RAM, NOR flash memory, or OTP ROM, as well as a small amount of RAM, is also often included on the chip. Compared to microprocessors used in personal computers or other general-purpose applications consisting of various discrete chips, microcontrollers can be used for embedded applications.

[0340] As used herein, the term controller or microcontroller may be a stand-alone IC or chip device that interfaces with peripheral devices. This may be a link between the two components of a computer or a controller on an external device that manages the operation of the device (and the connection to the device).

[0341] Any of the processors or microcontrollers described herein may be any single-core or multi-core processor, such as those offered by Texas Instruments under the trade name ARM Cortex. In one aspect, the processor may be, for example, the LM4F230H5QR ARM Cortex-M4F processor core available from Texas Instruments, which includes: 256KB of single-cycle flash or other non-volatile memory (up to 40 MHz) on-chip memory, a pre-fetch buffer for improving performance beyond 40 MHz, 32KB of single-cycle serial random access memory (SRAM), a 32-bit MCU with 100 MHz RAM, ... Internal read-only memory (ROM) for software, 2KB of electrically erasable programmable read-only memory (EEPROM), one or more pulse width modulation (PWM) modules, one or more quadrature encoder input (QEI) simulations, one or more 12-bit analog-to-digital converters (ADCs) with 12 analog input channels, details of which can be found in the product datasheet.

[0342] In one example, the processor may include a safety controller including two families based on controllers such as the TMS570 and RM4x also offered by Texas Instruments under the trade name Hercules ARMCortex R4. The safety controller may be configured to be specialized for IEC 61508 and ISO 26262 safety critical applications, among others, to provide advanced integrated safety features while delivering scalable performance, connectivity, and memory options.

[0343] The modular device includes a module that can be accommodated in a surgical hub (such as a combination of Figure 3 and Fig. 9The invention relates to a surgical device or instrument that can be connected to various modules so as to be connected or paired with a corresponding surgical hub. The modular device includes, for example, intelligent surgical instruments, medical imaging devices, suction / irrigation devices, smoke evacuators, energy generators, ventilators, insufflators, and displays. The modular device described herein can be controlled by a control algorithm. The control algorithm can be executed on the modular device itself, on a surgical hub paired with a specific modular device, or on both the modular device and the surgical hub (e.g., via a distributed computing architecture). In some examples, the control algorithm of the modular device controls the device based on data sensed by the modular device itself (i.e., by sensors in, on, or connected to the modular device). The data can be related to the patient being operated on (e.g., tissue properties or insufflation pressure) or the modular device itself (e.g., the rate at which the knife is advanced, the motor current, or the energy level). For example, the control algorithm of a surgical suturing and cutting instrument can control the rate at which the motor of the instrument drives its knife through the tissue according to the resistance encountered by the knife as it advances.

[0344] User Feedback Method

[0345] The present disclosure provides user feedback technology. In one aspect, the present disclosure provides an image display through a medical imaging device (e.g., laparoscope, endoscope, thoracoscope, etc.). The medical imaging device includes an optical component and an image sensor. The optical component may include, for example, a lens and a light source. The image sensor may be implemented as a charge coupled device (CCD) or a complementary oxide semiconductor (CMOS). The image sensor provides image data to the electronic components in the surgical hub. The data representing the image may be transmitted by wired or wireless communication to display the instrument status, feedback data, imaging data, and highlight tissue irregularities and underlying structures. On the other hand, the present disclosure provides a wired or wireless communication technology for transmitting user feedback from a device (e.g., an instrument, a robot, or a tool) to a surgical hub. On the other hand, the present disclosure provides identification and use records and activation. Finally, on the other hand, the surgical hub may have a direct interface control between the device and the surgical hub.

[0346] Data display via laparoscopic monitor

[0347] In various aspects, the present disclosure provides for display of data through a laparoscopic monitor. Display of data through a laparoscopic monitor may include display of alignment of the current instrument with adjacent previous operations, coordination between a local instrument display and a paired laparoscopic display, and display of instrument-specific data required for effective use of an end effector portion of a surgical instrument. Each of these techniques is described below.

[0348] Displays the alignment of the current instrument with the adjacent previous operation

[0349] In one aspect, the present disclosure provides an alignment guide display element that provides information to the user about the position of the previous firing or actuation and allows them to align the next instrument use to the proper position without directly seeing the instrument. In another aspect, the first device and the second device are separate; the first device is within the sterile field and the second device is used outside the sterile field.

[0350] During colorectal transection using double suture technique, it is difficult to align the position of the anvil trocar of circular stapler with the center of overlapping staple line. During this operation, the anvil trocar of circular stapler is inserted into the rectum below the staple line, and laparoscope is inserted into the peritoneal cavity above the staple line. Because the staple line closes the colon, there is no sight to use laparoscope to align the anvil trocar insertion position with respect to the center of the staple line overlap.

[0351] One solution provides a non-contact sensor located on the anvil trocar of the circular stapler and a target located at the distal end of the laparoscope.Another solution provides a non-contact sensor located at the distal end of the laparoscope and a target located on the anvil trocar of the circular stapler.

[0352] The surgical hub computer processor receives a signal from the non-contact sensor and displays a centering tool on the screen indicating the alignment of the overlapped portion at the center of the anvil trocar and the center of the staple line of the circular stapler. The screen displays a first image of the target staple line with a radius around the overlapped portion of the staple line and a second image of the projected anvil trocar position. When the first image and the second image overlap, the overlapped portion at the center of the anvil trocar and the staple line is aligned.

[0353] In one aspect, the present disclosure provides a surgical hub for aligning surgical instruments. The surgical hub includes a processor and a memory coupled to the processor. The memory stores instructions that can be executed by the processor to perform the following operations: receiving image data from an image sensor, generating a first image based on the image data, displaying the first image on a monitor coupled to the processor, receiving a signal from a non-contact sensor, generating a second image based on the position of a surgical device, and displaying the second image on the monitor. The first image data represents the center of a staple line seal. The first image represents a target corresponding to the center of the staple line. The signal indicates the position of the surgical device relative to the center of the staple line. The second image represents the position of the surgical device along a projection path of the surgical device toward the center of the staple line.

[0354] In one aspect, the center of the staple line is the overlapping portion of the double staple area. In another aspect, the image sensor receives an image from a laparoscope. In another aspect, the surgical device is a circular stapler including an anvil trocar, and the non-contact sensor is configured to detect the position of the anvil trocar relative to the center of the staple line seal. In another aspect, the non-contact sensor is an inductive sensor. In another aspect, the non-contact sensor is a capacitive sensor.

[0355] In various aspects, the present disclosure provides a control circuit for aligning a surgical instrument as described above. In various aspects, the present disclosure provides a non-transitory computer readable medium storing computer readable instructions that, when executed, cause a machine to align a surgical instrument as described above.

[0356] This technology provides better alignment of the overlapping portions of a surgical instrument, such as a circular stapler, around a staple line to produce a better seal and cut after firing the circular stapler.

[0357] In one aspect, the present disclosure provides a system for displaying the alignment of a current instrument relative to a previous adjacent operation. The instrument alignment information can be displayed on a monitor or any suitable electronic device that is suitable for visual presentation of data, whether locally on the instrument or remotely through a modular communication hub. The system can display the current alignment of a circular nail magazine relative to an overlapping nail line, display the current alignment of a circular nail magazine relative to a previous linear nail line, and / or show an existing nail line of a linear cross-section and an alignment circle of a circular nail magazine indicating proper centering. Each of these technologies is described below.

[0358] In one aspect, the present disclosure provides an alignment guide display element, which provides information about the position of the previous firing or actuation of a surgical instrument (e.g., a surgical stapler) to the user, and allows the user to align the next instrument use (e.g., the firing or actuation of a surgical stapler) to the appropriate position without directly seeing the instrument. On the other hand, the present disclosure provides a first device and a second device separated from the first device. The first device is located in a sterile field, and the second device is located outside the sterile field. Technology described herein can be applied to surgical staplers, ultrasonic instruments, electrosurgical instruments, combined ultrasonic / electrosurgical instruments and / or combined surgical staplers / electrosurgical instruments.

[0359] Fig. 22 A schematic diagram 6000 of a surgical instrument 6002 is shown according to one aspect of the present disclosure, the surgical instrument using a combination of Figure 23 to Figure 33 The benefits of the centering tools and techniques described are centered around the staple line 6003. Figure 23 to Figure 33 As used in the following description, a staple line may include multiple rows of staggered staples, and typically but not limited to two or three rows of staggered staples. The staple line may be a combination of Figure 23 to Figure 27 The double staple line 6004 formed by the double suture technique described above may be a double staple line 6004 formed by the double suture technique described above, or may be a double staple line 6004 formed by the double suture technique described above. Figure 28 to Figure 33 The linear staple line 6052 formed by the linear transection technique described herein. The centering tool and technique described herein can be used to align an instrument 6002 located in a part of the anatomical structure with a staple line 6003 or with another instrument located in another part of the anatomical structure without the benefit of sight. The centering tool and technique include displaying the current alignment of the instrument 6002 adjacent to the previous operation. The centering tool is useful, for example, in laparoscopically assisted rectal surgery using a double suture technique, which is also referred to as an overlapping suture technique. In the example shown, during laparoscopically assisted rectal surgery, a circular stapler 6002 is positioned in a rectum 6006 in a pelvic cavity 6008 of the patient, and a laparoscope is positioned in the peritoneal cavity.

[0360] During laparoscopically assisted rectal surgery, the colon is cross-cut and sealed by a staple line 6003 having a length of "l". Double suture technology uses a circular stapler 6002 to produce an end-to-end anastomosis, and is currently widely used in laparoscopically assisted rectal surgery. In order to successfully form anastomosis using a circular stapler 6002, the anvil trocar 6010 of the circular stapler 6002 should be aligned with the center "l / 2" of the staple line 6003 cross-cut, then pierce the center "l / 2" of the staple line 6003 and / or fully clamped on the tissue, and then the circular stapler 6002 is fired to remove the staple overlap 6012 and form anastomosis. The misalignment of the anvil trocar 6010 with the center of the staple line 6003 cross-cut can result in a high anastomosis failure rate. This technology can be applied to ultrasonic instruments, electrosurgical instruments, combined ultrasonic / electrosurgical instruments and / or combined surgical staplers / electrosurgical instruments. Several techniques for aligning the anvil trocar 6010 of the circular stapler 6002 at the center "1 / 2" of the staple line 6003 will now be described.

[0361] In one aspect, Figure 23 to Figure 25 and also refer to Figures 1 to 11, to illustrate interaction with an interactive surgical system 100 environment including a surgical hub 106, 206, the present disclosure provides an apparatus and method for detecting overlapping portions of a double staple line 6004 in a laparoscopically assisted rectal surgery colorectal transection using a double suture technique. The overlapping portions of the double staple line 6004 are detected, and the current position of the anvil trocar 6010 of the circular stapler 6002 is displayed on the surgical hub display 215 coupled to the surgical hub 206. The surgical hub display 215 displays the alignment of the circular stapler 6002 cartridge relative to the overlapping portion of the double staple line 6004 located at the center of the double staple line 6004. The surgical hub display 215 displays a circular image around the center of the overlapping double staple line 6004 area to ensure that the overlapping portion of the double staple line 6004 is contained within the knife of the circular stapler 6002 and is therefore removed after the circular firing. Using the display, the surgeon aligns the anvil trocar 6010 with the center of the double staple line 6004, then pierces the center of the double staple line 6004 and / or fully clamps it on the tissue, and then fires the circular stapler 6002 to cut off the staple overlap 6012 and form the anastomosis.

[0362] Figure 23 to Figure 25A method of aligning an anvil trocar 6010 of a circular stapler 6022 with a staple overlap 6012 of a double staple line 6004 produced by a double suture technique is shown according to one aspect of the present disclosure. The staple overlap 6012 is centered on the double staple line 6004 formed by the double suture technique. The circular stapler 6002 is inserted into the colon 6020 below the double staple line 6004, and the laparoscope 6014 is inserted through the abdominal cavity above the double staple line 6004. The laparoscope 6014 and the non-contact sensor 6022 are used to determine the position of the anvil trocar 6010 relative to the staple overlap 6012 of the double staple line 6004. The laparoscope 6014 includes an image sensor to generate an image of the double staple line 6004. The image sensor image is transmitted to the surgical hub 206 via the imaging module 238. The sensor 6022 generates a signal 6024 that detects a metal staple using an inductive or capacitive metal sensing technique. The signal 6024 varies based on the position of the anvil trocar 6010 relative to the staple overlap 6004. The centering tool 6030 presents an image 6038 of the double staple line 6004 and a target alignment ring 6032 on the surgical hub display 215, the target alignment ring surrounding the image 6038 of the double staple line 6004 centered on the image 6040 of the staple overlap 6012. The centering tool 6030 also presents a projected cutting path 6034 of the anvil knife of the circular stapler 6002. The alignment method includes displaying the image 6038 of the double staple line 6004 and the target alignment ring 6032, the target alignment ring surrounding the image 6038 of the double staple line 6004 centered on the image 6040 of the staple overlap 6012 to be cut by the circular knife of the circular stapler 6002. An image of a crosshair 6036 (X) relative to the image 6040 of the staple overlap 6012 is also displayed.

[0363] Fig.23 The anvil trocar 6010 of the circular stapler 6002 is shown not aligned with the staple overlap 6012 of the double staple line 6004 produced by the double suturing technique. The double staple line 6004 has a length "1", and the staple overlap 6012 is located at a mid-position "1 / 2" along the double staple line 6004. Fig.23 As shown, the circular stapler 6002 is inserted into a segment of the colon 6020 and positioned just below the double staple line 6004 transection. The laparoscope 6014 is positioned above the double staple line 6004 transection, and an image of the double staple line 6004 and the staple overlap 6012 within the field of view 6016 of the laparoscope 6014 is fed to the surgical hub display 215. The position of the anvil trocar 6010 relative to the staple overlap 6012 is detected by a sensor 6022 located on the circular stapler 6002. The sensor 6022 also provides the position of the anvil trocar 6010 relative to the staple overlap 6012 to the surgical hub display 215.

[0364] like Fig.23 As shown, the projected path 6018 of the anvil trocar 6010 is shown along the dashed line to the location marked by the X. Fig.23 As shown, the projected path 6018 of the anvil trocar 6010 is not aligned with the staple overlap 6012. Piercing the anvil trocar 6010 through the double staple line 6004 at a point away from the staple overlap 6012 may result in anastomosis failure. Fig.25 The anvil trocar 6010 centering tool 6030 described in the foregoing, the surgeon can use the image displayed by the centering tool 6030 to align the anvil trocar 6010 with the staple overlap 6012. For example, in one embodiment, the sensor 6022 is an inductive sensor. Since the staple overlap 6012 contains more metal than the rest of the lateral portion of the double staple line 6004, the signal 6024 is maximum when the sensor 6022 is aligned with the staple overlap 6012 and close to the staple overlap. The sensor 6022 provides a signal to the surgical hub 206 indicating the position of the anvil trocar 6010 relative to the staple overlap 6012. The output signal is converted into a visualization of the position of the anvil trocar 6010 relative to the staple overlap 6012, which is displayed on the surgical hub display 215.

[0365] like Fig.24 As shown, the anvil trocar 6010 is aligned with the staple overlap 6012 located at the center of the double staple line 6004 produced by the double suturing technique. The surgeon can now pierce the anvil trocar 6010 through the staple overlap 6012 of the double staple line 6004 and / or completely clamp on the tissue, and then fire the circular stapler 6002 to cut off the staple overlap 6012 and form anastomosis.

[0366] Fig.25 A centering tool 6030 is shown displayed on the surgical hub display 215, which provides a display of the staple overlap 6012 of the double staple line 6004 produced by the double suturing technique, wherein the anvil trocar 6010 is not aligned with the staple overlap 6012 of the double staple line 6004, as shown in FIG. Fig.23As shown. The centering tool 6030 presents an image 6038 of the double staple line 6004 and an image 6040 of the staple overlap 6012 received from the laparoscope 6014 on the surgical hub display 215. A target alignment ring 6032 centered on the image 6040 of the staple overlap 6012 surrounds the image 6038 of the double staple line 6004 to ensure that when the projected cutting path 6034 is aligned with the target alignment ring 6032, the staple overlap 6012 is located within the circumference of the projected cutting path 6034 of the circular stapler 6002 knife. The crosshairs 6036 (X) indicate the position of the anvil trocar 6010 relative to the staple overlap 6012. The crosshairs 6036 (X) indicate the point through the double staple line 6004 at which the anvil trocar 6010 will pierce if it is advanced from its current position.

[0367] like Fig.25 As shown, the anvil trocar 6010 is not aligned with the desired puncture position specified by the image 6040 of the staple overlap 6012. To align the anvil trocar 6010 with the staple overlap 6012, the surgeon manipulates the circular stapler 6002 until the projected cutting path 6034 overlaps the target alignment ring 6032 and the crosshairs 6036 (X) are centered on the image 6040 of the staple overlap 6012. Once the alignment is complete, the surgeon punctures the anvil trocar 6010 through the staple overlap 6012 of the double staple line 6004 and / or fully clamps on the tissue, and then fires the circular stapler 6002 to cut the staple overlap 6012 and form anastomosis.

[0368] As described above, the sensor 6022 is configured to be able to detect the position of the anvil trocar 6010 relative to the staple overlap 6012. Thus, the position of the crosshair 6036 (X) presented on the surgical hub display 215 is determined by the surgical stapler sensor 6022. In another aspect, the sensor 6022 can be located on the laparoscope 6014, wherein the sensor 6022 is configured to be able to detect the tip of the anvil trocar 6010. In other aspects, the sensor 6022 can be located on the circular stapler 6022 or the laparoscope 6014 or both to determine the position of the anvil trocar 6010 relative to the staple overlap 6012 and provide this information to the surgical hub display 215 via the surgical hub 206.

[0369] Fig.26 and Fig. 27 Shown are a before image 6042 and an after image 6043 of a centering tool 6030 in accordance with one aspect of the present disclosure. Fig.26An image of the projected cutting path 6034 of the anvil trocar 6010 and circular knife prior to alignment is shown, with the target alignment ring 6032 surrounding an image 6038 of the double staple line 6004 on an image 6040 of the staple overlap 6040 presented on the surgical hub display 215. Fig. 27 An image of the projected cutting path 6034 of the anvil trocar 6010 and circular knife after alignment is shown, with the target alignment ring 6032 surrounding an image 6038 of the double staple line 6004 on an image 6040 of the staple overlap 6040 presented on the surgical hub display 215. The current position of the anvil trocar 6010 (as indicated by the crosshairs 6036 (X)) is shown. Fig.26 ) is positioned below and to the left of the center of the image 6040 of the nail overlap portion 6040. Fig. 27 As shown, as the surgeon moves the anvil trocar 6010 along the projected path 6046, the projected cutting path 6034 is aligned with the target alignment ring 6032. For example, the target alignment ring 6032 can be displayed as a grayed alignment circle overlaid on the current position of the anvil trocar 6010 relative to the center of the double nail line 6004. The image may include an indicator mark to assist the alignment process by indicating which direction to move the anvil trocar 6010. When the target alignment ring 6032 is within a predetermined distance from the center within acceptable limits, the target alignment ring can be displayed as bold, change color, or can be highlighted.

[0370] In another aspect, the sensor 6022 can be configured to detect the start and end points of the linear staple line in the colorectal transection and provide the location of the current position of the anvil trocar 6010 of the circular stapler 6002. In another aspect, the present disclosure provides a surgical hub display 215 to present the circular stapler 6002 centered on the linear staple line (which will produce a uniform crimp) and provide the current position of the anvil trocar 6010 to allow the surgeon to center or align the anvil trocar 6010 as needed, then pierce and / or fully clamp on the tissue, and then fire the circular stapler 6002.

[0371] On the other hand, Figures 28 to 30 and also refer to Figures 1 to 11, to illustrate interaction with the interactive surgical system 100 environment including the surgical hub 106, 206, in a laparoscopically assisted rectal surgery colorectal transection using a linear suturing technique, the start and end points of the linear staple line 6052 are detected, and the current position of the anvil trocar 6010 of the circular stapler 6002 is displayed on the surgical hub display 215 coupled to the surgical hub 206. The surgical hub display 215 displays a circular image centered on the double staple line 6004, which will produce a uniform crimp, and displays the current position of the anvil trocar 6002 to allow the surgeon to center or align the anvil trocar 6010, then pierce the linear staple line 6052 and / or fully clamp on the tissue, and then fire the circular stapler 6002 to cut the center 6050 of the linear staple line 6052 to form an anastomosis.

[0372] Figures 28 to 30 A method of aligning the anvil trocar 6010 of a circular stapler 6022 with the center 6050 of a linear staple line 6052 created by a linear suturing technique is shown in accordance with one aspect of the present disclosure. Fig.28 and Fig.29 The laparoscope 6014 and sensor 6022 are shown positioned on the circular stapler 6022 to determine the position of the anvil trocar 6010 relative to the center 6050 of the linear staple line 6052. The anvil trocar 6010 and sensor 6022 are inserted into the colon 6020 below the linear staple line 6052, and the laparoscope 6014 is inserted through the abdominal cavity above the linear staple line 6052.

[0373] Fig.28 The anvil trocar 6010 is shown not aligned with the center 6050 of the linear staple line 6052, and Fig.29 Anvil trocar 6010 is shown aligned with the center 6050 of linear staple line 6052. Sensor 6022 is used to detect the center 6050 of linear staple line 6052 to align the anvil trocar 6010 with the center of staple line 6052. In one aspect, the center 6050 of linear staple line 6052 can be located by moving circular stapler 6002 until one end of linear staple line 6052 is detected. When there is no more nail in the path of sensor 6022, the end can be detected. Once one of these ends is reached, circular stapler 6002 moves along linear staple line 6053 until the opposite end is detected, and the length "l" of linear staple line 6052 is determined by sensor 6022 by measuring or by counting each nail. Once the length of linear staple line 6052 is determined, the center 6050 of linear staple line 6052 can be determined by dividing the length by two "l / 2".

[0374] Fig.30A centering tool 6054 is shown displayed on the surgical hub display 215, which provides a display of a linear staple line 6052 in which the anvil trocar 6010 is not aligned with the staple overlap portion 6012 of the double staple line 6004, as shown in FIG. Fig.28 The surgical hub display 215 presents a linear staple line 6052 and a standard reticle field of view 6056 of the laparoscopic field of view 6016 of a portion of the colon 6020. The surgical hub display 215 also presents a target ring 6062 around the center of the image of the linear staple line and a projected cutting path 6064 of the anvil trocar and circular knife. The crosshairs 6066 (X) indicate the position of the anvil trocar 6010 relative to the center 6050 of the linear staple line 6052. The crosshairs 6036 (X) indicate the point through the linear staple line 6052 at which the anvil trocar would pierce if the anvil trocar 6010 were advanced from its current position.

[0375] like Fig.30 As shown, the anvil trocar 6010 is not aligned with the desired puncture position specified by the offset between the target ring 6062 and the projected cutting path 6064. In order to align the anvil trocar 6010 with the center 6050 of the linear staple line 6052, the surgeon manipulates the circular stapler 6002 until the projected cutting path 6064 overlaps the target alignment ring 6062 and the crosshairs 6066 (X) are centered on the image 6040 of the staple overlap 6012. Once the alignment is complete, the surgeon punctures the anvil trocar 6010 through the center 6050 of the linear staple line 6052 and / or fully clamps on the tissue, and then fires the circular stapler 6002 to cut the staple overlap 6012 and form the anastomosis.

[0376] In one aspect, the present disclosure provides an apparatus and method for displaying an image of a linear staple line 6052 using a linear transection technique and an alignment ring or bull's eye positioned as if the anvil trocar 6010 of the circular stapler 6022 is properly centered along the linear staple line 6052. The apparatus displays a grayed alignment ring overlaid on the current position of the anvil trocar 6010 relative to the center 6050 of the linear staple line 6052. The image may include an indicator mark to assist the alignment process by indicating which direction to move the anvil trocar 6010. The alignment ring may be bolded, change color, or highlighted when it is within a predetermined distance of the center.

[0377] Reference now Figure 28 to Figure 31 , Fig.316080 is an image of a standard reticle field of view 6080 of a surgical procedure cross-sectioned by a linear staple line 6052 as viewed through a laparoscope 6014 displayed on a surgical hub display 215 according to one aspect of the present disclosure. In the standard reticle view 6080, it is difficult to see the linear staple line 6052 in the standard reticle field of view 6056. In addition, there is no alignment aid to help align and introduce the anvil trocar 6010 to the center 6050 of the linear staple line. This view does not show an alignment circle or alignment mark indicating whether the circular stapler is properly centered, nor does it show a projected trocar path. In this view, it is also difficult to see the staples because there is no contrast with the background image.

[0378] Reference now Figure 28 to Figure 32 , Fig.32 According to one aspect of the present disclosure, before the anvil trocar 6010 and the circular knife of the circular stapler 6002 are aligned with the center 6050 of the linear staple line 6052, Fig.31 An image 6082 of a laser-assisted reticle field of view 6072 of a surgical site is shown. The laser-assisted reticle field of view 6072 provides an alignment mark or crosshair 6066 (X) that is currently positioned below and to the left of the center of the linear staple line 6052, showing the projected path of the anvil trocar 6010 to assist in positioning the anvil trocar 6010. In addition to the projected path marked by the crosshair 6066 (X) of the anvil trocar 6010, the image 6082 shows the staples of the linear staple line 6052 in a contrasting color to make them more visible against the background. The linear staple line 6052 is highlighted, and a bull's-eye target 6070 is displayed above the center 6050 of the linear staple line 6052. Outside of the laser assisted marking field of view 6072, image 6082 displays status warning box 6068, suggestion box 6074, target ring 6062, and the current alignment position of the anvil trocar 6010 relative to the center 6050 of the linear staple line 6052 as marked by crosshairs 6066 (X). Fig.32 As shown, the status warning box 6068 indicates that the cannula needle is "misaligned" and the suggestion box 6074 indicates "adjust the cannula needle to the center staple line."

[0379] Reference now Figure 28 to Figure 33 , Fig.33 According to one aspect of the present disclosure, after the anvil trocar 6010 and the circular knife of the circular stapler 6002 are aligned with the center 6050 of the linear staple line 6052, Fig.32An image 6084 of a laser-assisted reticle field of view 6072 of a surgical site is shown. The laser-assisted reticle field of view 6072 provides an alignment mark or crosshair 6066 (X) that is currently positioned below and to the left of the center of the linear staple line 6052, showing the projected path of the anvil trocar 6010 to assist in positioning the anvil trocar 6010. In addition to the projected path marked by the crosshair 6066 (X) of the anvil trocar 6010, the image 6082 shows the staples of the linear staple line 6052 in a contrasting color to make them more visible against the background. The linear staple line 6052 is highlighted, and a bull's-eye target 6070 is displayed above the center 6050 of the linear staple line 6052. Outside of the laser assisted marking field of view 6072, image 6082 displays status warning box 6068, suggestion box 6074, target ring 6062, and the current alignment position of the anvil trocar 6010 relative to the center 6050 of the linear staple line 6052 as marked by crosshairs 6066 (X). Fig.32 As shown, the status warning box 6068 indicates that the cannula needle is "misaligned" and the suggestion box 6074 indicates "adjust the cannula needle to the center staple line."

[0380] Fig.33 After the anvil trocar 6010 and the circular knife are aligned with the center of the staple line 6052, Fig.32 Laser-assisted view of the surgical site shown. In this view, within the field of view 6072 of the laser-assisted reticle, the alignment mark crosshair 6066 (X) is positioned at the center of the staple line 6052 and the highlighted bull's-eye target to indicate the alignment of the trocar with the center of the staple line. Outside the field of view 6072 of the laser-assisted reticle, the status warning box indicates the trocar is "aligned" and the advice is "proceed with trocar introduction".

[0381] Fig.34 A non-contact inductive sensor 6090 embodiment of a non-contact sensor 6022 according to one aspect of the present disclosure is shown to determine the center of the anvil trocar 6010 relative to the staple line transection (eg, Figure 23 to Figure 24 The overlapping portion 6012 of the double nail line 6004 shown, or Figure 28 to Figure 29 The non-contact inductive sensor 6090 includes an oscillator 6092 that drives an inductive coil 6094 to generate an electromagnetic field 6096. When a metal target 6098, such as a metal nail, is introduced into the electromagnetic field 6096, eddy currents 6100 induced in the target 6098 oppose the electromagnetic field 6096, and the magnetic resistance shifts and the amplitude of the oscillator voltage 6102 decreases. The amplifier 6104 amplifies the amplitude of the oscillator voltage 6102 as it changes.

[0382] Reference now Figures 1 to 11 , to illustrate interaction with the interactive surgical system 100 environment including the surgical hub 106, 206, and also with reference to Figures 22 to 33 , the inductive sensor 6090 is a non-contact electronic sensor. The inductive sensor can be used to locate and detect metal objects, such as the metal nails in the above-mentioned nail lines 6003, 6004, 6052. The sensing range of the inductive sensor 6090 depends on the type of metal detected. Since the inductive sensor 6090 is a non-contact sensor, it can detect metal objects across the suture tissue barrier. The inductive sensor 6090 can be located on the circular stapler 6002 to detect the nails in the nail lines 6003, 6004, 6052, detect the position of the distal end of the laparoscope 6014, or it can be located on the laparoscope 6014 to detect the position of the anvil trocar 6010. A processor or control circuit located in the circular stapler 6002, laparoscope 6014, or coupled to the surgical hub 206 receives a signal from the inductive sensor 6090 and can be used to display a centering tool on the surgical hub display 215 to determine the position of the anvil cannula needle 6010 relative to the staple overlap 6012 of the double staple line 6004 or the center 6050 of the linear staple line 6052.

[0383] In one aspect, the distal end of the laparoscope 6014 can be detected by an inductive sensor 6090 located on the circular stapler 6002. The inductive sensor 6090 can detect a metal target 6098 positioned on the distal end of the laparoscope 6014. Once the laparoscope 6014 is aligned with the center 6050 of the linear staple line 6052 or the staple overlap portion 6012 of the double staple line 6004, the signal from the inductive sensor 6090 is transmitted to a circuit that converts the signal from the inductive sensor 6090 to present an image of the relative alignment of the laparoscope 6014 with the anvil trocar 6010 of the circular stapler 6002.

[0384] Fig.35A and Fig.35B One aspect of a non-contact capacitive sensor 6110 embodiment of a non-contact sensor 6022 according to one aspect of the present disclosure is shown to determine the center of the anvil trocar 6010 relative to the staple line transection (e.g., Figure 23 to Figure 24 The overlapping portion 6012 of the double nail line 6004 shown, or Figure 28 to Figure 29 The location of the center 6050 of the linear nail line 6052 is shown. Fig.35A A non-contact capacitive sensor 6110 is shown with no nearby metal target, and Fig.35BA non-contact capacitive sensor 6110 is shown proximate a metal target 6112. The non-contact capacitive sensor 6110 includes capacitor plates 6114, 6116 housed in a sensing head and when excited by an oscillator waveform establishes field lines 6118 to define a sensing area. Fig.35A Field lines 6118 are shown when there is no target near the capacitor plates 6114, 6116. Fig.35B An iron or non-iron metal target 6120 in the sensing region is shown. When the metal target 6120 enters the sensing region, the capacitance increases, causing the natural frequency to shift toward the oscillation frequency, thereby causing an amplitude gain. Since the capacitive sensor 6110 is a non-contact sensor, it can detect a metal object across a sutured tissue barrier. The capacitive sensor 6110 can be located on the circular stapler 6002 to detect the staple line 6004, 6052, or to detect the position of the distal end of the laparoscope 6014, or the capacitive sensor 6110 can be located on the laparoscope 6014 to detect the position of the anvil trocar 6010. A processor or control circuit located in the circular stapler 6002, the laparoscope 6014, or coupled to the surgical hub 206 receives a signal from the capacitive sensor 6110 to present an image of the relative alignment of the laparoscope 6014 with the anvil trocar 6010 of the circular stapler 6002.

[0385] Fig.36 is a logic flow diagram 6130 depicting a method of a control program or logic configuration for aligning a surgical instrument according to one aspect of the present disclosure. Figures 1 to 11 , to illustrate interaction with the interactive surgical system 100 environment including the surgical hub 106, 206, and also with reference to Figure 22 to Figure 35, the surgical hub 206 includes a processor 244 and a memory 249 coupled to the processor 244. The memory 249 stores instructions executable by the processor 244 to: receive 6132 image data from a laparoscopic image sensor, generate 6134 a first image based on the image data, display 6136 the first image on a surgical hub display 215 coupled to the processor 244, receive 6138 a signal from the non-contact sensor 6022 indicating a position of a surgical device, generate a second image based on the signal indicating a position of a surgical device (e.g., anvil trocar 6010), and display 6140 the second image on the surgical hub display 215. The first image data represents the center 6044, 6050 of the staple line 6004, 6052 seal. The first image represents a target corresponding to the center 6044, 6050 of the staple line 6004, 6052 seal. The signal indicates the position of the surgical device (e.g., anvil trocar 6010) relative to the center 6044, 6050 of the staple line 6004, 6052 seal. The second image represents the position of the surgical device (e.g., anvil trocar 6010) along the projected path 6018 of the surgical device (e.g., anvil trocar 6010) toward the center 6044, 6050 of the staple line 6004, 6052 seal.

[0386] In one aspect, the center 6044 of the double staple line 6004 seal defines the staple overlap portion 6012. In another aspect, the image sensor receives an image from a medical imaging device. In another aspect, the surgical device is a circular stapler 6002 including an anvil trocar 6010, and the non-contact sensor 6022 is configured to detect the position of the anvil trocar 6010 relative to the center 6044 of the double staple line 6004 seal. In another aspect, the non-contact sensor 6022 is an inductive sensor 6090. In another aspect, the non-contact sensor 6022 is a capacitive sensor 6110. In one aspect, the staple line can be a linear staple line 6052 formed using a linear cross-sectioning technique.

[0387] Coordination between local instrument display and paired imaging device display

[0388] In one aspect, the present disclosure provides an instrument including a local display, a hub having an operating room (OR) or operating theatre display separate from the instrument display. When the instrument is linked to the surgical hub, the secondary display on the device is reconfigured to display different information than when the instrument is connected independently of the surgical hub. In another aspect, some portion of the information on the secondary display of the instrument is then displayed on the primary display of the surgical hub. In another aspect, image fusion is provided on the surgical hub and / or instrument display, the image fusion allowing overlay of device status, integrated indicia for interlocking several images, and at least one guidance feature. In conjunction with the following Figures 45 to 53 and Figure 63 to Figure 67 Techniques are described for overlaying or enhancing images and / or text from multiple image / text sources to present a composite image on a single display.

[0389] In another aspect, the present disclosure provides coordination between a local instrument display and a paired laparoscopic display. In one aspect, when an instrument senses a connectable presence of a global display coupled to a surgical hub, the behavior of the instrument's local display changes. In another aspect, the present disclosure provides a 360° composite top-down visual field of view of the surgical site to avoid incidental structures. Each of these techniques is described below.

[0390] During surgery, the surgical site is displayed on the remote "master" surgical hub display. During surgery, surgical devices track and record the data stored in the instrument (see Figures 12 to 19 , including a processor, memory, control circuit, storage device, etc.) in the instrument architecture). The surgical parameters include firing force (FTF), closing force (FTC), firing progress, tissue gap, power level, impedance, tissue compression stability (creep), etc. Using traditional technology during surgery, the surgeon needs to observe two independent displays. Therefore, it is advantageous to provide an image / text overlay because during the operation, the surgeon can view a single display presenting the overlaid image / text information.

[0391] One solution detects when a surgical device (e.g., an instrument) is connected to a surgical hub and then displays a composite image on a primary display that includes a field of view of a surgical site received from a first instrument (e.g., a medical imaging device such as, for example, a laparoscope, endoscope, thoracoscope, etc.) augmented by surgical data and variables received from a second instrument (e.g., a surgical stapler) to provide relevant images and data on the primary display.

[0392] During surgery, the surgical site is displayed on the primary surgical hub display as a narrow field of view of the medical imaging device. Items and incidental structures outside the current field of view cannot be viewed without moving the medical imaging device.

[0393] One solution provides a narrow field of view of the surgical site in a first window of the display, which is enhanced by a wide field of view of the surgical site in a separate window of the display. This provides a composite top view field of view mapped using two or more imaging arrays to provide an enhanced image of multiple perspectives of the surgical site.

[0394] In one aspect, the present disclosure provides a surgical hub, comprising a processor and a memory coupled to the processor. The memory stores instructions executable by the processor to detect connection of a surgical device to the surgical hub, transmit a control signal to the detected surgical device to transmit surgical parameter data associated with the detected device to the surgical hub, receive the surgical parameter data, receive image data from an image sensor, and display an image received from the image sensor together with the surgical parameter data received from the surgical device on a display coupled to the surgical hub.

[0395] In another aspect, the present disclosure provides a surgical hub, comprising a processor and a memory coupled to the processor. The memory stores instructions executable by the processor to perform the following operations: receive first image data from a first image sensor, receive second image data from a second image sensor, and display a first image corresponding to a first field of view and a second image corresponding to a second field of view on a display coupled to the surgical hub. The first image data represents the first field of view, and the second image data represents the second field of view.

[0396] In one aspect, the first field of view is a narrow angle field of view and the second field of view is a wide angle field of view. In another aspect, the memory stores instructions executable by the processor to enhance the first image with the second image on the display. In another aspect, the memory stores instructions executable by the processor to perform the following operations: fuse the first image and the second image into a third image and display the fused image on the display. In another aspect, the fused image data includes status information associated with the surgical device, an image data integration flag for interlocking multiple images, and at least one guidance parameter. In another aspect, the first image sensor is the same as the same image sensor, and wherein the first image data is captured at a first time and the second image data is captured at a second time.

[0397] On the other hand, the memory stores instructions executable by the processor to perform the following operations: receive third image data from a third image sensor, wherein the third image data represents a third field of view; generate composite image data including the second image data and the third image data; display the first image in a first window of the display, wherein the first image corresponds to the first image data; and display the third image in a second window of the display, wherein the third image corresponds to the composite image data.

[0398] On the other hand, the memory stores instructions executable by the processor to perform the following operations: receive third image data from a third image sensor, wherein the third image data represents a third field of view; fuse the second image data and the third image data to generate fused image data; display the first image in a first window of the display, wherein the first image corresponds to the first image data; and display the third image in a second window of the display, wherein the third image corresponds to the fused image data.

[0399] In various aspects, the present disclosure provides a control circuit to perform the above functions. In various aspects, the present disclosure provides a non-transitory computer-readable medium storing computer-readable instructions, which, when executed, cause a machine to perform the above functions.

[0400] By displaying the endoscopic image enhanced with the surgical device image on a primary surgical hub display, the surgeon is able to focus on one display to obtain a field of view of the surgical site enhanced with surgical device data associated with the surgical procedure such as firing force, closure force, firing progress, tissue gaps, power levels, impedance, tissue compression stability (creep), etc.

[0401] Displaying a narrow field of view image and a composite image of several other viewing angles (such as a wider field of view) in a first window of the display enables the surgeon to simultaneously observe a magnified image of the surgical site and a wider field of view of the surgical site without moving the endoscope.

[0402] In one aspect, the present disclosure provides both a global display and a local display of a device (e.g., a surgical instrument) coupled to a surgical hub. The device displays all of its relevant menus and displays on the local display until it senses a connection to the surgical hub, at which point a subset of the information is displayed only on the monitor through the surgical hub, and the information is mirrored on the device display or is no longer accessible on the device detonation screen. This technique frees up the device display to display different information or display information in a larger font on the surgical hub display.

[0403] In one aspect, the present disclosure provides an instrument having a local display, a surgical hub having an operating room (e.g., operating room or OR) display separate from the instrument display. When the instrument is linked to the surgical hub, the instrument local display becomes an auxiliary display, and the instrument is reconfigured to display different information than when operating independently of the surgical hub connection. In another aspect, some portion of the information on the auxiliary display is then displayed on the primary display in the operating room through the surgical hub.

[0404] Fig.376200 of the surgical hub 206 including a global display 6202 and a local instrument display 6204 according to one aspect of the present disclosure. Figures 1 to 11 , to illustrate interaction with the interactive surgical system 100 environment including the surgical hub 106, 206, and with reference to Figures 12 to 21 as well as Fig.37 With respect to instruments connected to the surgical hub, when the instrument 235 senses the connectable presence of the global display 6202 through the surgical hub 206, the local instrument display 6204 behavior is displayed. The global display 6202 shows a field of view 6206 of a surgical site 6208 at the center of the surgical hub display 215, as viewed through a medical imaging device such as, for example, a laparoscope / endoscope 219 coupled to an imaging module 238, for example, which surgical hub display is also referred to herein as a monitor. An end effector 6218 portion of a connected instrument 235 is shown in the field of view 6206 of the surgical site 6208 in the global display 6202. For example, as Fig.37 As shown, the image displayed on the display 237 located on the instrument 235 coupled to the surgical hub 206 is displayed or mirrored on the local instrument display 6204 located in the lower right corner of the monitor 6200. During operation, all relevant instruments and information and menus are displayed on the display 237 located on the instrument 235 until the instrument 235 senses the connection of the instrument 235 to the surgical hub 206, at which time all or some subset of the information presented on the instrument display 237 is displayed only on the local instrument display 6204 portion of the surgical hub display 6200 through the surgical hub 206. The information displayed on the local instrument display 6204 may be mirrored on the display 237 located on the instrument 235, or may no longer be available on the screen where the instrument display 237 is activated. This technique frees the instrument 235 to display different information or display information in a larger font on the surgical hub display 6200. Figures 45 to 53 and Figure 63 to Figure 67 Several techniques are described for overlaying or enhancing images and / or text from multiple image / text sources to present a composite image on a single display.

[0405] The surgical hub display 6200 provides perioperative visualization of the surgical site 6208. Advanced imaging identifies and visually highlights 6222 key structures such as the ureter 6220 (or nerve, etc.), and an instrument proximity display 6210 may also be tracked and displayed on the left side of the display 6200. In the illustrated example, the instrument proximity display 6210 shows instrument specific settings. For example, the top instrument proximity display 6212 shows settings for monopolar instruments, the middle instrument proximity display 6214 shows settings for bipolar instruments, and the bottom instrument proximity display 6212 shows settings for ultrasonic instruments.

[0406] On the other hand, a separate auxiliary display or dedicated local display can be linked to the surgical hub 206 to provide an interactive portal via a touch screen display and / or an auxiliary screen that can display any number of data feeds tracked by the surgical hub 206 to provide a clear, unobstructed status. The auxiliary screen can display firing force (FTF), tissue gap, power level, impedance, tissue compression stability (creep), etc., while the main screen can only display key variables to keep the feed concise. The interactive display can be used to move the display of specific information to the main display to display it in a desired position, size, color, etc. In the example shown, the auxiliary screen displays the instrument proximity display 6210 on the left side of the display 6200 and displays the local instrument display 6204 on the bottom right side of the display 6200. The local instrument display 6204 presented on the surgical hub display 6200 displays icons of the end effector 6218, such as an icon of the currently used staple cartridge 6224, the size 6226 (e.g., 60 mm) of the staple cartridge 6224, and an icon of the current position of the knife 6228 of the end effector.

[0407] In another aspect, a display 237 located on the instrument 235 displays the wireless or wired attachment of the instrument 235 to the surgical hub 206 and the communication / recording of the instrument on the surgical hub 206. Settings may be provided on the instrument 235 to enable the user to select mirroring or extending the display to two monitoring devices. The instrument controls may be used to interact with the surgical hub display of information derived from the instrument. As previously described, the instrument 235 may include wireless communication circuitry to communicate wirelessly with the surgical hub 206.

[0408] In another aspect, a first instrument coupled to the surgical hub 206 can be paired with the screen of a second instrument coupled to the surgical hub 206, thereby allowing the two instruments to display some hybrid combination of information from the two devices, which become mirror images of portions of the primary display. In yet another aspect, the primary display 6200 of the surgical hub 206 provides a 360° composite top-down visual view of the surgical site 6208 to avoid incidental structures. For example, a secondary display of an end effector surgical stapler can be provided within the primary display 6200 of the surgical hub 206 or on another display to provide a better perspective of the area surrounding the current field of view 6206. The following in conjunction with Figures 38 to 40 Describe these aspects.

[0409] Figures 38 to 40 A composite top view of the end effector 6234 portion of a surgical stapler mapped using two or more imaging arrays or one array is shown, and multiple perspective views of the end effector 6234 are provided to enable composite imaging of the top view field. The technology described herein can be applied to ultrasonic instruments, electrosurgical instruments, combined ultrasonic / electrosurgical instruments, and / or combined surgical stapler / electrosurgical instruments. Figures 45 to 53 and Figure 63 to Figure 67 Several techniques are described for overlaying or enhancing images and / or text from multiple image / text sources to present a composite image on a single display.

[0410] Fig.38A main display 6200 of a surgical hub 206 according to one aspect of the present disclosure is shown. A main window 6230 is located in the center of the screen and shows an enlarged or exploded narrow angle view of a surgical field of view 6232. The main window 6230 located in the center of the screen shows an enlarged or narrow angle view of an end effector 6234 of a surgical stapler grasping a vessel 6236. The main window 6230 displays a stitched image to produce a composite image that enables visualization of structures adjacent to the surgical field of view 6232. A second window 6240 is shown in the lower left corner of the main display 6200. The second window 6240 displays the stitched image in a wide angle view in a top view with a standard focus of the image shown in the main window 6230. The top view provided in the second window 6240 enables an observer to easily see items outside the narrow field of view surgical field of view 6232 without moving a laparoscope or other imaging device 239 coupled to an imaging module 238 of the surgical hub 206. A third window 6242 is shown in the lower right corner of the primary display 6200, which shows an icon 6244 representing a staple cartridge (e.g., a staple cartridge in this case) of the end effector 6234 and additional information, such as "4 rows" indicating the number of staple rows 6246 and "35 mm" indicating the distance 6248 that the knife traverses along the length of the staple cartridge. Below the third window 6242, a clamp stabilization sequence 6250 ( Fig.39 )'s frame icon 6258 of the current state.

[0411] Fig.39 A clamp stabilization sequence 6250 is shown over a five second time period in accordance with one aspect of the present disclosure. In addition to providing an actual time 6266 (e.g., 09:35:10) which may be a pseudo-actual time to maintain the anonymity of the patient, the clamp stabilization sequence 6250 is shown over a five second time period with intermittent displays 6252, 6254, 6256, 6258, 6260 spaced apart by one second intervals 6268. The intermittent displays 6252, 6254, 6256, 6258, 6260 display the elapsed time by filling in circles until the clamp stabilization time period is complete. At this point in time, the last display 6260 is shown in solid color. Clamp stabilization after the end effector 6234 clamps the vessel 6236 enables a better seal to be formed.

[0412] Fig.40Schematic 6270 of four separate wide angle view images 6272, 6274, 6276, 6278 of a surgical site at four separate times during surgery according to one aspect of the present disclosure is shown. The sequence of images shows the creation of a top view composite image with wide focus and narrow focus over time. The first image 6272 is a wide angle view of the end effector 6234 clamping the vessel 6236 taken at an earlier time t0 (e.g., 09:35:09). The second image 6274 is another wide angle view of the end effector 6234 clamping the vessel 6236 taken at the current time t1 (e.g., 09:35:13). The third image 6276 is a composite image of a top view of the end effector 6234 clamping the vessel 6236 taken at the current time t1. The third image 6276 is shown in FIG. Fig.38 6240 of the primary display 6200 of the surgical hub 206 is shown. The fourth image 6278 is a narrow angle view of the end effector 6234 clamping the vessel 6236 at the current time t1 (e.g., 09:35:13). The fourth image 6278 is as shown in FIG. Fig.38 A narrow angle view of the surgical site shown in the main window 6230 of the main display 6200 of the surgical hub 206 is shown.

[0413] Displays instrument-specific data required for effective use of the end effector

[0414] In one aspect, the present disclosure provides a surgical hub display of instrument-specific data required for effective use of surgical instruments, such as surgical staplers. The technology described herein can be applied to ultrasonic instruments, electrosurgical instruments, combined ultrasonic / electrosurgical instruments, and / or combined surgical stapler / electrosurgical instruments. In one aspect, a clamping time indicator based on tissue characteristics is shown on the display. In another aspect, a 360° composite top-down visual view is shown on the display to avoid as described in conjunction with the incorporated herein by reference Figures 37 to 40 The accompanying structures shown and described, and for the sake of brevity and clarity of the present disclosure, will not be repeated here Figures 37 to 40 Description.

[0415] In one aspect, the present disclosure provides a display of tissue creep to provide the user with intra-tissue compression / tissue stability data and guide the user to appropriately select when to perform the next instrument action. In one aspect, an algorithm calculates a constant thrust related to the viscoelastic response of the tissue based on a progressive time feedback system. These and other aspects are described below.

[0416] Fig.416280 of tissue creep clamping stabilization curves 6282, 6284 for two tissue types according to one aspect of the present disclosure. The clamping stabilization curves 6284, 6284 are plotted as closing force (FTC) as a function of time, wherein FTC (N) is shown along the vertical axis and time t (s) is shown along the horizontal axis. FTC is the amount of force applied by the clamping arm to close the tissue. The first clamping stabilization curve 6282 represents gastric tissue and the second clamping stabilization curve 6284 represents lung tissue. In one aspect, the FTC is scaled from 0-180N along the vertical axis and from 0-5s along the horizontal axis. As shown, the FTC has different profiles over a five second clamping stabilization time period (e.g., as Fig.39 shown).

[0417] Referring to the first clamping stabilization curve 6282, when the stomach tissue is clamped by the end effector 6234, the closing force (FTC) applied by the end effector 6234 increases from 0 N to a peak closing force of about 180 N after about 1 second. While the end effector 6234 remains clamped on the stomach tissue, the closing force decays over time and stabilizes to about 150 N due to tissue creep.

[0418] Similarly, referring to the second clamping stabilization curve 6284, when lung tissue is clamped by the end effector 6234, the closing force applied by the end effector 6234 increases from 0 N to a peak closing force of about 90 N in less than about 1 second. As the end effector 6234 remains clamped on the lung tissue, the closing force decays over time and stabilizes to about 60 N due to tissue creep.

[0419] As above combined Figures 38 to 40 As described above, the clamping stability of the end effector 6234 is monitored and displayed every second at sampling times t1, t2, t3, t4, t5 corresponding to the closing force to provide user feedback on the status of clamping the tissue. Fig.41 An example of monitoring tissue stability of lung tissue by sampling the closing force every second over a 5 second period is shown. At each sampling time t1, t2, t3, t4, t5, the instrument 235 or surgical hub 206 calculates a corresponding vector tangent 6288, 6292, 6294, 6298, 6302 of the second clamp stability curve 6284. The vector tangent 6288, 6292, 6294, 6298, 6302 is monitored until its slope drops below a threshold to indicate that tissue creep is complete and the tissue is ready to seal and cut. Fig.41 As shown, lung tissue is ready for sealing and cutting after a clamping stabilization period of approximately 5 seconds, where a solid grey circle is shown at sample time 6300. As shown, vector tangent line 6302 is less than a predetermined threshold.

[0420] For example, the equations of the vector tangents 6288, 6292, 6294, 6298, 6302 of the clamping stable curve 6284 can be calculated using differential techniques. In one aspect, at a given point on the clamping stable curve 6284, the gradient of the curve 6284 is equal to the gradient of the tangent of the curve 6284. The derivative (or gradient function) describes the gradient of the curve 6284 at any point on the curve 6284. Similarly, it also describes the gradient of the tangent of the curve 6284 at any point on the curve 6284. The normal of the curve 6284 is the straight line perpendicular to the tangent of the curve 6284 at any given point. In order to determine the equation of the tangent of the curve, the derivative is found using the differential rule. Substitute the x coordinate (independent variable) of the given point into the derivative to calculate the gradient of the tangent. Substitute the gradient of the tangent and the coordinates of the given point into the appropriate form of the equation of the line. Make the y coordinate (dependent variable) the main term of the formula.

[0421] Fig.42 6310 is a time-dependent proportionally filled graph of clamping force stability curves according to one aspect of the present disclosure. Graph 6310 includes clamping stability curves 6312, 6314, 6316 for standard thick gastric tissue, thin gastric tissue and standard lung tissue. The vertical axis represents FTC (N) scaled from 0-240N, and the horizontal axis represents time t (s) scaled from 0-15s. As shown, the standard thick gastric tissue curve 6316 is a default force decay stability curve. Shortly after clamping on the tissue, all three clamping stability curves 6312, 6314, 6316 FTC profiles reach maximum force, and then the FTC decreases over time until it is finally stable due to the viscoelastic response of the tissue. As shown, the standard lung tissue clamping stability curve 6312 is stable after a time period of about 5s, the thin gastric tissue clamping stability curve 6314 is stable after a time period of about 10s, and the thick gastric tissue clamping stability curve 6316 is stable after a time period of about 15s.

[0422] Fig.43 6320 is a graph of the effect of tissue creep in a clamping force stabilization curve 6322 according to one aspect of the present disclosure. The vertical axis represents the closing force FTC (N), and the horizontal axis represents the time t (s) in seconds. The vector tangent angles dθ1, dθ2, ... dθ are measured at each closing force sampling time (t0, t1, t2, t3, t4, etc.) n . Vector tangent angle dθ n Used to determine when a tissue reaches the creep termination threshold, which indicates that the tissue has reached creep stability.

[0423] Fig.44A and Fig.44BTwo graphs 6330, 6340 are shown for determining when clamped tissue has reached creep stability in accordance with one aspect of the present disclosure. Fig.44A The graph 6330 in FIG. 6 shows a curve 6332 representing the vector tangent angle dθ as a function of time. Fig.43 The calculated vector tangent angle dθ discussed in . The horizontal line 6334 is the tissue creep termination threshold. Tissue creep is considered stable at the intersection 6336 of the vector tangent angle dθ curve 6332 and the tissue creep termination threshold 6334. Fig.44B Graph 6340 in shows a ΔFTC curve 6342 representing ΔFTC as a function of time. ΔFTC curve 6342 shows a threshold 6344 for 100% completion of tissue creep stability measurement. Tissue creep is considered stable at the intersection 6346 of ΔFTC curve 6342 and threshold 6344.

[0424] Communications Technology

[0425] refer to Figures 1 to 11 , to illustrate interaction with the interactive surgical system 100 environment including the surgical hub 106, 206, and in particular, with reference to Figures 9 and 10 In various aspects, the present disclosure provides communication techniques for exchanging information between instruments 235 or other modules and a surgical hub 206. In one aspect, the communication techniques include image fusion to place instrument status and analysis on a laparoscopic image, such as a screen overlay of data within and around the perimeter of the image presented on a surgical hub display 215, 217. In another aspect, the communication techniques include combining short- to medium-range wireless (e.g., Bluetooth) signals with images, and in another aspect, the communication techniques include security and identification of pairings requested by the application. In yet another aspect, the communication techniques include a standalone interactive headset worn by the surgeon that links to the hub with audio and visual information, which avoids the need for an overlay but allows for customization of displayed information around the periphery of the field of view. Each of these communication techniques will be discussed below.

[0426] Screen overlay of data in and around the perimeter of the displayed image

[0427] In one aspect, the present disclosure provides image fusion, allowing overlay of device status, integrated markers for interlocking several images, and at least one guidance feature. In another aspect, the present disclosure provides a technology for screen overlay of data within and around the perimeter of a displayed image. Radiographic integration can be used for real-time internal sensing and pre-operative overlay. Image fusion of one source may be superimposed on another source. Image fusion can be used to place instrument status and analysis on medical imaging device (e.g., laparoscope, endoscope, thoracoscope, etc.) images. Image fusion allows overlay of device or instrument status, integrated markers for interlocking several images, and at least one guidance feature.

[0428] Fig.45 An example of an augmented video image 6350 is shown, which includes a preoperative video image 6352, which is augmented with data 6354, 6356, 6358 identifying the displayed elements. The augmented reality visual system can be employed in a surgical procedure to implement a method for augmenting data onto the preoperative image 6352. The method includes generating a preoperative image 6352 of an anatomical segment of a patient and generating an augmented video image of a surgical site within the patient. The augmented video image 6350 includes an image of at least a portion of a surgical tool 6354 operated by a user 6456. The method also includes processing the preoperative image 6352 to generate data about the anatomical segment of the patient. The data includes a label 6358 for the peripheral edge of the anatomical segment and at least a portion of the anatomical segment. The peripheral edge is configured to guide the surgeon to a cutting position relative to the anatomical segment, embedding the data and the identity of the user 6356 into the preoperative image 6350 to display an augmented video image 6350 about the anatomical segment of the patient to the user. The method also includes sensing a load condition on the surgical tool 6354, generating a feedback signal based on the sensed load condition, and updating in real time the data embedded in the augmented video image 6350 and the position of the identity of the user operating the surgical tool 6354 in response to a change in the position of the surgical tool 6354 within the augmented video image 6350. Further examples are disclosed in U.S. Patent No. 9,123,155, issued on September 1, 2015, entitled "APPARATUS AND METHOD FOR USING AUGMENTED REALITYVISION SYSTEM IN SURGICAL PROCEDURES," which is incorporated herein by reference in its entirety.

[0429] In another aspect, radiographic integration techniques may be employed to overlay the preoperative image 6352 with data obtained through real-time internal sensing or preoperative techniques. Radiographic integration may include: marking and landmark identification using surgical landmarks, radiographic markers placed inside or outside the patient; identification of radiopaque staples, clamps, or other tissue fixation items. Digital radiographic techniques may be employed to generate digital images to overlay with the preoperative image 6352. Digital radiography is a form of X-ray imaging that uses a digital image capture device with a digital X-ray sensor instead of traditional photographic film. Digital radiographic techniques provide instant image preview and availability overlay with the preoperative image 6352. Additionally, special image processing techniques may be applied to digital X-ray images to enhance the overall display quality of the image.

[0430] Digital radiography techniques employ image detectors including flat panel detectors (FPDs) which are classified into two main categories - indirect FPDs and direct FPDs. Indirect FPDs include amorphous silicon (a-Si) bonded to a scintillator in the outer layer of the detector made of cesium iodide (CsI) or gadolinium oxysulfide (Gd2O2S) that converts X-rays into light. The light is directed through an a-Si photodiode layer where it is converted into a digital output signal. The digital signal is then read out by a thin film transistor (TFT) or fiber coupled charge coupled device (CCD). Direct FPDs include amorphous selenium (a-Se) FPDs that convert X-ray photons directly into electrical charge. In this design, the outer layer of the flat panel is usually a high voltage bias electrode. X-ray photons generate electron-hole pairs in the a-Se, and the migration of these electrons and holes depends on the potential of the bias charge. When holes are replaced by electrons, the resulting charge pattern in the selenium layer is read out by TFT arrays, active matrix arrays, electrometer probes, or microplasma line addressing. Other direct digital detectors are based on CMOS and CCD technologies. Phosphor detectors can also be used to record the X-ray energy during exposure and are scanned by a laser diode to stimulate the stored energy, which is released and read out by the CCD's digital image capture array.

[0431] Fig.46 is a logic flow diagram 6360 describing a method of a control program or logic configuration for displaying an image according to one aspect of the present disclosure. Figures 1 to 11, to illustrate interaction with an interactive surgical system 100 environment including a surgical hub 106, 206, the present disclosure provides, in one aspect, a surgical hub 206 including a processor 244 and a memory 249 coupled to the processor 244. The memory 249 stores instructions executable by the processor 244 to receive 6362 first image data from a first image sensor, receive 6364 second image data from a second image sensor, and display 6366 a first image corresponding to a first field of view and a second image corresponding to a second field of view on a display 217 coupled to the surgical hub 206. The first image data represents the first field of view, and the second image data represents the second field of view.

[0432] In one aspect, the first field of view is a narrow angle field of view and the second field of view is a wide angle field of view. In another aspect, the memory 249 stores instructions executable by the processor 244 to enhance the first image with the second image on the display. In another aspect, the memory 249 stores instructions executable by the processor 244 to fuse the first image and the second image into a third image and display the fused image on the display 217. In another aspect, the fused image data includes status information associated with the surgical device 235, an image data integration flag for interlocking multiple images, and at least one guidance parameter. In another aspect, the first image sensor is the same as the same image sensor, and wherein the first image data is captured at a first time and the second image data is captured at a second time.

[0433] On the other hand, the memory 249 stores instructions executable by the processor 244 to perform the following operations: receive third image data from a third image sensor, wherein the third image data represents a third field of view; generate composite image data including the second image data and the third image data; display the first image in a first window of the display, wherein the first image corresponds to the first image data; and display a third image in a second window of the display 215, wherein the third image corresponds to the composite image data.

[0434] On the other hand, the memory 249 stores instructions executable by the processor 244 to perform the following operations: receiving third image data from a third image sensor, wherein the third image data represents a third field of view; fusing the second image data and the third image data to generate fused image data; displaying the first image in a first window of the display 217, wherein the first image corresponds to the first image data; and displaying a third image in a second window of the display 217, wherein the third image corresponds to the fused image data.

[0435] Short- to medium-range wireless (e.g., Bluetooth) signal combiner

[0436] A short to medium range wireless (eg, Bluetooth) signal combiner may include a wireless heads-up display adapter placed in the communication path from the monitor to the laparoscopic console, allowing the surgical hub to overlay data on the screen. Security and identification of requested pairings may enhance communication techniques.

[0437] Fig.47 A communication system 6370 is shown according to one aspect of the present disclosure, the communication system including an intermediate signal combiner 6372 positioned in the communication path between the imaging module 238 and the surgical hub display 217. The signal combiner 6372 receives image data from the imaging module 238 in the form of a short-range wireless or wired signal. The signal combiner 6372 also receives audio and image data from a headset 6374 and combines the image data from the imaging module 238 with the audio and image data from the headset 6374. The surgical hub 206 receives the combined data from the combiner 6372 and overlays the data provided to the display 217, displaying the overlaid data on the display. The signal combiner 6372 can communicate with the surgical hub 206 via wired or wireless signals. The headset 6374 receives image data from an imaging device 6376 coupled to the headset 6374 and receives audio data from an audio device 6378 coupled to the headset 6374. The imaging device 6376 can be a digital video camera, and the audio device 6378 can be a microphone. In one aspect, the signal combiner 6372 can be a short to medium range wireless (e.g., Bluetooth) signal combiner. The signal combiner 6374 can include a wireless heads-up display adapter to couple to a headset 6374 placed in the communication path of the display 217 to the console, thereby allowing the surgical hub 206 to overlay data onto the screen of the display 217. The security and identification of the requested pairing can enhance the communication technology. For example, the imaging module 238 can be coupled to various imaging devices such as an endoscope 239, a laparoscope, etc.

[0438] Standalone interactive headset

[0439] Fig.48An independent interactive headset 6380 worn by a surgeon 6382 is shown according to one aspect of the present disclosure to transmit data to a surgical hub. The peripheral information of the independent interactive headset 6380 does not include active video. Instead, the peripheral information only includes device settings or signals that do not have the same refresh rate requirements. The interaction can enhance the information of the surgeon 6382 based on a link to a preoperative computed tomography (CT) or other data linked in the surgical hub 206. The independent interactive headset 6380 can identify structures, for example, asking whether the instrument is contacting a nerve, a vessel, or an adhesion. The independent interactive headset 6380 can include preoperative scan data, optical views, tissue interrogation characteristics obtained throughout the operation, and / or processing in the surgical hub 206 for providing answers. The surgeon 6382 can dictate notes to the independent interactive headset 6380 to be saved in the hub storage device 248 with the patient data for later use in reporting or follow-up.

[0440] In one aspect, a standalone interactive headset 6380 worn by the surgeon 6382 is linked to the surgical hub 206 with audio and visual information to avoid the need for an overlay and allow for customization of displayed information around the periphery of the field of view. The standalone interactive headset 6380 provides signals from the device (e.g., instrument), answers inquiries about device settings, or positional information linked to the video to identify the quadrant or location. The standalone interactive headset 6380 has audio controls and audio feedback from the headset 6380. The standalone interactive headset 6380 is still able to interact with all other systems in the operating room (e.g., operating room) and has feedback and interaction available no matter where the surgeon 6382 is looking.

[0441] Identification and use of records

[0442] In one aspect, the present disclosure provides a display of authenticity of a reload, modular component, or loading unit. Fig.49A method 6390 for controlling the use of a device 6392 is shown. The device 6392 is connected to an energy source 6394. The device 6392 includes a memory device 6396, which includes a storage device 6398 and a communication 6400 device. The storage device 6398 includes data 6402, which may be locked data 6404 or unlocked data 6406. In addition, the storage device 6398 includes an error detection code 6408 such as a cyclic redundancy check (CRC) value and a sterilization indicator 6410. The energy source 6394 includes a reader 6412, a display 6414, a processor 6416, and a data port 6418 that couples the energy source 6394 to a network 6420. The network 6420 is coupled to a central server 6422, which is coupled to a central database 6424. The network 6420 is also coupled to a reprocessing facility 6426. The reprocessing facility 6426 includes a reprocessing data reader / writer 6428 and a sterilization device 6430.

[0443] The method includes connecting the device to an energy source 6394. Data is read from a memory device 6396 incorporated in the device 6392. The data includes one or more of a unique identifier (UID), a usage value, an activation value, a reprocessing value, or a sterilization indicator. When the device 6392 is connected to the energy source 6394, the usage value is incremented. When the device 6392 is activated, the activation value is incremented, thereby allowing energy to flow from the energy source 6394 to energy consuming components of the device 6392. Use of the device 6392 can be avoided if the following conditions exist: the UID is on a prohibited UID list, the usage value is not less than the usage limit value, the reprocessing value is equal to the reprocessing limit value, the activation value is equal to the activation limit value, and / or the sterilization indicator does not indicate that the device has been sterilized since its previous use. Further examples are disclosed in U.S. Patent Application Publication No. 2015 / 0317899, published on November 5, 2015, and entitled “SYSTEM AND METHOD FOR USING RFID TAGS TO DETERMINE STERILIZATION OF DEVICES,” which is incorporated herein by reference in its entirety.

[0444] Fig.50A surgical system 6500 according to the present disclosure is provided and includes a surgical instrument 6502 that communicates with a console 6522 or a portable device 6526 via a wired or wireless connection through a local area network 6518 or a cloud network 6520. In various aspects, the console 6522 and the portable device 6526 can be any suitable computing device. The surgical instrument 6502 includes a handle 6504, an adapter 6508, and a loading unit 6514. The adapter 6508 is releasably coupled to the handle 6504, and the loading unit 6514 is releasably coupled to the adapter 6508, so that the adapter 6508 transmits force from the drive shaft to the loading unit 6514. The adapter 6508 or the loading unit 6514 may include a dynamometer (not explicitly shown) disposed therein to measure the force applied to the loading unit 6514. The loading unit 6514 includes an end effector 6530 having a first jaw 6532 and a second jaw 6534. The loading unit 6514 can be an in-situ loading or multi-fire loading unit (MFLU) that allows the clinician to fire multiple fasteners multiple times without having to remove the loading unit 6514 from the surgical site to reload the loading unit 6514.

[0445] The first jaw 6532 and the second jaw 6534 are configured to clamp tissue therebetween, fire fasteners through the clamped tissue, and cut the clamped tissue. The first jaw 6532 can be configured to fire at least one fastener multiple times, or can be configured to include a replaceable multiple firing fastener bin, which includes multiple fasteners (e.g., nails, clamps, etc.) that can be fired more than once before being replaced. The second jaw 6534 may include an anvil that deforms the fastener or otherwise fixes the fastener around the tissue when the fastener is ejected from the multiple firing fastener bin.

[0446] The handle 6504 includes a motor coupled to the drive shaft to affect the rotation of the drive shaft. The handle 6504 includes a control interface for selectively activating the motor. The control interface may include a button, a switch, a lever, a slider, a touch screen, and any other suitable input mechanism or user interface that can be engaged by a clinician to activate the motor.

[0447] The control interface of the handle 6504 communicates with the controller 6528 of the handle 6504 to selectively activate the motor to affect the rotation of the drive shaft. The controller 6528 is disposed in the handle 6504 and is configured to receive input from the control interface and adapter data from the adapter 6508 or loading unit data from the loading unit 6514. The controller 6528 analyzes the input from the control interface and the data received from the adapter 6508 and / or the loading unit 6514 to selectively activate the motor. The handle 6504 may also include a display that a clinician may view during use of the handle 6504. The display is configured to display portions of the adapter or loading unit data before, during, or after firing the instrument 6502.

[0448] The adapter 6508 includes an adapter identification device 6510 disposed therein, and the loading unit 6514 includes a loading unit identification device 6516 disposed therein. The adapter identification device 6510 communicates with the controller 6528, and the loading unit identification device 6516 communicates with the controller 6528. It should be understood that the loading unit identification device 6516 can communicate with the adapter identification device 6510, and the adapter identification device relays or transmits the communication from the loading unit identification device 6516 to the controller 6528.

[0449] The adapter 6508 may also include a plurality of sensors 6512 (one is shown) disposed around it to detect various conditions of the adapter 6508 or the environment (e.g., whether the adapter 6508 is connected to the loading unit, whether the adapter 6508 is connected to the handle, whether the drive shaft is rotating, the torque of the drive shaft, the strain of the drive shaft, the temperature within the adapter 6508, the number of firings of the adapter 6508, the peak force of the adapter 6508 during firing, the total amount of force applied to the adapter 6508, the peak retraction force of the adapter 6508, the number of pauses of the adapter 6508 during firing, etc.). The plurality of sensors 6512 provide input to the adapter identification device 6510 in the form of data signals. The data signals of the plurality of sensors 6512 may be stored in the adapter identification device 6510, or may be used to update the adapter data stored in the adapter identification device. The data signals of the plurality of sensors 6512 may be analog or digital. The plurality of sensors 6512 may include a dynamometer to measure the force applied to the loading unit 6514 during firing.

[0450] The handle 6504 and the adapter 6508 are configured to interconnect the adapter identification device 6510 and the loading unit identification device 6516 with the controller 6528 via an electrical interface. The electrical interface can be a direct electrical interface (i.e., comprising electrical contacts that engage with each other to transmit energy and signals therebetween). Additionally or alternatively, the electrical interface can be a contactless electrical interface to wirelessly transmit energy and signals therebetween (e.g., inductive transmission). It is also conceivable that the adapter identification device 6510 and the controller 6528 can communicate wirelessly with each other via a wireless connection separate from the electrical interface.

[0451] The handle 6504 includes a transmitter 6506 configured to transmit instrument data from the controller 6528 to other components of the system 6500 (e.g., the LAN 6518, the cloud 6520, the console 6522, or the portable device 6526). The transmitter 6506 may also receive data (e.g., cartridge data, loading unit data, or adapter data) from other components of the system 6500. For example, the controller 6528 may transmit instrument data to the console 6528, the instrument data including the serial number of the attachment adapter (e.g., adapter 6508) attached to the handle 6504, the serial number of the loading unit (e.g., loading unit 6514) attached to the adapter, and the serial number of the multi-fire fastener cartridge (e.g., multi-fire fastener cartridge) loaded into the loading unit. Thereafter, the console 6522 may transmit data associated with the attached cartridge, loading unit, and adapter, respectively (e.g., cartridge data, loading unit data, or adapter data) back to the controller 6528. The controller 6528 may display the message on a local instrument display or transmit the message to the console 6522 or portable device 6526 via the transmitter 6506 for display on the display 6524 or portable device screen, respectively.

[0452] Multifunctional surgical control system and switching interface for speech control of imaging devices

[0453] Fig.51 A speech AESOP camera positioning system is shown. Further examples are disclosed in U.S. Patent No. 7,097,640, issued August 29, 2006, entitled "MULTI-FUNCTIONAL SURGICAL CONTROL SYSTEM AND SWITCHING INTERFACE," the entire contents of which are incorporated herein by reference. Fig.51 shows that it can be coupled to the combination Figures 1 to 11The surgical system 6550 of the surgical hub 206 is described. The system 6550 allows a surgeon to operate multiple different surgical devices 6552, 6554, 6556, and 6558 from a single input device 6560. Providing a single input device reduces the complexity of operating the various devices and increases the efficiency of the surgical procedures performed by the surgeon. The system 6550 can be adapted and configured to be able to operate a positioning system for an imaging device such as a camera or an endoscope using verbal commands.

[0454] The surgical device 6552 can be a robotic arm that can hold and move surgical instruments. The arm 6552 can be a device such as that sold by Computer Motion, Inc. (Goleta, Calif.) under the trade name AESOP, which is an acronym for Automated Endoscopic System for Optimal Positioning. The arm 6552 is typically used to hold and move an endoscope within a patient's body. The system 6550 allows the surgeon to control the operation of the robotic arm 6552 through an input device 6560.

[0455] The surgical device 6554 can be an electrocautery device. An electrocautery device typically has a bipolar tip that carries an electrical current that heats and denatures tissue. The device is typically coupled to an on-off switch to actuate the device and heat tissue. The electrocautery device can also receive a control signal to vary its power output. System 6550 allows the surgeon to control the operation of the electrocautery device via input device 6560.

[0456] The surgical device 6556 can be a laser. The laser 6556 can be actuated by an on-off switch. In addition, the power of the laser 6556 can be controlled by a control signal. The system 6550 allows the surgeon to control the operation of the laser 6556 through an input device 6560.

[0457] Device 6558 may be a surgical table. The surgical table 6558 may include a motor and mechanism for adjusting the position of the surgical table. The present invention allows the surgeon to control the position of the surgical table 6558 via input device 6560. Although four surgical devices 6552, 6554, 6556, and 6558 are described, it should be understood that other functions within the operating room may be controlled via input device 6560. For example, system 6560 may allow the surgeon to control the lighting and temperature of the operating room via input device 6560.

[0458] The input device 6560 may be a foot pedal having a plurality of buttons 6562, 6564, 6565, 6566, and 6568 that may be depressed by the surgeon. Each button is typically associated with a specific control command for the surgical device. For example, when the input device 6560 is controlling the robotic arm 6552, depressing button 6562 may cause the arm to move in one direction, and depressing button 6566 may cause the arm to move in the opposite direction. Similarly, when an electrocautery device 6554 or a laser 6556 is coupled to the input device 6560, depressing button 6568 may cause the device to power on, and so on. Although a foot pedal is shown and described, it should be understood that the input device 6560 may be a manual controller, a voice interface that accepts voice commands from the surgeon, a cantilever pedal, or other input devices known in the field of surgical device control. Using the voice interface, the surgeon is able to position a camera or endoscope connected to the robotic arm 6552 using verbal commands. An imaging device such as a camera or endoscope can be coupled to a robotic arm 6552 positioning system that is controlled by system 6550 using verbal commands.

[0459] The system 6550 has a switching interface 6570 that couples the input device 6560 to the surgical devices 6552, 6554, 6556, and 6558. The interface 6570 has an input channel 6572 that is connected to the input device 6560 via a bus 6574. The interface 6570 also has a plurality of output channels 6576, 6578, 6580, and 6582 that are coupled to the surgical devices via buses 6584, 6586, 6588, 6590, 6624, 6626, 6628, and which may have an adapter or controller disposed in electrical communication therewith and therebetween. Such adapters and controllers will be discussed in more detail below.

[0460] Since each device 6552, 6554, 6556, 6558 may require a specifically configured control signal for proper operation, an adapter 6620, 6622 or controller 6618 may be interposed between and in electrical communication with a specific output channel and a specific surgical device. In the case of the robotic arm system 6552, no adapter is required, and thus the robotic arm system 6552 may be directly connected to a specific output channel. The interface 6570 couples the input channel 6572 to one of the output channels 6576, 6578, 6580, and 6582.

[0461] The interface 6570 has a selection channel 6592 that can switch the input channel 6572 to different output channels 6576, 6578, 6580, or 6582 so that the input device 6560 can control any surgical device. The interface 6570 can be a multiplexer circuit configured as an integrated circuit and placed on an ASIC. Alternatively, the interface 6570 can be a plurality of solenoid-actuated relays coupled to the selection channel through a logic circuit. The interface 6570 switches to a specific output channel in response to an input signal or a switching signal applied to the selection channel 6592.

[0462] like Fig.51 As depicted, there may be several inputs to the selection channel 6592. Such inputs originate from the foot pedal 6560, the voice interface 6600, and the CPU 6662. The interface 6570 may have a multiplexing unit so that only one switching signal can be received at the selection channel 6592 at any one time, thereby ensuring that there is no substantial hardware conflict. The priority of the input device can be configured so that the foot pedal has the highest priority, followed by the voice interface and the CPU. This is intended to ensure the most efficient system, for example, by adopting a priority scheme. In this way, other priority schemes may be adopted. Each time a switching signal is provided to the selection channel 6592, the selection channel 6592 may sequentially connect the input channel to one of the output channels. Alternatively, the selection channel 6592 may be addressable so that when an address is provided to the selection channel 6592, the interface 6570 connects the input channel to a specific output channel. Such addressing is known in the field of electrical switches.

[0463] The selection channel 6592 may be connected to a dedicated button 6596 on the foot pedal 6560 via a line 6594. The surgeon may switch surgical devices by pressing the button 6596. Alternatively, the selection channel 6592 may be coupled to a voice interface 6600 via a line 6598 that allows the surgeon to switch surgical devices using voice commands.

[0464] The system 655...

Claims

1. A surgical hub, comprising: processor; as well as A memory coupled to the processor, the memory storing instructions executable by the processor to: receiving first image data from a first image sensor, wherein the first image data represents a first field of view, wherein the first field of view is a narrow angle field of view; receiving second image data from a second image sensor, wherein the second image data represents a second field of view, wherein the second field of view is a wide-angle field of view; Receiving surgical parameter data associated with the surgical device, the surgical parameter data indicating one or more of: firing force, closing force, firing progress, tissue clearance, power level, impedance, tissue compression stability, number of staple rows, distance traversed by the knife along the length of the staple cartridge, clamp stabilization sequence, and clamp time; and A first image rendered from the first image data corresponding to the first field of view, a second image rendered from the second image data corresponding to the second field of view, and the surgical parameter data associated with the surgical device are displayed on a single surgical hub main display coupled to the processor.

2. The surgical hub according to claim 1, wherein: The memory stores instructions executable by the processor to enhance the first image with the second image on the single surgical hub primary display.

3. The surgical hub according to claim 1, wherein: The memory stores instructions executable by the processor to fuse the first image and the second image into a third image and display the fused image on the single surgical hub primary display.

4. The surgical hub according to claim 3, wherein: The fused image data of the fused image includes status information associated with the surgical device, an image data integration flag for interlocking the plurality of images, and at least one guidance parameter.

5. The surgical hub of claim 1, wherein: The first image sensor is the same as the second image sensor, and wherein the first image data is captured by the first image sensor at a first time and the second image data is captured by the first image sensor at a second time.

6. The surgical hub of claim 1, wherein: The memory stores instructions executable by the processor to: receiving third image data from a third image sensor, wherein the third image data represents a third field of view; generating composite image data including the second image data and the third image data; displaying the first image in a first window of the single surgical hub primary display, wherein the first image corresponds to the first image data; as well as A third image is displayed in a second window of the single surgical hub main display, wherein the third image corresponds to the composite image data.

7. The surgical hub of claim 1, wherein: The memory stores instructions executable by the processor to: receiving third image data from a third image sensor, wherein the third image data represents a third field of view; fusing the second image data and the third image data to generate fused image data; displaying the first image in a first window of the single surgical hub primary display, wherein the first image corresponds to the first image data; as well as A third image is displayed in a second window of the single surgical hub main display, wherein the third image corresponds to the fused image data.

8. A surgical hub, comprising: processor; as well as A memory coupled to the processor, the memory storing instructions executable by the processor to: detecting connection of a surgical device to the surgical hub; transmitting a control signal to the detected surgical device to transmit surgical parameter data associated with the detected surgical device to the surgical hub, wherein the surgical parameter data indicates one or more of: a firing force, a closing force, a firing progress, a tissue gap, a power level, an impedance, a tissue compression stability, a number of staple rows, a distance traversed by the knife along the length of the staple cartridge, a clamp stabilization sequence, and a clamp time; receiving the surgical parameter data from the detected surgical device; receiving image data from an image sensor, the image data representing a narrow-angle field of view and a wide-angle field of view; and An image rendered based on the image data received from the image sensor together with the surgical parameter data received from the surgical device is displayed on a single surgical hub master display coupled to the surgical hub.

9. The surgical hub of claim 8, wherein: The surgical device includes an instrument local display that is separate from the single surgical hub main display coupled to the surgical hub.

10. The surgical hub of claim 9, wherein: The surgical device connected to the surgical hub is configured to be able to reconfigure the instrument local display to present information different from the information presented when the surgical device is not connected to the surgical hub.

11. The surgical hub of claim 9, wherein: A portion of the information displayed on the instrument local display is displayed on the single surgical hub master display coupled to the surgical hub.

12. The surgical hub of claim 9, wherein: Information displayed on the single surgical hub primary display coupled to the surgical hub is mirrored on the instrument local display of the surgical device.

13. A surgical hub, comprising: A control circuit configured to: detecting connection of a surgical device to the surgical hub; transmitting a control signal to the detected surgical device to transmit surgical parameter data associated with the detected surgical device to the surgical hub; receiving the surgical parameter data from the detected surgical device, wherein the surgical parameter data indicates one or more of: a firing force, a closing force, a firing progress, a tissue gap, a power level, an impedance, a tissue compression stability, a number of staple rows, a distance traversed by a knife along a length of a staple cartridge, a clamp stabilization sequence, and a clamp time; receiving image data from an image sensor, the image data representing a narrow-angle field of view and a wide-angle field of view; and The images received from the image sensor are displayed together with the surgical parameter data received from the surgical device on a single surgical hub master display coupled to the surgical hub.

14. The surgical hub of claim 13, wherein: The surgical device includes an instrument local display that is separate from the single surgical hub main display coupled to the surgical hub.

15. The surgical hub of claim 14, wherein: The surgical device connected to the surgical hub is configured to be able to reconfigure the instrument local display to present information different from the information presented when the surgical device is not connected to the surgical hub.

16. The surgical hub of claim 14, wherein: A portion of the information displayed on the instrument local display is displayed on the single surgical hub master display coupled to the surgical hub.

17. The surgical hub of claim 14, wherein: Information displayed on the single surgical hub primary display coupled to the surgical hub is mirrored on the instrument local display of the surgical device.

18. A non-transitory computer readable medium storing computer readable instructions that, when executed, cause a machine to: detecting connection of a surgical device to a surgical hub; transmitting a control signal to the detected surgical device to transmit surgical parameter data associated with the detected surgical device to the surgical hub, wherein: The surgical parameter data indicates one or more of: firing force, closing force, firing progress, tissue clearance, power level, impedance, tissue compression stability, number of staple rows, distance traversed by the knife along the length of the staple cartridge, clamp stabilization sequence, and clamp time; receiving the surgical parameter data from the detected surgical device; receiving image data from an image sensor, the image data representing a narrow-angle field of view and a wide-angle field of view; as well as The images received from the image sensor are displayed together with the surgical parameter data received from the surgical device on a single surgical hub master display coupled to the surgical hub.

19. A non-transitory computer readable medium storing computer readable instructions that, when executed, cause a machine to: receiving first image data from a first image sensor, wherein the first image data represents a first field of view, wherein, The first field of view is a narrow-angle field of view; receiving second image data from a second image sensor, wherein the second image data represents a second field of view, wherein the second field of view is a wide-angle field of view; Receiving surgical parameter data associated with the surgical device, the surgical parameter data indicating one or more of: firing force, closing force, firing progress, tissue clearance, power level, impedance, tissue compression stability, number of staple rows, distance traversed by the knife along the length of the staple cartridge, clamp stabilization sequence, and clamp time; and A first image corresponding to the first field of view, a second image corresponding to the second field of view, and the surgical parameter data associated with the surgical device are displayed on a single surgical hub main display coupled to the surgical hub.

Citation Information

Patent Citations

  • Surgical communication and control system

    US20090046146A1

  • Controllable magnetic source to fixture intracorporeal apparatus.

    US20110306840A1

  • System for performing a minimally invasive surgical procedure

    US20140243597A1

  • Staple cartridge tissue thickness sensor system

    US20140263552A1

  • System and method for using RFID tags to determine sterilization of devices

    US20150317899A1