Operating room devices, methods and systems

Abstract

Operating room devices, methods, and systems are disclosed. A method includes: receiving data associated with a patient at a processing unit; determining, using the processing unit, a treatment for the patient; identifying, using the processing unit, control settings associated with one or more treatment devices that (i) communicate with the processing unit and (ii) are operable to perform the treatment; and generating, using the processing unit, a display of at least one view including the control settings and the data. Related devices and systems are also disclosed.

Description

[0001] manual Technical Field

[0002] Aspects of the present disclosure generally relate to operating room devices, methods, and systems.Some aspects are suitable for urological surgery. Background Art

[0003] Many treatment devices may be used in a typical urological surgery to diagnose the condition and perform treatment (e.g., kidney stone management, BPH treatment, prostatectomy, tumor resection, uterine fibroid management, etc.). Each treatment device (e.g., fluid source or laser source) may rely on specific inputs (e.g., flow rate or power level). These inputs are typically equipped with device-specific controls, such as a keyboard attached to a source module (e.g., fluid source or laser source) located outside the operating room.

[0004] In order to perform certain treatments, the surgeon may be required to configure and operate each of these treatment devices independently and / or in combination. For example, a single urological surgery may employ: multiple scopes, each with its own display and controls; multiple treatment devices, each with its own display and controls; and multiple patient monitoring devices, each with its own display and controls - all of which must be coordinated during the various stages of a typical surgery. Surgical inefficiencies can be attributed to the inability to communicate between these devices at each stage, thereby increasing the time and cost of the operation. For example, the surgeon may be required to operate each device separately, requiring proficiency in many devices; and / or utilize an assistant to operate one or more devices, thereby increasing the communication burden. For example, post-operative management efficiency can also be reduced by requiring staff to separately record the use of each device, further increasing workload and cost.

[0005] Aspects of the operating room devices, methods, and systems described herein may address these problems and / or other deficiencies in the art. Summary of the invention

[0006] One disclosed aspect is a method. For example, the method may include: receiving data associated with a patient at a processing unit; determining, using the processing unit, a treatment for the patient; identifying, using the processing unit, control settings associated with one or more treatment devices that (i) are in communication with the processing unit and (ii) are operable to perform the treatment; and generating, using the processing unit, a display of at least one view including the control settings and the data. A number of aspects of an exemplary method are now described.

[0007] According to some aspects, the data may include a three-dimensional model of a portion of the patient, and the receiving step may include: receiving the three-dimensional model from a data source at a processing unit; and selecting, with the processing unit, at least one view from the three-dimensional model. The data may include an image of the patient, and the receiving step may include: receiving the image from the data source at the processing unit; and / or generating, with the processing unit, the three-dimensional model of the patient from the image. The determining step may also include: identifying, with the processing unit, a potential treatment for the patient; determining, with the processing unit, whether one or more treatment devices are operable to perform the potential treatment; and generating, with the processing unit, a display to include a list of potential treatments that can be performed by the one or more treatment devices.

[0008] In some aspects, the identifying step may include obtaining control settings from one or more treatment devices using the processing unit. For example, the identifying step may include: receiving a device identifier from one or more treatment devices at the processing unit; delivering the device identifier to a data source using the processing unit; and receiving the control settings from the data source at the processing unit. The one or more treatment devices may include a first treatment device in communication with the processing unit and a second treatment device in communication with the processing unit. Thus, the identifying step may also include: receiving a first control setting for the first treatment device and a second control setting for the second treatment device at the processing unit; and identifying one or more computer applications using the processing unit for operating the first treatment device and the second treatment device in a coordinated manner to perform treatment. For example, identifying the one or more computer applications may include: delivering the first control setting and the second control setting to the data source using the processing unit; and receiving one or more applications from the data source, the one or more applications configured to operate the first device and the second device simultaneously.

[0009] At least one of the views may include a first view that is different from a second view, and the generating step may include: placing a distal end of one or more treatment devices within the patient; and locating the distal end in the first view and the second view using a processing unit. For example, the distal end of the treatment may include a localization beacon, and the processing unit may include a tracking module configured to identify the localization beacon in the first view and the second view. The data may include an image of an internal surface of the patient, the first view may include the internal surface, and the method may include: overlaying a grid onto the internal surface depicted in the first view of the patient using the processing unit; marking at least one area defined by the grid using the processing unit; and locating at least one area in the second view of the patient using the processing unit.

[0010] According to some aspects, the method may include: receiving, with a processing unit, input from an input device in communication with the processing unit; and operating, with the processing unit, a treatment device according to the input and control settings, wherein the input is a user-generated signal including at least one of an audio signal, a tactile signal, and a visual signal. The method may further include: identifying, with the processing unit, an object within a patient's body; and locating, with the processing unit, the object in at least one view. The generating step may include: determining, with the processing unit, a characteristic of the object using at least one sensor; and modifying, with the processing unit, the input or control settings based on the characteristic. Additionally, the method may further include: generating, with the processing unit, one or more reports including the control settings and the input; and outputting, with the processing unit, one or more reports.

[0011] Another disclosed aspect is a method. For example, the method may include: generating, with a processing unit, a display including control settings for a treatment device and at least one view of data associated with a patient; overlaying, with the processing unit, a depiction of (i) a treatment site, (ii) a path to the treatment site, and (iii) a position of the treatment device on the path onto the at least one view; moving the treatment device along the path in response to the display, and continuously updating, with the processing unit, the display in response to the movement until the position of the treatment device reaches the treatment site; obtaining, with the processing unit, input from an input device in response to the control settings; and operating, with the processing unit, the treatment device based on the input and the control settings to apply treatment energy at the treatment site. Many aspects of an exemplary method are now described.

[0012] According to some aspects, the input may include a user-generated signal, the user-generated signal including at least one of an audio signal, a tactile signal, and a visual signal; and the method may further include: converting the user-generated signal into a control signal using a processing unit; and outputting the control signal to the treatment device using the processing unit. The method may further include: determining, using the processing unit, a characteristic of the object or the treatment energy using one or more sensors; and modifying the control signal based on the determined characteristic using the processing unit. For example, the method may include: obtaining, using the processing unit, a computer application configured for use with one or more sensors; and determining, using the processing unit, the characteristic using the computer application and the one or more sensors. The object may include one or more stones, the characteristic may include a measure of stone burden, stone size, or stone type associated with the one or more stones, and the computer application may be configured to modify the control signal based on the measure. The characteristic may also include a composition of the one or more stones, and the computer application may be configured to modify the control signal based on the composition. In some aspects, the treatment energy may include laser energy, the characteristic may include a measure of the laser energy, and the computer application may be configured to modify the control signal based on the measure of the laser energy.

[0013] Another disclosed aspect is a system. For example, the system may include: a processing unit in communication with one or more treatment devices; a display generated by the processing unit to include at least one view of data associated with a patient and control settings for the one or more treatment devices; and an input device operable with the display to receive input in response to the control settings and activate the one or more treatment devices. Many aspects of an exemplary system are now described.

[0014] According to some aspects, the processing unit may be configured to: obtain data from a data source; and obtain control settings from a treatment device or data source. The data may include a three-dimensional model of a portion of a patient, and the processing unit may be configured to generate at least one view based on the three-dimensional model. For example, the data may include an image of the patient, and the processing unit may be configured to: obtain from the data source a computer application configured to generate the three-dimensional model from the image; and / or generate the three-dimensional model using the application.

[0015] The processing unit may be configured to: identify capabilities associated with one or more treatment devices; obtain a computer application from a data source based on the identified capabilities; and generate a control setting using the computer application. The one or more treatment devices may include a first treatment device and a second treatment device, and the control setting may include at least one option for operating the first treatment device and the second treatment device in a coordinated manner to perform treatment. For example, the first treatment device may be a laser source, the second treatment device may be a fluid source, and the at least one option may be configured to operate the laser source and the fluid source according to a predetermined sequence.

[0016] Another disclosed aspect is an input device. For example, the treatment device may include a handle, and the input device may include a controller mounted on the handle and operable to communicate with at least one visual Figure 1 The therapeutic device may be a mirror, and the handle may include a display actuator and one or more mirror actuators configured to operate the steerable portion of the mirror. The input device may be configured to receive a user-generated signal including at least one of an audio signal, a tactile signal, and a visual signal. For example, the input device may include: one or more sensors configured to receive user-generated signals, such as a display actuator having one or more buttons configured to receive tactile signals, or a movement sensor configured to receive visual signals by tracking the movement of the display actuator or the user. In one aspect, one of the systems described above also includes a projector configured to output a display onto a surface, and the input device may include an eye movement sensor configured to receive visual signals by tracking the movement of at least one eye of the user relative to the surface. For example, the surface and / or eye movement sensor may be head-mounted so as to position the display and sensor within the field of view of at least one eye.

[0017] It is to be understood that both the foregoing summary and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as hereinafter claimed. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings are incorporated into and constitute a part of this specification. These drawings illustrate various aspects of the present disclosure and are used together with the written description herein to explain the present disclosure. Each drawing depicts one or more exemplary aspects according to the present disclosure, as follows:

[0019] Figure 1 depicts aspects of an exemplary system;

[0020] Figure 2A-2C Aspects of exemplary methods are described;

[0021] Figure 3 depicts aspects of an exemplary display;

[0022] Figure 4A-4C depicts additional aspects of an exemplary display;

[0023] Figure 5 depicts aspects of an exemplary processing unit;

[0024] Fig. 6A depicts aspects of an exemplary therapeutic device;

[0025] Figure 6B depicts aspects of an exemplary input device; and

[0026] Figure 7 Aspects of another exemplary control device are depicted. DETAILED DESCRIPTION

[0027] Various aspects of the present disclosure are now described with reference to operating room devices, methods, and systems. Some aspects are described with reference to urological surgical procedures, in which a therapeutic device (e.g., a scope) can be advanced through a path or passageway within the body (e.g., a ureter) to remove an unwanted object (e.g., a stone) from a cavity within the body (e.g., a renal calyx). For convenience, references to the following are provided and are not intended to limit the present disclosure: a particular type of surgery, such as a urological surgical procedure; a therapeutic device, such as a scope; unwanted material, such as a stone; or a body part, such as a ureter. Thus, the devices, methods, and systems described herein may be used for medical or any other similar purpose.

[0028] The terms "proximal" and "distal" and their corresponding initials "P" and "D" can be used together with terms such as "parallel" and "lateral" to describe related aspects in the present disclosure. The proximal end refers to a position closer to the outside of the body (or closer to the user), while the distal end refers to a position closer to the inside of the body (or farther away from the user). The initials "P" or "D" are attached to the element number to indicate the proximal or distal position or direction. The term "elongated" as used herein refers to any object that is substantially longer relative to its width, such as an object having a length that is at least twice as long as its width. However, unless protection is claimed, these terms are provided for convenience and are not intended to limit the present disclosure to a specific position, direction or orientation.

[0029] As used herein, terms such as "comprises," "comprising," or similar variations are intended to cover a non-exclusive inclusion, such that any aspect that includes a list of elements includes not only those elements or steps, but may include other elements or steps that are not expressly listed or inherent to them. Unless otherwise specified, the term "exemplary" is used in the sense of "example" rather than "ideal." In contrast, the terms "consisting of" and "composed of" are intended to cover an exclusive inclusion, such that an aspect consisting of a list of elements includes only those elements. As used herein, terms such as "about," "substantially," "approximately," or similar variations may indicate a range of values ​​within + / - 5% of a stated value.

[0030] Aspects of hardware and software are disclosed. Thus, some aspects may be entirely hardware, entirely software, or a combination of hardware and software. Some aspects may be described as computer applications, such as computer program products stored on a computer-usable data storage medium or data source. Such applications may be executed by one or more processors in communication with a data source. Any data source may be utilized, including a hard disk, CD-ROM, optical storage device, or other electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, apparatus, or similar propagation medium.

[0031] Any combination of local or remote resources for data processing and storage can be used to perform the described applications, including the combinations described herein. The relative locations of these resources can be optimized to achieve beneficial advances in processing power. For example, one or more processors may be located locally in the operating room, such as behind the sterile area; and the data source may be remote from the operating room, such as at a server farm located miles away. Therefore, certain described aspects are particularly useful when large amounts of data are obtained from the data source in real time, such as during urological surgery. However, unless protection is required, these terms are provided for convenience and are not intended to limit the present disclosure to specific locations and / or relativity.

[0032] Some aspects may be described using conceptual and / or flow chart illustrations, such as Figure 2A-2C Although such illustrations may include sequential depictions, many steps may be performed in parallel, performed simultaneously, or omitted entirely, including Figure 2A-2CThose in. The order of the steps may also be rearranged. The method may terminate when the last step is performed, but may also have additional steps, including intermediate steps described herein and / or any configuration steps inherent to the surgical execution or use of the technique. Some of the described methods and / or method steps may be implemented as computer applications executable by one or more processors (e.g., microprocessors or microcontrollers, etc.); while other methods and / or method steps may be implemented as surgical methods executable by a human operator or user (e.g., a surgeon). Other methods and / or steps may be implemented as combinations thereof.

[0033] Many aspects of the present disclosure are now described with reference to a basic system 100 . Figure 1 An exemplary basic system 100 is depicted in FIG. Basic system 100 may be used to perform a number of operating room methods, including exemplary methods 200, 300, and 400 described below. As shown, aspects of basic system 100 may include: a display 10; a processing unit 50 configured to generate a display using one or more computer applications; and an input device 80 configured to operate display 10. A user 1 (e.g., a surgeon) may control a display 10 by inputting a display device 80 to a computer program program. Figure 1 Also depicted is a hand 2, a mask 3, and a pair of glasses 4. Many aspects of the basic system 100 are now described, followed by: a detailed description of methods 200, 300, and 400; additional aspects of the system 100; and additional aspects of the input device 80.

[0034] The display 10 may include at least one view of data associated with the patient and at least one view of one or more control settings associated with one or more treatment devices. Figure 1 , the display 10 includes a first view or navigation view 20 of the patient; a second view or mapping view 30 of the patient; and a third view or control view 40 for control settings of the treatment device. At least one of the views can be based on any data associated with the patient. Exemplary data types can include: (i) image data, such as still frames or video files of the patient generated by one or more imaging devices 69; (ii) sensory data, such as characteristics of objects within the patient's body determined by one or more sensors 61; and (iii) geometric data, such as a three-dimensional model based on any image and / or sensor data associated with at least a portion of the patient. The processing unit 50 can receive any type of data in real time (e.g., accessed from a real-time video feed) and / or in advance (e.g., downloaded from a remote server) from any data source local or remote to the system 100.

[0035] The navigation view 20 and the mapping view 30 may be generated from the same or different types of data. Figure 4AAs shown in FIG. 1 , for example, the navigation view 20 may be generated from a fluoroscopic image of the patient, while the mapping view 30 may be generated from a first view of the three-dimensional model of the patient. Figure 4B An additional example of display 10 is depicted in , where a navigation view 20 may be generated from a real-time video feed of a path extending through a patient, and a mapping view 30 may be generated from a second view of a three-dimensional model of the patient; and Figure 4C , where the navigation view 20 can be generated by output from one or more sensors 61 located in the path, and the mapping view 30 is generated by a third view of the three-dimensional model of the patient. The data types can be grouped and / or layered to create at least one view. The display 10 can be further configured to switch between different views, types, groupings, and / or layers. For example, Figure 4A-4C As shown in FIG. 1 , each navigation view 20 and map view 30 may be switchable between different data types using its corresponding toggle switch 23 and 33 .

[0036] The control view 40 may be generated by the processing unit 50 using data associated with any device. Figure 4A As shown in FIG. 4 , the control view 40 may be configured for use with a treatment device 62 by including an activation switch 42, a performance indicator 44, and a status indicator 46. Figure 4A , for example: one or more treatment devices 62 may include a fluid source (e.g., a fluid pump or pressure bag mounted on a saline bag); an activation switch 42 may activate the fluid source; a performance indicator 44 may continuously monitor fluid pressure and temperature using one or more sensors 61; and a status indicator 46 may confirm the operating mode of the fluid source (e.g., stagnant). The control view 40 may be similarly configured to control Figure 1 For example, view 40 may be configured to control any treatment device 62, any treatment device 62 together with another device, and / or any source element 68 of treatment device 62, such as a source of fluid, medication, vacuum pressure, etc. In certain urological surgical procedures, any device described herein may be considered a treatment device.

[0037] Each treatment device 62 may have its own control settings, and the control view 40 may include a toggle switch 43 for switching between one or more settings of the control settings. Figure 4B , one treatment device 62 can be a laser source, and the control view 40 can be switched to generate laser energy using the laser source such that the activation switch 42 now generates laser energy, the performance indicator 44 now monitors the power level of the laser source, and the status indicator 46 now confirms the operating mode of the laser source (e.g., manual). Figure 4CA dual-use example of a control view 40 is depicted, wherein the control view 40 includes: a first control arrangement 40A having a first activation switch 42A, a first performance indicator 44A, and a first state indicator 46A for a fluid source; and a second control arrangement 40B having a second activation switch 42B, a second performance indicator 44B, and a second state indicator 46B for a laser source. According to these aspects, other multi-use configurations of the view 40 can be utilized to control any number of devices.

[0038] The processing unit 50 can communicate with multiple devices, receive data from one or more devices, generate displays from the data, and control one or more devices using the display 10 and / or input device 80. Figure 1 As shown in , a non-exclusive list of multiple devices may include: one or more display devices 60 (e.g., a touch screen display); one or more sensors 61 (e.g., an ultrasound transducer, a pressure sensor, or a temperature sensor); one or more treatment devices 62 (e.g., a fluid source or a laser source); one or more patient monitors 63 (e.g., a vital signs monitor); one or more operating room monitors 64 (e.g., an operating room camera); one or more data sources 67 (e.g., a remote server for storing and accessing electronic medical records or preoperative images); one or more source elements 68 (e.g., a drug source); and / or one or more imaging devices 69 (e.g., a fluoroscope). Any equivalent one or more devices may also be included in the list and / or in the description. Figure 1 Depicted in.

[0039] Figure 1 An exemplary circuit architecture for processing unit 50 is depicted in FIG. Figure 5 Additional aspects of the architecture are depicted in , which include many of the optional elements described below with respect to methods 200, 300, and / or 400. Figure 1 As shown in , the processing unit 50 may include: a memory 52; one or more processors 53, which are configured to execute computer applications; and a transceiver 55, which is configured to communicate with multiple devices. Portions of the memory 52 and / or the processor 53 may be remote from the processing unit 50, but still maintain constant communication with it via the transceiver 55. For example, a portion of the computer application may be stored locally on the memory 52 and executed locally by the processor 53, such as code for displaying a three-dimensional view on the display device 60; and another one or more portions of the computer program may be stored and remotely executed by the data source 67, such as code for generating a three-dimensional model from image and / or sensor data using a remote application server. The transceiver 55 can be configured to establish and maintain communication between the processing unit 50 and any device using any known wired and / or wireless technology.

[0040] The processing unit 50 can serve as a local communication and control hub for the base system 100, which is configured for use in an operating room behind a sterile field. The processing unit 50 can be a stand-alone device. For example, Figure 1 As shown in , each of the memory 52, one or more processors 53 and the transceiver 55 can be powered by a power source 54 and sealed in an external housing 59. The power source 54 can include a battery, a power cord and / or a local power generation resource. The housing 59 may include a sealed housing and / or one or more sealable ports, thereby allowing the processing unit 50 to be sterilized (e.g., wiped) before use in a sterile field. Alternatively, the housing 59 can be sealable in a sterile housing (e.g., a placeable box or cover) without hindering the performance of the transceiver 55. The housing 59 may also include an attachment portion, such as a clamp engageable with a support structure (e.g., an operating bed); or a clip engageable with the user 1, so that the processing unit 50 is wearable.

[0041] The processing unit 50 may also be part of another device. For example, the processing unit 50 may be integrally formed with: the sensor 61, allowing for more direct reception of sensor data; or the imaging device 69, allowing for more direct reception of image data (e.g., a real-time feed of a fluoroscopic image). For urological surgery, for example, the processing unit 50 may be integrally formed with a life monitoring device, allowing for direct reception of sensor data associated with the patient's vitals (e.g., an EKG signal); or integrally formed with a fluoroscope, allowing for direct reception of image data including a fluoroscopic image of the patient. The processing unit 50 may also be a peripheral accessory to another device. For example, the memory 52 and the processor 53 may be housed in a USB stick, and the transceiver 55 may be configured to establish communication with one or more devices using WiFi and / or USB protocols. The processing unit 50 may similarly be incorporated into any device described herein.

[0042] Many functions of the processing unit 50 described herein can be performed using one or more computer applications. Certain portions of these applications can be stored on the memory 52. ​​The data source 67 can be used to enhance the capabilities of the processing unit 50 and / or the memory 52 by providing and / or executing all or part of the computer application. In some aspects, the data source 67 can be used as an application store that is configured to facilitate the selection of computer applications via the processing unit 50 and to support the continued development of such applications. The various capabilities of each device in communication with the processing unit 50 can guide the selection. For example, the data source 67 can be used to: provide and / or update computer applications that are locally stored on the memory 52 and are configured to identify the capabilities of any device in communication with the processing unit 50; provide specialized applications configured to utilize the combined capabilities of one or more devices in communication with the processing unit 50, including any combination of sensors 61, treatment devices 62, and / or imaging devices 69; perform analytical applications that would otherwise exceed the local capabilities of the processor 53, including the diagnostic and feedback control methods described herein; and access any capabilities provided by third-party computer applications (such as environmental control of the operating room, inventory tracking and management, and operating room monitoring applications).

[0043] One or more treatment devices 62 may include (or be delivered with) a scope 70 configured for non-invasive surgery, such as those provided by Boston Trademark name Any ureteroscope for sale. Fig. 6A As shown in FIG. 1 , for example, scope 70 may include a scope body 72 extending between a proximal end 72P and a distal end 72D, and a scope sheath 74 extending away from end 72D. A working channel 77 may extend from a port 73 on scope body 72, through scope body 72 and scope sheath 74, and out from distal end 74D of sheath 74, thereby allowing one or more treatment devices 62 to be delivered to treatment site 32 (e.g., Figure 3 ). Fluid from one or more source elements 68 may also be delivered to the treatment site 32 via the working channel 77. Fig. 6A As also shown in FIG. 7 , the mirror 70 may also include: one or more mirror actuators 71 configured to manipulate portions of the sheath 74, such as the steerable portion 75; a delivery mechanism 76 configured to move another device (e.g., an elongated tool or laser fiber) relative to the mirror body 72 (e.g., inside or outside the working channel 77). Any sensor 61, treatment device 62, and / or imaging device 69 may be located at the distal end 74D of the sheath 74. For example, Fig. 6A The distal end 74D of the mirror 70 includes an imaging element 78; and a location beacon 79. An exemplary use of the mirror 70 is described further below.

[0044] exist Figure 110 is depicted as being configured to operate the display 10 via the processing unit 50. As shown, the input device 80 may include: a transceiver 82; and a display actuator 84. As with the transceiver 55, the transceiver 82 may be configured to establish and maintain communications between the input device 80 and the processing unit 50 using any known wired or wireless technology. The display actuator 84 may be used to operate the display 10 in response to user-generated signals. Figure 1 As shown in , for example, the display actuator 84 may include a plurality of buttons configured to operate the display 10 in response to a user-generated tactile signal, such as a remote control or a computer mouse. In this example, the display actuator 84 is positioned adjacent to one or more mirror actuators 71, thereby allowing the mirror actuator 71 and the display actuator 84 to be used with one hand.

[0045] The transceiver 82 and / or the display actuator 84 may be mounted on the mirror body 72. Figure 1 In the embodiment of the present invention, for example, the transceiver 82 and the actuator 84 are attached to an input module 88 that is removably mounted to the proximal end 72P of the mirror body 72. In this configuration, the input module 88 can be swapped out and / or used interchangeably with multiple mirrors 70, thereby providing the user 1 with an opportunity to replace, upgrade and / or customize the input device 80.

[0046] As described herein, the basic system 100 can be uniquely configured to achieve operating room benefits by utilizing the capabilities of any of the devices described herein independently and / or in combination. For example, by utilizing the processing unit 50 to obtain and / or access various computer applications (e.g., from the data source 67) for operating these devices, the system 100 can be further configured to utilize and / or enhance the capabilities of each device, and / or create new combinations of these capabilities. As another example, by providing an application store (e.g., the data source 67), the system 100 also promotes the development and support of these computer applications by a larger development community (including doctors seeking medical advances and software developers seeking technological advances). The different benefits of the system 100 can be realized during the preoperative, intraoperative, and postoperative stages of an operation such as a urological operation. Many exemplary benefits are now described with reference to methods 200, 300, and 400.

[0047] An exemplary use of the basic system 100 will now be described with reference to a method 200, which may be a preoperative method. Figure 2AAs shown in , method 200 may include: (210) receiving data associated with a patient at processing unit 50; (220) determining a treatment for the patient using processing unit 50; (230) identifying control settings associated with one or more treatment devices 62 using processing unit 50, wherein the one or more treatment devices 62 (i) communicate with processing unit 50 and (ii) are operable to perform treatment; and (240) generating a display of at least one view including control settings and data using processing unit 50.

[0048] Method 200 may include intermediate steps for receiving data from one or more data sources. As mentioned above, display 10 may be based on any data associated with the patient, including one or more of the following data types: (i) image data; (ii) sensor data; and (iii) geometric data; and processing unit 50 may be configured to receive data from any data source, whether local or remote, in real time or in advance. Thus, receiving step 210 may include receiving data from any data source, including any intermediate steps required to establish communication between processing unit 50 and the data source. For example, step 210 may include: establishing communication with data source 67 and obtaining data therefrom.

[0049] The receiving step 210 may include a data collection step. For example, the receiving step 210 may include: generating image data (e.g., an X-ray image) using one or more imaging devices 69 prior to the procedure; storing the image data on the imaging device 69 and / or the data source 67; and / or obtaining the image data from the imaging device 69 and / or the data source 67. If the image data is to be received in real time, the receiving step 210 may include: establishing communication with the imaging device 69 (e.g., the imaging element 78 of the mirror 70) and receiving the image data therefrom (e.g., as a real-time video feed). The sensor data may similarly be obtained from one or more sensors 61, such that the receiving step 210 includes: establishing communication with the one or more sensors 61 and receiving the sensor data therefrom. For example, the sensor 61 may include one or more of an ultrasound transducer, a pressure sensor, a light sensor, a radiation sensor, or the like, each sensor 61 being configured to output sensor data, wherein the receiving step 210 includes receiving the data.

[0050] The geometric data may be received or generated in the receiving step 210. For example, geometric data including a three-dimensional model of the patient or a portion of the patient may be generated prior to surgery and stored on the data source 67, such that the receiving step 210 includes: receiving the three-dimensional model from the data source 67; and selecting at least one view from the three-dimensional model. The processing unit 50 may include a graphics module 57 (e.g., Figure 5), which is configured to generate a three-dimensional model from data associated with the patient (such as the images or sensor data described above). Thus, receiving step 210 may also include receiving image or sensor data associated with the patient and generating the three-dimensional model based on the data using graphics module 57. For example, the image data may include multiple X-ray images of the patient, each taken at a different position and / or angle, and receiving step 210 may include generating the three-dimensional model by aligning the multiple X-ray images relative to one or more reference points of the patient (such as the location of the kidneys (e.g., Figure 3 )) are stitched together to generate a three-dimensional model. As another example, the sensor data may include output from an ultrasound transducer configured to output a path extending through the patient (e.g., Figure 3 22), and step 210 may include generating a three-dimensional model by combining the localized representations.

[0051] Step 210 may include generating the three-dimensional model using one or more computer applications. For example, receiving step 210 may include: analyzing the image and / or sensor data to identify a computer application configured to generate the three-dimensional model of the patient using the data; obtaining the identified application from the data source 67; and generating the three-dimensional model from the data using the application. Graphics module 57 may, for example, be configured to execute a computer application using the image and / or sensor data stored locally or remotely in memory 52.

[0052] The method 200 can be used to enrich a three-dimensional model. For example, the receiving step 210 can include: identifying the capabilities of one or more sensors 61 and / or imaging devices 69 in communication with the processing unit 50; identifying one or more computer applications configured to generate layers for the three-dimensional model using the identified capabilities; and incorporating the layers into the model. For urological surgery, for example, the step 210 can include: identifying the capabilities of the sensors 61 and imaging devices 69; identifying a stone recognition application configured to map the location and characteristics of each stone at the treatment site 32 using the identified capabilities; generating layers including the mapped locations and characteristics using the stone recognition application; and incorporating the layers into the mapping view 30. Additional examples are described below.

[0053] The determining step 220 may include an intermediate planning step. Figure 3 As shown in , for example, step 220 may include expanding the mapping view 30 to include a selection portion 30A and a planning portion 30B. The selection portion 30A may be based on a three-dimensional model of the patient and may be operable to identify a treatment site 32; and the planning portion 30B may be based on the selection portion 30A and may be operable to identify characteristics and potential treatments of the treatment site 32. Figure 3In the embodiment of the present invention, for example, four exemplary treatment sites 32A, 32B, 32C, and 32D are identified in the selection portion 30A; and the planning portion 30B includes a list 34A, 34B, 34C, or 34D of potential laser energy treatments for each treatment site 32A-32D. Thus, step 220 may further include: identifying the treatment site 32; locating one or more objects (e.g., kidney stones) at the treatment site 32; determining the composition of each located object; and generating a list of potential treatments based on the composition.

[0054] Aspects of the determining step 220 may be responsive to user generated signals, such as a first tactile signal for operating the selection portion 30A using the display device 60, and / or a second tactile signal for operating the planning portion 30B using the input device 80. A computer application may be used to perform any portion of the determining step 220. For example, the stone identification program described above may be used in step 220 to automatically identify and locate stones at each treatment site 32A-32D based on image and / or sensor data. At any point in step 220, additional information 35 (e.g., surgical instructions) may also be automatically and / or manually associated with each treatment site 32A-32D and / or the list 34A-34D of potential treatments.

[0055] Step 220 may include intermediate configuration steps. For example, as with other method steps described herein, determining step 220 may include: identifying capabilities of one or more sensors 61 in communication with processing unit 50; identifying one or more computer applications configured to utilize the identified capabilities; and / or obtaining one or more computer applications. For urological surgery, for example, step 220 may include: identifying capabilities of any sensor 61 configured to detect heat and radiation at treatment site 32; identifying laser therapy applications configured to control the release of laser energy in response to the detected heat and radiation; and obtaining laser therapy applications from data source 67. Similar configuration steps may be performed for any of the devices described herein. Additional configuration steps may also include: updating planning views 34A-34D; obtaining additional input to the above-mentioned computer applications; and / or selecting or enabling selection of potential treatments using one or more display devices 60 and / or input devices 80.

[0056] The identification step 230 may include an intermediate step for receiving control settings for one or more treatment devices 62. The control settings may be received directly from each treatment device 62. For example, step 230 may include receiving control settings directly from each treatment device 62 during a handshake process performed to establish communication with the processing unit 50. In some aspects, the control settings may be obtained from one or more data sources 67. For example, step 230 may also include obtaining a device identifier from each treatment device 62 (e.g., during a handshake process); delivering the device identifier to the data source 67; and receiving the control settings therefrom. The device identifier may also be used to facilitate the development of additional settings. For example, the identifier may be associated with a device specification that can be used by third-party developers to develop new control settings, and the processing unit 50 may be configured to make those developments available for immediate use via the data source 67.

[0057] The control settings may be determined using a computer application. For example, the identification step 230 may include: identifying the capabilities of one or more treatment devices 62 in communication with the processing unit 50; identifying one or more computer applications configured to generate a procedure-specific set of control settings based on the identified capabilities; and / or obtaining one or more computer applications. For urological surgery, for example, the identification step 230 may include: identifying the capabilities of a fluid source configured to deliver fluid to the treatment site 32; identifying a urological-specific fluid management application configured to generate control settings for controlling the fluid source; and / or obtaining the fluid management application from the data source 67. New and / or combined capabilities may be implemented in this manner. For example, step 230 may include using the computer application to generate control settings for operating the first treatment device 62 and the second treatment device 62 to perform a specific treatment. Consistent with the previous urological example, step 230 may further include: identifying the capabilities of a laser source configured to release laser energy to the treatment site 32; and identifying a treatment application configured to generate control settings for controlling the laser source and the fluid source to perform the treatment; obtaining the treatment application from the data source 67.

[0058] Generating step 240 may include intermediate steps for generating a display. In some aspects, step 240 may include identifying a location 24 of treatment device 62 in at least one view of display 10 (e.g., Figure 4A ); and tracking the movement of the identified location 24 in the at least one view. The location beacon 79 of the mirror 70 can be used to identify the location 24. For example, Figure 5240, the processing unit 50 may include a tracking module 58 configured to identify and track the location beacon 79, such that step 240 includes establishing communication between the tracking module 58 and the location beacon 79 and identifying the location 24 therewith. In step 240, the location 24 may also be established using one or more sensors 61 and / or one or more imaging devices 69 with or without the location beacon 79. For example, a portion of the sheath 74 of the scope 70 may include a radiopaque material that may be tracked using a fluoroscope. Additional steps for configuring the display 10 for use with the display device 60 may also be performed.

[0059] Reference now Figure 2B Method 300 of the present invention describes another use of system 100, which may be an intraoperative method. As shown, method 300 may include: (310) generating, with processing unit 50, a display including control settings for treatment device 62 (e.g., control view 40) and at least one view of data associated with a patient (e.g., navigation view 20 or mapping view 30); (320) overlaying, with processing unit 50, a depiction of (i) treatment site 32, (ii) path 22 leading to treatment site 32, and (iii) position 24 of treatment device 62 on path 22; (330) moving treatment device 62 along path 22 in response to the display, and continuously updating display 10 in response to the movement until position 24 reaches treatment site 32; (340) obtaining, with processing unit 50, input responsive to the control settings; and (350) operating treatment device 62, with processing unit 50, based on the input and the control settings.

[0060] Generating step 310 may include intermediate steps for configuring display 10, including any of the steps described above with respect to generating step 240 of method 200. For example, generating step 310 may include identifying location 24, establishing communications between tracking module 58 and location beacon 79, and / or configuring display 10 for use with one or more display devices 60.

[0061] The display may be enhanced using the overlay step 320. For example, Figure 4A The navigation view 20 of may include a background layer generated from a fluoroscopic image of the patient. In this example, the overlay step 320 may include: generating a foreground layer including a graphical depiction of the treatment site 32, the path 22, and the location 24; and overlaying the foreground layer onto the background layer. Figure 4BAnother example is provided by a mapping view 30 of , which includes a background layer generated from a view of a three-dimensional model, and a foreground layer including a graphical depiction of the path 22 and treatment sites 32A-32D. The location of the path 22 and treatment sites 32A-32D can be determined in step 320. For example, the location of the path 22 and treatment sites 32 can be determined using step 220 of the method 200 described above; and / or the processing unit 50 can obtain a computer application for this purpose. As mentioned above, the positioning beacon 79, the sensor 61 and / or the imaging device 69 can be used to establish and track the location 24.

[0062] Overlay step 320 may also include an intermediate step for selecting or "marking" portions of display 10. Figure 4B An example is provided in , where the background layer is generated by a video feed output by the imaging element 78 of the scope 70, and the foreground layer includes a wireframe depiction of the inner surface of the path 22. In this example, step 320 may include: overlaying the wireframe grid 25 on the inner surface of the path 22 to define a plurality of surface regions 26; selecting one or more surface regions 26; and identifying the selected regions in the navigation view 20 and / or the mapping view 30. One or more surface regions 26 may be automatically marked in step 320 using one or more sensors 61. For example, step 320 may further include: scanning each surface region 26; and marking each surface region 26 that meets predetermined scanning criteria. For urological surgery, for example, overlay step 230 may include: scanning each surface region 26 using the sensor 61 to distinguish between a stone and tissue surrounding the stone; and marking each surface region 26 having a stone density greater than a predetermined maximum value. Similar to above, processing unit 50 may be further configured to obtain one or more computer applications operable to perform aspects of step 320, such as scanning each surface area 26 using sensor 61, imaging device 69, or the like.

[0063] The moving step 330 may include an intermediate step for guiding the movement of the treatment device 62 using the display 10. For example, Figure 4B 3, step 330 may include defining a path 22 toward one of the treatment sites 32A-32D; and moving the treatment device 62 along the path 22 by tracking the movement of the location 24. Continuous communication between the processing unit 50 and the positioning beacon 79, one or more sensors 61, or other tracking devices may be required to simultaneously move the treatment device 62 and update the display 10 in response to the movement. Therefore, step 330 may further include intermediate steps for establishing such communication.

[0064] The moving step 330 may also include intermediate steps for operating the mirror 70 and / or the delivery mechanism 76. For example, Fig. 6A, the mirror 70 includes a mirror actuator 71 configured to manipulate a steerable portion 75 of a sheath 74; and a delivery mechanism 76 configured to move a therapeutic device relative to the mirror 70, such as a laser fiber. The actuator 71 and / or the delivery mechanism 76 may include an electrical actuator, such that method step 330 includes: receiving a movement signal from the display 10 and / or the input device 80; and moving the therapeutic device 62 along the path 22 toward the area 32 by operating the electrical actuator according to the movement signal. Similar to the above, one or more computer applications may be used to generate the motion signal, such that step 330 further includes any of the following intermediate steps: for identifying the movement capability of the actuator 71 and / or the delivery mechanism 76; and identifying one or more computer applications configured to move the therapeutic device 62 using the capability. For example, for urological surgery, a computer application may be configured to: convert geometric data associated with path 22 into motion signals; and automatically move treatment device 62 through path 22 by operating actuator 71 and / or delivery mechanism 76 based on the motion signals.

[0065] Obtaining step 340 may be used to obtain any input required to operate treatment device 62 (or other devices described herein). For example, obtaining step 340 may include: receiving input from user 1 including at least one of an audio signal, a tactile signal, and a visual signal; converting the input to a control signal; and outputting the control signal. Each signal may be user-generated and / or specific to a treatment type, power level, time, or similar quantity. In some aspects, display 10 and / or input device 80 may be configured to receive input. For example, control view 40 may be output to display device 60, and the configuration of display actuator 84 may correspond to the configuration of control view 40, so that display 10 or input device 80 may be used to receive similar tactile signals. One or more sensors 61 may also be configured to receive input. For example, sensor 61 may include a motion sensor configured to receive a visual signal by tracking the movement of display actuator 84 and / or a portion of user 1.

[0066] Obtaining step 340 may include intermediate steps for modifying the control signal. For example, obtaining step 340 may include: identifying an object at treatment site 32; determining a characteristic of the identified object using one or more sensors 61; and modifying the control signal based on the determined characteristic. Any characteristic may be determined and utilized within step 340, and any number of computer applications may be used to make these determinations. Figure 4CAn example is depicted in , which includes a background layer generated by the imaging element 78 to include a close-up view of stones at the treatment site 32A, and a foreground layer generated by the sensor 61 to include a measure of stone burden 35 (e.g., shown as an outline of each stone at the treatment site 32A); a measurement of stone size 36 (e.g., shown as a measurement relative to the center of each stone); and / or an indication of stone type (e.g., shown as an indicator at or near each stone). In this example, the sensor 61 may include an ultrasound transducer located inside or outside the body, and the measure of stone burden 35, stone size 36, and / or stone type may be generated by the processing unit 50 and a stone identification application configured for use with the transducer, and thus, step 340 may include modifying the control signal based on the measure of stone burden 35, size 36, and / or type. Other applications may be used to modify the signal based on other characteristics.

[0067] The treatment energy may be applied using operation 350. At this point in method 300, all control settings may have been determined such that step 350 includes: activating treatment device 62 using activation switch 42 of control view 40 and / or display actuator 84 of input device 80; and releasing treatment energy to the target object at treatment site 32. Similar to the above, operation 350 may include intermediate modification steps. For example, in step 350, Figure 4B The control view 40 of the apparatus 62 can be used to manually adjust the treatment energy through the operation of adjustment buttons 45A and 45B, both of which are configured to tune a particular aspect of the treatment energy. For urological surgery, for example, the treatment device 62 can be configured to deliver laser energy, and the adjustment button 45A can be used to control the power level of the laser energy, and the adjustment button 45B can be used to control the frequency, pulse rate, or other characteristics of the laser energy.

[0068] Method 300 may be used to establish a control loop for one or more treatment devices 62, such as a feedback control loop that modifies the output of treatment device 62 in response to a feedback signal generated by sensor 61. For example, operation 350 may include: determining a characteristic of a target object using one or more sensors 61; and modifying the treatment energy based on the determined characteristic. For urological surgery, for example, treatment device 62 may be configured to release laser energy to a stone located at treatment site 32, and operation 350 may include: receiving a reflected portion of the laser energy from the stone and / or treatment site 32; analyzing the reflected portion using one or more sensors 61; and modifying the laser energy in response to the output from sensor 61. In this example, if / when the output from sensor 61 indicates that the stone has been destroyed, the feedback control loop may prevent unnecessary tissue damage by stopping or gradually reducing the release of laser energy. Similar control loops may be established for any of the devices described herein. Continuing with the previous urology example, source element 68 may include a source of fluid or medication, and step 350 may include: analyzing a characteristic of treatment site 32, such as internal pressure or radiation level, using one of sensors 61; and modifying the amount of fluid or medication flow in response to the output from sensor 61. One or more computer applications may be used to establish a feedback control loop, so that operation step 350 may include any intermediate steps for identifying, obtaining, and utilizing the application.

[0069] Another exemplary use of the system 100 is now described with reference to method 400, which may be a post-operative method. Figure 2C As shown in , for example, method 400 may include: (410) recording data associated with the treatment performed; (420) generating one or more reports based on the recorded data; (430) outputting the one or more reports to a data source 67.

[0070] The recording step 410 may include, for example, an intermediate step for recording any data generated during the execution of the methods 200 and 300. The recorded data may take any form. For example, the recording step 410 may include generating a video stream of the display 10 during the operation, thereby recording each selection, input or output relative thereto. Because the display 10 includes at least one view of data associated with the patient (e.g., a navigation view 20 and / or a mapping view 30) and a view of associated control settings (e.g., a control view 40), the video stream may be used to archive any number of decisions made by the user 1 and / or the system 100. The recorded data may also include any data generated by one or more patient monitors 63 (e.g., a vital signs monitor) and / or one or more operating room monitors 64 (e.g., an observation camera). For example, in step 410, an operating room monitor 64 may be configured to record the amount of materials used during the operation by tracking the use and / or weight of each device in the operating room.

[0071] The reporting step 420 may be used to perform various archival functions on the recorded data. For example, the reporting step 420 may include: analyzing the recorded data; and generating one or more reports therefrom. In one aspect, one or more reports may be utilized to improve operating room efficiency by, for example, automatically summarizing treatments, treatment times, outcomes, and similar performance metrics, any of which may be used to achieve operating room benefits. These reports may also be used for inventory management purposes. For example, the reporting step 420 may include: generating a report based on the amount of materials used during surgery; and delivering the report to a third party to automatically replenish the materials. As mentioned above, the amount of materials may be determined from user input or using one or more operating room monitors 64.

[0072] The sending step 430 may be used to archive the recorded data and / or one or more reports for future use. For example, step 430 may include sending the recorded data and / or one or more reports to the memory 52 and / or the data source 67 along with a patient identifier, such as a reference number associated with the patient's electronic medical record, such as a social security number. Certain portions of the recorded data and / or one or more reports may also be output to the data source 67 without the patient identifier for various statistical reports.

[0073] Reference now Figure 6B The input device 180 and Figure 7 The input device 280 describes additional aspects of the system 100, both of which are configured to operate the display 10 via the processing unit 50. Figure 6BAs shown in FIG. 1 , the input device 180 may include a transceiver 182; a first display actuator 184; and a second display actuator 188. The transceiver 182 may be configured to establish and maintain communication between the input device 180 and the processing unit 50 using any known wired or wireless technology. The first display actuator 184 and the second display actuator 188 are configured to operate the display 10 in response to input from the user 1. Figure 6B As shown in FIG. 1 , like the display actuator 84, the first actuator 184 may include a plurality of buttons mounted on the mirror body 72, thereby allowing general control of the display 10; while the second display actuator 188 may include a touch-sensitive screen, thereby allowing specialized control of the display 10. For example, in Figure 6B , various devices for activating treatment energy (e.g., laser energy) may be depicted using the control view 40, while various devices for modifying the treatment energy may be depicted using the second display actuator 188. In another example, the control view 40 may be switchable between control settings for various treatment devices 62, while the second display actuator 188 remains dedicated to the control settings of one device.

[0074] Various aspects of the input device 280 may be configured for hands-free operation of the display 10 within a sterile field. Figure 7 As shown in FIG. 6 , for example, input device 280 may include a portion of sensor 61, such as one or more of audio sensor 284, gesture sensor 286, and / or visual sensor 288. Figure 7 , one audio sensor 284 is a microphone mounted on the mask 3 and configured to receive voice commands, such as an activation command corresponding to the activation switch 42. As shown, the gesture sensor 286 includes a motion sensor associated with the fingers of the hand 2, which is configured to receive visual signals by tracking the movement of the fingers (such as a pinching motion for zooming into the navigation view 20). The gesture sensor 286 may also include any type of camera or motion sensor configured to receive hand signals by visually observing the hand 2. In one aspect, the sensor 286 includes a camera mounted on the mask 3, the glasses 4, or another part of the user 1 and aimed at the hand 2. For example, the hand 2 may include a glove with a motion tracking pattern, and the sensor 286 may be configured to output a motion signal by recognizing the pattern and tracking the relative movement of the hand 2 therewith.

[0075] The visual sensor 288 may include any type of camera or motion sensor, any of which may operate with any type of display device 60. Figure 7 As shown in FIG. 4 , for example, the display device 60 may include a projector mounted on the glasses 4 and configured to output a display to the field of view of at least one eye of the user 1. Figure 7In the embodiment of the present invention, the projector may output the display to the inner surface 4S of the glasses 4; or directly output the display to at least one eye, such as directly to the retina. The visual sensor 288 may include an eye movement sensor configured to generate a visual signal by tracking the movement of the eye. For example, the visual selection signal may be determined by focusing the eye on a portion of the display for a predetermined period of time. Figure 7 The depiction of the glasses 4 in is exemplary, and any type of head support can be used to ensure that the display remains in view. A ceiling or wall bracket can also be used, as can any mounting structure that can be engaged with the mirror 70.

[0076] Many benefits can be achieved using various aspects of the operating room devices, methods, and systems described herein. For example, various aspects of the system 100 can be configured to improve operating room efficiency, reduce the burden on operating room assistants and administrators, and improve patient safety without sacrificing desired results. According to the present disclosure, some benefits can be achieved by utilizing the system 100 as a hub that is configured to communicate with multiple devices local or remote to the operating room and generate displays as a means for controlling at least some of these devices from a location within the operating room (such as behind the sterile field). Other benefits can be achieved by expanding the following capabilities of the system 100: addressing the unique capabilities of each device (such as a sensor 61, a treatment device 62, and / or an imaging device 69) that communicates with it; generating or modifying a three-dimensional model of the patient using the data; analyzing portions of the data; and / or performing similar functions, any of which can be further expanded by using one or more computer applications.

[0077] Although the principles of the present disclosure are described herein with reference to the illustrative aspects for specific applications, the present disclosure is not limited thereto. Those of ordinary skill in the art and those who have access to the teachings provided herein will recognize that additional modifications, applications, aspects, and replacements of equivalents fall within the scope of the aspects described herein. Therefore, the present disclosure should not be considered to be limited by the foregoing description.

Claims

1. A method comprising: receiving data associated with a patient at a processing unit; determining, using the processing unit, a treatment for the patient; identifying, with the processing unit, control settings associated with one or more treatment devices in communication with the processing unit and operable to perform the treatment, wherein identifying the control settings comprises: receiving, at the processing unit, a device identifier from the one or more therapeutic devices; delivering, with the processing unit, the device identifier to a data source; and receiving, at the processing unit, control settings from the data source; generating, with the processing unit, a display comprising at least one view of the control settings and the data; In response to receiving an input associated with a control setting of at least one of the one or more therapeutic devices included on the display, causing, with a processing unit, the at least one therapeutic device to operate in accordance with the input, wherein causing the at least one therapeutic device to operate in accordance with the input comprises: converting the input into a control signal; and outputting the control signal to the at least one therapeutic device, Wherein, causing the at least one therapeutic device to operate according to the input further comprises: determining, using at least one sensor in communication with the processing unit, characteristics of an object identified at the treatment area; and modifying the control signal based on the determined characteristic; and Accessing or making available for use, by the processing unit, new control settings via a data source, wherein the new control settings are accessed or made available based on an association of the device identifier with a device specification configured for use in developing the new control settings.

2. The method according to claim 1, wherein: The data includes a three-dimensional model of a portion of the patient, and receiving the data associated with the patient includes: receiving, at the processing unit, a three-dimensional model from a data source; and The at least one view is selected from the three-dimensional model using the processing unit.

3. The method according to claim 1 or 2, wherein: The data includes an image of the patient, and receiving data associated with the patient includes: receiving, at the processing unit, an image from a data source; and A three-dimensional model of the patient is generated from the images using the processing unit.

4. The method according to claim 1 or 2, wherein: The determining step according to claim 1 further comprises: identifying, using the processing unit, a potential treatment for the patient; determining, using the processing unit, whether the one or more treatment devices are operable to perform any of the potential treatments; and The display is generated, using the processing unit, to include a list of potential treatments that can be performed by the one or more treatment devices.

5. The method according to claim 1 or 2, wherein: The one or more treatment devices include a first treatment device in communication with the processing unit and a second treatment device in communication with the processing unit, and the identifying step according to claim 1 further includes: receiving, at a processing unit, first control settings for the first treatment device and second control settings for the second treatment device; and One or more computer applications for operating the first treatment device and the second treatment device in a coordinated manner to perform treatment are identified using the processing unit.

6. The method according to claim 5, wherein: Identifying the one or more computer applications comprises: delivering, with the processing unit, the first control setting and the second control setting to a data source; and The one or more computer applications are received from the data source.

7. The method according to claim 1 or 2, wherein: The displayed at least one view includes a first view different from a second view, and the method further includes: placing a distal end of the one or more therapeutic devices within the patient; and The distal end is located in the first view and the second view using the processing unit.

8. The method according to claim 7, wherein: The data comprises an image of an internal surface of the patient, the first view comprises the internal surface, and the method comprises: overlaying a mesh onto the interior surface depicted in the first view using the processing unit; marking, with the processing unit, one or more regions defined by the grid; and One or more regions are located in the second view using the processing unit.

9. The method according to claim 1 or 2, further comprising: receiving, with the processing unit, input from an input device in communication with the processing unit; and operating the one or more therapeutic devices using the processing unit based on the input and the control settings, The input is a user-generated signal, including at least one of an audio signal, a tactile signal, and a visual signal.

10. The method according to claim 9, further comprising: identifying the object within the patient using the processing unit; and The object is positioned in the at least one view using the processing unit.

11. The method according to claim 10, wherein: The at least one sensor generates and sends a transmission feedback signal to the processing unit, the feedback signal comprising the determined characteristic for modifying the control signal.

12. The method of claim 11, wherein modifying a control signal based on the determined characteristic causes a corresponding modification to an output of the at least one therapeutic device.

13. The method according to claim 1 or 2, further comprising: generating, with the processing unit, one or more reports including the control settings and the inputs; and The one or more reports are outputted using the processing unit.

14. The method of claim 1 or 2, wherein the identifying step further comprises receiving, at the processing unit, a device identifier from one or more therapeutic devices during a handshake process performed to establish communication between the processing unit and the one or more therapeutic devices.

Images