Endoscopic imaging system and method

Abstract

Disclosed herein is an endoscopic imaging system including an endoscope configured to capture one or more images, the endoscope in communication with a laser system and a display, and a console in communication with the endoscope, the laser system, and the display, the console configured to receive one or more parameter settings from the laser system, receive one or more captured images from the endoscope, generate one or more icons corresponding to the parameter settings, and overlay the icons on the captured images depicted on the display.

Description

[Background technology]

[0001] During a medical procedure using a laser system and an endoscope, it can be difficult for a physician to see the settings of the laser system while looking at the endoscope monitor. Often, the physician must turn his or her head to the side to see the laser system to check the settings, then turn his or her head back toward the endoscope monitor. It would be beneficial for the physician to be able to check the laser settings with an orientation on the endoscope monitor. Disclosed herein are systems and methods of use that address the above. Summary of the Invention

[0002] Disclosed herein is an endoscopic imaging system comprising an endoscope configured to capture one or more images, the endoscope in communication with a laser system and a display, and a console in communication with the endoscope, the laser system, and the display, the console configured to receive one or more parameter settings from the laser system, receive one or more captured images from the endoscope, generate one or more icons corresponding to the parameter settings, and overlay the icons on the captured image depicted on the display.

[0003] In some embodiments, the console is coupled to the endoscope via a wired connection. In some embodiments, one or more of the laser system, the endoscope, or the display are coupled to a console via a wireless connection.

[0004] In some embodiments, the console includes one or more processors, an energy source, a non-transitory computer readable medium, and a number of logic modules. In some embodiments, the logic modules are configured to do one or more of the following: receive one or more parameter settings from the laser system; receive one or more captured images from the endoscope; select one or more parameter settings for rendering on the display; generate one or more icons corresponding to the one or more parameter settings; overlay the one or more icons on the one or more captured images; and display the one or more icons overlaid on the one or more captured images on the display.

[0005] In some embodiments, the parameter settings include one or more of pulse energy, pulse frequency, pulse duration, total power, and pulse width. In some embodiments, the console is included within an image overlay unit.

[0006] In some embodiments, the image overlay unit includes a control panel having a plurality of selection buttons and a directional button, each selection button corresponding to a parameter setting, and the directional button configured to move the one or more icons around a screen of the display.

[0007] In some embodiments, the image overlay unit is wired to each of the endoscope, the laser system, and the display. In some embodiments, the image overlay unit includes a laser system input, an endoscope input, and a display output.

[0008] Also disclosed herein is a method of rendering parameter settings of a laser system on a display of an endoscope, the method including configuring one or more parameter settings of the laser system, capturing one or more images using the endoscope, and generating one or more icons using a console, the console in communication with the laser system, the endoscope, and the display, the method further including overlaying the one or more icons on a captured image, and rendering the icons on the display along with the captured image.

[0009] In some embodiments, one or more of the laser system, the endoscope, or the display are coupled to a console via a wired connection. In some embodiments, one or more of the laser system, the endoscope, or the display are coupled to a console via a wireless connection.

[0010] In some embodiments, the console is included within an image overlay unit. In some embodiments, the parameter settings include one or more of pulse energy, pulse frequency, pulse duration, total power, and pulse width.

[0011] In some embodiments, generating one or more icons includes a user selecting one or more parameter settings to be rendered on the display. In some embodiments, the one or more icons correspond to the one or more parameter settings.

[0012] In some embodiments, the one or more icons include icons for all of the parameter settings received by the console. In some embodiments, the one or more icons include an icon for the parameter setting selected by the user to be rendered on the display.

[0013] In some embodiments, overlaying the one or more icons on the captured image includes (i) receiving by the console the one or more parameter settings from the laser system; and (ii) receiving by the console the one or more captured images from the endoscope.

[0014] In some embodiments, rendering the icon and the captured image on the display includes the user determining the icon to be rendered on the display.

[0015] In some embodiments, the user uses a control panel of an image overlay unit to select the one or more parameter settings to be rendered on the display. These and other features of the concepts provided herein will become more apparent to those of ordinary skill in the art in view of the accompanying drawings and following description, which describe in more detail certain embodiments of such concepts.

[0016] A more particular description of the present disclosure will be made by reference to specific embodiments that are illustrated in the accompanying drawings. It should be understood that these drawings depict only typical embodiments of the invention and should not be considered as limiting its scope. Exemplary embodiments of the invention will be described and explained with additional specificity and detail through the use of the accompanying drawings. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 shows a perspective view of an endoscopic imaging system according to some embodiments. [Diagram 2] 1 shows a block diagram of some components of an endoscopic imaging system according to some embodiments. [Figure 3A] 1 shows a perspective view of an endoscopic imaging system including an image overlay unit, according to some embodiments. [Figure 3B]FIG. 2 shows a block diagram of an image overlay unit according to some embodiments. [Figure 4] 13 illustrates a rendering of an image captured by an endoscope showing icons of parameter settings of a laser system on a display, according to some embodiments. [Diagram 5] 1 illustrates a flowchart of an exemplary method for displaying parameter settings of a laser system on an endoscope display, according to some embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Before some specific embodiments are disclosed in more detail, it should be understood that the specific embodiments disclosed herein do not limit the scope of the concepts provided herein. It should also be understood that the specific embodiments disclosed herein can have features that can be easily separated from the specific embodiment and, optionally, combined with or substituted for features of any of the other numerous embodiments disclosed herein.

[0019] With regard to the terms used herein, it should also be understood that the terms are intended to describe some particular embodiments, and that the terms do not limit the scope of the concepts provided herein. Ordinal numbers (e.g., first, second, third, etc.) are generally used to distinguish or identify different features or steps within a group of features or steps, and do not provide sequential or numerical limitations. For example, the "first", "second", and "third" features or steps do not necessarily have to appear in that order, and a particular embodiment including such features or steps is not necessarily limited to three features or steps. Labels such as "left", "right", "upper", "lower", "front", "rear", etc. are used for convenience and do not imply, for example, a particular fixed position, orientation, or direction. Instead, such designations are used to reflect, for example, a relative position, orientation, or direction. The singular forms "one", "one", and "said" also include plural references unless the context clearly dictates otherwise.

[0020] The term "logic" may refer to hardware, firmware, or software configured to perform one or more functions. As hardware, the term logic may refer to or include circuitry having data processing and / or storage capabilities. Examples of such circuitry include, but are not limited to, hardware processors (e.g., microprocessors, one or more processor cores, digital signal processors, programmable gate arrays, microcontrollers, application specific integrated circuits "ASICs," etc.), semiconductor memory, or combinational elements.

[0021] Additionally or alternatively, the term logic may refer to or include software such as one or more processes, one or more instances, application programming interfaces (APIs), subroutines, functions, applets, servlets, routines, source code, object code, shared libraries / dynamic link libraries (DLLs), or one or more instructions. This software may be stored on any type of suitable non-transitory or transitory storage medium (e.g., electrical, optical, acoustic, or other forms of propagated signals, such as carrier waves, infrared signals, or digital signals). Examples of non-transitory storage media include, but are not limited to, non-transitory storage such as programmable circuits, volatile memory (e.g., any type of random access memory "RAM"), or transitory storage such as non-volatile memory (e.g., read only memory "ROM", power backed RAM, flash memory, phase change memory, etc.), solid state drives, hard disk drives, optical disk drives, or portable memory devices. As firmware, logic may be stored in persistent storage.

[0022] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. 1 shows a perspective view of an endoscopic imaging system 100 according to some embodiments. In some embodiments, the image overlay system 100 includes a laser system 110, an endoscope 120, and a display 150. The endoscope 120 may be in communication with each of the laser system 110 and the display 150. In some embodiments, the endoscope 120 may be wired to the laser system 110 and the display 150 or may be in wireless communication with at least one of the laser system 110 and the display 150. In use, the endoscope 120 may be configured to capture one or more images from a patient while the laser system 110 is also being used on the patient. In some embodiments, the captured images may include live images. In some embodiments, the endoscope 120 includes a console 122 in communication with each of the laser system 110, the endoscope 120, and the display 150, the console 122 configured to receive one or more parameter settings from the laser system 110, superimpose one or more icons depicting the one or more parameter settings on a captured image from the endoscope 120, and depict the captured endoscopic image and the icon for the parameter settings on the display 150. Advantageously, the laser system 110 may be positioned anywhere in the operating room while allowing a clinician to monitor the progress of the endoscope 120 and verify the one or more parameter settings of the laser system 110 on the display 150. In some embodiments, the endoscope 120 may include a ureteroscope.

[0023] FIG. 2 illustrates a block diagram of some components of an endoscopic imaging system 100 according to some embodiments. In some embodiments, the endoscope 120 may include a console 122 having one or more processors 124, an energy source 126, a non-transitory computer-readable medium ("memory") 128, and a number of logic modules. In some embodiments, the console 122 is wired to or in wireless communication with the laser system 110, the endoscope 120, and the display 150. Exemplary wireless communication methods may include WiFi, Bluetooth, Near Field Communication (NFC), Global System for Cellular Mobile Communications (GSM), electromagnetic (EM), radio frequency (RF), combinations thereof, and the like. In some embodiments, the console 122 may be coupled to the endoscope 120, integrated into the endoscope 120, or may be a stand-alone unit, as described further below. In some embodiments, the energy source 126 may include a battery, or a power source, including a power source for the endoscope 120.

[0024] In some embodiments, the plurality of logic modules may include laser system parameter setting receiving logic 130, endoscopic image receiving logic 132, laser system parameter setting overlay logic 134, laser system parameter setting selection logic 136, and display transmission logic 138. In some embodiments, the laser system parameter setting receiving logic 130 may be configured to receive one or more parameter settings from the laser system 110. In some embodiments, the one or more parameters may include one or more of pulse energy (Joules), pulse frequency (Hertz), pulse duration (microseconds), total power (Watts), and pulse width. In some embodiments, the endoscopic image receiving logic 132 may be configured to receive one or more captured images from the endoscope 120. In some embodiments, the captured images may include live images. In some embodiments, the laser system parameter setting overlay logic 134 may be configured to generate one or more icons depicting the one or more parameter settings received from the laser system 110 and overlay them on the captured endoscopic image. In some embodiments, the icon may include a shape, text, numbers, or combinations thereof, including the name of the parameter setting, the numerical value of the parameter setting, and the unit of measure of the parameter setting. In some embodiments, the laser system parameter setting selection logic 136 may be configured to allow a user to select / determine which of one or more parameter settings received from the laser system 110 are to be superimposed on the endoscopic image. In some embodiments, all of the parameter settings received from the laser system 110 may be depicted on the display 150. In some embodiments, the laser system parameter setting superimposition logic 134 may be configured to generate icons for all of the parameter settings received from the laser system 110 and to superimpose only the parameter settings determined / selected by the user.In some embodiments, the laser system parameter setting overlay logic 134 may be configured to generate icons for only those parameter settings determined by the user through the laser system parameter setting selection logic 136. In some embodiments, the display transmission logic 138 may be configured to transmit the captured image onto the display 150 with overlaid icons depicting one or more parameter settings.

[0025] FIG. 3A shows a perspective view of an endoscopic imaging system 100 including an image overlay unit 160, according to some embodiments. In some embodiments, the console 122 may be included in a stand-alone image overlay unit 160 that may communicate with each of the laser system 110, the endoscope 120, and the display 150, and the image overlay unit 160 may be configured to receive parameter settings from the laser system 110 and one or more images captured from the endoscope 120. Advantageously, the stand-alone image overlay unit 160 may be configured to receive captured image inputs from an endoscope from any manufacturer that includes a standard video output on the endoscope. Furthermore, the image overlay unit 160 may be located anywhere in the procedure room, including near the display 150, allowing the user to focus on the procedure. The image overlay unit 160 may be configured to overlay one or more icons of one or more parameter settings from the laser system 110 onto a captured image depicted on the display 150, as described above. In some embodiments, the image overlay unit 160 may include a control panel 162 disposed on a front surface of the image overlay unit 160. The control panel 162 may be configured to allow a user to control which parameter settings of the laser system 150 are depicted on the display 150. In some embodiments, the control panel 162 may be configured to have one or more selection buttons 164, each selection button corresponding to a parameter setting of the laser system 110 that may be depicted on the display 150. In one embodiment, the selection buttons 164 may be organized or grouped into two sections: a left pedal section 166 corresponding to a left pedal on the laser system control pedal module (not shown), and a right pedal section 168 corresponding to a right pedal on the laser system control pedal module. A user may select the parameter setting that is depicted on the display 150 by selecting the button 164 corresponding to the parameter setting that the user desires.In this embodiment, image overlay unit 160 may include directional buttons 170 configured to move one or more of the depicted icons around the periphery of display screen 150. In some embodiments, laser system 110, endoscope 120, and display 150 may be coupled to a rear side of image overlay unit 160.

[0026] 3B shows a rear view of the image overlay unit 160, according to some embodiments. The rear of the image overlay unit 160 may include a laser system input 174, an endoscope input 172, and a display output 176. In some embodiments, the laser system input 174 may include any number of standard inputs (e.g., Ethernet, component video, composite audio / video, VGA, FireWire, serial port, DVI, HDMI, parallel port, USB Type-C, USB port, optical audio Toslink, etc.). In some embodiments, the endoscope input 172 may include a standard video input (e.g., HDMI, mini HDMI, micro HDMI, VGA, mini VGA, DVI-D, DVI-I, mini DVI, micro DVI, DisplayPort, mini DisplayPort, USB Type-C, Thunderbolt, etc.) received from the endoscope 120. In some embodiments, the display output 176 may include a standard video output (e.g., HDMI, mini HDMI, micro HDMI, VGA, mini VGA, DVI-D, DVI-I, mini DVI, micro DVI, DisplayPort, mini DisplayPort, USB Type-C, Thunderbolt, etc.).

[0027] FIG. 4 illustrates the rendering of a captured image by the endoscope 120 displaying icons of parameter settings of the laser system 110 on the display 150, according to some embodiments. In some embodiments, the one or more icons 180 may be rendered near a corner or edge of the display 150 so as not to obstruct the captured image. In some embodiments in which the laser system 110 includes two pedals, the one or more icons 180 may be differentiated by location on the display 150. For example, as shown in FIG. 4, an icon 180A corresponding to a parameter setting for the left pedal of the laser system 110 is located at the top left of the display 150, and an icon 180B corresponding to a parameter setting for the top right pedal of the laser system 110 is located at the right side of the display 150. In some embodiments, the directional buttons 170 may be configured to move the one or more icons 180 to various locations on the display screen at the discretion of the user.

[0028] FIG. 5 illustrates a flowchart of an exemplary method 200 of displaying parameter settings of the laser system 110 on the display 150 of the endoscope 120, according to some embodiments. The method 200 includes configuring one or more parameter settings of the laser system 110 (block 202). In some embodiments, the one or more parameter settings include one or more of pulse energy, pulse frequency, pulse duration, total power, and pulse width. The method 200 further includes capturing one or more images using the endoscope 120 (block 204). The method 200 further includes generating one or more icons 180 (block 206). In some embodiments, generating the one or more icons 180 includes the console 122 generating the one or more icons 180. In some embodiments, the console 122 is included within the image overlay unit 160. In some embodiments, the icon 180 may include a shape and / or text corresponding to the one or more parameter settings of the laser system 110. In some embodiments, generating the one or more icons 180 includes a user selecting one or more parameter settings to be rendered on the display 150. In some embodiments, generating the one or more icons 180 includes the console 122 generating one or more icons 180 for all parameter settings received by the console 122, or the console 122 generating one or more icons 180 for only the parameter settings selected by the user to be rendered on the display 150.

[0029] Method 200 further includes overlaying one or more icons 180 on the captured image (block 208). In some embodiments, overlaying one or more icons 180 on the captured image includes console 112 (i) receiving one or more parameter settings from laser system 110 and (ii) receiving one or more captured images from endoscope 120. In some embodiments, overlaying includes overlaying one or more icons 180 on a live captured image. Method 200 further includes rendering the overlayed icons 180 and the captured image on display 150 (block 210). In some embodiments, rendering the icons 180 and the captured image on display 150 includes a user determining the icons 180 to be rendered on display 150. In some embodiments, determining the icons 180 to be rendered on display 150 includes a user using a control panel 162 of image overlay unit 160 to select one or more parameter settings to be shown on display 150. In some embodiments, drawing the icon 180 and the captured image superimposed on the display 150 includes drawing the icon 180 towards a side or corner of the display 150 .

[0030] Although some specific embodiments have been disclosed herein, and those specific embodiments have been disclosed in some detail, those specific embodiments are not intended to limit the scope of the concepts provided herein. Further adaptations and / or modifications may become apparent to those skilled in the art, and are likewise encompassed in the broader aspects. Thus, departures from the specific embodiments disclosed herein may be made without departing from the scope of the concepts provided herein.

Claims

1. 1. An endoscopic imaging system, comprising: an endoscope configured to capture one or more images, the endoscope in communication with a laser system and a display; a console in communication with the endoscope, the laser system, and the display, receiving one or more parameter settings from the laser system; receiving one or more captured images from the endoscope; generating one or more icons corresponding to said parameter settings; a console configured to overlay the icon onto the captured image rendered on the display; An endoscopic imaging system comprising:

2. The endoscopic imaging system of claim 1 , wherein the console is connected to the endoscope by a wire.

3. The endoscopic imaging system of claim 1 , wherein the console is in wireless communication with one or more of the laser system, the endoscope, or the display.

4. The endoscopic imaging system of claim 1 , wherein the console includes one or more processors, an energy source, a non-transitory computer readable medium, and a plurality of logic modules.

5. 5. The endoscopic imaging system according to claim 4, wherein the plurality of logic modules are receiving one or more parameter settings from the laser system; receiving one or more captured images from the endoscope; selecting the one or more parameter settings for rendering on the display; generating one or more icons corresponding to the one or more parameter settings; superimposing said one or more icons onto said one or more captured images; drawing said one or more icons superimposed on said one or more captured images on said display; 1. An endoscopic imaging system configured to perform operations including:

6. The endoscopic imaging system of claim 1 , wherein the parameter settings include one or more of pulse energy, pulse frequency, pulse duration, total power, or pulse width.

7. The endoscopic imaging system of claim 1 , wherein the console is included in an image overlay unit.

8. 8. The endoscopic imaging system according to claim 7, the image overlay unit includes a control panel having a plurality of selection buttons and a direction button; Each selection button corresponds to one parameter setting, An endoscopic imaging system, wherein the directional buttons are configured to move the one or more icons around a screen of the display.

9. The endoscopic imaging system of claim 8 , wherein the image overlay unit is coupled with each of the endoscope, the laser system, and the display via wired connections.

10. The endoscopic imaging system of claim 9 , wherein the image overlay unit includes a laser system input, an endoscope input, and a display output.

11. 1. A method for depicting parameter settings of a laser system on an endoscope display, comprising: configuring one or more parameter settings of the laser system; capturing one or more images using the endoscope; generating one or more icons using a console in communication with the laser system, the endoscope, and the display; superimposing said one or more icons onto the captured image; rendering said icon and said captured image on said display; The method includes:

12. The method of claim 11 , wherein one or more of the laser system, the endoscope, or the display are coupled to a console via a wired connection.

13. The method of claim 11 or 12, wherein one or more of the laser system, the endoscope, or the display are coupled to a console via a wireless connection.

14. The method according to any one of claims 11 to 13, wherein the console is included in an image overlay unit.

15. 15. The method of any one of claims 11 to 14, wherein the parameter settings include one or more of pulse energy, pulse frequency, pulse duration, total power, or pulse width.

16. 16. A method according to any one of claims 11 to 15, wherein generating one or more icons comprises a user selecting one or more parameter settings to be depicted on the display.

17. 17. The method of any one of claims 11 to 16, wherein the one or more icons correspond to the one or more parameter settings.

18. The method of claim 17 , wherein the one or more icons include icons for all of the parameter settings received by the console.

19. The method of claim 17 , wherein the one or more icons include an icon for the parameter setting selected by a user.

20. 19. The method of claim 11, wherein the overlaying of one or more icons onto the captured image comprises: receiving, by the console, the one or more parameter settings from the laser system; receiving, by the console, the one or more captured images from the endoscope; The method includes:

21. 21. The method of claim 11, wherein rendering the icon and the captured image on the display includes a user determining the icon to be rendered on the display.

22. The method of claim 16 , wherein the one or more parameter settings to be rendered on the display are selected by the user via a control panel of an image overlay unit.

Images