Endoscopic imaging system and method

Abstract

Disclosed herein is an endoscopic imaging system including an endoscope configured to capture one or more images, the endoscope in communication with a laser system and a display, and a console in communication with the endoscope, the laser system, and the display, the console configured to receive one or more parameter settings from the laser system, receive one or more captured images from the endoscope, generate one or more icons corresponding to the parameter settings, and overlay the icons on the captured images depicted on the display.

Description

Background Art

[0001] During a medical procedure using a laser system and an endoscope, it may be difficult for a physician to view the settings of the laser system while looking at the endoscope monitor. In many cases, the physician has to turn his or her head to look at the laser system to check the settings and then turn his or her head back towards the endoscope monitor. It would be beneficial for the physician to be able to view the laser settings in the orientation on the endoscope monitor. Systems and methods of dealing with the above are disclosed herein.

Summary of the Invention

[0002] An endoscope imaging system is disclosed herein, the endoscope imaging system comprising an endoscope configured to capture one or more images, the endoscope communicating with a laser system and a display, and a console communicating with the endoscope, the laser system, and the display, the console receiving one or more parameter settings from the laser system, receiving one or more captured images from the endoscope, generating one or more icons corresponding to the parameter settings, and configured to overlay the icons on the captured images drawn on the display.

[0003] In some embodiments, the console is coupled to the endoscope via a wired connection. In some embodiments, one or more of the laser system, the endoscope, or the display are coupled to the console via a wireless connection.

[0004] In some embodiments, the console includes one or more processors, an energy source, a non-transitory computer-readable medium, and a plurality of logic modules. In some embodiments, the plurality of logic modules are configured to perform one or more of the following: receive one or more parameter settings from the laser system; receive one or more captured images from the endoscope; select one or more parameter settings to draw on the display; generate one or more icons corresponding to the one or more parameter settings; superimpose the one or more icons onto the one or more captured images; and display the one or more icons superimposed on the one or more captured images on the display.

[0005] In some embodiments, the parameter setting includes one or more of pulse energy, pulse frequency, pulse duration, total power, and pulse width. In some embodiments, the console is included within the image overlay unit.

[0006] In some embodiments, the image overlay unit includes a control panel having a plurality of selection buttons and one directional button, each selection button corresponding to a parameter setting, and the directional button is configured to move the one or more icons around the periphery of the display screen.

[0007] In some embodiments, the image overlay unit is wired to an endoscope, a laser system, and a display, respectively. In some embodiments, the image overlay unit includes a laser system input, an endoscope input, and a display output.

[0008] Also disclosed herein is a method for plotting parameter settings of a laser system on the display of an endoscope, comprising configuring one or more parameter settings of the laser system, capturing one or more images using the endoscope, and generating one or more icons using a console, the console communicating with the laser system, the endoscope, and the display. The method further comprises superimposing the one or more icons onto the captured images and plotting the icons together with the captured images on the display.

[0009] In some embodiments, one or more of the laser system, the endoscope, or the display are coupled to a console via a wired connection. In some embodiments, one or more of the laser system, the endoscope, or the display are coupled to a console via a wireless connection.

[0010] In some embodiments, the console is included within the image overlay unit. In some embodiments, the parameter setting includes one or more of pulse energy, pulse frequency, pulse duration, total power, and pulse width.

[0011] In some embodiments, generating one or more icons includes the user selecting one or more parameter settings to be drawn on the display. In some embodiments, the one or more icons correspond to the one or more parameter settings.

[0012] In some embodiments, the one or more icons include icons for all of the parameter settings received by the console. In some embodiments, the one or more icons include icons for the user-selected parameter settings that are to be drawn on the display.

[0013] In some embodiments, overlaying the one or more icons onto the capture image includes (i) receiving the one or more parameter settings from the laser system via the console, and (ii) receiving the one or more capture images from the endoscope via the console.

[0014] In some embodiments, drawing the icon and the capture image on the display includes the user determining the icon to be drawn on the display.

[0015] In some embodiments, the user uses the control panel of the image overlay unit to select one or more parameter settings to be drawn on the display. Such and other features of the concepts provided herein will become more apparent to those skilled in the art in consideration of the accompanying drawings and the following description, which describe in more detail specific embodiments of such concepts.

[0016] A more specific description of this disclosure is made by reference to the specific embodiments shown in the accompanying drawings. It should be understood that these drawings only illustrate typical embodiments of the invention and should not be considered limiting its scope. Illustrative embodiments of the invention are described and illustrated with additional specificities and details using the accompanying drawings. [Brief explanation of the drawing]

[0017] [Figure 1] Perspective views of endoscopic imaging systems according to several embodiments are shown. [Figure 2] Block diagrams of some components of an endoscopic imaging system according to several embodiments are shown. [Figure 3A] Perspective views of an endoscopic imaging system including an image overlay unit, according to several embodiments, are shown. [Figure 3B]Block diagrams of image overlay units according to several embodiments are shown. [Figure 4] This describes the rendering of captured images by an endoscope, with icons for setting the parameters of the laser system displayed on a screen, according to several embodiments. [Figure 5] A flowchart illustrates an exemplary method for displaying laser system parameter settings on an endoscope display, according to several embodiments. [Modes for carrying out the invention]

[0018] Before certain specific embodiments are disclosed in more detail, it should be understood that certain embodiments disclosed herein do not limit the scope of the concepts provided herein. It should also be understood that certain embodiments disclosed herein may have features that are easily separable from a particular embodiment and which, at their discretion, can be combined with or substituted for features of any of the many other embodiments disclosed herein.

[0019] With regard to the terminology used herein, it should be understood that the terms are for the purpose of describing certain specific embodiments and do not limit the scope of the concepts provided herein. Ordinal numbers (e.g., first, second, third, etc.) are generally used to distinguish or identify different features or steps within a group of multiple features or steps and do not provide a sequential limitation or numerical limitation. For example, the "first," "second," and "third" features or steps do not necessarily have to appear in that order, and a particular embodiment containing such features or steps does not necessarily have to be limited to three features or steps. Labels such as "left," "right," "up," "down," "front," and "back" are used for convenience and do not, for example, imply a specific fixed position, orientation, or direction. Instead, such notations are used to reflect, for example, a relative position, orientation, or direction. The singular forms "one," "one," and "the said" also include plural references unless explicitly indicated in the context.

[0020] The term "logic" can represent hardware, firmware, or software configured to perform one or more functions. As hardware, the term "logic" may refer to or include a circuit having data processing and / or storage functions. Examples of such circuits include, but are not limited to, hardware processors (e.g., microprocessors, one or more processor cores, digital signal processors, programmable gate arrays, microcontrollers, application specific integrated circuits "ASICs", etc.), semiconductor memories, or combinational elements.

[0021] Additionally or alternatively, the term "logic" may refer to or include software such as one or more processes, one or more instances, application programming interfaces (APIs), subroutines, functions, applets, servlets, routines, source code, object code, shared libraries / dynamic link libraries (DLLs), or one or more instructions. This software may be stored on any type of suitable non-transitory storage medium, or a transitory storage medium (e.g., electrical, optical, acoustic, or other forms of propagated signals such as carrier waves, infrared signals, or digital signals). Examples of non-transitory storage media include non-transitory storage such as programmable circuits, volatile memories (e.g., any type of random access memory "RAM"), or non-volatile memories (e.g., read-only memory "ROM", power-backup type RAM, flash memory, phase change memory, etc.), semiconductor drives, hard disk drives, optical disk drives, or transitory storage such as portable memory devices, but are not limited thereto. As firmware, logic can be stored in persistent storage.

[0022] Unless otherwise defined, all scientific and technical terms used in this specification have the same meaning as commonly understood by those skilled in the art. FIG. 1 shows a perspective view of an endoscopic imaging system 100 according to some embodiments. In some embodiments, the image overlay system 100 includes a laser system 110, an endoscope 120, and a display 150. The endoscope 120 can communicate with each of the laser system 110 and the display 150. In some embodiments, the endoscope 120 may be wired to the laser system 110 and the display 150, or may wirelessly communicate with at least one of the laser system 110 and the display 150. In use, the endoscope 120 may be configured to capture one or more images from a patient while the laser system 110 is also being used on the patient. In some embodiments, the captured images may include live images. In some embodiments, the endoscope 120 includes a console 122 that communicates with each of the laser system 110, the endoscope 120, and the display 150, and the console 122 receives one or more parameter settings from the laser system 110 and overlays one or more icons that draw the one or more parameter settings on the captured image from the endoscope 120, and is configured to draw the captured endoscopic image and the icons of the parameter settings on the display 150. Advantageously, the laser system 110 can be placed anywhere in the operating room while allowing a clinician to monitor the progress of the endoscope 120 and verify one or more parameter settings of the laser system 110 on the display 150. In some embodiments, the endoscope 120 may include a ureteroscope.

[0023] Figure 2 shows a block diagram of some components of an endoscopic imaging system 100 according to several embodiments. In some embodiments, the endoscope 120 may include one or more processors 124, an energy source 126, a non-temporary computer-readable medium ("memory") 128, and a console 122 having a plurality of logic modules. In some embodiments, the console 122 is wired to or wirelessly connected to the laser system 110, the endoscope 120, and the display 150. Exemplary wireless communication methods may include WiFi, Bluetooth®, Near Field Communication (NFC), Global System for Cellular Mobile Communications (GSM), electromagnetic (EM), radio frequency (RF), and combinations thereof. In some embodiments, the console 122 may be coupled to the endoscope 120, integrated into the endoscope 120, or be a standalone unit, as further described below. In some embodiments, the energy source 126 may include a battery or a power supply including the power supply for the endoscope 120.

[0024] In some embodiments, the logic modules may include a laser system parameter setting reception logic 130, an endoscope image reception logic 132, a laser system parameter setting overlay logic 134, a laser system parameter setting selection logic 136, and a display transmission logic 138. In some embodiments, the laser system parameter setting reception logic 130 may be configured to receive one or more parameter settings from the laser system 110. In some embodiments, one or more parameters may include one or more of pulse energy (joules), pulse frequency (Hertz), pulse duration (microseconds), total power (watts), and pulse width. In some embodiments, the endoscope image reception logic 132 may be configured to receive one or more captured images from the endoscope 120. In some embodiments, the captured images may include live images. In some embodiments, the laser system parameter setting overlay logic 134 may be configured to generate one or more icons that draw the one or more parameter settings received from the laser system 110 and to overlay them onto the captured endoscope image. In some embodiments, the icons may include shapes, text, numbers, or a combination thereof, including the name of the parameter setting, the numerical value of the parameter setting, and the unit of measurement for the parameter setting. In some embodiments, the laser system parameter setting selection logic 136 may be configured to allow the user to select / determine which of the one or more parameter settings received from the laser system 110 will be overlaid on the endoscopic image. In some embodiments, all parameter settings received from the laser system 110 may be drawn on the display 150. In some embodiments, the laser system parameter setting overlay logic 134 may generate icons for all parameter settings received from the laser system 110 and be configured to overlay only the parameter settings determined / selected by the user.In some embodiments, the laser system parameter setting overlay logic 134 may be configured to generate icons only for parameter settings determined by the user through the laser system parameter setting selection logic 136. In some embodiments, the display transmission logic 138 may be configured to transmit a capture image onto the display 150 along with overlaid icons that depict one or more parameter settings.

[0025] Figure 3A shows a perspective view of an endoscopic imaging system 100 including an image overlay unit 160 according to several embodiments. In some embodiments, the console 122 may be contained within a standalone image overlay unit 160 capable of communicating with each of the laser system 110, the endoscope 120, and the display 150, and the image overlay unit 160 may be configured to receive parameter settings from the laser system 110 and one or more captured images from the endoscope 120. Advantageously, the standalone image overlay unit 160 may be configured to receive captured image input from an endoscope from any manufacturer, including a standard video output on the endoscope. Furthermore, the image overlay unit 160 may be located anywhere in the treatment room, including near the display 150, allowing the user to concentrate on the procedure. As described above, the image overlay unit 160 may be configured to overlay one or more icons of one or more parameter settings from the laser system 110 onto the captured image drawn on the display 150. In some embodiments, the image overlay unit 160 may include a control panel 162 located in front of the image overlay unit 160. The control panel 162 may be configured to allow the user to control which parameter settings of the laser system 150 are displayed on the display 150. In some embodiments, the control panel 162 may be configured to have one or more selection buttons 164, each corresponding to a parameter setting of the laser system 110 that can be displayed on the display 150. In one embodiment, the selection buttons 164 may be organized or grouped into two sections: a left pedal section 166 corresponding to the left pedal on a laser system control pedal module (not shown) and a right pedal section 168 corresponding to the right pedal on a laser system control pedal module. The user can select the parameter settings to be displayed on the display 150 by selecting the button 164 corresponding to the parameter setting the user desires.In this embodiment, the image overlay unit 160 may include directional buttons 170 configured to move one or more icons drawn around the display screen 150. In some embodiments, the laser system 110, the endoscope 120, and the display 150 may be coupled to the rear of the image overlay unit 160.

[0026] Figure 3B shows a rear view of the image overlay unit 160 according to several embodiments. The rear of the image overlay unit 160 may include a laser system input 174, an endoscope input 172, and a display output 176. In some embodiments, the laser system input 174 may include any number of standard inputs (e.g., Ethernet®, component video, composite audio / video, VGA, FireWire®, serial port, DVI, HDMI®, parallel port, USB Type-C, USB port, optical audio Toslink®, etc.). In some embodiments, the endoscope input 172 may include a standard video input received from the endoscope 120 (e.g., HDMI®, mini HDMI, micro HDMI, VGA, mini VGA, DVI-D, DVI-I, mini DVI, micro DVI, DisplayPort, mini DisplayPort, USB Type-C, Thunderbolt®, etc.). In some embodiments, the display output 176 may include standard video outputs (e.g., HDMI®, mini HDMI, micro HDMI, VGA, mini VGA, DVI-D, DVI-I, mini DVI, micro DVI, DisplayPort, mini DisplayPort, USB Type-C, Thunderbolt®, etc.).

[0027] Figure 4 illustrates the drawing of an image captured by an endoscope 120, displaying icons for parameter settings of a laser system 110 on a display 150, according to several embodiments. In some embodiments, one or more icons 180 may be drawn near the corners or edges of the display 150 so as not to obstruct the captured image. In some embodiments where the laser system 110 includes two pedals, one or more icons 180 may be distinguished by their position on the display 150. For example, as shown in Figure 4, icon 180A, corresponding to the parameter setting of the left pedal of the laser system 110, is located in the upper left of the display 150, and icon 180B, corresponding to the parameter setting of the upper right pedal of the laser system 110, is located on the right side of the display 150. In some embodiments, directional buttons 170 may be configured to move one or more icons 180 to various positions on the display screen at the user's discretion.

[0028] Figure 5 shows a flowchart of an exemplary method 200 for displaying parameter settings of a laser system 110 on a display 150 of an endoscope 120, according to several embodiments. Method 200 includes configuring one or more parameter settings of the laser system 110 (block 202). In some embodiments, one or more parameter settings include one or more of pulse energy, pulse frequency, pulse duration, total power, and pulse width. Method 200 further includes capturing one or more images using the endoscope 120 (block 204). Method 200 further includes generating one or more icons 180 (block 206). In some embodiments, generating one or more icons 180 includes the console 122 generating one or more icons 180. In some embodiments, the console 122 is contained within an image overlay unit 160. In some embodiments, the icons 180 may include shapes and / or text corresponding to one or more parameter settings of the laser system 110. In some embodiments, generating one or more icons 180 includes the user selecting one or more parameter settings to be drawn on the display 150. In some embodiments, generating one or more icons 180 includes the console 122 generating one or more icons 180 for all parameter settings received by the console 122, or the console 122 generating one or more icons 180 only for parameter settings selected by the user to be drawn on the display 150.

[0029] Method 200 further includes superimposing one or more icons 180 onto a captured image (block 208). In some embodiments, superimposing one or more icons 180 onto a captured image includes the console 112 (i) receiving one or more parameter settings from the laser system 110 and (ii) receiving one or more captured images from the endoscope 120. In some embodiments, superimposing includes superimposing one or more icons 180 onto a live captured image. Method 200 further includes drawing the superimposed icons 180 and captured image on a display 150 (block 210). In some embodiments, drawing the icons 180 and captured image on the display 150 includes a user determining which icons 180 are to be drawn on the display 150. In some embodiments, the user determining which icons 180 are to be drawn on the display 150 includes the user using the control panel 162 of the image superimposition unit 160 to select one or more parameter settings to be shown on the display 150. In some embodiments, drawing the superimposed icons 180 and capture images on the display 150 includes drawing the icons 180 toward the edges or corners of the display 150.

[0030] While several specific embodiments are disclosed herein, and these specific embodiments are disclosed in some degree of detail, they are not intended to limit the scope of the concepts provided herein. Further adaptations and / or modifications may be apparent to those skilled in the art, and these adaptations and / or modifications are also encompassed in broader embodiments. Thus, it is possible to carry out developments from specific embodiments disclosed herein without departing from the scope of the concepts provided herein.

Claims

1. An endoscopic imaging system, An endoscope configured to capture one or more images, comprising an endoscope that communicates with a laser system and a display, A console that communicates with the endoscope, the laser system, and the display, The laser system receives one or more parameter settings, One or more capture images are received from the endoscope. Generate one or more icons corresponding to the parameter settings, A console configured to overlay the icon onto the capture image drawn on the display. Equipped with, The console is included within the image overlay unit. The image overlay unit includes a control panel having multiple selection buttons and one directional button. Each selection button corresponds to one parameter setting. The directional buttons are configured to move one or more icons around the screen of the display in an endoscopic imaging system.

2. The endoscopic imaging system according to claim 1, wherein the console is wiredly connected to the endoscope.

3. The endoscopic imaging system according to claim 1, wherein the console wirelessly communicates with one or more of the laser system, the endoscope, or the display.

4. The endoscopic imaging system according to any one of claims 1 to 3, wherein the console includes one or more processors, an energy source, a non-temporary computer-readable medium, and a plurality of logic modules.

5. The endoscopic imaging system according to claim 4, wherein the plurality of logic modules are Receiving one or more parameter settings from the laser system, Receiving one or more captured images from the endoscope, Selecting one or more parameter settings to draw on the aforementioned display, To generate one or more icons corresponding to the one or more parameter settings, Overlaying one or more icons onto one or more of the aforementioned capture images Drawing one or more icons superimposed on one or more capture images on the display. An endoscopic imaging system configured to perform operations including those described above.

6. The endoscopic imaging system according to any one of claims 1 to 3, wherein the parameter setting includes one or more of pulse energy, pulse frequency, pulse duration, total power, or pulse width.

7. The endoscopic imaging system according to claim 1, wherein the image overlay unit is coupled to the endoscope, the laser system, and the display, respectively, via a wired connection.

8. The endoscopic imaging system according to claim 7, wherein the image overlay unit includes a laser system input, an endoscope input, and a display output.

9. A method for operating an image overlay unit that communicates with a laser system, an endoscope, and a display, The console included in the aforementioned image overlay unit Receiving one or more parameter settings of the laser system, Receiving one or more captured images from the endoscope, To generate one or more icons corresponding to the aforementioned parameter settings, The process involves superimposing one or more icons onto the aforementioned capture image, To draw the aforementioned icon and the aforementioned capture image on the display. Includes, The image overlay unit includes a control panel having multiple selection buttons and one directional button. Each selection button corresponds to one parameter setting. The directional buttons are configured to move one or more icons around the screen of the display.

10. The method according to claim 9, wherein one or more of the laser system, the endoscope, or the display are coupled to the console via a wired connection.

11. The method according to claim 9 or 10, wherein one or more of the laser system, the endoscope, or the display is coupled to the console via a wireless connection.

12. The method according to claim 9 or 10, wherein the parameter setting includes one or more of pulse energy, pulse frequency, pulse duration, total power, or pulse width.

13. The method according to claim 9, wherein the one or more icons include icons for all of the parameter settings.

Images