Imaging device comprising two image sensors capable of implementing multiple imaging modes and associated imaging system

Abstract

Various methods and systems are provided to implement multiple imaging modalities with a single camera head. The camera head may include a two-chip or three-chip system capable of measuring light of different wavelengths to generate different images. The light source in the system can adjust the output spectrum by using multiple luminophors and filters, and measurements from different light channels on one or more image sensors can be used to generate white light images, fluorescence images, perfusion images, fluorescein images, etc.

Description

Cross - Reference to Related Applications

[0001] This application claims the benefit and priority of U.S. Patent Application No. 17 / 971,452, filed on October 21, 2022, under 35 U.S.C.§119(e). For all purposes and for all of its teachings, the entire disclosure of that U.S. patent application is hereby incorporated by reference in its entirety. Background Art

[0002] During a surgical operation or procedure, one or more images of the surgical site can be captured. Imaging can enable a surgeon to view the surgical site and make decisions based on the imaging. For example, a surgeon can use an image or real - time feed of the surgical site when manipulating surgical tools or performing visual diagnosis, taking a biopsy, etc. Different imaging modalities can be used for different purposes during a surgical operation or procedure, where each modality provides a different view or set of information about the surgical site.

[0003] A camera head that is typically attached to an imaging endoscope (such as an endoscope or an exoscope) can provide imaging modalities such as white - light imaging and fluorescence imaging, but is limited in the number of different imaging modalities that can be provided simultaneously. Further, some such imaging modalities require complex time synchronization between the camera head and the corresponding light source to accurately capture the image information required for a given modality, which generally results in a reduced effective frame rate for the given modality. For example, common fluorescence imaging (FI) techniques require the light source to strobe between white - light illumination and fluorescence - excitation light illumination. Each frame that is displayed combines a first white - light frame that is collected with a subsequently collected FI frame (appropriately processed) to create an overlay of the two images. This process necessarily reduces the frame rate that can be displayed by at least 50%. Summary of the Invention

[0004] The disadvantages of the systems discussed above can be addressed with the systems and methods disclosed herein. By providing a light source having multiple individual light emitters and one or more possible optical filters, the light source can output light of different wavelengths corresponding to the requirements of the current imaging modality. Additionally, different imaging modalities can be implemented using the dual - chip or triple - chip camera heads discussed herein. The camera head includes two or three image sensors positioned relative to different prisms and associated spectral filters such that light received from the surgical scene can be processed according to the selected imaging modality without the need to use different camera heads. These imaging sensors can be or include color filter arrays capable of capturing data for various wavelengths or spectral bands of light, such as a Bayer array. The various color channels of these image sensors can be processed to generate images of various modalities.

[0005] The camera head can beneficially enable a physician to alternate between different imaging modes during a surgical operation or procedure to capture different images of the surgical scene. For example, the physician may be able to start in white light mode and capture a white light image of the surgical scene, and then transition the imaging system to an oxygenation mode to generate a perfusion image to examine how blood is flowing in the surgical site, without turning off the camera head. Additionally, image processing can use data from the image sensor to produce a false color overlay of a fluorescence image on the visible light image, which can be beneficial in performing various surgical operations and diagnoses. Using a single camera head also beneficially reduces the cost and time required to perform a surgical operation or procedure. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] Figure 1 A block diagram of a system in accordance with at least one exemplary embodiment is shown;

[0007] Figure 2 A light source in accordance with at least one exemplary embodiment is shown;

[0008] Figure 3 A dual-chip imaging system in accordance with at least one exemplary embodiment is shown;

[0009] Figure 4 A triple-chip imaging system in accordance with at least one exemplary embodiment is shown;

[0010] Figure 5 A method in accordance with at least one exemplary embodiment is shown;

[0011] Figure 6A Six spectral channel sensitivities of at least one exemplary dual-sensor embodiment are shown;

[0012] Figure 6B Three spectral channel sensitivities of the first sensor of an exemplary dual-sensor embodiment are shown;

[0013] Figure 6C Three spectral channel sensitivities of the first sensor of an exemplary dual-sensor embodiment are shown, wherein the optical system includes a filter for blocking excitation light between 700 and 800 nm; and

[0014] Figure 6D Three spectral channel sensitivities of the second sensor of an exemplary dual-sensor embodiment are shown. DETAILED DESCRIPTION

[0015] Exemplary systems and methods of the present disclosure will be described with respect to imaging. However, to avoid unnecessarily obscuring the present disclosure, many known structures and devices are omitted from the description. Such omissions should not be construed as a limitation on the scope of the claimed disclosure. Numerous details are set forth to provide an understanding of the present disclosure. However, it should be understood that the present disclosure may be practiced in various ways beyond the specific details set forth herein.

[0016] Turning first to Figure 1 , aspects of a system 100 according to at least one exemplary embodiment are shown. The system 100 includes an imaging device 104, a network 140, a user interface 144, a display 148, and a network interface 152. In some embodiments, the system 100 may include additional or alternative components, and Figure 1 the components shown in

[0017] are in no way limiting. For example, the system 100 may include additional or alternative imaging devices, additional surgical tools (e.g., surgical drills, endoscopes, etc.), combinations thereof, and the like. As another example, a controller 108 disposed within the imaging device 104 may alternatively be disposed external to the imaging device 104 and may communicate with the imaging device 104 (or its components) wirelessly and / or via a wired connection. Such an external controller may be included in a camera control unit (CCU).

[0018] The camera head 116 can be a device that includes a lens assembly 132 and an imaging assembly 136 that measures light received that has been reflected from the surgical scene. The imaging assembly 136 includes a prism assembly 137 and a plurality of image sensors. The lens assembly 132 can include a plurality of optical components that condition and / or direct light received from the surgical scene into the prism assembly 137. The plurality of image sensors of the imaging assembly 136 measure the captured light, where these measurements are used by the controller 108 to generate one or more images of the surgical scene.

[0019] The processor 120 can provide processing functionality and can correspond to one or more computer processing devices. For example, the processor 120 can be provided as a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), any other type of integrated circuit (IC) chip, a collection of IC chips, a microcontroller, a collection of microcontrollers, (a) GPU, etc. As another example, the processor 120 can be provided as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), and / or a plurality of microprocessors configured to execute instructions or algorithms 128 and / or data stored in the memory 124. The processor 120 implements the various functions of the system 100 when executing the instructions or algorithms 128 and / or data stored in the memory 124.

[0020] The memory 124 can be or include a computer-readable medium that includes instructions executable by the controller 108 and / or the processor 120. The memory 124 can include any type of computer memory device and can be volatile or non-volatile in nature. In some embodiments, the memory 124 can include a plurality of different memory devices. Non-limiting examples of the memory 124 include random access memory (RAM), read-only memory (ROM), flash memory, electrically erasable programmable ROM (EEPROM), dynamic RAM (DRAM), etc. The memory 124 can include instructions that enable the controller 108 to control the various elements of the system 100 and store data to and retrieve information from, for example, the database 156. The memory 124 can be local to the imaging device 104 (e.g., integrated with the imaging device) or separate from the imaging device 104.

[0021] Instruction 128 includes computer-readable software executable by controller 108 and / or processor 120, which causes controller 108 and / or processor 120 to perform one or more functions. When processed by processor 120, instruction 128 can cause processor 120 to execute one or more algorithms for image processing, for controlling one or more components of system 100, combinations thereof, etc. As an example, instruction 128 can cause the processor to execute one or more image processing techniques (e.g., edge detection techniques, interpolation, demosaicing algorithms, Bayer filter pattern algorithms, image overlay, etc.) to convert measurements from an image sensor into one or more images for storage and / or display.

[0022] User interface 144 includes hardware and / or software that enables a user to input into system 100 and / or any one or more of its components. User interface 144 can include a keyboard, mouse, touch-sensitive pad, touch-sensitive button, mechanical button, switch, and / or other control elements for providing user input to system 100 to enable the user to control certain functions of system 100 (e.g., operating the illumination and / or imaging capabilities of imaging device 104, presenting processed video to display 148, etc.). Independent of or in addition to user interface controls not provided in imaging device 104, user interface 144 can include buttons, switches, or other control devices provided on imaging device 104 itself. Simply as an illustrative example, imaging device 104 and / or display 148 can have input buttons and switches, and additionally, a keyboard or mouse can be directly connected to processor 120 (in an embodiment where processor 120 is disposed external to imaging device 104). All of these together constitute user interface 144.

[0023] Display 148 can be or include a liquid crystal display (LCD), a light-emitting diode (LED) display, a high-definition (HD) display, a 4K display, etc. Display 148 can be a stand-alone display or a display integrated as part of another device such as a smart phone, laptop computer, tablet computer, headgear, or head-mounted device, etc. In one embodiment, display 148 can be a monitor or other viewing device disposed in an operating room such that a video feed captured from a surgical procedure or operation can be presented to display 148 for viewing by a physician. In some embodiments, display 148 can include multiple displays depending on, for example, system design.

[0024] The network interface 152 may enable one or more components of the system 100 to communicate with each other or with components external to the system 100, either wired and / or wirelessly. These communication interfaces that allow the components of the system 100 to communicate using the network interface 152 include wired and / or wireless communication interfaces for exchanging data and control signals with each other. Examples of wired communication interfaces / connections include Ethernet connections, HDMI connections, connections compliant with the PCI / PCIe standard and the SATA standard, and the like. Examples of wireless interfaces / connections include Wi-Fi connections, LTE connections, connections, NFC connections, and the like.

[0025] The database 156 includes a structure that is the same as or similar to the memory 124 described above. In at least one exemplary embodiment, the database 156 is included in a remote server and stores video data captured during a surgical operation or procedure (e.g., a camera on an endoscope captures a live feed during an endoscopy).

[0026] Although Figure 1 the various elements in the system 100 are shown as being separate from each other, it should be understood that some or all of the elements may be integrated with each other if desired. For example, a single desktop computer or laptop computer or CCU may include the processor 120, the memory 124, the user interface 144, and optionally the display 148. It should be further understood that each element in the system 100 includes one or more communication interfaces that enable communication with other elements in the system 100, such as through the network interface 152. Another example of a preferred embodiment of the system 100 includes an endoscope combined with (or removably connected to) the camera head 116, the endoscope having a built-in user interface 144 connected to an external camera control unit (CCU), the CCU including the controller 108, the memory 124, the processor 120, the network interface 152, and the user interface 144, and the CCU is also connected such that it can output image data to the display 148.

[0027] Figure 2Shows aspects of a light source 112 in accordance with at least one exemplary embodiment of the present disclosure. The light source 112 may be or include a lighting device that includes a first light emitter 204, a second light emitter 208, a third light emitter 212, a fourth light emitter 216, and a fifth light emitter 220. Each of these light emitters may be capable of generating and / or emitting light of a set wavelength or light within a wavelength range. In one embodiment, the first light emitter 204 may generate green light (e.g., light having a center wavelength of about 550 nanometers (nm)), or white light (e.g., light having a wavelength between 400 and 700 nm) in some embodiments using a white light source; the second light emitter 208 may generate blue light (e.g., light having a center wavelength of about 450 nm); the third light emitter 212 may generate infrared (IR) light having a wavelength of about 940 nm; the fourth light emitter 216 may generate infrared light having a wavelength of about 770 nm; and the fifth light emitter 220 may generate red light having a center wavelength of about 630 nm. The light generated by these light emitters may pass through a series of filters before being output from the light source 112 such that the final light output from the light source 112 includes a set of wavelengths generated by these individual light emitters. For example, the first filter 224 may reflect red light and transmit all other light such that the red light generated by the fifth light emitter 220 is directed towards the third filter 232. Similarly, the second filter 228 may reflect light having a wavelength below 500 nm and transmit light having a wavelength above 500 nm. Thus, the second filter 228 may direct the blue light generated by the second light emitter 208 towards the third filter 232. The filtering parameters of the first filter 224 and the second filter 228 may be such that the green light generated by the first light emitter 204 can pass through both the first filter 224 and the second filter 228 as the green light travels towards the third filter 232. This configuration of filters and light emitters allows for precise selection of the spectral bands in the resulting combined output light 244. The spectral values of the light emitters and filters of the light source may be adjusted to correspond to a desired configuration of the imaging assembly 136 of the camera head 116, details of various embodiments of which are described below.

[0028] As used herein and unless otherwise specified, a list of wavelengths of light includes approximate wavelength values. For example, green light having a wavelength of 550 nm may also include, for example, its percentage variations (e.g., 1% below and above the 550 nm value, 2% below and above the 550 nm value, 10% below and above the 550 nm value, 25% below and above the 550 nm value, etc.). Additionally, the term "about" includes percentage variations of the light wavelength. For example, "about 550 nm" may encompass all wavelengths between 544.5 and 555.5 nm. In some embodiments, the listed wavelengths of light may be the wavelengths centered within a broader wavelength spectrum of the light. As an example, green light having a wavelength of 550 nm may indicate that the green light includes a broad wavelength spectrum centered at 550 nm, for example, between 485 nm and 615 nm. As can be understood, such a broad wavelength spectrum is not limited to green light, and other illumination sources discussed herein may similarly produce light having a broad wavelength spectrum. In some preferred embodiments, the light produced by different light sources may have overlapping spectra. In other words, both the fifth light emitter 220 and the first light emitter 204 may produce light including an overlapping wavelength range (e.g., overlapping wavelengths between 560 nm and 590 nm, overlapping wavelengths between 550 nm and 600 nm, etc.), and both the first light emitter 204 and the second light emitter 208 may produce light including an overlapping wavelength range (e.g., overlapping wavelengths between 480 nm and 550 nm, overlapping wavelengths between 450 nm and 580 nm, etc.). However, it should be understood that these exemplary ranges are in no way limiting, and broader or narrower spectral overlap ranges of the light produced by different light emitters are possible.

[0029] The third filter 232 can operate to separate the visible light emitter from the infrared light emitter by allowing light with a wavelength below 650 nm to pass through it while reflecting light with a wavelength above 650 nm. Thus, the visible light generated and emitted by the first light emitter 204, the second light emitter 208, and / or the fifth light emitter 220 passes through the third filter 232, while any infrared light generated by the first light emitter 204, the second light emitter 208, and / or the fifth light emitter 220 is reflected. The placement of the third filter 232 can ensure that no infrared light is output from the first light emitter 204, the second light emitter 208, and / or the fifth light emitter 220. The fourth filter 236 can reflect light with a wavelength between approximately 725 and 800 nm while transmitting light with a wavelength shorter than 725 nm and a wavelength greater than 800 nm. The fourth filter 236 directs the infrared light (whose wavelength can be approximately 770 nm) generated by the fourth light emitter 216 towards the exit of the light source 112. Similarly, the fifth filter 240 can reflect a wavelength of approximately 940 nm while allowing all other wavelengths to pass through it; the fifth filter 240 ensures that the infrared light (whose wavelength can be approximately 940 nm) generated by the third light emitter 212 is directed towards the exit of the light source 112. The fourth filter 236 and the fifth filter 240 allow visible wavelengths to pass through them and exit the light source 112. As Figure 2 shown, the positioning of the first filter 224, the second filter 228, the third filter 232, the fourth filter 236, and the fifth filter 240 results in a combined light output 244 being output from the light source 112, where the combined light output 244 contains the light wavelengths generated by each light emitter. In other words, the combined light output 244 can include two, three, or more spectrally distinct spectrally different light portions based on the number of activated light emitters.

[0030] In some embodiments, the light source 112 can be strobed. In other words, the first light emitter 204, the second light emitter 208, the third light emitter 212, the fourth light emitter 216, and / or the fifth light emitter 220 can be modulated or duty-cycled to emit light periodically such that the combined light output 244 periodically illuminates the surgical site. In other embodiments, the light source 112 can not be strobed. In other words, the first light emitter 204, the second light emitter 208, the third light emitter 212, the fourth light emitter 216, and / or the fifth light emitter 220 can continuously generate light such that the combined light output 244 illuminates the surgical site as long as the light source 112 remains on.

[0031] Figure 3Shows aspects of the camera head 116 according to at least one exemplary embodiment of the present disclosure. The camera head 116 includes a lens assembly 132 and an imaging assembly 136, which imaging assembly includes a prism assembly 137. The lens assembly 132 may include a collection of mirrors, lenses, filters, polarizers, and / or windows capable of conditioning the received light and directing it into the prism assembly 137. As Figure 3 shown, the lens assembly 132 includes a plurality of lenses 312A - 312N and a first filter 316, which first filter may direct light 302 into the prism assembly 137. In some embodiments, the light 302 may be light reflected from the surgical scene and captured by the optics of an attached endoscope or the optics of an exoscope, and relayed or transmitted to the camera head 116. The first filter 316 may filter out one or more wavelengths of the light captured by the camera head 116. The first filter 316 may be a replaceable, selectable, or tunable filter such that its characteristics can be selected according to the requirements of the desired mode. For example, in one embodiment, the first filter 316 may be a dichroic filter that passes light in a first wavelength band but rejects light in a second wavelength band. In a further embodiment, the first filter 316 may be a different dichroic filter that passes light in a third wavelength band and rejects light in a fourth wavelength band. Various specific embodiments are discussed below. In one embodiment, the first filter 316 blocks wavelengths between 725 nm and 800 nm. In some embodiments, the first filter 316 may be removable from the lens assembly 132. The first filter 316 may be used in imaging modalities, such as indocyanine green (ICG) or OTL - 38 (OTL) fluorescence imaging modalities, to block the illumination wavelengths between 725 nm and 800 nm used to stimulate fluorescence. Although wavelengths between 725 nm and 800 nm are filtered out, the transmitted light may still contain additional spectrally distinct light components. For example, the transmitted light may include fluorescence wavelengths as well as visible light wavelengths, which can be separately separated by the prism assembly 137, as discussed in further detail below.

[0032] Light 302 is focused by lens assembly 132 and enters prism assembly 137. Prism assembly 137 includes a first prism 320 that receives light 302. The first prism 320 may include a first spectral filter 324 disposed on its surface. The first spectral filter 324 can filter and reflect light of different wavelengths, thereby creating a cut-off value between different spectral bands. For example, the first spectral filter 324 can reflect light with wavelengths below 500 nm and above 650 nm, while transmitting light with wavelengths between 500 nm and 650 nm. Thus, the spectral band between 500 nm and 650 nm exits the first prism 320 as transmitted light 336, while the remaining spectral bands remain in the first prism 320 as reflected light 328. The reflected light 328 can be bent or reflected inside the first prism 320 by the first prism until the reflected light 328 enters the first image sensor 332. The first image sensor 332 can receive the reflected light 328, and photosensitive elements (e.g., photodiodes, pixels) within the first image sensor 332 generate corresponding electrical signals. In some embodiments, the electrical signals can be transmitted to one or more other components of system 100 (such as to controller 108) and further used to generate one or more images. For example, the first image sensor 332 can have a color filter array (CFA) that can receive light of one or more wavelengths, such as visible light (e.g., red, blue, and green light), infrared light, combinations thereof, etc. In some embodiments, the CFA can include a plurality of photodiodes arranged in an array to capture light of different wavelengths. For example, the CFA can be a Bayer filter arranged in a Bayer pattern (e.g., a filter pattern having half green, one-quarter red, and one-quarter blue filters). In such an embodiment, the first image sensor 332 can include four spectrally distinct spectral channels: a red channel, a blue channel, a green channel, and an infrared channel. Each channel can be used to determine pixel values when reconstructing one or more images of the surgical site. In some embodiments, the first image sensor 332 can be used to measure light of wavelengths reflected by the first spectral filter 324 (e.g., light with wavelengths below 500 nm and above 650 nm).

[0033] The transmitted light 336 can pass through the first spectral filter 324 and can enter the second prism 340. The second prism 340 may include a second image sensor 344. The second image sensor 344 can be similar or identical to the first image sensor 332. For example, the second image sensor 344 can include a CFA that can capture white light (e.g., red, blue, and green light), infrared light, combinations thereof, etc. In one embodiment, the second image sensor 344 can be used to detect light with wavelengths between 500 nm and 650 nm.

[0034] In some embodiments, the first image sensor 332 and / or the second image sensor 344 may be attached (e.g., glued or adhered) to the first prism 320 and the second prism 340, respectively. Alternatively, the first image sensor 332 and / or the second image sensor 344 may not be attached to the first prism 320 and the second prism 340, respectively, but may instead be disposed close to the first prism 320 and the second prism 340. In such embodiments, it may be possible to adjust or vary the position of the first image sensor 332 and / or the second image sensor 344 relative to the first prism 320 and / or the second image sensor 344.

[0035] In some embodiments, both the first image sensor 332 and the second image sensor 334 may include three distinct spectral channels: a red channel, a blue channel, and a green channel. These embodiments are particularly advantageous because image sensors with a standard RGB CFA are readily commercially available (such as those used in the mobile phone market) and are generally less expensive than specialized sensors (such as those that include an IR channel) or even grayscale sensors. Further, in these embodiments, the two image sensors may be the same, thereby simplifying manufacturing and increasing potential versatility. In such embodiments, the red channel on the first image sensor 332 is sensitive to infrared light. Thus, the first image sensor 332 may be able to detect the blue, green, and infrared spectral channels. The presence of three channels on the first image sensor 332, and the ability of the second image sensor 344 to detect three spectrally distinct spectral channels different from the three channels on the first image sensor 332 (including red, green, and blue channels) may enable the prism assembly 137 to receive light 302 and manipulate it into at least six distinct spectral bands measured by the first image sensor 332 and the second image sensor 344. Additionally or alternatively, the spectral bands, while spectrally distinct, may include overlapping bands. It should be understood that the amount of spectral overlap between the spectral bands present in the light 302, manipulated by the prism assembly 137, and / or detected on any sensor channel is not limiting.

[0036] For illustrative purposes only, the following are examples of methods for performing various imaging modalities using the camera head 116 and other components of the system 100.

[0037] In the "white light imaging" modality, the light source 112 and the camera head 116 can provide imaging of the surgical scene using white light. The white light can be output from the first light emitter 204, or from a combination of green light, blue light, and red light, where the green light, blue light, and red light are output from the first light emitter 204, the second light emitter 208, and the fifth light emitter 220, respectively. In this case, the third light emitter 212 and the fourth light emitter 216 can be turned off or disabled so that the combined light output 244 contains only white light. In some embodiments, the first light emitter 204 can emit white light, while the second light emitter 208 and the fifth light emitter 220 can each also emit blue light and red light, respectively. In other words, all three of the first light emitter 204, the second light emitter 208, and the fifth light emitter 220 can emit light in the white light modality. Once the light is emitted from the light source 112, the light can illuminate the surgical scene. The light reflected from the surgical scene can be transmitted into the camera head 116 and, more specifically, into the lens assembly 132. Then, the lens assembly 132 can condition the light and / or transmit the light into the prism assembly 137 of the imaging assembly 136. In embodiments where the "white light imaging" modality is enabled, the first image sensor 332 can capture light having a wavelength below 500 nm and light having a wavelength above 650 nm, while the second image sensor 344 can capture light having a wavelength between 500 nm and 650 nm. The measurements from the first image sensor 332 and the second image sensor 344 can be processed by the processor 120 to generate a true color image. In some embodiments, the processor 120 can use one or more algorithms (e.g., image reconstruction algorithms, bilinear interpolation, gradient direction interpolation algorithms, etc.) to process the color channels on the first image sensor 332 and the second image sensor 344 to generate a true color image. In one embodiment, the green channel and the blue channel of the first image sensor 332 (e.g., spectral channels that respectively detect green light and blue light) and the red channel, the green channel, and the blue channel of the second image sensor 344 can be used to reconstruct the true color image.

[0038] As another illustrative example, the imaging device 104 can operate in an ICG / OTL fluorescence and simultaneous white light imaging mode. In this mode, white light can be generated as described above in the white light mode. However, in addition, a fourth light emitter 216 can be enabled such that infrared light is included in the combined light output 244 of the light source 112. The wavelength or wavelength range emitted by the fourth light emitter is selected to correspond to the excitation wavelength of the target fluorophore. The combined light output 244 can then illuminate the surgical scene, and the light reflected from the surgical scene is captured by the camera head 116. In this case, the ICG / OTL fluorescence can occur at an infrared light wavelength different from the infrared light (e.g., approximately 770 nm) generated by the light source 112 (e.g., an infrared light wavelength higher than 800 nm). However, the direct infrared light generated by the fourth light emitter 216 can be blocked by the first filter 316 before reaching the prism assembly 137. True color images can be created using the same color channels of the first image sensor 332 and the second image sensor 344, while the ICG / OTL fluorescence based on the infrared spectral band is detected by the infrared channel of the first image sensor 332. The channel measurement results of the first image sensor 332 and the second image sensor 344 can be sent to the processor 120, which can use one or more algorithms to generate an image of the surgical scene. The image of the surgical scene can include both a white light image and an overlay image representing the collected fluorescence image. Generally, as is known in the art, the combined image is represented as a false color image with the fluorescence image overlaid on the white light image.

[0039] To further illustrate a variation of the previous example, Figures 6A to 6D illustrates Figure 3 the channel sensitivities of one or more exemplary embodiments of the dual-sensor imaging assembly 136 (and more generally the camera head 116) having the above-described configuration, where both the first image sensor 332 and the second image sensor 344 are RGB sensors with a standard Bayer-type CFA. Figure 6A Illustrates the complete spectral sensitivity 600 across all six spectral channels represented across two image sensors. The sensitivity of the blue sensor is represented by peaks indicated as 612 and 624. The sensitivity of the green sensor is represented by peaks indicated as 608 and 620. Finally, the sensitivity of the red sensor is represented by peaks indicated as 616 and 604. As previously discussed, the spectral filter 324 in this example reflects light with wavelengths shorter than 500 nm and longer than 650 nm and directs the reflected light 328 to the first image sensor 332.

[0040] Figure 6BShows the sensitivities 628 of the red, blue, and green channels of the first sensor 332 with respect to this reflected light 328. Trace 612 shows the sensitivity of the blue channel, trace 608 shows the sensitivity of the green channel, and trace 604 shows the sensitivity of the red channel. It should be noted that the sensitivity depicted by trace 604 of the red channel extends well into the near-infrared (NIR) spectral range and is thus sensitive to NIR radiation, which is of particular interest for some fluorescence imaging applications (such as those employing ICG) as its emission peak is in this range.

[0041] Figure 6C Shows the sensitivities 632 of the three RGB channels of the first sensor 332 when the first filter 316 is an element of the lens assembly 132 of the camera head 116 and blocks light representing the excitation range of, for example, ICG. Thus, when this excitation band is blocked, the sensitivity 604 of the red channel now shows a notch 636 because the content of the reflected light 328 will not contain any light in this spectral range as that light has previously been blocked by the optical system. Therefore, when operating in the ICG mode, the only light detected by the red channel of sensor 1 will be the NIR signal corresponding to the ICG emission light as the excitation light has been blocked by filter 316 and the light source 112 does not emit any light in the range of 650 - 700 nm when operating in this mode. When operating in the CY5 / CY5.5 mode, the red channel of the first sensor is used to detect the emission that occurs for these fluorophores in the 650 - 700 nm spectral band. Further, when the imaging system is used in combination with a conventional white light source rather than Figure 2 the white light source shown, when operating in the "white light imaging mode", this embodiment can utilize the sensitivity in this range. In this case, the first image sensor will then generate blue, green, and red signals, and the combined signals from the first image sensor and the second image sensor can give a more complete spectral image.

[0042] Figure 6D Shows the sensitivities 640 of the three RGB channels of the second image sensor 344 to the light 336 in the wavelength range of 500 - 650 nm transmitted by the spectral filter 324. Here, we can see the sensitivity 624 of the blue channel, the sensitivity 620 of the green channel, and the sensitivity 616 of the red channel. Thus, we see six distinct channels received by the two sensors, in this case two blue channels, two green channels, one red channel, and one channel that will operate in the red light band or the NIR band depending on the operating mode. In this exemplary embodiment, the image data received by these six distinct channels can be used to produce white light and to provide a fluorescence image overlay.

[0043] As another illustrative example, the imaging device 104 can operate in an oxygenation / perfusion and simultaneous white light imaging mode. In this mode, the first light emitter 204, the second light emitter 208, and the fifth light emitter 220 can together produce white light, and the fifth light emitter 220 can produce discrete red light having a wavelength of 630 nm. Further, the third light emitter 212 can produce infrared light having a wavelength of approximately 940 nm. Since the fifth light emitter 220 generates red light having a wavelength of 630 nm and the third filter 232 blocks light having a wavelength greater than 650 nm, the light in the combined light output 244 can not include light having a wavelength greater than 650 nm other than the 940 nm infrared light. The light entering the prism assembly 137 can be directed towards the first image sensor 332 and the second image sensor 344 in the manner discussed above, and a true color white image can be generated based on the green and blue channels of the first image sensor 332 and the red, green, and blue channels of the second image sensor 344. Perfusion is determined by comparing the red channel data from the second image sensor 344 with the 940 nm signal captured by the infrared light channel in the first image sensor 332 using one or more algorithms known in the art. Based on this comparison, a perfusion image can be generated.

[0044] In another illustrative example, the imaging device 104 can operate in an anthocyanin-5 (Cy5) or Cy 5.5 fluorescence and simultaneous white light imaging mode. In this mode, the light source 112 can produce white light, where the red light is produced by a discrete red source and has a wavelength of 630 nm. Due to the position of the third filter 232, the combined light output 244 can not have light having a wavelength longer than 650 nm. The light reflected from the surgical scene can then be directed through the lens assembly 132 to the prism assembly 137. A white light image can be generated based on the green and blue channels of the first image sensor 332 and the red, blue, and green channels of the second image sensor 344. A fluorescence image can be generated based on the red light channel of the first image sensor 332.

[0045] In yet another illustrative example, the imaging device 104 can operate in a fluorescein fluorescence and simultaneous grayscale imaging mode. In this mode, the light source 112 can output combined light 244 having a combined spectral output that includes blue light and does not include wavelengths longer than 500 nm. In other words, there may be no green and red light in the combined light 244. In some alternative embodiments, the combined light output 244 can also include wavelengths longer than 650 nm (e.g., near-infrared or infrared light). Light reflected from the surgical scene can be received by the camera head 116, and a grayscale image can be created based on all color channels (e.g., blue, green, red, and infrared light channels) of the first image sensor 332. Additionally, the green and blue channels of the second image sensor 344 can be used to generate a fluorescein fluorescence image.

[0046] Figure 4 An alternative aspect of the camera head 116 is shown in accordance with at least one exemplary embodiment of the present disclosure. As Figure 3 an alternative to the dual-chip camera head shown in Figure 4 the camera head 116 shown in

[0047] Figure 4 the camera head 116 includes a lens assembly 132 and an imaging assembly 136, which includes a prism assembly 137. The lens assembly 132 can be similar or identical to the lens assembly 132 in Figure 3 In other words, the plurality of lenses 412A to 412N and the first filter 416 can be the same components as the plurality of lenses 312A to 312N and the first filter 316, respectively. In other embodiments, the lens assembly 132 can include additional or alternative components.

[0048] Figure 4 the imaging assembly 136 includes a first prism 420, a first spectral filter 424, a first image sensor 432, a second prism 440, a second image sensor 444, a third prism 456, and a third image sensor 460.

[0049] The camera head 116 can receive light 402 that has been generated, for example, by the light source 112 and then reflected from the surgical scene. The light 402 can pass through the lens assembly 132 and enter the first prism 420. The first prism 420 can include a first spectral filter 424 that reflects light with a wavelength less than 500 nm and transmits light with a wavelength greater than 500 nm. The light 428 can be reflected by the first spectral filter 424 and can propagate through the first prism 420 until the reflected light 428 is captured by the first image sensor 432. The light 436 that passes through the first spectral filter 424 can enter the second prism 440 and reach the second spectral filter 438. The second spectral filter 438 can reflect light with a wavelength greater than 650 nm while allowing light with a wavelength less than 650 nm to pass through it. The reflected light 448 (e.g., the light that does not pass through the second spectral filter 438) can propagate through the second prism 440 and be captured by the second image sensor 444. The transmitted light 452 can pass through the second spectral filter 438 and propagate through the third prism 456. The third image sensor 460 can capture the transmitted light 452.

[0050] The first image sensor 432, the second image sensor 444, and the third image sensor 460 can each include a CFA, such as a Bayer array. The reflected light 428 includes wavelengths less than 500 nm, and thus the color channels of the first image sensor 432 can be used to detect the wavelengths of light with wavelengths less than 500 nm. Similarly, since the reflected light 448 contains light with wavelengths greater than 650 nm, the color channels of the second image sensor 444 can be used to detect the wavelengths of light with wavelengths greater than 650 nm. In some embodiments, the second image sensor 444 can be a monochrome sensor (e.g., an image sensor without a CFA). The third image sensor 460 can be used to detect light with wavelengths between 500 nm and 650 nm.

[0051] In some embodiments, the first image sensor 432, the second image sensor 444, and / or the third image sensor 460 can be respectively attached (e.g., glued or adhered) to the first prism 420, the second prism 440, and the third prism 456. Alternatively, the first image sensor 432, the second image sensor 444, and / or the third image sensor 460 can not be respectively attached to the first prism 420, the second prism 440, and the third prism 456, but can instead be arranged to be close to the first prism 420, the second prism 440, and the third prism 456. In such embodiments, the positions of the first image sensor 432, the second image sensor 444, and / or the third image sensor 460 relative to the first prism 420, the second prism 440, and / or the third prism 456 can be adjusted or changed.

[0052] For illustrative purposes only, the following are examples of methods for performing various imaging modalities using the camera head 116 and other components of the system 100.

[0053] In the "white light imaging" modality, the light source 112 and the camera head 116 can enable imaging of the surgical scene using white light. The white light can be output from the first light emitter 204, or from a combination of green, blue, and red light, where the green, blue, and red light are output from the first light emitter 204, the second light emitter 208, and the fifth light emitter 220, respectively. In this case, the third light emitter 212 and the fourth light emitter 216 can be turned off or disabled so that the combined light output 244 contains only white light. In some embodiments, the first light emitter 204 can emit white light, while the second light emitter 208 and the fifth light emitter 220 can also emit blue and red light, respectively. In other words, all three of the first light emitter 204, the second light emitter 208, and the fifth light emitter 220 can emit light in the white light modality. Once the light is emitted from the light source 112, the light can be used to illuminate the surgical scene. It should be noted that throughout this specification, the light output 244 from the light source 112 can be directed to the surgical scene by any means known in the art, such as through a fiber optic bundle coupled to the light source 112 and a light tube within the endoscope, or by another means, such as being directed to an extended lens system through a fiber optic bundle to illuminate the scene of the external endoscope. The light reflected from the surgical scene can be transmitted into the camera head 116, and more specifically into the lens assembly 132. Then, the lens assembly 132 can condition the light and / or transmit the light into the prism assembly 137 of the imaging assembly 136. In this "white light imaging" modality, the first image sensor 432 can capture light with a wavelength below 500 nm, while the third image sensor 460 can capture light with a wavelength between 500 nm and 650 nm. The measurements from the first image sensor 432 and the third image sensor 460 can be processed by the processor 120 to generate a true color image. In some embodiments, the processor 120 can use one or more algorithms (e.g., image reconstruction algorithms, bilinear interpolation, gradient direction interpolation algorithms, etc.) to process the color channels on the first image sensor 432 and the third image sensor 460 to generate a true color image. In one embodiment, the green and blue channels of the first image sensor 432 (e.g., the channels that detect green and blue light, respectively) and the red, green, and blue channels of the third image sensor 460 can be used to reconstruct the true color image.

[0054] As another illustrative example, the imaging device 104 may operate in an indocyanine green (ICG) / OTL fluorescence and simultaneous white light imaging mode. In this fluorescence and white light imaging mode, white light may be generated similar to the white light mode discussed above, but the fourth light emitter 216 may also be enabled such that infrared light is included in the combined light output 244 of the light source 112. The combined light output 244 may then illuminate the surgical scene, and the light reflected from the surgical scene is captured by the camera head 116. In this case, the ICG / OTL fluorescence may be emitted from the fluorophore at an infrared light wavelength (e.g., higher than 800 nm) different from the infrared excitation light (e.g., about 770 nm) generated by the light source 112. However, the infrared light generated by the fourth light emitter 216 and collected by the camera head 116 may be blocked by the first filter 416 before reaching the prism assembly 137. A true color image may be created using the same color channels of the first image sensor 432 and the third image sensor 460, while the ICG / OTL fluorescence is detected by the second image sensor 444. The channel measurement results of the first image sensor 432, the second image sensor 444, and the third image sensor 460 may be sent to the processor 120, which may use one or more algorithms to generate an image of the surgical scene.

[0055] As another illustrative example, the imaging device 104 may operate in an oxygenation / perfusion and simultaneous white light imaging mode. In this mode, the first light emitter 204, the second light emitter 208, and the fifth light emitter 220 may be used to create white light, and the fifth light emitter 220 may generate discrete red light having a wavelength of 630 nm. Further, the third light emitter 212 may generate infrared light having a wavelength of about 940 nm. Since the fifth light emitter 220 generates red light having a wavelength of 630 nm and the third filter 232 blocks light having a wavelength greater than 650 nm, the light in the combined light output 244 may not have light having a wavelength greater than 650 nm, other than the 940 nm infrared light. The light entering the prism assembly 137 may be directed towards the first image sensor 432 and the third image sensor 460 in the manner discussed above, and a true color image may be generated based on the green and blue channels of the first image sensor 432 and the red, green, and blue channels of the second image sensor 460. Additionally, perfusion is determined by comparing the red channel data from the third image sensor 460 with the 940 nm signal captured by the second image sensor 444 using one or more algorithms. Based on this comparison, a perfusion image may be generated.

[0056] As another illustrative example, imaging device 104 can operate in an anthocyanin-5 (Cy5) or Cy 5.5 fluorescence and simultaneous white light imaging mode. In this mode, light source 112 can generate white light, where the red light is generated by a discrete red source and has a wavelength of 630 nm. Due to the position of the third filter 232, the combined light output 244 may not have light with a wavelength longer than 650 nm. Then, the light reflected from the surgical scene can pass through the lens assembly 132 and be directed to the prism assembly 137 of the image assembly 136. A white light image can be generated based on the green and blue channels of the first image sensor 432 and the red, blue, and green channels of the third image sensor 460. A fluorescence image can be generated based on the second image sensor 444.

[0057] As yet another illustrative example, imaging device 104 can operate in a fluorescein fluorescence and simultaneous grayscale imaging mode. In this mode, light source 112 can output a combined light output 244 that includes blue light and does not include wavelengths longer than 500 nm. In other words, there may be no green and red light in the combined light 244. In some alternative embodiments, the combined light output 244 may also include wavelengths longer than 650 nm (e.g., near-infrared light or infrared light). The light reflected from the surgical scene can be received by the camera head 116, and a grayscale image can be created based on all the color channels of the second image sensor 444 (e.g., blue, green, red, and infrared light channels) in combination with the green and blue channels of the first image sensor 432. Additionally, the green and blue channels of the third image sensor 460 can be used to generate a fluorescein fluorescence image.

[0058] Figure 5 Method 500 according to at least one exemplary embodiment of the present disclosure is shown. Method 500 can be used, for example, to select and generate one or more images for a selected image modality.

[0059] Method 500 begins and then proceeds to step 504, in which an imaging mode is selected. The imaging mode can be a white light imaging mode, an ICG / OTL fluorescence mode, an oxygenation / perfusion mode, a Cy5 / Cy 5.5 fluorescence mode, a fluorescein fluorescence mode, etc. The mode can be selected based on a physician input (e.g., the physician selects the mode by pressing a virtual button on the screen presented on the display 148).

[0060] Then, method 500 proceeds to step 508, which generates a light source based on the selected imaging mode to illuminate the surgical scene. The light source can be similar to or the same as light source 112. Controller 108 can determine, based on the physician input and by using instructions and / or algorithms 128, one or more light emitters that should be enabled to produce the desired illumination. For example, in the white light mode, controller 108 can determine that the first light emitter 204, the second light emitter 208, and the fifth light emitter 220 should be enabled such that red, blue, and green light are generated, and also determine that the third light emitter 212 and the fourth light emitter 216 should not be enabled. In another example, in the oxygenation / perfusion mode, controller 108 can determine that the first light emitter 204, the second light emitter 208, and the fifth light emitter 220 should be enabled and also that the third light emitter 212 (which produces infrared light at 940 nm) should be enabled. Once the light emitters are enabled or disabled, controller 108 can cause the light emitters to emit light such that light source 112 illuminates the surgical scene with the light required by the imaging mode.

[0061] Then, method 500 proceeds to step 512, in which light is reflected and / or fluoresces from the surgical scene and is captured at the camera head (such as camera head 116). Method 500 then proceeds to step 516, in which the reflected light and / or fluorescence passes through one or more optical components (such as lens assembly 132) and enters the prism assembly 137 of the imaging assembly 136. The light can be split by one or more beam splitters (such as a beam splitting prism that can include a selective spectral filter), where the transmitted light and the reflected light are passed to different image sensors. In some embodiments, imaging assembly 136 can include a first image sensor 332 and a second image sensor 344, while in other embodiments, image assembly 136 can include a first image sensor 432, a second image sensor 444, and a third image sensor 460.

[0062] Method 500 then proceeds to step 520, in which one or more images are generated based on the measurements from the one or more image sensors. The number and type of images are based on the current imaging mode of the camera head. For example, during the white light mode, true color images can be generated based on the color channels of the one or more image sensors. As another example, and when the camera head is in the ICG mode, ICG fluorescence images can be generated based on the detected infrared light. The number and type of the generated images are not limited, and any images discussed herein can be generated at step 520. Controller 108 can be used with instructions 128 to access and implement one or more image processing algorithms to transform the data received from the one or more image sensors into corresponding images.

[0063] Method 500 then proceeds to step 524, in which the one or more images are presented to a display. The display can be similar to or the same as display 148. In some embodiments, the one or more images can be captured in the form of a video, such as when the camera head continuously receives light and continuously generates images based on sensor measurements. Then, method 500 ends. In some embodiments, method 500 can then be repeated during a surgical operation or procedure as different imaging modalities are used.

[0064] Any of the steps, functions, and operations discussed herein can be performed continuously and automatically.

[0065] Although the exemplary embodiments shown herein illustrate the arrangement of various components of the system, certain components of the system can be located remotely at a distant portion of a distributed network (such as a LAN and / or the Internet), or within a dedicated system. Thus, it should be understood that the components of the system can be combined into one or more devices, such as servers, communication devices, or collocated at specific nodes of a distributed network (such as an analog and / or digital telecommunications network, a packet-switched network, or a circuit-switched network). From the foregoing description and for reasons of computational efficiency, it will be understood that the components of the system can be arranged anywhere within the distributed component network without affecting the operation of the system.

[0066] In addition, it should be understood that the various links connecting these elements can be wired or wireless links, or any combination thereof, or any other known or later-developed element capable of supplying data to and / or transmitting data with the connected elements. These wired or wireless links can also be secure links and may be capable of transmitting encrypted information. For example, the transmission medium used as a link can be any suitable carrier of an electrical signal, including coaxial cables, copper wires, and optical fibers, and can take the form of acoustic or light waves (such as those generated during radio wave and infrared data communication).

[0067] Although the flowcharts have been discussed and shown with respect to a particular sequence of events, it should be understood that the sequence can be changed, added to, and omitted without significantly affecting the operation of the disclosed embodiments, configurations, and aspects.

[0068] Many variations and modifications of the present disclosure can be used. Some features of the present disclosure can be provided without providing other features.

[0069] In yet another embodiment, the systems and methods of the present disclosure may be implemented in conjunction with: a dedicated computer, a programmed microprocessor or microcontroller and one or more peripheral integrated circuit elements, an ASIC or other integrated circuit, a digital signal processor, hard-wired electronic circuitry or logic circuitry such as discrete element circuitry, a programmable logic device or gate array such as a PLD, PLA, FPGA, PAL, a dedicated computer, any similar device, etc. Generally, any one or more devices or apparatuses capable of implementing the methods shown herein may be used to implement various aspects of the present disclosure. Exemplary hardware that may be used for the present disclosure includes computers, handheld devices, telephones (e.g., cellular, Internet-enabled, digital, analog, hybrid, and others), and other hardware known in the art. Some of these devices include a processor (e.g., a single or multiple microprocessors), a memory, non-volatile memory, an input device, and an output device. Additionally, alternative software implementations (including but not limited to distributed processing or component / object distributed processing, parallel processing, or virtual machine processing) may be constructed to implement the methods described herein.

[0070] In yet another embodiment, the disclosed method may be readily implemented in conjunction with software for using an object or software using an object-oriented software development environment that provides portable source code that may be used on various computer or workstation platforms. Alternatively, the disclosed system may be implemented in part or in whole in hardware using standard logic circuitry or VLSI design. Whether to implement the system according to the present disclosure using software or hardware depends on the speed and / or efficiency requirements of the system, the particular functions, and the particular software or hardware system or microprocessor or microprocessor system utilized.

[0071] In yet another embodiment, the disclosed method may be implemented in part in software that may be stored on a storage medium and executed on a programmed general-purpose computer in cooperation with a controller and memory, a dedicated computer, a microprocessor, etc. In these cases, the systems and methods of the present disclosure may be implemented as a program embedded on a personal computer, such as an applet, or a CGI script, etc., implemented as a resource resident on a server or computer workstation, implemented as a routine embedded in a dedicated measurement system, system component, etc. The system may also be implemented by physically integrating the system and / or method into a software and / or hardware system.

[0072] Although the present disclosure describes components and functions implemented in embodiments with reference to specific standards and protocols, the present disclosure is not limited to such standards and protocols. Other similar standards and protocols that are not mentioned herein exist and are considered to be included in the present disclosure. In addition, the standards and protocols mentioned herein and other similar standards and protocols not mentioned herein are periodically replaced by faster or more efficient equivalents having substantially the same function. Such replacement standards and protocols having the same function are considered to be equivalents included in the present disclosure.

[0073] The present disclosure includes, in various embodiments, configurations, and aspects, components, methods, processes, systems, and / or devices that are substantially as depicted and described herein, including their various embodiments, sub-combinations, and subsets. Those skilled in the art will understand how to make and use the systems and methods disclosed herein after understanding the present disclosure. The present disclosure includes, in various embodiments, configurations, and aspects, providing devices and processes in the absence of matters not depicted and / or described herein or their various embodiments, configurations, or aspects (including in the absence of such matters that may have been used in prior devices or processes), for example, to improve performance, achieve simplicity, and / or reduce implementation costs.

[0074] The foregoing discussion of the present disclosure has been presented for purposes of illustration and description. The foregoing is not intended to limit the present disclosure to one or more forms disclosed herein. For example, in the foregoing detailed description, for purposes of streamlining the present disclosure, different features of the present disclosure are combined in one or more embodiments, configurations, or aspects. The features of the embodiments, configurations, or aspects of the present disclosure may be combined in alternative embodiments, configurations, or aspects other than those discussed above. Such a disclosure method should not be construed as reflecting an intention that the claimed present disclosure requires more features than are expressly recited in each claim. Rather, as reflected in the following claims, the inventive aspects rely on less than all of the features of a single foregoing disclosed embodiment, configuration, or aspect. Accordingly, the following claims are hereby incorporated into this detailed description, where each claim stands on its own as a separate preferred embodiment of the present disclosure.

[0075] Moreover, although the description of the present disclosure has included a description of one or more embodiments, configurations, or aspects, as well as certain variations and modifications, other variations, combinations, and modifications are within the scope of the present disclosure, such as may be within the skill and knowledge of those skilled in the art after understanding the present disclosure. It is intended to obtain rights to include alternative embodiments, configurations, or aspects within the allowable scope, including alternative, interchangeable, and / or equivalent structures, functions, scopes, or steps of those claimed to be included, whether or not such alternative, interchangeable, and / or equivalent structures, functions, scopes, or steps are disclosed herein, and it is not intended to publicly dedicate any patentable subject matter.

[0076] Example aspects of the present disclosure include:

[0077] An endoscope or exoscope imaging device according to at least one embodiment of the present disclosure includes: an optical component that includes a spectral filter that separates input light into two different spectrally distinct portions of output light; a first image sensor having a first color filter array (CFA) that is configured to detect at least three spectrally distinct spectral channels; and a second image sensor having a second CFA that is configured to detect at least three spectrally distinct spectral channels; wherein the output light, in combination with the first CFA and the second CFA, results in at least six spectrally distinct spectral channels.

[0078] Any aspect herein, wherein the at least three spectrally distinct spectral channels are configured to detect at least four spectrally distinct spectral channels.

[0079] Any aspect herein, wherein the at least four spectrally distinct spectral channels of the first image sensor include a red light channel, a green light channel, a blue light channel, and an infrared light channel.

[0080] Any aspect herein, wherein the second at least three spectrally distinct spectral channels of the second image sensor include a red light channel, a green light channel, and a blue light channel.

[0081] Any aspect herein, wherein the spectral filter in the optical component provides a transmission cutoff between spectral bands.

[0082] Any aspect herein, wherein the transmission cutoff between spectral bands includes: the spectral filter reflects light having wavelengths between 500 nanometers (nm) and 650 nm and transmits light having wavelengths longer than 650 nm and shorter than 500 nm.

[0083] In any aspect herein, the transmission cutoff between the spectral bands includes: the spectral filter transmits light with wavelengths between 500 nanometers (nm) and 650 nm and reflects light with wavelengths longer than 650 nm and light with wavelengths shorter than 500 nm.

[0084] In any aspect herein, it further includes: a second filter configured to block a wavelength band corresponding to a fluorescence excitation signal.

[0085] In any aspect herein, the second filter blocks a spectral band from about 700 nanometers (nm) to about 800 nm.

[0086] In any aspect herein, the output light with wavelengths shorter than about 500 nanometers (nm) is directed towards the first image sensor.

[0087] In any aspect herein, the output light with wavelengths longer than about 500 nm and shorter than about 650 nm is directed to the second image sensor.

[0088] In any aspect herein, the output light with wavelengths longer than about 650 nm is directed towards the first image sensor.

[0089] In any aspect herein, it further includes: an illumination device that illuminates the scene to be imaged with a first spectral content.

[0090] In any aspect herein, the illumination device is not stroboscopic.

[0091] In any aspect herein, the illumination device provides white light with wavelengths between about 450 nm and about 650 nm, and a white light image is created from the blue and green channels of the first image sensor and the blue, green, and red channels of the second image sensor.

[0092] In any aspect herein, the illumination device generates ICG or OTL excitation illumination at wavelengths between about 725 nm and 800 nm, and an ICG or OTL fluorescence image is imaged onto the first image sensor.

[0093] In any aspect herein, the illumination device generates illumination including a red spectral band centered at about 630 nm and an infrared spectral band centered at about 940 nm, and an oxygenation or perfusion image is created based on calculations from the red channel of the second image sensor and the IR channel on the first image sensor.

[0094] Any aspect herein, wherein the illumination device produces illumination including a red spectral band centered at about 630 nm, and wherein a Cy5 or Cy5.5 fluorescence image is imaged onto the first image sensor.

[0095] Any aspect herein, wherein the illumination device produces illumination including a blue spectral band having a wavelength between 450 nm and 500 nm that provides fluorescein excitation illumination, wherein a fluorescein fluorescence image is imaged onto the second image sensor, and wherein a grayscale image is created from the fluorescein excitation illumination and the grayscale image is imaged onto the first image sensor.

[0096] Any aspect herein, wherein output light having a wavelength longer than about 650 nanometers (nm) is directed toward the first image sensor.

[0097] Any aspect herein, wherein output light having a wavelength longer than about 500 nanometers (nm) and shorter than about 650 nm is directed to the second image sensor.

[0098] An endoscope or exoscope imaging system according to at least one embodiment of the present disclosure includes: a processor; and a memory storing instructions that, when processed by the processor, cause the processor to: detect at least three spectrally distinct spectral channels through a first image sensor; and detect at least three spectrally distinct spectral channels through a second image sensor, wherein the output light and the combination of the first image sensor and the second image sensor result in at least six spectrally distinct spectral channels.

[0099] Any aspect herein, wherein the at least three spectrally distinct spectral channels of the first are configured to detect at least four spectrally distinct spectral channels.

[0100] Any aspect herein, wherein the at least four spectrally distinct spectral channels include a red channel, a green channel, a blue channel, and an infrared channel.

[0101] Any aspect herein, wherein the at least three spectrally distinct spectral channels of the second image sensor include a red channel, a green channel, and a blue channel.

[0102] Any aspect herein, wherein a spectral filter in the optical components provides a transmission cutoff between spectral bands.

[0103] Any aspect herein, wherein the transmission cutoff between the spectral bands includes: the spectral filter reflects light having a wavelength between 500 nanometers (nm) and 650 nm and transmits light having a wavelength longer than 650 nm and light having a wavelength shorter than 500 nm.

[0104] In any aspect herein, the transmission cut-off between the spectral bands includes: the spectral filter transmits light with wavelengths between 500 nanometers (nm) and 650 nm and reflects light with wavelengths longer than 650 nm and light with wavelengths shorter than 500 nm.

[0105] In any aspect herein, it further includes: a second filter, which is configured to block a wavelength band corresponding to a fluorescence excitation signal.

[0106] In any aspect herein, the second filter blocks a spectral band of approximately 700 nanometers (nm) to approximately 800 nm.

[0107] In any aspect herein, the output light with wavelengths shorter than approximately 500 nanometers (nm) is directed towards the first image sensor.

[0108] In any aspect herein, the output light with wavelengths longer than approximately 500 nm and shorter than approximately 650 nm is directed to the second image sensor.

[0109] In any aspect herein, the output light with wavelengths longer than approximately 650 nm is directed towards the first image sensor.

[0110] In any aspect herein, it further includes: an illumination device, which illuminates the scene to be imaged with a first spectral content.

[0111] In any aspect herein, the illumination device is not stroboscopic.

[0112] In any aspect herein, the illumination device provides white light with wavelengths between approximately 450 nm and approximately 650 nm, and a white light image is created from the blue channel and green channel of the first image sensor and the blue channel, green channel, and red channel of the second image sensor.

[0113] In any aspect herein, the illumination device generates ICG or OTL excitation illumination with wavelengths between approximately 725 nm and 800 nm, and an ICG or OTL fluorescence image is imaged onto the first image sensor.

[0114] In any aspect herein, the illumination device generates illumination including a red light spectral band centered at approximately 630 nm and an infrared spectral band centered at approximately 940 nm, and an oxygenation or perfusion image is created based on calculations from the red channel of the second image sensor and the IR channel on the first image sensor.

[0115] Any aspect herein, wherein the illumination device produces illumination comprising a red spectral band centered at about 630 nm, and wherein a Cy5 or Cy5.5 fluorescence image is imaged onto the first image sensor.

[0116] Any aspect herein, wherein the illumination device produces illumination comprising a blue spectral band having wavelengths between 450 nm and 500 nm that provides fluorescein excitation illumination, wherein a fluorescein fluorescence image is imaged onto the second image sensor, and wherein a grayscale image is created from the fluorescein excitation illumination and the grayscale image is imaged onto the first image sensor.

[0117] Any aspect herein, wherein output light having a wavelength longer than about 650 nanometers (nm) is directed toward the first image sensor.

[0118] Any aspect herein, wherein output light having a wavelength longer than about 500 nanometers (nm) and shorter than about 650 nm is directed to the second image sensor.

[0119] A method for operating an endoscope or an exoscope imaging device according to at least one embodiment of the present disclosure includes: separating input light into two different spectrally distinct portions of output light using an optical component including a spectral filter; using a first image sensor having a first color filter array (CFA) to detect a first at least three spectrally distinct spectral channels; and using a second image sensor having a second CFA to detect a second at least three spectrally distinct spectral channels, wherein the output light combined with the first CFA and the second CFA results in at least six spectrally distinct spectral channels.

[0120] Any aspect herein, wherein the first at least three spectrally distinct spectral channels are configured to detect at least four spectrally distinct spectral channels.

[0121] Any aspect herein, wherein the at least four spectrally distinct spectral channels of the first image sensor include a red channel, a green channel, a blue channel, and an infrared channel.

[0122] Any aspect herein, wherein the second at least three spectrally distinct spectral channels of the second image sensor include a red channel, a green channel, and a blue channel.

[0123] Any aspect herein, wherein the spectral filter in the optical component provides a transmission cutoff between spectral bands.

[0124] In any aspect herein, the transmission cutoff between the spectral bands includes: the spectral filter reflects light with wavelengths between 500 nanometers (nm) and 650 nm and transmits light with wavelengths longer than 650 nm and shorter than 500 nm.

[0125] In any aspect herein, the transmission cutoff between the spectral bands includes: the spectral filter transmits light with wavelengths between 500 nanometers (nm) and 650 nm and reflects light with wavelengths longer than 650 nm and shorter than 500 nm.

[0126] In any aspect herein, it further includes: using a second filter to block the wavelength band corresponding to the fluorescence excitation signal.

[0127] In any aspect herein, the second filter blocks the spectral band from approximately 700 nanometers (nm) to approximately 800 nm.

[0128] In any aspect herein, the output light with wavelengths shorter than approximately 500 nanometers (nm) is directed towards the first image sensor.

[0129] In any aspect herein, the output light with wavelengths longer than approximately 500 nm and shorter than approximately 650 nm is directed to the second image sensor.

[0130] In any aspect herein, the output light with wavelengths longer than approximately 650 nm is directed towards the first image sensor.

[0131] In any aspect herein, it further includes: using an illumination device to illuminate the scene to be imaged with a first spectral content.

[0132] In any aspect herein, the illumination device is not stroboscopic.

[0133] In any aspect herein, the illumination device provides white light with wavelengths between approximately 450 nm and approximately 650 nm, and a white light image is created from the blue and green channels of the first image sensor and the blue, green, and red channels of the second image sensor.

[0134] In any aspect herein, ICG or OTL excitation illumination is generated by the illumination device at wavelengths between approximately 725 nm and 800 nm, and an ICG or OTL fluorescence image is imaged onto the first image sensor.

[0135] Any aspect herein, wherein the illumination device produces illumination including a red spectral band centered at about 630 nm and an infrared spectral band centered at about 940 nm, and wherein an oxygenation or perfusion image is created based on a calculation from the red channel of the second image sensor and the IR channel on the first image sensor.

[0136] Any aspect herein, wherein the illumination device produces illumination including a red spectral band centered at about 630 nm, and wherein a Cy5 or Cy5.5 fluorescence image is imaged onto the first image sensor.

[0137] Any aspect herein, wherein the illumination device produces illumination including a blue spectral band having a wavelength between 450 nm and 500 nm that provides fluorescein excitation illumination, wherein a fluorescein fluorescence image is imaged onto the second image sensor, and wherein a grayscale image is created from the fluorescein excitation illumination and the grayscale image is imaged onto the first image sensor.

[0138] Any aspect herein, wherein output light having a wavelength longer than about 650 nanometers (nm) is directed toward the first image sensor.

[0139] Any aspect herein, wherein output light having a wavelength longer than about 500 nm and shorter than about 650 nm is directed to the second image sensor.

[0140] An endoscope or exoscope imaging system according to at least one embodiment of the present disclosure includes: means for separating input light into two different spectrally distinct portions of output light; means for detecting a first set of at least three spectrally distinct spectral channels; and means for detecting a second set of at least three spectrally distinct spectral channels, wherein the output light, in combination with the means for detecting the first set of at least three spectrally distinct spectral channels and the means for detecting the second set of at least three spectrally distinct spectral channels, results in at least six spectrally distinct spectral channels.

[0141] An endoscope or exoscope imaging device according to at least one embodiment of the present disclosure includes: an optical component including at least two spectral filters that separate input light into three different spectrally distinct portions of output light; a first image sensor having a first color filter array (CFA) configured to detect a first set of at least three spectrally distinct spectral channels; a second image sensor having a second CFA configured to detect a second set of at least three spectrally distinct spectral channels; and a third image sensor, wherein the first set and the second set of at least three spectrally distinct spectral channels are different from the three different spectrally distinct portions of the output light.

[0142] In any aspect herein, the first set of at least three spectrally distinct spectral channels and the second set of at least three spectrally distinct spectral channels each include a red channel, a green channel, and a blue channel.

[0143] In any aspect herein, the first CFA and the second CFA are arranged in a Bayer pattern.

[0144] In any aspect herein, the first spectral filter of the at least two spectral filters provides a first transmission cut-off between spectral bands, and wherein the second spectral filter of the at least two spectral filters provides a second transmission cut-off between spectral bands.

[0145] In any aspect herein, the first transmission cut-off includes reflecting light with a wavelength shorter than 500 nanometers (nm) and transmitting light with a wavelength longer than 500 nm.

[0146] In any aspect herein, the second transmission cut-off includes reflecting light with a wavelength longer than 650 nanometers (nm) and transmitting light with a wavelength shorter than 650 nm.

[0147] In any aspect herein, a third filter is configured to block a wavelength band corresponding to a fluorescence excitation signal.

[0148] In any aspect herein, the third filter blocks a spectral band from about 700 nanometers (nm) to about 800 nm.

[0149] In any aspect herein, output light with a wavelength shorter than about 500 nanometers (nm) is directed towards the first image sensor.

[0150] In any aspect herein, output light with a wavelength longer than about 500 nm and shorter than about 650 nm is directed to the second image sensor.

[0151] In any aspect herein, output light with a wavelength longer than about 650 nm is directed towards the third image sensor.

[0152] In any aspect herein, it further includes: an illumination device that illuminates a scene to be imaged with a first spectral content.

[0153] In any aspect herein, the illumination device is not stroboscopic.

[0154] In any aspect herein, the illumination device provides white light with a wavelength between about 450 nm and about 650 nm, and wherein a white light image is created from the blue channel and the green channel of the first image sensor and the blue channel, the green channel, and the red channel of the second image sensor.

[0155] Any aspect herein, wherein the illumination device generates ICG or OTL excitation illumination at a wavelength between about 725 nm and 800 nm, and wherein the ICG or OTL fluorescence image is imaged onto the third image sensor.

[0156] Any aspect herein, wherein the illumination device generates illumination including a red light spectral band centered at about 630 nm and an infrared light spectral band centered at about 940 nm, and wherein an oxygenation or perfusion image is created based on calculations of the red light channel from the second image sensor and the image on the third image sensor.

[0157] Any aspect herein, wherein the illumination device generates illumination including a red light spectral band centered at about 630 nm, and wherein a Cy5 or Cy5.5 fluorescence image is imaged onto the third image sensor.

[0158] Any aspect herein, wherein the illumination device generates illumination including a blue light spectral band at a wavelength between 450 nm and 500 nm that provides fluorescein excitation illumination, wherein the fluorescein fluorescence image is imaged onto the second image sensor, and wherein a grayscale image is created from the fluorescein excitation illumination and the grayscale image is imaged onto the first image sensor.

[0159] Any aspect herein, wherein the illumination further includes an infrared spectral component that is imaged onto the third image sensor.

[0160] An endoscope or exoscope imaging system according to at least one embodiment of the present disclosure includes: an optical component including at least two spectral filters that separate input light into three spectrally distinct portions of output light; a processor; and a memory storing instructions that, when processed by the processor, cause the processor to: detect a first set of at least three spectrally distinct spectral channels via a first image sensor having a first color filter array (CFA); detect a second set of at least three spectrally distinct spectral channels via a second image sensor having a second CFA, wherein the first set and the second set of at least three spectrally distinct spectral channels are different from the three different spectrally distinct portions of the output light; and a third image sensor.

[0161] Any aspect herein, wherein the first set of at least three spectrally distinct spectral channels and the second set of at least three spectrally distinct spectral channels each include a red light channel, a green light channel, and a blue light channel.

[0162] Any aspect herein, wherein the first CFA and the second CFA are arranged in a Bayer pattern.

[0163] Any aspect herein, wherein a first spectral filter of the at least two spectral filters provides a first transmission cut-off between spectral bands, and wherein a second spectral filter of the at least two spectral filters provides a second transmission cut-off between spectral bands.

[0164] Any aspect herein, wherein the first transmission cut-off includes reflecting light with a wavelength shorter than 500 nanometers (nm) and transmitting light with a wavelength longer than 500 nm.

[0165] Any aspect herein, wherein the second transmission cut-off includes reflecting light with a wavelength longer than 650 nanometers (nm) and transmitting light with a wavelength shorter than 650 nm.

[0166] Any aspect herein, wherein a third filter is configured to block a wavelength band corresponding to a fluorescence excitation signal.

[0167] Any aspect herein, wherein the third filter blocks a spectral band from about 700 nanometers (nm) to about 800 nm.

[0168] Any aspect herein, wherein output light with a wavelength shorter than about 500 nanometers (nm) is directed towards the first image sensor.

[0169] Any aspect herein, wherein output light with a wavelength longer than about 500 nm and shorter than about 650 nm is directed to the second image sensor.

[0170] Any aspect herein, wherein output light with a wavelength longer than about 650 nm is directed towards the third image sensor.

[0171] Any aspect herein, further comprising: an illumination device that illuminates a scene to be imaged with a first spectral content.

[0172] Any aspect herein, wherein the illumination device is not stroboscopic.

[0173] Any aspect herein, wherein the illumination device provides white light with a wavelength between about 450 nm and about 650 nm, and wherein a white light image is created from the blue and green channels of the first image sensor and the blue, green, and red channels of the second image sensor.

[0174] Any aspect herein, wherein ICG or OTL excitation illumination is generated by the illumination device at a wavelength between about 725 nm and 800 nm, and wherein an ICG or OTL fluorescence image is imaged onto the third image sensor.

[0175] Any aspect herein, wherein the illumination device produces illumination including a red spectral band centered at about 630 nm and an infrared spectral band centered at about 940 nm, and wherein an oxygenation or perfusion image is created based on a calculation of the red channel from the second image sensor and an image on the third image sensor.

[0176] Any aspect herein, wherein the illumination device produces illumination including a red spectral band centered at about 630 nm, and wherein a Cy5 or Cy5.5 fluorescence image is imaged onto the third image sensor.

[0177] Any aspect herein, wherein the illumination device produces illumination including a blue spectral band having a wavelength between 450 nm and 500 nm that provides fluorescein excitation illumination, wherein a fluorescein fluorescence image is imaged onto the second image sensor, and wherein a grayscale image is created from the fluorescein excitation illumination and the grayscale image is imaged onto the first image sensor.

[0178] Any aspect herein, wherein the illumination further includes an infrared spectral component that is imaged onto the third image sensor.

[0179] A method for operating an endoscope or an endoscopic imaging device according to at least one embodiment of the present disclosure includes: separating input light into three different spectrally distinct portions of output light using an optical component including at least two spectral filters; detecting a first set of at least three spectrally distinct spectral channels by a first image sensor having a first color filter array (CFA); and detecting a second set of at least three spectrally distinct spectral channels by a second image sensor having a second CFA, wherein the first set and the second set of at least three spectrally distinct spectral channels are different from the three different spectrally distinct portions of the output light.

[0180] Any aspect herein, wherein the first set of at least three spectrally distinct spectral channels and the second set of at least three spectrally distinct spectral channels each include a red channel, a green channel, and a blue channel.

[0181] Any aspect herein, wherein the first CFA and the second CFA are arranged in a Bayer pattern.

[0182] Any aspect herein, wherein a first spectral filter of the at least two spectral filters provides a first transmission cutoff between spectral bands, and wherein a second spectral filter of the at least two spectral filters provides a second transmission cutoff between spectral bands.

[0183] Any aspect herein, wherein the first transmission cutoff includes reflecting light having a wavelength shorter than 500 nanometers (nm) and transmitting light having a wavelength longer than 500 nm.

[0184] Any aspect herein, wherein the second transmission cut-off includes light with a reflection wavelength longer than 650 nanometers (nm) and light with a transmission wavelength shorter than 650 nm.

[0185] Any aspect herein, wherein the third filter is configured to block a wavelength band corresponding to a fluorescence excitation signal.

[0186] Any aspect herein, wherein the third filter blocks a spectral band from about 700 nanometers (nm) to about 800 nm.

[0187] Any aspect herein, wherein the output light with a wavelength shorter than about 500 nanometers (nm) is directed towards the first image sensor.

[0188] Any aspect herein, wherein the output light with a wavelength longer than about 500 nm and shorter than about 650 nm is directed to the second image sensor.

[0189] Any aspect herein, wherein the output light with a wavelength longer than about 650 nm is directed towards a third image sensor.

[0190] Any aspect herein, further comprising: illuminating a scene to be imaged with a lighting device having a first spectral content.

[0191] Any aspect herein, wherein the lighting device is not stroboscopic.

[0192] Any aspect herein, wherein the lighting device provides white light having a wavelength between about 450 nm and about 650 nm, and wherein a white light image is created from the blue and green channels of the first image sensor and the blue, green, and red channels of the second image sensor.

[0193] Any aspect herein, wherein the lighting device generates ICG or OTL excitation illumination at a wavelength between about 725 nm and 800 nm, and wherein an ICG or OTL fluorescence image is imaged onto the third image sensor.

[0194] Any aspect herein, wherein the lighting device generates illumination including a red light spectral band centered at about 630 nm and an infrared spectral band centered at about 940 nm, and wherein an oxygenation or perfusion image is created based on calculations from the red channel of the second image sensor and the image on the third image sensor.

[0195] Any aspect herein, wherein the lighting device generates illumination including a red light spectral band centered at about 630 nm, and wherein a Cy5 or Cy5.5 fluorescence image is imaged onto the third image sensor.

[0196] Any aspect herein, wherein the illumination device produces illumination including a blue light spectral band having a wavelength between 450 nm and 500 nm that provides fluorescein excitation illumination, wherein a fluorescein fluorescence image is imaged onto the second image sensor, and wherein a grayscale image is created from the fluorescein excitation illumination and the grayscale image is imaged onto the first image sensor.

[0197] Any aspect herein, wherein the illumination further includes an infrared spectral component that is imaged onto a third image sensor.

[0198] An endoscope or exoscope imaging system according to at least one embodiment of the present disclosure includes: means for separating input light into three different spectrally distinct portions of output light; means for detecting a first set of at least three spectrally distinct spectral channels; and means for detecting a second set of at least three spectrally distinct spectral channels, wherein the first set and the second set of at least three spectrally distinct spectral channels are different from the three different spectrally distinct portions of the output light.

[0199] Any aspect herein, wherein the means for separating input light into three different spectrally distinct portions of output light includes at least two spectral filters, wherein the means for detecting a first set of at least three spectrally distinct spectral channels includes a first image sensor having a first color filter array (CFA), and wherein the means for detecting a second set of at least three spectrally distinct spectral channels includes a second image sensor having a second CFA.

[0200] A system according to at least one embodiment of the present disclosure includes: an illumination device that illuminates a scene to be imaged with a first spectral content, the illumination device including: a first light emitter capable of outputting visible light; and a second light emitter capable of outputting infrared light; an optical component that includes at least two spectral filters that receive input light reflected from the scene and separate the input light into three different spectrally distinct portions of output light; a first image sensor having a first color filter array (CFA) that is configured to detect a first set of at least three spectrally distinct spectral channels; a second image sensor having a second CFA that is configured to detect a second set of at least three spectrally distinct spectral channels; and a third image sensor, wherein the first set and the second set of at least three spectrally distinct spectral channels are different from the three different spectrally distinct portions of the output light.

[0201] A combination of any aspect with any one or more other aspects.

[0202] Any one or more of the features disclosed herein.

[0203] Any one or more of the features substantially disclosed herein.

[0204] A combination of any one or more of the features substantially disclosed herein and any one or more other features substantially disclosed herein.

[0205] A combination of any one of these aspects / features / embodiments with any one or more other aspects / features / embodiments.

[0206] The use of any one or more of the aspects or features disclosed herein.

[0207] It should be understood that any feature described herein can be claimed in combination with any other feature described herein, regardless of whether these features are from the same embodiment described.

[0208] The phrases "at least one", "one or more", "or", and "and / or" are open-ended expressions, and these phrases are both combinative and disjunctive in operation. For example, each of the expressions "at least one of A, B, and C", "at least one of A, B, or C", "one or more of A, B, and C", "one or more of A, B, or C", "A, B, and / or C", and "A, B, or C" means A alone, B alone, C alone, A and B together, A and C together, B and C together, or A, B, and C together.

[0209] The term "a" or "an" entity refers to one or more of that entity. Thus, the terms "a" (or "an"), "one or more", and "at least one" may be used interchangeably herein. It should also be noted that the terms "comprising", "including", and "having" may be used interchangeably.

[0210] As used herein, the term "automatically" and its variants refer to any process or operation that is completed without significant human input during its execution or operation, and such process or operation is typically continuous or semi-continuous. However, even if the execution of a process or operation uses significant or insignificant human input, the process or operation may still be automatic if the input is received prior to the execution of the process or operation. Human input is considered significant if it affects how the process or operation will be executed. Human input that merely consents to the execution of a process or operation is not considered "significant".

[0211] Aspects of the present disclosure may take the form of an embodiment that is entirely hardware, an embodiment that is entirely software (including firmware, resident software, microcode, etc.), or an embodiment that combines software and hardware aspects (generally may be referred to herein as "circuitry", "module", or "system"). Any combination of one or more computer-readable media may be used. The computer-readable media may be a computer-readable signal medium or a computer-readable storage medium.

[0212] A computer-readable storage medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer-readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0213] A computer-readable signal medium may include a propagated data signal in which the computer-readable program code is embedded, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including but not limited to electromagnetic, optical, or any suitable combination thereof. A computer-readable signal medium may be any computer-readable medium that is not a computer-readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. The program code embedded on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

[0214] As used herein, the terms "determine", "calculate", "operate" and variations thereof may be used interchangeably and include any type of method, process, mathematical operation, or technique.

Claims

1. An endoscope or external endoscope imaging device, comprising: An optical component, the optical component including a spectral filter that separates input light into two different spectrally distinct portions of output light; A first image sensor having a first color filter array (CFA), the first image sensor being configured to detect at least three spectrally distinct spectral channels; And A second image sensor having a second CFA, the second image sensor being configured to detect at least three spectrally distinct spectral channels; Wherein, the output light and the combination of the first CFA and the second CFA result in at least six spectrally distinct spectral channels.

2. The imaging device according to claim 1, wherein, The at least three spectrally distinct spectral channels are configured to detect at least four spectrally distinct spectral channels.

3. The imaging device according to claim 2, wherein, The at least four spectrally distinct spectral channels of the first image sensor include a red light channel, a green light channel, a blue light channel, and an infrared light channel.

4. The imaging device according to claim 2, wherein, The second at least three spectrally distinct spectral channels of the second image sensor include a red light channel, a green light channel, and a blue light channel.

5. The imaging device according to claim 1, wherein, The spectral filter in the optical component provides a transmission cutoff between spectral bands.

6. The imaging device according to claim 1, further comprising: A second filter, the second filter being configured to block a wavelength band corresponding to a fluorescence excitation signal.

7. The imaging device according to claim 1, further comprising: An illumination device that illuminates a scene to be imaged with a first spectral content.

8. The imaging device according to claim 7, wherein, The illumination device provides white light having a wavelength between about 450 nm and about 650 nm, and wherein, a white light image is created from the blue light channel and the green light channel of the first image sensor and the blue light channel, the green light channel, and the red light channel of the second image sensor.

9. The imaging device according to claim 1, wherein, Output light having a wavelength longer than about 650 nanometers (nm) is directed towards the first image sensor.

10. The imaging device according to claim 1, wherein, Output light having a wavelength longer than about 500 nanometers (nm) and shorter than about 650 nm is directed to the second image sensor.

11. An endoscope or external endoscope imaging system, comprising: A processor; And A memory having instructions stored thereon, the instructions when processed by the processor cause the processor to: Detect at least three spectrally distinct spectral channels through a first image sensor; and Detect at least three spectrally distinct spectral channels through a second image sensor, Wherein, the output light and the combination of the first image sensor and the second image sensor result in at least six spectrally distinct spectral channels.

12. The imaging system according to claim 11, wherein, The at least three spectrally distinct spectral channels are configured to detect at least four spectrally distinct spectral channels.

13. The imaging system according to claim 12, wherein, The at least four spectrally distinct spectral channels include a red light channel, a green light channel, a blue light channel, and an infrared light channel.

14. The imaging system according to claim 11, further comprising: An illumination device that illuminates a scene to be imaged with a first spectral content.

15. The imaging system according to claim 14, wherein, The illumination device provides white light having a wavelength between about 450 nm and about 650 nm, and wherein, a white light image is created from the blue channel and the green channel of the first image sensor and the blue channel, the green channel, and the red channel of the second image sensor.

16. The imaging system according to claim 14, wherein, The illumination device generates ICG or OTL excitation illumination at a wavelength between approximately 725 nm and 800 nm, and wherein the ICG or OTL fluorescence image is imaged onto the first image sensor.

17. The imaging system according to claim 14, wherein The illumination device generates illumination including a red light spectral band centered at approximately 630 nm and an infrared spectral band centered at approximately 940 nm, and wherein an oxygenation or perfusion image is created based on calculations from the red light channel of the second image sensor and the IR channel on the first image sensor.

18. The imaging system according to claim 14, wherein, The illumination device generates illumination including a red light spectral band centered at approximately 630 nm, and wherein a Cy5 or Cy5.5 fluorescence image is imaged onto the first image sensor.

19. The imaging system according to claim 14, wherein, The illumination device generates illumination including a blue light spectral band at a wavelength between 450 nm and 500 nm that provides fluorescein excitation illumination, wherein a fluorescein fluorescence image is imaged onto the second image sensor, and wherein a grayscale image is created from the fluorescein excitation illumination and the grayscale image is imaged onto the first image sensor.

20. An endoscope or exoscope imaging system, comprising: An illumination device that illuminates a scene to be imaged with a first spectral content; A processor; And A memory storing instructions that, when processed by the processor, cause the processor to: Detect a first at least three spectrally distinct spectral channels via a first image sensor; and Detect a second at least three spectrally distinct spectral channels via a second image sensor, Wherein the output light combined with the first image sensor and the second image sensor results in at least six spectrally distinct spectral channels, Wherein the imaging system is configured to operate in one or more imaging modes from the group consisting of: A white light imaging mode, wherein the illumination device provides white light having a wavelength between approximately 450 nm and approximately 650 nm, and wherein a white light image is created from the blue light channel and the green light channel of the first image sensor and the blue light channel, the green light channel, and the red light channel of the second image sensor, An ICG or OTL mode, wherein the illumination device generates ICG or OTL excitation illumination at a wavelength between approximately 725 nm and 800 nm, and wherein the ICG or OTL fluorescence image is imaged onto the first image sensor, An oxygenation or perfusion mode, wherein the illumination device generates illumination including a red light spectral band centered at approximately 630 nm and an infrared spectral band centered at approximately 940 nm, and wherein an oxygenation or perfusion image is created based on calculations from the red light channel of the second image sensor and the image on the first image sensor, A Cy5 or Cy5.5 mode, wherein the illumination device generates illumination including a red light spectral band centered at approximately 630 nm, and wherein a Cy5 or Cy5.5 fluorescence image is imaged onto the first image sensor, and A fluorescein mode, wherein the illumination device produces illumination including a blue light spectral band having a wavelength between 450 nm and 500 nm that provides fluorescein excitation illumination, wherein a fluorescein fluorescence image is imaged onto the second image sensor, and wherein a grayscale image is created from the fluorescein excitation illumination and the grayscale image is imaged onto the first image sensor.

Images