Method for displaying a colour video in a medical application, in particular in a visualisation application

Abstract

The invention relates to a method (100) for displaying a colour video in a medical application, in particular in a visualisation application. The invention also relates to a visualisation system (300) for carrying out such a method. The invention further relates to a visualisation unit (400) comprising such a visualisation system (300) and at least one monitor (260).

Description

[0001] JENOPTIK Optical Systems GmbH

[0002] Method for displaying a color video in a medical application, in particular in a visualization application

[0003] Description

[0004] The invention relates to a method for displaying a color video in a medical application, particularly in a visualization application. The invention further relates to a visualization system and a visualization unit. The visualization system can be configured as an endoscope system or an exoscope system. The visualization unit can, for example, be configured as an endoscope unit or an exoscope unit.

[0005] It is generally known that in a visualization application, an object to be examined is illuminated with light, whereby the light reflected from the object to be examined is received by an image sensor and subsequently converted into digital image and video signals in an image processing device.

[0006] German patent DE 2633742 A1 discloses an endoscope for creating color images. A rotating tricolor filter is used for illumination, enabling sequential illumination of the object with the primary colors. Alternatively, sequentially switchable light emission chips of different colors are used. A color video signal is generated from the signals of an image scanner and displayed on a screen. A disadvantage is the lack of ambient light correction. This can lead to image artifacts caused by ambient light of unknown color composition. Furthermore, the use of rotating parts is detrimental to reliability. Additionally, no fluorescence image is provided.

[0007] US patent 4253447 A discloses an endoscope with an image sensor that generates a color video signal by periodically switching on primary colors of illumination, which can then be viewed on a television. A disadvantage is the lack of ambient light correction. This can lead to image artifacts caused by ambient light of unknown color composition. Furthermore, no fluorescence image is provided.

[0008] US patent 4875091 A discloses a sequential color imaging device in which a sample is sequentially illuminated in the primary colors by means of a rotating, three-part color filter disk. The color mixing caused by the readout time is corrected using weighted coefficients to generate a color-accurate video signal. Disadvantages include the use of a rotating component and the lack of ambient light correction. Furthermore, no fluorescence image is provided.

[0009] US patent 4845553 A discloses an endoscope with a sequential color imaging device in which a sample is sequentially illuminated in the primary colors by means of a rotating, three-part color filter disk. Disadvantages include the use of a rotating component and the lack of ambient light correction. Furthermore, no fluorescence image is provided.

[0010] From EP 0 601 179 B1, a single-sensor video image generation system and method with color-sequential illumination of objects is known. A disadvantage is the lack of ambient light correction. Furthermore, no fluorescence image is provided.

[0011] In other methods and systems known from the prior art, for example US 2010 / 0079587 A1, the object under investigation is usually illuminated simultaneously with light of different wavelengths. A disadvantage of this is that a color image sensor is required if color images are to be captured.

[0012] From DE 10 2011 053 880 B4, a device and a method for imaging the fundus of the eye are known, employing time-sequential slit illumination with different colors. Due to the slit illumination and the characteristics of the eye, stray light is critical for image quality. This document describes two methods for determining the influence of stray light. Firstly, an additional camera is provided to capture the stray light that occurs next to the image of the slit, i.e., at a different angle than the slit image. Alternatively, it is proposed to provide an additional light source in the device, which is activated during a specific time interval to generate a stray light image with the recording camera.

[0013] In known systems, color-sensitive CCD image sensors (C = charge, C = coupled, D = device), in particular RGB color image sensors (R = red, G = green, B = blue), are typically used as image sensors to detect the different color spectra of the light reflected by the object under investigation.

[0014] RGB color image sensors are primarily characterized by their simple design, capturing only one of the three primary colors—red, green, or blue—in an alternating pattern. For this purpose, RGB color image sensors employ a so-called CFA matrix (C = color, F = filter, A = array). The most widely used CFA matrix is ​​the "Bayer matrix," which features alternating rows of red-green and green-blue filters.

[0015] While RGB color image sensors are suitable for generating digital color images, especially color videos, they have a significant disadvantage: each pixel of the sensor can effectively capture only 1 / 3 of the light reflected by the object being examined, because any color that does not match the CFA matrix is ​​filtered out. For example, red or blue light striking a green pixel of the RGB color image sensor will not be registered.

[0016] In other words, RGB color image sensors have very poor light efficiency, especially very low quantum efficiency.

[0017] Furthermore, CMOS image sensors (C = complementary, M = metal, O = oxide, S = semiconductor) are known for image acquisition, which allow for faster image readout compared to CCD sensors. These can also be designed as monochrome or color sensors, with the color sensors exhibiting a lower light sensitivity than the monochrome sensors.

[0018] Furthermore, arrangements for color image acquisition with multiple monochrome sensors are known, for example from DE 10 2021 119 417 A1 and DE 12 89 409 A. These divide the color components using a multitude of prism geometries and filter layers and, in particular, use a separate image sensor for each color channel to increase the light yield. Such arrangements are complex and require more installation space.

[0019] However, excessively high light intensity is detrimental and therefore undesirable in certain situations. Particularly in neurosurgical visualization applications, where the object being examined is tissue of the human brain, spinal cord, or other nerve tissue, excessive light intensity can lead to tissue damage or even destruction.

[0020] To avoid such impairment or damage to the tissue, the sensitivity of the CMOS image sensors is usually increased in the prior art in order to reduce the illumination intensity to a minimum.

[0021] However, increasing the sensitivity of the CMOS image sensors and simultaneously reducing the illuminance inevitably means that the image signal captured by the CMOS image sensors must subsequently be electronically amplified in the image processing device.

[0022] Operating the CMOS image sensor at increased sensitivity, as well as subsequent electronic amplification of the recorded image signal, has the disadvantage of drastically reducing image quality, especially resulting in high image noise.

[0023] In summary, it can therefore be stated that in the systems currently known from the state of the art, either inexpensive and simply constructed image sensors are used, which have the disadvantage of reduced image resolution and high image noise, or expensive and complexly constructed image sensors.

[0024] Starting from this problem, the object of the invention is to avoid the disadvantages of the prior art and to develop the latter advantageously. In particular, a more cost-effective and improved method for generating high-resolution digital color images, especially for displaying high-resolution color videos, is to be provided for a medical application, particularly an endoscope application. Furthermore, it is an object of the invention to provide an improved visualization system and an improved visualization unit. The visualization system can advantageously be designed as an endoscope or as a surgical microscope, specifically as an exoscope.

[0025] An exoscope is a visualization system suitable for open surgery, particularly in minimally invasive procedures. It allows images or video signals of internal organs to be acquired through an incision outside the patient's body and displayed on a monitor or other visualization device, such as a smartphone. This provides optimal and comfortable visualization of the surgical site. The image can be magnified, making the exoscope a specialized surgical microscope.

[0026] While stray light can often be disregarded with an endoscope, it can interfere with image acquisition using an operating microscope or exoscope. This difference may be due to the fact that the ambient light intensity is higher outside the patient's body than inside.

[0027] Surgical microscopes and exoscopic visualization systems according to the invention may be particularly suitable for open surgery. Endoscopic visualization systems according to the invention may be particularly suitable for minimally invasive surgery.

[0028] According to the invention, this problem is solved by a method according to dependent claim 1 or dependent claim 2. With regard to the visualization system, the problem is solved by the subject matter of dependent claim 7 or dependent claim 9, and with regard to the visualization unit, by the subject matter of dependent claim 12.

[0029] According to a first aspect of the invention, a method for displaying a color video in a medical application, particularly in a visualization application, is proposed. The method according to dependent claim 1 comprises the steps: a) irradiating an object to be examined with a first light from a visible spectral range by an illumination module for the duration of a first irradiation time, b) irradiating the object to be examined with a second light from a visible spectral range by the illumination module for the duration of a second irradiation time, c) irradiating the object to be examined with a third light from a visible spectral range by the illumination module for the duration of a third irradiation time, d) irradiating the object to be examined with at least a fourth light from an excitation spectral range, in particular with a first fluorescence excitation light.which is suitable for exciting a first fluorescent light emitted by the object, by the illumination module for the duration of a fourth irradiation time, e) continuous detection of light reflected from the object and of first fluorescent light emitted by the object as well as of stray light from at least one stray light source which is arranged in the vicinity of the object to be examined, by at least one monochrome image sensor, wherein the illumination module is switched synchronously with the at least one monochrome image sensor by a control module, f) detection of a dark image by the at least one monochrome image sensor for the duration of a non-irradiation time, wherein during the detection of the dark image the object to be examined is not illuminated by light from the illumination module, but only by stray light from the at least one stray light source,g) wherein the illumination module is sequentially and selectively switched on and off by the control module to form a pattern sequence for the first, second, third, fourth irradiation and non-irradiation periods, h) storing the image signals output by the at least one monochrome image sensor in a storage module, i) generating at least three different spectral images and at least one spectral fluorescence image by an image generation module, j) subtracting the captured dark image from the at least three different spectral images and the at least one spectral fluorescence image to generate the respective clean images in a processing module, k) adding the respective clean images to form a composite color image in the processing module, l) wherein the process steps a) to k) are performed at least 50 cycles per second, preferably at least 60 cycles per second,particularly preferably repeated at exactly 50 or 60 cycles per second to generate a large number of summed color images by a computer unit, m) generation of a color video from the large number of summed color images by the computer unit, n) display of the color video on a monitor.

[0030] The core idea of ​​the invention is, firstly, to irradiate the object to be examined not simultaneously as in the prior art, but in a color sequence, i.e., one after the other at intervals, in particular sequentially and selectively, with light of different wavelengths or wavelength bands.

[0031] The color sequence is generated primarily using light from the visible (VIS) spectral range and / or the excitation spectral range. The fourth light source can have an excitation spectral range in the infrared (near (NIR), mid (MIR), or far (FIR)). For example, the fourth light source could be a first fluorescence excitation light in the infrared spectral range. It could also be advantageous to use a first fluorescence excitation light in the ultraviolet or visible spectral range. Which fluorescence excitation light is advantageous depends on the fluorescent dye used to treat the object.

[0032] The at least one monochrome image sensor can be particularly advantageous if it is precisely a monochrome image sensor. In this case, a device for carrying out the method can be particularly cost-effective. However, multiple image sensors can also be present, for example, arranged side by side to obtain a larger image field.

[0033] Secondly, the core idea of ​​the invention is to use a monochrome image sensor, preferably a monochrome CMOS image sensor, instead of a color-sensitive image sensor.

[0034] The monochrome image sensor is distinguished from other sensors by its higher light sensitivity and detail resolution, particularly pixel size, and its simpler and more cost-effective design. The monochrome image sensor does not feature a CFA matrix like the RGB color image sensor, nor complexly aligned prism geometries or filter layers like the multi-sensor arrangements mentioned above.

[0035] This allows the light reflected from the object under investigation, and in particular the entire amount of light captured by a lens, to reach the monochrome image sensor, thus utilizing the full potential of the monochrome image sensor. The term "light reflected from the object" refers not only to specularly reflected light, but also to light scattered by the object – that is, all light reflected back from the object.

[0036] The monochrome image sensor particularly increases the resolution in each individual color of the reflected light, since there are no longer dedicated pixels for, for example, red, green and blue, as is the case with the RGB color image sensor, but rather each pixel represents each color sequentially.

[0037] The sequential rendering of each pixel, and especially each color, means that the image information of the individual color channels can be captured one after the other. This necessitates higher frame rates for image capture than those subsequently displayed on the monitor. For example, if color images are to be displayed at 60 fps, image capture at 240 fps or 300 fps may be required, as the individual color channels and the dark frame are captured sequentially.

[0038] Due to the sequential illumination, color separation and / or color filtration can be dispensed with, so that the light reflected from the object under investigation is not attenuated.

[0039] In other words, the monochrome image sensor exhibits very good light efficiency, in particular very high quantum efficiency, due to the sensor itself and the method presented in this paper.

[0040] The very high light sensitivity, and in particular the very high quantum efficiency, of the monochrome image sensor has the further advantage of reducing image noise due to the unfiltered light available. However, to largely eliminate artifacts caused by ambient light, the core idea of ​​the invention is to additionally capture a dark frame of the object under investigation using the monochrome image sensor. When capturing the dark frame, the object is illuminated only by ambient light. Ambient light can include ambient light as well as light from other light sources, such as those in an operating room. Artifacts in the color image can arise because the ambient light may not be integrated into the color sequence and may have an unknown spectrum.

[0041] The color sequence generated according to the invention and the dark image acquired according to the invention together form a pattern sequence. The color sequence can advantageously comprise an RGB (red, green, blue) color sequence if the first light is red, the second light is green, and the third light is blue. The color sequence can also, for example, comprise a cyan-magenta-yellow color sequence, known in English as CMY (cyan, magenta, yellow). If the fourth light is ultraviolet (UV) light, the color sequence can, for example, be an RGB-UV sequence. If the fourth light is infrared (IR) light, the color sequence can, for example, be an RGB-IR sequence. Such a color sequence can be expressed mathematically as color sequence F: {RGB IR}.If a fifth light source with a fifth irradiation time is included, for example, another infrared fluorescence excitation light IR2, then the color sequence can be an RGB-IR1-IR2 sequence, also representable in the notation F: {RGB IR1 IR2}. Permutations of the specified order can be equally advantageous.

[0042] For this purpose, the lighting module is sequentially and selectively switched on and off by a control module according to the desired pattern sequence for a first, second, third, fourth irradiation time and non-irradiation time.

[0043] The pattern sequence captured by the monochrome image sensor or the image signals output by the monochrome image sensor are stored in a memory module.

[0044] Depending on the generated color sequence, an image generation module produces spectral images, specifically at least three differently colored spectral images and at least one spectral fluorescence image. A calculation module then subtracts the captured dark image from each of the at least three differently colored spectral images and the at least one spectral fluorescence image to generate the respective clean images. Finally, the calculation module adds these clean images together to create a composite color image.

[0045] To generate a multitude of stacked color images, the process steps a) to k) according to the invention are repeated by a computer unit at least 50 cycles per second, preferably at least 120 cycles per second, and particularly preferably at least 240 cycles per second, so that the impression of a multicolored video sequence is created. In particular, a high-resolution color video is generated from the multitude of stacked color images by the computer unit, which can then be displayed on a monitor. The number of cycles per second can be selected according to the refresh rate of the monitor in order to avoid, for example, artifacts caused by frame rate conversion. If necessary, the refresh rate of the monitor can be selected according to the mains frequency of the power grid in order to minimize flickering of the monitor image.

[0046] Alternatively, according to a second aspect of the invention, a method for displaying a color video in a medical application, particularly in a visualization application, is proposed. The method according to dependent claim 2 comprises the steps: a) irradiating an object to be examined with a first light from a visible spectral range by an illumination module for the duration of a first irradiation time, b) irradiating the object to be examined with a second light from a visible spectral range by the illumination module for the duration of a second irradiation time, c) irradiating the object to be examined with a third light from a visible spectral range by the illumination module for the duration of a third irradiation time, d) irradiating the object to be examined with at least a fourth light from an excitation spectral range, in particular with a first fluorescence excitation light.which is suitable for exciting a first fluorescent light emitted by the object, by the illumination module for the duration of a fourth irradiation time, e) continuous detection of light reflected by the object as well as of stray light from at least one stray light source located in the vicinity of the object under investigation, by at least one monochrome image sensor, wherein the illumination module is synchronized with the at least one monochrome image sensor by a control module, f) continuous detection of a first fluorescent light emitted by the object by at least one fluorescent light sensor, wherein the illumination module is synchronized with the at least one fluorescent light sensor by the control module, g) detection of a dark image by the at least one monochrome image sensor for the duration of a non-irradiation time,wherein during the acquisition of the dark image, the object under investigation is not illuminated by light from the illumination module, but only by ambient light from the at least one ambient light source; h) acquisition of a fluorescence dark image by the at least one fluorescence light sensor for the duration of a non-irradiation period, wherein during the acquisition of the fluorescence dark image, the object under investigation is not illuminated by light from the illumination module, but only by ambient light from the at least one ambient light source; i) wherein the illumination module is switched on and off sequentially and selectively by the control module to form a pattern sequence for the first, second, third, fourth irradiation and non-irradiation periods; j) storage of the image signals output by the at least one monochrome image sensor and the at least one fluorescence light sensor in a storage module.k) Generation of at least three differently colored spectral images and at least one spectral fluorescence image by an image generation module, l) respective subtraction of the captured dark frame from the at least three differently colored spectrally generated individual images and subtraction of the captured fluorescence dark frame from the at least one spectrally generated fluorescence image to generate respective clean images in a processing module, m) addition of the respective clean images to form a composite color image in the processing module, n) wherein the process steps a) to m) are repeated by a computer unit at least 60 cycles per second, preferably at least 120 cycles per second, particularly preferably at least 240 cycles per second, to generate a plurality of composite color images, o) generation of a color video from the plurality of composite color images by the computer unit, p) display of the color video on a monitor.

[0047] As described in the first aspect of the invention, the object under investigation is irradiated with light of different wavelengths or wavelength bands in a color sequence, i.e., sequentially and selectively, with temporally spaced intervals. The color sequence can again be generated by light from the visible spectral range (VIS) and / or the excitation spectral range, as described in the first aspect of the invention.

[0048] The basic idea according to the first aspect of the invention is to simultaneously detect the various spectral ranges, in particular the visible (VIS) and infrared (NIR) ranges, as well as the near-infrared (NIR) ranges, of the light reflected from the object under investigation, and also the ambient light, using preferably one or more monochrome image sensors. It can be particularly advantageous to use the same image sensor used for the primary colors (i.e., first, second, and third light) as a fluorescence light sensor as well. In this case, only a single monochrome image sensor is required.

[0049] The basic idea according to the second aspect of the invention is to use, in addition to the monochrome image sensor, a further image sensor, which is in particular designed as a fluorescence light sensor. In principle, according to the second aspect of the invention, several monochrome image sensors and several additional fluorescence light sensors can be used. It can be advantageous to provide exactly one monochrome image sensor and exactly one fluorescence light sensor, wherein the fluorescence light sensor can advantageously be designed as another monochrome image sensor.

[0050] This approach allows for a performance increase, so that a future device upgrade can achieve a performance boost simply by replacing one component (the sensor), with the improvement affecting all modalities (RGB / IR, etc.) equally. Another advantage is that the fluorescence image can be captured at a lower resolution than the color channels. A lower-resolution sensor can be used for the fluorescence image. Furthermore, it can be advantageous to apply a binning technique to the fluorescence image to reduce image noise in the fluorescence channel at the expense of resolution, especially if the fluorescence image is detected by the same sensor as the other color channels.

[0051] In particular, according to the second aspect of the invention, the different spectral ranges of the light reflected from the object under investigation can be separated from each other, wherein in particular the visible spectral range (VIS) of the color sequence according to the invention and the background light are further detected by the at least one monochrome image sensor or by the several monochrome image sensors, and the infrared spectral range, in particular the near-infrared spectral range (NIR), as well as the background light, are detected by a possible further image sensor, in particular by several fluorescent light sensors.

[0052] As in accordance with the first aspect of the invention, in accordance with the second aspect of the invention, a dark image is still captured without irradiation of the object to be examined in order to eliminate artifacts caused by the interfering light.

[0053] However, an additional fluorescence dark image is captured without irradiation of the object under investigation, wherein the dark image is captured by the at least one monochrome image sensor or by the several monochrome image sensors and the fluorescence dark image is captured by the at least one fluorescence light sensor or by the several fluorescence light sensors.

[0054] The color sequence, the dark image according to the invention, and the fluorescence dark image according to the invention together form a pattern sequence.

[0055] For this purpose, the lighting module can again be switched on and off sequentially and selectively by the control module according to the desired pattern sequence for a first, second, third, fourth irradiation time and non-irradiation time.

[0056] The memory module stores the image signals output by the monochrome image sensor and additionally by the fluorescence light sensor.

[0057] Depending on the generated color sequence, the image generation module produces spectral images, specifically at least three differently colored spectral images and at least one spectral fluorescence image. The calculation module then subtracts the captured dark frame from each of the at least three differently colored spectral images and additionally subtracts the captured fluorescence dark frame from the at least one spectrally generated fluorescence image to produce the respective clean images. These clean images are then summed in the calculation module to form a composite color image.

[0058] To generate a multitude of stacked color images, the process steps a) to m) according to the invention are repeated by the computer unit at least 50 cycles per second, preferably at least 120 cycles per second, and particularly preferably at least 240 cycles per second, so that the impression of a multicolored video sequence is created. In particular, a high-resolution color video is generated from the multitude of stacked color images by the computer unit, which can then be displayed on a monitor.

[0059] Further features and advantages of the invention are specified in the dependent claims.

[0060] Preferably, the object under investigation is irradiated by the illumination module for a fifth irradiation time with at least one fifth light source from an infrared spectral range (near (NIR), medium (MIR), or far (FlR)), an ultraviolet spectral range (extreme (EUV), strong (DUV), or weak (UV)), a tera-Hz spectral range, or an X-ray range, in particular with a second fluorescence excitation light suitable for exciting a second fluorescence light emitted by the object. This allows further detailed information about the object under investigation to be acquired.

[0061] It is conceivable that the object under investigation is irradiated by the illumination module with a variety of other different lights, in particular further fluorescence excitation lights suitable for exciting different fluorescence lights emitted by the object, for the duration of further different irradiation times or the same irradiation times.

[0062] Preferably, the duration of the first, second, third, non-irradiation, fourth, and fifth irradiation periods is flexibly adjustable. This allows for the generation of a multitude of different color sequences and thus the creation of any desired variation of the pattern sequence. The individual durations can be chosen to be of different lengths. This can mean that at least two of the first, second, third, fourth, and non-irradiation periods differ in their duration. In particular, the fourth irradiation period can be longer than the longest of the first, second, and third irradiation periods. In contrast to the prior art, the irradiation time is thus adjustable for any spectral range.

[0063] When using two separate image sensors for RGB and fluorescence light, the object under investigation is preferably continuously illuminated by the illumination module with the fourth light of the excitation spectral range, in particular with the first fluorescence excitation light, which is suitable for exciting a first fluorescence light emitted by the object, and / or the fifth light, in particular with the second fluorescence excitation light, which is suitable for exciting a second fluorescence light emitted by the object, but not during the acquisition of the dark image and / or the fluorescence dark image.However, it may be advantageous to irradiate the object under investigation with the first fluorescence excitation light during the first, second and third irradiation times, and also to irradiate the object with the first fluorescence excitation light during the acquisition of the dark image, but not during the acquisition of the fluorescence dark image.

[0064] This is particularly advantageous for the embodiment according to the second aspect of the invention, in which the different spectral ranges of the light reflected from the object under investigation are separated from each other, wherein in particular the visible spectral range (VIS) of the color sequence according to the invention and the background light are further detected by the at least one monochrome image sensor or by the several monochrome image sensors, and the infrared spectral range, in particular near-infrared spectral range (NIR), and the background light are detected by the further image sensor, in particular by the at least one fluorescent light sensor or by the several fluorescent light sensors.

[0065] Preferably, the first fluorescence light emitted by the object and / or the second fluorescence light emitted by the object can be guided through a blocking filter, in particular a UV blocking filter, in an observation beam path to filter out reflected fluorescence excitation light. The blocking filter can have a pass band for the first fluorescence light (IR1) and / or the second fluorescence light (IR2). For other wavelengths, it can have one or more blocking bands.

[0066] According to a third aspect of the invention, a visualization system for displaying a color video in a medical application, in particular in a visualization application, is presented.

[0067] The visualization system comprises: an illumination module configured to emit at least one first light from a visible spectral range for the duration of a first irradiation time, at least one second light from a visible spectral range for the duration of a second irradiation time, at least one third light from a visible spectral range for the duration of a third irradiation time, at least one fourth light from an excitation spectral range, in particular a first fluorescence excitation light suitable for exciting a first fluorescence light emitted by an object under investigation, for the duration of a fourth irradiation time, and at least one fifth light from an infrared spectral range (near (NIR), medium (MIR), or far (FIR)) or an ultraviolet spectral range (extreme (EUV), high (DUV), or low (UV)), or a tera-Hz spectral range, or an X-ray range, in particular a second fluorescence excitation light.which is suitable for exciting a second fluorescent light emitted by an object under investigation, to emit for the duration of a fifth irradiation time, at least one monochrome image sensor configured to detect light reflected from the object under investigation, at least one first fluorescent light emitted by the object under investigation, at least one second fluorescent light emitted by the object under investigation, an interfering light from at least one interfering light source located in the vicinity of the object under investigation, and a dark image, wherein the at least one monochrome image sensor is further configured to detect at least 50 cycles per second, preferably at least 60 cycles per second, particularly preferably exactly 50 or 60 cycles per second, a control module configured to synchronize the illumination module with the at least one monochrome image sensor,wherein the control module is further configured to switch the illumination module on and off sequentially and selectively according to a pattern sequence for the duration of different irradiation times and / or for constant irradiation times, a storage module configured to store the image signals output by the at least one monochrome image sensor, an image generation module configured to generate at least three differently colored spectral images and at least one spectral fluorescence image from the image signals stored in the storage module, a calculation module configured toa respective subtraction of the captured dark image from the at least three differently colored spectrally generated individual images and the at least one spectrally generated fluorescence image, or a respective subtraction of the captured dark image from the at least three differently colored spectrally generated individual images to generate respective clean images, wherein the calculation module is further configured to perform an addition of the respective clean images to form a sum color image, a computing unit configured to operate the illumination module, the at least one monochrome image sensor, the control module, the storage module, the image generation module, and the calculation module at least 50 cycles per second, preferably at least 60 cycles per second, particularly preferably at exactly 50 or 60 cycles per second,to repeatedly control the system and generate a color video from the multitude of resulting sum color images for display on a monitor.

[0068] Preferably, the visualization system according to the invention is designed to carry out the method according to the invention in accordance with the first aspect of the invention.

[0069] According to a fourth aspect of the invention, a visualization system for displaying a color video in a medical application, in particular in a visualization application, is presented.

[0070] The visualization system comprises: an illumination module configured to emit at least one first light from a visible spectral range for the duration of a first irradiation time, at least one second light from a visible spectral range for the duration of a second irradiation time, at least one third light from a visible spectral range for the duration of a third irradiation time, at least one fourth light from an excitation spectral range suitable for exciting a first fluorescence light emitted by an object under investigation, in particular a first fluorescence excitation light, for the duration of a fourth irradiation time, and at least one fifth light from an infrared spectral range (near (NIR), medium (MIR), or far (FIR)) or an ultraviolet spectral range (extreme (EUV), high (DUV), or low (UV)), or a tera-Hz spectral range or an X-ray range, in particular a second fluorescence excitation light.which is suitable for exciting a second fluorescent light emitted by an object under investigation, to emit for the duration of a fifth irradiation time, at least one monochrome image sensor configured to detect light reflected from the object under investigation, at least one first fluorescent light emitted by the object under investigation, at least one second fluorescent light emitted by the object under investigation, an interfering light from at least one interfering light source located in the vicinity of the object under investigation, and a dark image, wherein the at least one monochrome image sensor is further configured to detect at least 50 cycles per second, preferably at least 60 cycles per second, particularly preferably exactly 50 or 60 cycles per second, at least one fluorescent light sensor configured toto detect at least one fluorescence light emitted by the object under investigation, at least one fluorescence light emitted by the object under investigation, an interfering light from at least one interfering light source located in the vicinity of the object under investigation, and a fluorescence dark image, wherein the at least one fluorescence light sensor is further configured to detect at least 50 cycles per second, preferably at least 60 cycles per second, particularly preferably exactly 50 or 60 cycles per second, a control module configured to switch the illumination module synchronously with the at least one monochrome image sensor and / or the at least one fluorescence light sensor, wherein the control module is further configured to switch the illumination module on and off sequentially and selectively according to a pattern sequence for different irradiation times and / or for constant irradiation times,a storage module configured to store the image signals output by the at least one monochrome image sensor and / or the at least one fluorescence light sensor; an image generation module configured to generate at least three differently colored spectral images and at least one spectral fluorescence image from the image signals stored in the storage module; a calculation module configured to perform a respective subtraction of the captured dark frame from the at least three differently colored spectral images and the at least one spectral fluorescence image, or a respective subtraction of the captured dark frame from the at least three differently colored spectral images and a subtraction of the captured fluorescence dark frame from the at least one spectral fluorescence image to generate the respective clean images.wherein the calculation module is further configured to perform an addition of the respective pure images to form a summed color image, a computing unit configured to repeatedly control the illumination module, the at least one monochrome image sensor, the at least one fluorescent light sensor, the control module, the storage module, the image generation module and the calculation module at least 50 cycles per second, preferably at least 60 cycles per second, particularly preferably at exactly 50 or 60 cycles per second, and to generate a color video for display on a monitor from the multitude of summed color images formed.

[0071] Preferably, the visualization system according to the invention is designed to carry out the method according to the second aspect of the invention.

[0072] Preferably, the computer unit comprises the image generation module, the control module and / or the calculation module.

[0073] According to a fifth aspect of the invention, a visualization unit is proposed comprising a visualization system according to the third aspect of the invention or a visualization system according to the fourth aspect of the invention, as well as at least one monitor.

[0074] Further advantages, features, and details of the invention will become apparent from the following description, in which exemplary embodiments of the invention are described in detail with reference to the drawings. Features and details described in connection with the method according to the first and / or second aspect of the invention naturally also apply in connection with the visualization system according to the third and / or fourth aspect of the invention and the visualization unit according to the invention, and vice versa, so that the disclosure relating to the individual aspects of the invention always includes, or allows for, reciprocal reference.

[0075] Each schematically illustrates:

[0076] Figure 1 shows a visualization unit according to a first embodiment of the present invention;

[0077] Figure 2 shows a pattern sequence according to the first embodiment of the present invention;

[0078] Figure 3 shows a visualization unit according to a second embodiment of the present invention;

[0079] Figure 4 shows a pattern sequence according to the second embodiment of the present invention;

[0080] Figure 5 shows an extended pattern sequence according to a further embodiment of the present invention; and

[0081] Figure 6 shows the irradiation times according to a further embodiment of the present invention.

[0082] Fig. 1 shows a visualization unit 400 according to a first embodiment of the present invention. The visualization unit 400 comprises a visualization system 300 and at least one monitor 260 for displaying high-resolution digital color images, in particular a high-resolution color video, in a medical application, especially a visualization application.

[0083] The visualization system 300 comprises a lighting module 200, a storage module 210, an image generation module 220, a control module 230, a calculation module 240, and a computing unit 250. It is conceivable that the computing unit 250 includes the image generation module 220, the control module 230, and / or the calculation module 240.

[0084] The illumination module 200 is configured in particular to emit at least one first light R of a visible spectral range (VIS) for the duration of a first irradiation time T10, at least one second light G of a visible spectral range (VIS) for the duration of a second irradiation time T20, at least one third light B of a visible spectral range (VIS) for the duration of a third irradiation time T30, at least one fourth light FAR1 of an excitation spectral range (NIR), which is suitable for exciting a first fluorescence light IR1 emittable by the object 70 under investigation, in particular a first fluorescence excitation light, for the duration of a fourth irradiation time T40, and at least one fifth light FAR2 of an infrared spectral range (near (NIR), medium (MIR) or far (FIR)) or an ultraviolet spectral range (extreme (EUV), strong (DUV) or weak (UV)) or a tera-Hz spectral range or an X-ray range,in particular a second fluorescence excitation light, which is suitable for exciting a second fluorescence light IR2 emitted by the object 70 under investigation, to be emitted for the duration of a fifth irradiation time T50.

[0085] It is conceivable that the lighting module 200 is configured to emit a large number of additional lights from a visible spectral range (VIS) and / or an infrared spectral range (near (NIR), medium (MIR) or far (FIR)) and / or an ultraviolet spectral range (extreme (EUV), strong (DUV) or weak (UV)) and / or a tera-Hz spectral range and / or an X-ray range sequentially and selectively for different irradiation times and / or for constant irradiation times.

[0086] It is conceivable that the illumination module 200 is designed as a single broadband, in particular multi- or hyperspectral light source, to emit light from the visible spectral range (VIS) and / or an infrared spectral range (near (NIR), medium (MIR) or far (FIR)) and / or an ultraviolet spectral range (extreme (EUV), strong (DUV) or weak (UV)) and / or a tera-Hz spectral range and / or an X-ray range sequentially and selectively for different irradiation times and / or for constant irradiation times.

[0087] The broadband, in particular multi- or hyperspectral, light source can include a continuous, quasi-continuous or frequency comb spectrum and wavelength-dispersive means for spectral splitting of the light emitted by the light source into several spatially separated spectral components, each with different wavelengths or wavelength bands.

[0088] For this purpose, the broadband, in particular multi- or hyperspectral light source can be switched on and off sequentially and selectively for the first irradiation time T10, second irradiation time T20, third irradiation time T30, fourth irradiation time T40 and fifth irradiation time T50 by the control module 230.

[0089] In particular, the control module 230 can modulate the individual spectral components of the light emitted by the broadband, especially multi- or hyperspectral, light source over time, with the temporal modulations of the individual spectral components being different from each other.

[0090] In particular, the individual spectral components are modulated with different modulation frequencies, modulation frequency ranges, and / or modulation sequences. The control module 230 can therefore include at least one electrically controllable spatial light modulator configured to modulate the individual spectral components over time.

[0091] The lighting module 200 can also be designed not as a single broadband, in particular multi- or hyperspectral light source, but as shown in Figures 1 to 6, comprise several light sources in order to emit light of the visible spectral range (VIS) and / or an infrared spectral range (near (NIR), medium (MIR) or far (FIR)) and / or an ultraviolet spectral range (extreme (EU), strong (DU) or weak (UV)) and / or a tera-Hz spectral range and / or an X-ray range sequentially selectively for different irradiation times and / or for constant irradiation times.

[0092] As can be clearly seen in Fig. 1, the illumination module 200 specifically comprises a first light source 10, a second light source 20, a third light source 30, a fourth light source 40, and a fifth light source 50, all connected via a common optical waveguide 201. The optical waveguide 201 can be understood as a multispectral beam of illumination rays that can focus the light of the different wavelengths or wavelength bands separately or simultaneously onto the object 70 under investigation. A multiplexed-mode fiber, for example, can be used as the optical waveguide 201.

[0093] It is conceivable that the light sources 10, 20, 30, 40, and 50 of the illumination module 200 are each arranged at a light-entry surface of a dichroic prism of the illumination module 200. In this way, the typical application of a dichroic prism is reversed, in which white or multicolored light is usually split into different colors and directed onto individual image sensors. By reversing the orientation, the different colored light rays are combined into a single beam path within the dichroic prism. Thus, by simultaneously activating the different light sources 10, 20, 30, 40, and 50, white light can also be generated to produce a luminance image L.

[0094] The visualization system 300 further comprises at least one monochrome image sensor 80, which is configured to detect light RF reflected from an object 70 under investigation and / or fluorescent light IR1, IR2 emitted from the object 70 under investigation, a stray light S, at least one stray light source 60 which is arranged in the vicinity of the object 70 under investigation, and a dark image D, wherein the at least one monochrome image sensor 80 is further configured to detect at least 50 cycles Z per second, preferably at least 60 cycles per second, particularly preferably exactly 50 or 60 cycles per second.

[0095] It is conceivable that at least one monochrome image sensor 80 is designed as a full-frame sensor and configured to have at least 49 MP with a pixel size of 4.3 pm. 2It is conceivable that at least one monochrome image sensor 80 is configured to support a bit depth of at least 16 bits per pixel. It is also conceivable that at least one monochrome image sensor 80 is configured to transmit via 64 LVDS subchannels at 1.2 Gbit / s per channel.

[0096] It is conceivable that the visualization system 300 has several monochrome image sensors 80, wherein the light RF reflected by the object 70 under investigation and / or the fluorescence light IR1 , IR2 emitted by the object 70 under investigation, the interference light S of the at least one interference light source 60, which is arranged in the vicinity of the object 70 under investigation, as well as the dark image D, are simultaneously and / or with a time delay detected by at least one of the other monochrome image sensors or by all other monochrome image sensors 80.

[0097] Fig. 2 shows a representation of a pattern sequence M according to the first embodiment of the present invention.

[0098] The core idea of ​​the invention is to irradiate the object 70 under investigation not simultaneously, as in the prior art, but in a color sequence F, i.e., sequentially and selectively, with light of different wavelengths or wavelength bands, whereby black-and-white images of the object 70 under investigation are synchronously and sequentially recorded. The black-and-white images produced in this way are assigned to the emitted lights, and a color image is then reconstructed by additive color mixing.

[0099] The sequential irradiation of the object 70 to be examined according to the invention has the advantage that, particularly in neurological surgical visualization applications, the illuminance does not have to be reduced in order not to impair or destroy the tissue.

[0100] In other words, the sequential irradiation of the object 70 under investigation according to the invention has the advantage that all the light radiated onto the object 70 is available, since there are no filters that attenuate the emitted light or necessitate stronger illumination. In this way, the object 70 under investigation is protected. At the same time, extremely color-accurate image generation and processing are possible, since the irradiation is carried out with very precise and synchronous knowledge of the color information, whereby the different sub-spectra cannot overlap in time.

[0101] In the prior art, simultaneous irradiation of the object 70 with the different sub-spectra is only possible with a fraction of the maximum irradiance. For example, in the CMOS case, the irradiation for an RGB color image would have to be regulated with 1 / 3 of the maximum irradiance in red, green, and blue, respectively, whereas the sequential irradiation of the object 70 under investigation according to the invention enables a maximum irradiance.

[0102] Furthermore, the simultaneous irradiation of object 70 with the various sub-spectra, as in the prior art, leads to a contamination of the real view, since the different sub-spectra overlap in time. The color sequence F according to the invention can prevent such overlap, thus achieving a significantly improved signal-to-noise ratio.

[0103] The basic idea according to the first embodiment of the present invention is to simultaneously detect the different spectral ranges, in particular the visible spectral range (VIS) and the infrared spectral range, in particular the near infrared spectral range (NIR), of the light RF reflected by the object 70 to be examined, as well as the background light S, by means of at least one monochrome image sensor 80 or by means of several monochrome image sensors 80.

[0104] The method according to the invention is based in particular on a multispectral or hyperspectral sequential image decomposition, which can be used in medical applications, especially visualization applications, in order to generate a high-resolution color image, in particular a high-resolution color video, with augmented image information (augmented information / augmented view) or to display it on a monitor 260 in the sense of a so-called "spectrum reconstruction" (reconstruction of the imaging spectrum).

[0105] In other words, the inventive method represents an imaging method with advanced imaging technology that makes it possible to obtain more information from an image than the human eye can.

[0106] To achieve this, the various color spectra or sub-spectra of the object 70 under investigation are sequentially and separately acquired by at least one monochrome image sensor 80 or by several monochrome image sensors 80. A subsequent analysis of these various sub-spectra can then provide insights into extended image information.

[0107] For this purpose, the light sources 10, 20, 30, 40, 50 of the lighting module 200 are synchronized by the control module 230 with the at least one monochrome image sensor 80 or the several monochrome image sensors 80.

[0108] The light sources 10, 20 and 30 serve in particular to generate visual color images, especially a visual color video, which, however, does not contain any extended image information, but rather image information of the visual, in particular visible, spectral range, which can also be perceived by the human eye.

[0109] The first light source 10 is designed as a first primary light source, in particular as a first monochromatic LED, to irradiate the object 70 under investigation with a first light R, for example with a red light, of a visible spectral range (VIS) for the duration of a first irradiation time T10.

[0110] The second light source 20 is designed as a second primary light source, in particular as a second monochromatic LED, to irradiate the object 70 under investigation with a second light G, for example with a green light, of a visible spectral range (VIS) for the duration of a second irradiation time T20.

[0111] The third light source 30 is designed as a third primary light source, in particular as a third monochromatic LED, to irradiate the object 70 under investigation with a third light B, for example with a blue light, of a visible spectral range (VIS) for the duration of a third irradiation time T30.

[0112] The first light R, in particular the red light, the second light G, in particular the green light, and the third light B, in particular the blue light, are lights of the visible spectral range (VIS), in particular of the RGB color space. In other words, the first light R, the second light G, and the third light B are lights that represent the primary colors of an RGB color space. It is conceivable that the first light R, the second light G, and the third light B exhibit mixtures of the primary colors of the RGB color space and / or their complementary colors and / or primary colors of a CI E color space and / or their mixtures and / or primary colors of a YUV color space and / or their mixtures.

[0113] For example, the first light can be R, in particular a cyan-colored light, the second light can be G, in particular a magenta-colored light, and the third light can be B, in particular a yellow light.

[0114] It is conceivable that, in addition to light sources 10, 20 and 30, further similar light sources are used to generate visual color images, in particular a visual color video, which, however, does not contain any extended image information.

[0115] Light sources 40 and 50 differ from light sources 10, 20, 30 and are used in particular for displaying the extended image information.

[0116] Such extended image information can include, for example, the spatial distribution of oxygen saturation in the tissue or local fluorescence signals from fluorescent dyes with which certain tissue types, such as blood vessels, or other infrared, ultraviolet or X-ray signals can be visualized.

[0117] The acquisition of the extended image information by the light sources 40 and 50 is based in particular on fluorescence detection.

[0118] Fluorescence detection requires excitation of the fluorescence, which can be easily achieved through optical excitation. The fluorescence excitation light should preferably be in the infrared (IR) spectral range, particularly preferably in the near-infrared (NIR) range. The fluorescence excitation light can also be in an infrared (near (NIR), mid (MIR), or far (FIR)) spectral range and / or in an ultraviolet (ultraviolet, ultra-high, or ultraviolet) range and / or in a tera-Hz range and / or in an X-ray range.

[0119] Which specific frequency range is suitable depends primarily on the object being examined, and especially on the substance being investigated. Particularly in medical visualization applications, molecular properties, commonly referred to as "molecular signatures" in medical diagnostics, provide information about the health status of the tissue or the patient and can thus be diagnostically evaluated. Molecular signatures can be used, in particular, for the detection of cancer. Other diseases, such as rheumatoid arthritis or arteriosclerosis of the carotid artery, can also be identified in this way.

[0120] Substances that themselves lack molecular or chemical properties, but would be suitable for fluorescence detection, can be appropriately "labeled" molecularly. For example, it is conceivable to use markers that, with appropriate preparation, bind or attach only to very specific molecules.

[0121] This type of labeling works primarily according to a mechanism known in medical technology as a lock-and-key mechanism. The marker and the molecule to be detected fit together like a key and a lock, while the marker does not bind to other substances. If the marker exhibits known fluorescence properties, it can be optically detected after binding or attachment. Detection of the marker then indicates the presence of the labeled substance.

[0122] Particularly in the intraoperative detection of tumor tissue, activatable markers are used to precisely identify and subsequently remove the diseased tissue. A typical application is surgical treatment.

[0123] In medical diagnosis, so-called fluorophores are known as marker substances, for example indocianin green (ICG), which bind to vessels and are optically detectable, thus increasing the contrast with which vessels are displayed.

[0124] Furthermore, so-called "smart contrast agents" are known. These are activatable fluorescent markers that bind to, for example, tumor tissue, and whose fluorescent properties are only activated by binding to the substance to be labeled. Such substances can consist of self-quenched dyes, such as Cy5.5, which are bound to larger molecules via specific peptides. These peptides, in turn, can be recognized and cleaved by specific proteases, which are produced, for example, in tumors. This cleavage releases the fluorophores, which are no longer self-inhibited and instead develop their fluorescent properties.

[0125] The released fluorophores can be activated, for example, in the near-infrared wavelength range around 740 nm. An example of a marker based on this principle is AF 750 (Alexa Fluor 750), which has a defined absorption and emission spectrum in the wavelength range of 750 nm (excitation) and 780 nm (emission), respectively.

[0126] In other words, fluorescence detection requires a detector capable of detecting light at the wavelength emitted by the substance under investigation or the marker used when excited.

[0127] For this purpose, the fourth light source 40 is designed as a first fluorescence excitation light source in order to irradiate the object 70 under investigation with a fourth light FAR1, for example with a first fluorescence excitation light, of an infrared spectral range (NIR), which is suitable for exciting a first fluorescence light IR1 emittable by the object 70 under investigation, for the duration of a fourth irradiation time T40.

[0128] The fifth light source 50 is designed as a second fluorescence excitation light source to illuminate the object 70 under investigation with a fifth light FAR2 of an infrared spectral range (near (NIR), medium (MIR) or far (Fl R)) or an ultraviolet spectral range (extreme (EUV), strong (DUV) or weak (UV)) or a tera-Hz spectral range or an X-ray range, in particular with a second fluorescence excitation light suitable for exciting a second fluorescence light IR2 emittable by the object 70 under investigation, for the duration of a fifth irradiation time T50.

[0129] The fourth light source 40, in particular the first fluorescence excitation light source, and the fifth light source 50, in particular the second fluorescence excitation light source, can, for example, emit 5ALA fluorescence excitation light in the wavelength range of 400 nm to detect only the fluorescence in the visible spectral range (VIS). It is conceivable that the fourth light source 40 and / or the fifth light source 50 could emit light from an infrared spectral range (near (NIR), mid (MIR), or far (FIR)), an ultraviolet spectral range (extreme (EUV), high (DUV), or low (UV)), a tera-Hz spectral range, or an X-ray range.

[0130] It is conceivable that the fourth light source 40 and / or the fifth light source 50 can emit light for the detection of further luminescent lights, in particular a phosphorescent light and / or bioluminescent light and / or chemiluminescent light.

[0131] In other words, the color sequence F according to the invention can be generated in particular with light of the visible spectral range (VIS), and / or the infrared spectral range (near (NIR), medium (MIR) or far (FIR)) and / or the ultraviolet spectral range (extreme (EUV), strong (DUV) or weak (UV)), and / or the tera-Hz spectral range and / or the X-ray range.

[0132] In Fig. 2, the color sequence F according to the invention is, for example, {RGB IR1 IR2}, wherein the RGB portion of the color sequence F comprises the first light R, in particular a red light, the second light G, in particular a green light, and the third light B, in particular a blue light, which are reflected by the object 70 under investigation and are detected by the at least one monochrome image sensor 80 for the duration of the first irradiation time T10, second irradiation time T20, and third irradiation time T30, wherein the IR1 IR2 portion of the color sequence F comprises the fourth light IR1, in particular a first fluorescent light, and the fifth light IR2, in particular a second fluorescent light, which are emitted by the object 70 under investigation as a result of excitation and are detected by the at least one monochrome image sensor 80 for the duration of the fourth irradiation time T40 and fifth irradiation time T50.

[0133] The components of the color sequence F can be understood as phases or time intervals.

[0134] The light sources 10, 20, 30, 40, 50 of the illumination module 200 are synchronously switched by the control module 230 with the at least one monochrome image sensor 80, so that the color sequence F according to the invention is generated, in particular by sequentially and selectively switching the light sources 10, 20, 30, 40, 50 on and off. For example, the color sequence F according to the invention can be: {BGRIR 1}, such that first the third light source 30 to emit a blue light, then the second light source 20 to emit a green light, then the first light source 10 to emit a red light, and then the fourth light source 40 to emit a fourth light FAR1, in particular a first fluorescent excitation light, are sequentially and selectively switched on and off by the control module 230.

[0135] For example, the color sequence F according to the invention can be: {BGRGBGR IR1 IR2 IR3}, wherein the component IR3 is in particular a further third fluorescence light which is emitted by the object 70 to be examined as a result of excitation by a third fluorescence excitation light FAR3 and which is detected by at least one monochrome image sensor 80 for the duration of a further irradiation time.

[0136] The more components or phases the color sequence includes, the more detailed the resulting color images are, or the more extended image information is contained in the resulting color images.

[0137] In principle, the generated color sequence F can include any further variation thereof. The generated color sequence F can be cyclically regular or cyclically irregular. The generated color sequence F can be extended or reduced by further components, i.e., phases or time intervals, and its order can be changed.

[0138] To eliminate image noise, the invention provides that a dark image D is captured by the at least one monochrome image sensor 80 for the duration of a non-irradiation time TN.

[0139] The dark image D is acquired in such a way that during the duration of a non-irradiation time TN, the object 70 to be examined is not irradiated by light from the light sources 10, 20, 30, 40, 50 of the illumination module 200, but only by stray light S from at least one stray light source 60.

[0140] In other words, during the acquisition of the dark image D, all light sources 10, 20, 30, 40, 50 of the illumination module 200 are switched off. The dark image D, acquired by the at least one monochrome image sensor 80, contains, in particular, noise information. The noise information of the acquired dark image D includes at least information about the stray light S of at least one stray light source 60, which is located in the vicinity of the object 70 under investigation.

[0141] The noise information of the captured dark image D may also include additional information on the decay behavior of the monochrome image sensor 80 and / or information on the afterglow behavior of the monochrome image sensor 80.

[0142] The noise information of the captured dark frame D can also include additional information on unwanted effects such as artifacts, unrealistic edges, invisible lines, corners, blurred objects and disturbing background scenes.

[0143] The color sequence F and the dark image D according to the invention together form a pattern sequence M.

[0144] The generated pattern sequence M can be, for example, {RGB IR1 IR2 D}, where the proportion RGB IR1 IR2 of the pattern sequence M corresponds to the generated color sequence F, and the proportion D of the pattern sequence M corresponds to the captured dark frame D.

[0145] The resulting pattern sequence M, like the color sequence F, can include any further variation thereof. The resulting pattern sequence M can be cyclically regular or cyclically irregular. The resulting pattern sequence M can be extended or reduced by additional components.

[0146] For example, the pattern sequence M according to the invention, as shown in Fig. 5, can be extended by further components and be {DBGRGBGRDBGR} and, in particular, comprise two dark frames D, wherein the dark frame D is acquired first. It is conceivable that more than two dark frames D are acquired within a pattern sequence M. It is conceivable that the dark frame D is acquired not after every first cyclic color sequence F, but after every second or third cyclic color sequence F by the at least one monochrome image sensor 80. The resulting pattern sequence M can, for example, be {RGB IR1 IR2 DW} and additionally comprise a white frame W, wherein, during the acquisition of the white frame W, certain light sources 10, 20, 30, 40, 50 of the illumination module 200 are switched on simultaneously in order to illuminate the object 70 under investigation with certain colors simultaneously.Such a white image W is particularly suitable for focusing the object 70 under investigation, especially for generating a high-resolution sharp still image.

[0147] The generated pattern sequence M can, for example, be {LRGB IR1 IR2 D} and additionally include a luminance image L, whereby during the acquisition of the luminance image L, all light sources 10, 20, 30, 40, 50 of the illumination module 200 are switched on simultaneously in order to illuminate the object 70 under investigation with all colors at once. Such a luminance image L represents only the brightness, with all information usually captured without a filter. The luminance image L is, in particular, a black-and-white image, but it is not known which color information is contained in which pixel.

[0148] Fig. 3 shows a visualization unit 400 according to a second embodiment of the present invention. The visualization unit 400 comprises a visualization system 300 according to the invention and at least one monitor 260 for displaying high-resolution digital color images, in particular a high-resolution color video, in a medical application, especially in a visualization application.

[0149] The visualization system 300 comprises, as in the first embodiment, a lighting module 200, a storage module 210, an image generation module 220, a control module 230, a calculation module 240, and a computing unit 250. It is conceivable that the computing unit 250 includes the image generation module 220, the control module 230, and / or the calculation module 240.

[0150] The visualization system 300 comprises, as in the first embodiment, at least one monochrome image sensor 80 and additionally at least one further image sensor, which is in particular designed as a fluorescent light sensor 90. In other words, according to the second embodiment, several monochrome image sensors 80 and additionally several fluorescent light sensors 90 can be used. It is conceivable that the visualization system 300 has a beam splitter comprising the at least one monochrome image sensor 80 and the at least one fluorescent light sensor 90.

[0151] The monochrome image sensor 80 has a higher quantum efficiency or better light yield than the fluorescent light sensor 90.

[0152] It is conceivable that, in addition to the monochrome image sensor 80, or at least one of the other image sensors, it is designed as a multispectral sensor, mini-spectrometer, XYZ sensor, true-color sensor or RGB sensor.

[0153] In other words, it is conceivable that the additional image sensors, besides the monochrome image sensor, 80 further image sensors, or at least one of the further image sensors, are designed to detect a visible spectral range (VIS), and / or an infrared spectral range (near (NIR), medium (MIR) or far (FIR)), and / or an ultraviolet spectral range (extreme (EUV), strong (DUV) or weak (UV)), and / or a tera-Hz spectral range and / or an X-ray range.

[0154] For example, it is conceivable that at least one monochrome image sensor 80, one fluorescent light sensor 90 and one RGB sensor could be used.

[0155] The basic idea according to the second embodiment of the present invention is to separate the different sub-spectra from each other, in particular to separate the light RF reflected from the object 70 under investigation and the fluorescence light IR1, IR2 emitted from the object 70 under investigation, wherein in particular the visible spectral range (VIS) of the inventive color sequence F and the background light S are further detected by the at least one monochrome image sensor 80 or by the several monochrome image sensors 80, and the infrared spectral range (IR), in particular near-infrared spectral range (NIR), and the background light S are detected by the further image sensor, in particular by the at least one fluorescent light sensor 90 or by several fluorescent light sensors 90.

[0156] In other words, different sub-spectra can be simultaneously, but spatially and / or temporally separately, captured by various types of image sensors. The key advantage of this approach is that the resulting color images, especially color video, can be reconstructed more realistically and / or with improved color fidelity, or reproduced with improved image quality and / or reduced signal noise. This makes it possible to achieve the best possible spectral reconstruction of a real, observed scene at any given time.

[0157] By separately capturing the different sub-spectra using the monochrome image sensor 80 and the fluorescent light sensor 90, smaller amounts of image information are recorded per sensor for each sequence, thus enabling higher frame rates. This approach allows for such a dramatic increase in performance that it enables support for very high-resolution color videos, particularly 8K (7680 horizontal pixels and 4320 vertical pixels) at a frame rate of 60 FPS, and potentially even up to 12K (12288 horizontal pixels and 6480 vertical pixels) at a frame rate of 120 FPS.

[0158] The visualization system 300 according to the second embodiment further comprises a blocking filter 91 to allow the first fluorescent light IR1 and / or the second fluorescent light IR2 emitted by the object 70 to pass through an observation beam path, while filtering out reflected fluorescent excitation light and, if necessary, also stray light. The blocking filter 91 is specifically designed for light in the ultraviolet spectral range (extreme (EUV), strong (DUV), or weak (UV)), i.e., a filter that blocks ultraviolet light and is transparent to visible light.

[0159] Fig. 4 shows a representation of a pattern sequence M according to the second embodiment of the present invention.

[0160] As in the first embodiment of the present invention, the object 70 to be examined is irradiated with light of different wavelengths or wavelength bands in a color sequence F, i.e., in a temporally spaced sequence, in particular sequentially and selectively. As in the first embodiment of the present invention, a dark frame D is also acquired without irradiation of the object 70 to be examined in order to eliminate image noise.

[0161] However, an additional fluorescence dark image DF is acquired without irradiation of the object 70 to be examined, wherein the dark image D is further acquired by the at least one monochrome image sensor 80 or by the several monochrome image sensors 80 and the fluorescence dark image DF by the at least one fluorescence light sensor 90 or by the several fluorescence light sensors 90.

[0162] The inventive color sequence F, the inventive dark image D and the inventive fluorescence dark image DF together form a pattern sequence M.

[0163] As can be clearly seen in Fig. 4, the formed pattern sequence M is extended by a portion of the fluorescence dark image DF and can, for example, be {RGB IR1 D FD}, where the portion RGB IR1 of the pattern sequence M corresponds to the generated color sequence F and the portion D FD of the pattern sequence M corresponds to the captured dark image D and fluorescence dark image DF.

[0164] The resulting pattern sequence M can again comprise any further variation thereof. The resulting pattern sequence M can be cyclically regular or cyclically irregular. The resulting pattern sequence M can be extended or reduced by further components.

[0165] Image noise increases with the ISO value, especially at higher exposure indices. Image noise is primarily dependent on the pixel size and pixel pitch of an image sensor. The smaller the distance between the individual pixels of the image sensor, or the smaller the pixel size, the less light, and specifically fewer photons, each pixel can capture. This leads to an increase in interference signals and consequently to increased image noise.

[0166] Since the monochrome image sensor 80 and the fluorescence light sensor 90 differ in the size of the quanta and thus in the light yield, the dark image D captured by the at least one monochrome image sensor 80 and the fluorescence dark image DF captured by the at least one fluorescence light sensor 90 contain different noise information, so that this difference must be taken into account when processing the spectral individual images.

[0167] Fig. 6 shows a representation of the irradiation times for the formation of a pattern sequence M according to the invention.

[0168] The light sources 10, 20, 30, 40, 50 of the lighting module 200 are synchronized by the control module 230 with the at least one monochrome image sensor 80, so that the color sequence or pattern sequence according to the invention is generated in particular by sequential and selective switching on and off of the light sources 10, 20, 30, 40, 50.

[0169] In Fig. 6, the pattern sequence M according to the invention is: {BGR IR1 IR2 D}.

[0170] Accordingly, the object 70 to be examined is first irradiated by the third primary light source 30 with the third light B, in particular with a blue light with a wavelength range of approximately 420 to 480 nm for the duration of a third irradiation time T30.

[0171] The object 70 to be examined is then irradiated by the second primary light source 20 with the second light G, in particular with a green light with a wavelength range of approximately 480 to 620 nm for the duration of a second irradiation time T20.

[0172] The object 70 to be examined is then irradiated by the first primary light source 10 with the first light R, in particular with a red light with a wavelength range of approximately 620 to 680 nm for the duration of a first irradiation time T10.

[0173] The object 70 under investigation is then irradiated by the fourth light source 40, specifically by the first fluorescence excitation light source, with a first fluorescence excitation light FAR1, in particular with infrared light (IR ICG EX) with a central wavelength of 780 ± 10 nm, for a fourth irradiation time T40. The irradiation of the object 70 under investigation by the fourth light source 40 is based, in particular, on fluorescence detection, such that the object 70 under investigation is excited by the fourth light source 40. In response to the excitation, the object 70 under investigation emits a first fluorescence light IR1 (ICG EM), which has a defined absorption and emission spectrum in the wavelength range of approximately 800 to 850 nm.

[0174] The object 70 under investigation is then irradiated by the fifth light source 50, specifically by the second fluorescence excitation light source, with a second fluorescence excitation light FAR2, specifically with ultraviolet light (UV PpIX EX) with a central wavelength of 405 ± 10 nm, for a fifth irradiation time T50. The irradiation of the object 70 under investigation by the fifth light source 50 is also based on fluorescence detection, so that the object 70 under investigation is excited by the fifth light source 50. In response to the excitation, the object 70 under investigation emits a second fluorescence light IR2 (PpIX EM), which has a defined absorption and emission spectrum in the wavelength range of approximately 610 to 690 nm.

[0175] Afterwards, the object 70 to be examined is irradiated for a period of non-irradiation time TN, not by any light from the light sources 10, 20, 30, 40, 50 of the illumination module 200, but only by interference light S from at least one interference light source 60, which is arranged in the vicinity of the object 70 to be examined, in order to capture a dark image D.

[0176] The generated color sequence F: {BGR IR1 IR2} and the captured dark image D together form the pattern sequence M: {BGR IR1 IR2 D}.

[0177] The duration of the first irradiation time T10, the second irradiation time T20, the third irradiation time T30, the fourth irradiation time T40, the fifth irradiation time T50 and the non-irradiation time TN can each be flexibly adjusted.

[0178] In particular, the clock ratios or switching times of the control module 230 or the light modulator can be flexibly adjusted, so that the luminous intensities of the individual light sources 10, 20, 30, 40, 50 of the lighting module 200 can also be flexibly adjusted.

[0179] It is conceivable that the irradiation time and / or luminance of individual or all colors within the color sequence F are the same. It is conceivable that the irradiation time and / or luminance of individual or all colors within the color sequence F are different. It is conceivable that only individual components of the color sequence F with short irradiation times and high luminance are used. Depending on the requirements for latency and signal strength in the spectral images, it may be advantageous, for example, to make the green component G of the color sequence F shorter due to the high sensitivity of the monochrome image sensor 80 and to use more irradiation time for the detection of the fluorescent light, for example 5ALA.

[0180] As can be clearly seen in Fig. 5, it is conceivable to repeat the green component G of the color sequence F several times within a cycle in order to increase the frame rate in this channel.

[0181] This allows a large number of different color sequences F to be generated, and thereby any variations of the pattern sequences M to be formed.

[0182] The pattern sequence M captured by the monochrome image sensor 80 or the image signals output by the monochrome image sensor 80 are stored in a memory module 210.

[0183] Depending on the pattern sequence formed, an image generation module 220 generates individual spectral images, in particular at least three different colored spectral images and at least one spectral fluorescence image.

[0184] The three differently colored spectral images and the at least one spectral fluorescence image each correspond to individual black and white images, in particular grayscale images, which were recorded sequentially and synchronously by the monochrome image sensor 80 for the respective light source and irradiation time.

[0185] The monochrome image sensor 80 does not have a CFA matrix and therefore cannot register colors, since in each individual black-and-white image, especially grayscale images, it is not known which color information is contained in which pixel. The color information is determined via the light intensity and the corresponding synchronously assigned light. In other words, each spectral image and the spectral fluorescence image is a grayscale image in which the value of each recorded pixel represents the respective amount of light at its position; that is, it only carries intensity information. The contrast ranges from black at the weakest intensity to white at the strongest intensity. Each individual grayscale image uses different shades of gray. In 8-bit images, up to 256 shades of gray can be present. Each pixel of an individual grayscale image thus has a brightness value between 0 (black) and 255 (white).In contrast, 16-bit and 32-bit images have a greater number of shades in an image than 8-bit images.

[0186] During the sequential recording of each individual spectral image and the spectral fluorescence image, the monochrome image sensor 80 also simultaneously recorded the background light S of at least one background light source 60, which is located in the vicinity of the object 70 under investigation, so that noise information is contained in each individual spectral image and the spectral fluorescence image.

[0187] To eliminate this contained noise information, the dark frame D, which serves in particular as a correction and reference image, was captured by the monochrome image sensor 80.

[0188] In calculation module 240, the acquired dark image D is subtracted from each of the individual spectrally generated images and at least one spectrally generated fluorescence image to generate the respective clean images. Subsequently, in calculation module 240, the respective clean images are summed to form a composite color image.

[0189] When using an additional fluorescence light sensor 90, a subtraction of the captured dark image D from the at least three differently colored spectrally generated individual images and, additionally, a subtraction of the captured fluorescence dark image DF from the at least one spectrally generated fluorescence light image would have to be performed to generate the respective clean images, since the dark image D and the fluorescence dark image DF contain different noise information. To generate a plurality of summed color images, the process steps a) to k) according to the invention are repeated by the computer unit 250 at least 50 cycles Z per second, preferably at least 60 cycles Z per second, and particularly preferably at exactly 50 or 60 cycles Z per second, so that the impression of a multicolored video sequence is created.In particular, a high-resolution color video is generated from the multitude of sum color images by the computer unit 250, which can then be displayed on a monitor 260.

[0190] B ez uqs ze ichenli ste

[0191] 10 first light source 20 second light source 30 third light source 40 first fluorescence excitation light source

[0192] 50 Second fluorescence excitation light source 60 Interference light source

[0193] 70 objects to be examined

[0194] 80 monochrome image sensor 90 fluorescence light sensor 91 blocking filter

[0195] 100 procedures

[0196] 200 Lighting module 210 Storage module 220 Image generation module 230 Control module

[0197] 240 Calculation module 250 Computer unit 260 Monitor 300 Visualization system

[0198] 400 visualization units

[0199] D Dark image DF Fluorescence dark image L Luminance image W White image

[0200] F Color sequence M Pattern sequence R First light

[0201] G second light

[0202] B third light

[0203] RF light reflected from the object

[0204] FAR1 fourth light

[0205] FAR2 fifth light

[0206] IR1 is the first fluorescent light emitted by the object.

[0207] IR2 is the second fluorescent light emitted by the object.

[0208] NIR near-infrared spectral range

[0209] MIR mid-infrared spectral range

[0210] FIR and infrared spectral range

[0211] UV weak ultraviolet spectral range

[0212] DUV (strong ultraviolet spectral range)

[0213] EUV extreme ultraviolet spectral range

[0214] S Stray light

[0215] T10 first irradiation time

[0216] T20 second irradiation time

[0217] T30 third irradiation time

[0218] T40 fourth irradiation time

[0219] T50 fifth irradiation time

[0220] TN Non-irradiation time

[0221] Z cycles

Claims

P a t e n t a n s p r ü c h e 1. Method (100) for displaying a color video in a medical application, in particular in a visualization application, wherein the method (100) comprises the steps of: a) irradiating an object (70) to be examined with a first light (R) of a visible spectral range by an illumination module (200) for the duration of a first irradiation time (T10), b) irradiating the object (70) to be examined with a second light (G) of a visible spectral range by the illumination module (200) for the duration of a second irradiation time (T20), c) irradiating the object (70) to be examined with a third light (B) of a visible spectral range by the illumination module (200) for the duration of a third irradiation time (T30), d) irradiating the object (70) to be examined with at least one fourth light (FAR1) of an excitation spectral range, in particular with a first fluorescence excitation light,which is suitable for exciting a first fluorescent light (IR 1 ) emitted by the object (70) by the illumination module (200) for the duration of a fourth irradiation time (T40), e) continuous detection of light (RF) reflected by the object (70) and of first fluorescent light (IR1) emitted by the object (70) as well as of background light (S) from at least one background light source (60) which is arranged in the vicinity of the object (70) to be examined, by at least one monochrome image sensor (80), wherein the illumination module (200) is switched synchronously with the at least one monochrome image sensor (80) by a control module (230), f) detection of a dark frame (D) by the at least one monochrome image sensor (80) for the duration of a non-irradiation time (TN), wherein during the detection of the dark frame (D) the object (70) to be examined is not illuminated by light from the illumination module (200),but only by interference light (S) from at least one interference light source (60), g) wherein the illumination module (200) is sequentially and selectively switched on and off by the control module (230) to form a pattern sequence (M) for the first, second, third, fourth irradiation time (T10, T20, T30, T40) and non-irradiation time (TN), h) Storing the image signals output by the at least one monochrome image sensor (80) in a storage module (210), i) Generating at least three different spectral images and at least one spectral fluorescence image by an image generation module (220), j) Subtracting the captured dark image (D) from the at least three different spectral images and the at least one spectral fluorescence image to generate the respective clean images in a processing module (240), k) Adding the respective clean images to form a composite color image in the processing module (240), l) wherein the process steps a) to k) are repeated by a computer unit (250) at least 50 cycles (Z) per second, preferably at least 60 cycles (Z) per second, and particularly preferably at exactly 50 or 60 cycles (Z) per second to generate a plurality of composite color images.m) Generation of a color video from the multitude of sum color images by the computer unit (250), n) Display of the color video on a monitor (260), wherein the interfering light is ambient light.

2. Method (100) for displaying a color video in a medical application, in particular in a visualization application, wherein the method (100) comprises the steps of: a) irradiating an object (70) to be examined with a first light (R) of a visible spectral range by means of an illumination module (200) for the duration of a first irradiation time (T10), b) irradiating the object (70) to be examined with a second light (G) of a visible spectral range by means of the illumination module (200) for the duration of a second irradiation time (T20), c) irradiating the object (70) to be examined with a third light (B) of a visible spectral range by means of the illumination module (200) for the duration of a third irradiation time (T30), d) Irradiation of the object (70) to be examined with at least one fourth light (FAR1) of an excitation spectral range, in particular with a first fluorescence excitation light suitable for exciting a first fluorescence light (IR1) emitted by the object (70), by the illumination module (200) for the duration of a fourth irradiation time (T40); e) Continuous detection of light (RF) reflected by the object (70) and of stray light (S) from at least one stray light source (60) located in the vicinity of the object (70) to be examined by at least one monochrome image sensor (80), wherein the illumination module (200) is synchronized with the at least one monochrome image sensor (80) by a control module (230); f) Continuous detection of a first fluorescence light (IR1) emitted by the object (70) by at least one fluorescence light sensor (90).wherein the illumination module (200) is synchronized with the at least one fluorescence light sensor (90) by the control module (230), g) acquisition of a dark image (D) by the at least one monochrome image sensor (80) for the duration of a non-irradiation time (TN), wherein during the acquisition of the dark image (D) the object (70) to be examined is not irradiated by light from the illumination module (200), but only by background light (S) from the at least one background light source (60), h) acquisition of a fluorescence dark image (DF) by the at least one fluorescence light sensor (90) for the duration of a non-irradiation time (TN), wherein during the acquisition of the fluorescence dark image (DF) the object (70) to be examined is not irradiated by light from the illumination module (200), but only by background light (S) from the at least one background light source (60), i) wherein the illumination module (200) sequentially selective to form a pattern sequence for the first,second, third, fourth irradiation time (T10, T20, T30, T40) and non-irradiation time (TN) is switched on and off by the control module (230), j) storing the image signals output by the at least one monochrome image sensor (80) and the at least one fluorescence light sensor (90) in a storage module (210), k) Generation of at least three differently colored spectral images and at least one spectral fluorescence image by an image generation module (220), l) respective subtraction of the captured dark frame (D) from the at least three differently colored spectrally generated individual images and subtraction of the captured fluorescence dark frame (DF) from the at least one spectrally generated fluorescence image to generate respective clean images in a processing module (240), m) addition of the respective clean images to form a composite color image in the processing module (240), n) wherein the process steps a) to m) are repeated with at least 50 cycles (Z) per second, preferably with at least 60 cycles (Z) per second, particularly preferably with exactly 50 or 60 cycles (Z) per second, to generate a plurality of composite color images by a processing unit (250), o) generation of a color video from the plurality of composite color images by the processing unit (250),p) Display of the color video on a monitor (260), wherein the interfering light is an ambient light.

3. Method (100) according to claim 1 or 2, characterized in that the object (70) to be examined is irradiated by the illumination module (200) with at least one fifth light (FAR2) of an infrared spectral range (near (NIR), medium (MIR) or far (FIR)) or of an ultraviolet spectral range (extreme (EUV), strong (DUV) or weak (UV)), or of a tera-Hz spectral range or of an X-ray range, in particular with a second fluorescence excitation light which is suitable for exciting a second fluorescence light (IR2) emitted by the object (70) for the duration of a fifth irradiation time (T50).

4. Method (100) according to one of the preceding claims, characterized in that the duration of the first irradiation time (T10), the second irradiation time (T20), the third irradiation time (T30), the non-irradiation time (TN), the fourth irradiation time (T40) and the fifth irradiation time (T50) is flexibly adjustable.

5. Method (100) according to one of the preceding claims, characterized in that the object (70) to be examined is continuously irradiated with the fourth light (FAR1) and / or the fifth light (FAR2) through the illumination module (200), but not during the acquisition of the dark image (D) and / or the fluorescence dark image (DF).

6. Method (100) according to one of the preceding claims, characterized in that the first fluorescence light (IR1) and / or the second fluorescence light (IR2) emitted by the object (70) are guided in an observation beam path through a blocking filter (91), in particular a UV blocking filter, which has a pass range for first fluorescence light (IR1) and / or second fluorescence light (IR2).

7. Visualization system (300) for displaying a color video in a medical application comprising: an illumination module (200) configured to emit at least one first light (R) of a visible spectral range for the duration of a first irradiation time (T10), at least one second light (G) of a visible spectral range for the duration of a second irradiation time (T20), at least one third light (B) of a visible spectral range for the duration of a third irradiation time (T30), at least one fourth light (FAR1) of an excitation spectral range, in particular a first fluorescence excitation light suitable for exciting a first fluorescence light (IR1) emitted by an object (70) under investigation, for the duration of a fourth irradiation time (T40), and at least one fifth light (FAR2) of an infrared spectral range (near (NIR), medium (MIR), or far (FIR)) or an ultraviolet Spectral range (extreme (EUV),strong (DUV) or weak (UV)), or a tera-Hz spectral range or an X-ray range, in particular a second fluorescence excitation light suitable for exciting a second fluorescence light (IR2) emanating from the object (70), to be emitted by the illumination module (200) for the duration of a fifth irradiation time (T50), at least one monochrome image sensor (80) configured to detect light (RF) reflected from the object (70) under investigation, at least one first fluorescent light (IR1) emitted from the object (70) under investigation, at least one second fluorescent light (I2) emitted from the object (70) under investigation, a background light (S) from at least one background light source (60) located in the vicinity of the object (70), wherein the background light is ambient light, and a dark frame (D), wherein the at least one monochrome image sensor (80) is further configured to detect at least 50 cycles (Z) per second, preferably at least 60 cycles (Z) per second, and particularly preferably exactly 50 or 60 cycles (Z) per second, a control module (230) configured to synchronize the illumination module (200) with the at least one monochrome image sensor (80),wherein the control module (230) is further configured to switch the illumination module (200) on and off sequentially and selectively according to a pattern sequence (M) for the duration of different irradiation times and / or for constant irradiation times, a storage module (210) configured to store the image signals output by the at least one monochrome image sensor (80), an image generation module (220) configured to generate at least three differently colored spectral images and at least one spectral fluorescence image from the image signals stored in the storage module (210), a calculation module (240) configured toa respective subtraction of the captured dark image (D) from the at least three differently colored spectrally generated individual images and the at least one spectrally generated fluorescence image, or a respective subtraction of the captured dark image (D) from the at least three differently colored spectrally generated individual images to generate respective clean images, wherein the computing module (240) is further configured to perform an addition of the respective clean images to form a sum color image, a computing unit (250) configured to operate the illumination module (200), the at least one monochrome image sensor (80), the control module (230), the storage module (210), the image generation module (220) and the computing module (240) at least 50 cycles (Z) per second, preferably at least 60 cycles (Z) per second, particularly preferably exactly 50 or 60 cycles (Z) per second, to repeatedly control and to generate a color video for display on a monitor (260) from the multitude of formed sum color images.

8. Visualization system (300) according to claim 7, characterized in that the visualization system (300) is configured to carry out a method according to one of claims 1, 3 to 6.

9. Visualization system (300) for displaying a color video in a medical application, comprising: an illumination module (200) configured to emit at least one first light (R) of a visible spectral range for the duration of a first irradiation time (T10), at least one second light (G) of a visible spectral range for the duration of a second irradiation time (T20), at least one third light (B) of a visible spectral range for the duration of a third irradiation time (T30), at least one fourth light (FAR1) of an excitation spectral range, in particular a first fluorescence excitation light suitable for exciting a first fluorescence light (IR1) emitted by an object (70) under investigation, for the duration of a fourth irradiation time (T40), and at least one fifth light (FAR2) of an infrared spectral range (near (NIR), medium (MIR), or far (FIR)) or an ultraviolet Spectral range (extreme (EUV),strong (DUV) or weak (UV)), or a tera-Hz spectral range or an X-ray range, in particular a second fluorescence excitation light suitable for exciting a second fluorescence light (IR2) emanating from the object (70), to be emitted by the illumination module (200) for the duration of a fifth irradiation time (T50), - at least one monochrome image sensor (80) configured to detect light (RF) reflected from the object (70) under investigation, at least one first fluorescence light (IR1) emitted from the object (70) under investigation, at least one second fluorescence light (IR2) emitted from the object (70) under investigation, a stray light (S) from at least one stray light source (60) located in the vicinity of the object (70) under investigation, and a dark frame (D), wherein the at least one monochrome image sensor (80) is further configured to take at least 50 cycles (Z) per second, preferably at least 60 cycles (Z) per second. to capture 50 or 60 cycles (Z) per second, especially preferably exactly 50 or 60 cycles per second, - at least one fluorescence light sensor (90) configured to detect at least one first fluorescence light (IR1), at least one second fluorescence light (IR2), a stray light (S) from at least one stray light source (60) located in the vicinity of the object (70), and a fluorescence dark image (DF), wherein the fluorescence light sensor (90) is further configured to detect at least 50 cycles (Z) per second, preferably at least 60 cycles (Z) per second, and particularly preferably exactly 50 or 60 cycles (Z) per second; a control module (230) configured to synchronize the illumination module (200) with the at least one monochrome image sensor (80) and / or the fluorescence light sensor (90), wherein the control module (230) furthermore, it is configured tothe illumination module (200) sequentially and selectively switches on and off according to a pattern sequence (M) for different irradiation times and / or for constant irradiation times, a storage module (210) configured to store the image signals output by the monochrome image sensor (80) and the fluorescence light sensor (90), an image generation module (220) configured to generate at least three differently colored spectral images and at least one spectral fluorescence light image from the image signals stored in the storage module (210), a calculation module (240) configured toa respective subtraction of the captured dark image (D) from the at least three differently colored spectrally generated individual images and the at least one spectrally generated fluorescence image, or a respective subtraction of the captured dark image (D) from the at least three differently colored spectrally generated individual images and a subtraction of the captured fluorescence dark image (DF) from the at least one spectrally generated fluorescence image to generate respective clean images, wherein the calculation module (240) is further configured to perform an addition of the respective clean images to form a sum color image, a computing unit (250) configured to control the illumination module (200), the monochrome image sensor (80), the fluorescence light sensor (90), the control module, dul (230), the storage module (210), the image generation module (220) and the calculation module (240) repeatedly in at least 50 cycles (Z) per second, preferably in at least 60 cycles per (Z) second, particularly preferably in exactly 50 or cycles (Z) per second, and to generate a color video for display on a monitor from the multitude of formed sum color images.

10. Visualization system (300) according to claim 9, characterized in that the visualization system (300) is configured to carry out a method according to one of claims 2 to 6.

11. Visualization system (300) according to claims 7 to 10, characterized in that it comprises the computer unit (250), the image generation module (220), the control module (230) and / or the computation module (240).

12. Visualization unit (400) comprising a visualization system (300) according to any one of claims 7 to 11 and at least one monitor (260).

Images