Method of using two color images and a color camera for fluorescence and white light, a processor, and a medical observation device

Abstract

This application relates to an image processor (170) and a computer-implemented image processing method for generating a digital output color image (160) of an object (106) using a medical observation device (100) such as a microscope or an endoscope. The method includes the following steps: recording or acquiring a digital white light color image (114) of the object (106) in a first imaging spectrum (202) using a white light color camera (110); recording or acquiring a digital fluorescence color image (112) of the object (106) in a second imaging spectrum (222) using a fluorescence color camera (111), wherein the second imaging spectrum (222) overlaps with the fluorescence emission spectrum (226) of at least one phosphor (116), the second imaging spectrum (222) is different from the first imaging spectrum (202), and both the first and second imaging spectra (202, 222) overlap with the visible spectrum (212); and generating a digital output color image (160) by combining the digital fluorescence color image (112) and the digital white light color image (114). The image processor (170) is configured to perform these steps. The application further relates to a medical observation device (100) including such an image processor (170) and a method for operating such a device including the above computer-implemented image processing method.

Description

Technical Field

[0001] The claimed subject matter relates to a computer-implemented image processing method and an image processor for generating a digital output color image of an object using a medical observation device such as a microscope or an endoscope. Further, the claimed subject matter relates to a method for operating such a medical observation device and the medical observation device itself.

Background Art

[0002] In existing medical observation devices, fluorescence images and white light images are recorded by a single camera. However, it is a problem that the fluorescence intensity is significantly lower than the white light reflectance. Therefore, the recorded fluorescence is masked by this white light reflectance and is difficult to detect.

[0003] Other medical observation devices use a grayscale camera to record fluorescence and a color camera to record white light images. In such a setup, the fluorescence image and the white light image are digitally mixed and the fluorescence is marked with a pseudo-color. The drawback here is that this pseudo-color cannot accurately represent the color of the fluorescence as perceived by the human eye.

Summary of the Invention

Problems to be Solved by the Invention

[0004] Therefore, there is a need to provide a medical observation device that generates a natural appearance of both the reflection spectrum and the fluorescence spectrum of an object, i.e., a true-color color image.

Means for Solving the Problems

[0005] This need is addressed by a computer-implemented image processing method for generating a digital output color image of an object, in particular using a medical observation device such as a microscope or an endoscope. The method comprises the following steps: obtaining a digital white light color image of the object recorded in a first imaging spectrum, for example using a white light color camera; obtaining a digital fluorescence color image of the object recorded in a second imaging spectrum, for example using a fluorescence color camera, wherein the second imaging spectrum overlaps with the fluorescence emission spectrum of at least one phosphor, the second imaging spectrum is different from the first imaging spectrum, and both the first and the second imaging spectra overlap with the visible spectrum; and generating a digital output color image by combining the digital fluorescence color image and the digital white light color image.

[0006] This need is further addressed by an image processor for a medical observation device such as a microscope or an endoscope. The image processor is configured to obtain a digital white light color image of the object recorded in a first imaging spectrum, for example using a white light color camera, and to obtain a digital fluorescence color image of the object recorded in a second imaging spectrum, for example using a fluorescence color camera, wherein the first imaging spectrum overlaps with the fluorescence emission spectrum of at least one phosphor, the first imaging spectrum is different from the second imaging spectrum, and both the first and the second imaging spectra overlap with the visible spectrum, and to generate a digital output color image by combining the digital fluorescence color image and the digital white light color image.

[0007] Finally, this need is addressed in a medical observation device by using a fluorescence color camera to record a part of the spectrum of the digital output color image generated by the medical observation device. The medical observation device further comprises a white light color camera configured to record another part of the spectrum of the digital output color image.

[0008] By using a color camera for both the fluorescence image and the white light image, a faithful color output image with high color accuracy can be provided.

[0009] The above solution means may be further improved by the following features, which may be added or combined independently of each other, and each feature has its own advantageous technical effect.

[0010] Each of the following features may be used to improve one of the above methods and / or may be used to improve one of the above devices, regardless of whether a particular feature is mentioned in relation to the method only or in relation to the device only.

[0011] The computer-implemented image processing method may include a step of demosaicking at least one of a digital white light color image and a digital fluorescence color image. Demosaicking may avoid color artifacts.

[0012] The computer-implemented image processing method may further include a step of normalizing at least one of a digital white light color image and a digital fluorescence color image. Normalization facilitates the co-processing of the digital white light color image and the digital fluorescence color image.

[0013] The computer-implemented image processing method may further include a step of aligning at least one of a digital white light color image and a digital fluorescence color image. By this alignment, image features present in both the digital white light color image and the digital fluorescence color image are represented in the same size and orientation in each image. After alignment, the digital white light color image and the digital fluorescence color image match each other.

[0014] The image processor may be configured to execute any of the above processing steps.

[0015] The fluorescence color camera is not necessarily limited to recording only fluorescence images. In one embodiment, the fluorescence color camera can record additional digital white light color images that can complement the digital white light color images recorded by the white light color camera. If it is necessary to change the second imaging spectrum, i.e., if the fluorescence color camera needs to record images in a different second imaging spectrum, changes in the optical settings may be required, for example, the replacement of one or more filters may be necessary. This may apply to cases where different phosphors are used in the object.

[0016] According to another advantageous embodiment of the computer-implemented image processing method and / or the image processor, the first imaging spectrum and the second imaging spectrum are complementary to each other. In such a configuration, crosstalk between fluorescence and white light is avoided, while on the one hand, the fluorescence of at least one phosphor and on the other hand, an accurate representation of the reflectance of the object are maintained. Furthermore, by providing the digital fluorescence color image and the digital white light color image with spectra that are complementary to each other, respectively, the joint processing of these two images for forming a multi-spectral image is facilitated.

[0017] The digital white light color image may be represented using at least three first color bands in a first color space.

[0018] The digital fluorescence color image may be represented in a second color space including at least three second color bands. The first and second color spaces are preferably the same, whereby the first and second color bands are also the same. However, this does not necessarily have to be the case. The first and second color spaces may be different.

[0019] The digital output color image may be generated in a third color space including at least three third color bands. The third color space may be the same color space as the first and / or second color spaces, or may be a different color space.

[0020] Any one of the first, second, and / or third color spaces may be an RGB color space including three color bands R, G, B, or any other color space such as a multi-spectral color space or a hyper-spectral color space, that is, a color space using four or more color bands. The expression "color band" is used as a synonym for "color space coordinates" in this text. The same color is represented by different color space coordinates in different color spaces.

[0021] According to one embodiment of a computer-implemented image processing method and / or an image processor, the first color band and the second color band are mapped onto a third color band of a digital output color image using a linear transformation. The linear transformation can include a color transformation matrix or a linear function. A color transformation matrix may be applied to the first color band and the second color band to map the first and second color bands onto the third color band. Preferably, each color band of the first color band and each color band of the second color band are input into the linear transformation as separate color bands. In particular, each color band of the first color band and each color band of the second color band may be input into the linear transformation simultaneously.

[0022] The color transformation matrix or the linear function can be resident in the memory of the image processor or the medical observation device.

[0023] The color transformation matrix can have dimensions of a numerical value X in one direction × a numerical value Y in another direction. The numerical value X may be the sum of the amount of the first color band, that is, the number of color bands in the first color band, and the amount of the second color band, that is, the number of color bands in the second color band. In other words, one dimension of the color transformation matrix may be the sum of the dimension of the color space of the digital fluorescence color image and the dimension of the color space of the digital white light color image. The numerical value Y may be the amount of color bands in the third color space. In other words, the other dimension of the color transformation matrix may correspond to the dimension of the color space of the digital output color image. For example, when the first, second, and third color spaces are each an RGB color space, the color transformation matrix has dimensions of 6×3 or 3×6.

[0024] Thus, the third color band, i.e., the color band of the digital output color image, can result from a linear combination of the color band of the digital white light color image and the color band of the digital fluorescence color image.

[0025] According to one aspect, the digital fluorescence color image and the digital white light color image are co-processed as a multi-spectrum image whose color band is formed or constituted by complementary color bands of the digital fluorescence color image and the digital white light color image. This leads to improved color rendering, especially when the fluorescence image is represented by reflected white light recorded in the second imaging spectrum and thus can complement the white light information in the white light color image. By using this procedure, the white light information is included in the color band of the digital fluorescence color image and thus will be provided with a finer color granularity than the color granularity that the digital white light color image exactly provides. When the digital fluorescence color image is represented by fluorescence emission, processing the digital white light color image and the digital fluorescence color image as a multi-spectrum image represents a faithful representation of the object under both reflected white light and fluorescence.

[0026] According to another advantageous embodiment, the first imaging spectrum can include a first sub-band in the color band of the color space, and the second imaging spectrum can include a second sub-band in this color band, where the first sub-band and the second sub-band are preferably complementary to each other. The color space can be the color space of the digital white light color image, the color space of the digital fluorescence color image, or preferably the color space of the digital output color image. Having such subdivided color bands facilitates the linear transformation for mapping the color bands of the fluorescence and white light color images to the color band of the digital output color image. It is preferable that the sub-bands of one color band together complete each respective color band. This ensures that no useful spectral information is lost.

[0027] Of course, in two or more color bands of each color space, the first and second sub-bands may be present. The more sub-bands are used in different color bands, the more accurate the spectral information recorded in each white light or fluorescent color image becomes. The sub-bands within a color band may themselves be divided into a plurality of different wavelength bands that are distinct from each other.

[0028] Preferably, the second imaging spectrum includes IR wavelengths. This enables the capture of near-infrared fluorescence emission.

[0029] The above computer-implemented image processing method may be executed when executing a method for operating a medical observation device. The above-described image processor may be part of a medical observation device such as a microscope or an endoscope, and in particular may be part of a microscope or an endoscope configured for surgery such as neurosurgery, orthopedic surgery, and / or ophthalmic surgery. The microscope may be, for example, a laboratory microscope used for biopsy.

[0030] A method for operating a medical observation device may include recording a digital white light color image using a white light color camera and recording a digital fluorescent color image using a digital fluorescent color camera. The medical observation device may include a digital fluorescent color camera and a white light color camera.

[0031] To reduce post-processing, the fluorescent color camera and the white light color camera can have overlapping coaxial and / or preferably the same field of view.

[0032] The medical observation device may be a stereoscopic device or a monocular device. In one embodiment, a digital fluorescent color camera and a white light color camera may be provided in each stereoscopic channel. Alternatively, in a medical monocular observation device, only a single white light color camera and a single digital fluorescent color camera may be provided.

[0033] In an alternative arrangement configuration of the medical stereoscopic observation device, the fluorescence color camera may be provided in one stereoscopic channel, while the white light color camera may be provided in the other stereoscopic channel. In such an arrangement configuration, the fluorescence color camera may be configured to record a (white light) reflected image in the second imaging spectrum. In the case of the (white light) reflected image, this arrangement configuration provides stereoscopic vision, but strictly speaking, this stereoscopic vision is limited to the overlapping portion of the first and second imaging spectra. However, this is hardly noticed by a human observer. When fluorescence emission is recorded, the fluorescence color camera provides monocular vision based on the fluorescence emission of the object, while the white light color camera provides monocular vision based on the reflectivity of the object.

[0034] The medical observation device can include an optical color separation assembly configured to split the light incident thereon into a first imaging spectrum and a second imaging spectrum. The color separation assembly can include optical elements such as a beam splitter, particularly a dichroic beam splitter, and / or optical filters such as a fluorescence filter that blocks light other than fluorescence emission and a white light filter that blocks fluorescence emission.

[0035] The medical observation device can further include an illumination assembly that is preferably adjustable by including, for example, a plurality of LEDs or OLEDs of different colors or other light sources that emit light in a plurality of different spectral bands and can be individually turned on and off.

[0036] To facilitate post-processing and ensure that the recorded intensity values of digital white light images and digital fluorescence color images are comparable to each other, it is preferred that the digital fluorescence color image and the digital white light color image are recorded simultaneously, and / or the same exposure time is used, and / or the same gain and / or the same white balance and / or color correction are used. Furthermore, the gain of the digital fluorescence color camera and the gain of the digital white light color camera may be maintained at a constant ratio, or alternatively, may be automatically adapted. Among these possibilities, it is most preferred that the white light color camera and the fluorescence color camera are synchronized with respect to at least one of the exposure time and the gain. The white light color camera and / or the fluorescence color camera are preferably CCD or CMOS cameras. The fluorescence camera and the white light color camera are preferably identical.

[0037] According to another aspect, the medical observation device can include a memory in which a plurality of different color conversion matrices are stored. Each color conversion matrix represents a different combination of the first and second imaging spectra, i.e., a different filter set used in the color separation assembly, which is required when different phosphors or combinations of different phosphors are used. Examples of phosphors used in this context are 5-ALA, fluorescein, and ICG. Each of these phosphors requires excitation at a different wavelength and emits fluorescence at a different wavelength. Thus, in a surgical environment where ICG is used, the first and second imaging spectra are different from those in a surgical environment where 5-ALA is used and require different color conversion matrices. Therefore, the sub-bands of the first and second imaging spectra in the color bands of each color space are different for each case of the phosphor.

[0038] The color conversion matrix may be selectable automatically or manually from a plurality of color conversion matrices depending on the phosphor used. For example, a medical observation device may be configured to automatically detect the configuration or setting of a color separation assembly and select a color conversion matrix depending on this setting. For example, when the optical filter of the color separation assembly is replaced for use with 5-ALA, the medical observation device can automatically select the color conversion matrix for this 5-ALA. Of course, this selection can also be made manually, or the automatic selection may be overwritten manually.

[0039] The subject matter recited in the claims also relates to a computer-readable medium and a computer program that, in any of the above-described embodiments, includes instructions for causing a computer to perform computer-implemented image processing.

[0040] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".

[0041] Although some aspects have been described in the context of an apparatus, it is clear that these aspects also represent a description of the corresponding method, where a block or apparatus corresponds to a step or a feature of a step. Similarly, aspects described in the context of a step also represent a description of the corresponding block or item or feature of the corresponding apparatus.

[0042] Hereinafter, the present invention will be exemplarily described with reference to embodiments and drawings. The combinations of features shown in these embodiments should not be regarded as limiting. For example, features that are not required for a particular application in an embodiment having the above-described technical effects may be omitted. Conversely, in some of the embodiments described below, features that are not part of the embodiments described above may be added if they are required for the technical effects associated with this particular feature in a particular application.

[0043] Throughout this specification and the drawings, the same reference numerals are used for elements that correspond to each other with respect to function and / or structure.

Brief Description of the Drawings

[0044]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Embodiments for Carrying Out the Invention

[0045] Exemplary embodiments of the present invention will be described with reference first to FIG. 1.

[0046] Figure 1 schematically shows a medical observation device 100. The medical observation device 100 may be a microscope or an endoscope. The main difference between a microscope and an endoscope is that in an endoscope (not shown), the object 106 is observed through an optical fiber that is brought close to the object 106 to be inspected, for example, by inserting it into the body containing the object, while in a microscope, the objective lens 174 is directed towards the object. The medical observation device in Figure 1 is a microscope, but the following description also applies to an endoscope. The medical observation device 100 may be a medical observation device used in surgery. The medical observation device 100 may also be a medical observation device such as a laboratory microscope used in a laboratory. The object 106 to be inspected may consist of or include a biological tissue 107.

[0047] The object 106 may include one or more phosphors 116, 118. At least one phosphor may be a phosphor naturally contained in the object. For example, bone and blood contain phosphors. At least one phosphor may be added to the object 106, for example, by injecting it into the biological tissue 107. Examples of phosphors that may be added to the object 106 are ICG, fluorescein, and / or 5-ALA.

[0048] The medical observation device 100 is a fluorescence imaging device. This means that the medical observation device is configured to observe the fluorescence of one or more phosphors 116, 118 and preferably also to excite it.

[0049] The medical observation device 100 may be a stereoscopic device as exemplarily shown in Figure 1. Thus, this device may include two identical sub-assemblies 101L and 101R for each of the two stereoscopic channels. Since the two sub-assemblies 101L, 101R are identical in terms of function and structure, the following description focuses on the right-hand sub-assembly 101R, but is equally applicable to the left-hand stereoscopic channel 101L.

[0050] The medical observation device 100 may alternatively be a monocular device. In this case, only one of the two sub-assemblies 101L, 101R may be present. Therefore, the following description also applies equally to the medical monocular observation device 100.

[0051] The medical observation device 100 may be used to generate at least one digital white light color image 114, which preferably represents a reflected image of the object 106 over the entire visible light range. This visible light range or visible spectrum includes wavelengths from about 310 nm to about 1100 nm, or from about 380 nm to about 750 nm, or from about 450 nm to about 700 nm. When a fluorescence spectrum or multiple phosphors are used, the fluorescence spectra of the phosphors 116, 118 are preferably omitted from the spectrum recorded in the digital white light color image 114. This ensures that only the reflected light is included in the digital white light color image 114 when fluorescence is present. For example, when 5-ALA is used as a phosphor, the fluorescence spectrum from about 625 nm to about 650 nm may not be recorded in the digital white light color image 114.

[0052] When light of a specific wavelength is used to excite fluorescence, the spectrum including or consisting of these wavelengths may also not be recorded or represented in the digital white light color image 114. For example, when 5-ALA is used as a phosphor, fluorescence may be excited by irradiating the object 106 with wavelengths between about 380 nm and about 450 nm. For fluorescein, ICG and other phosphors, although the excitation and emission spectra are different from those of 5-ALA, they are applied within known ranges.

[0053] By not recording the fluorescence excitation spectrum and the fluorescence emission spectrum, the digital white light color image 114 represents the reflectance of the object 106, that is, a white light image of the object 106 that would be seen by a human observer. Therefore, the digital white light color image 114 may be regarded as a natural color or true color image.

[0054] The digital imaging system 102 may further be used to generate a digital fluorescence color image 112 of the object 106. The digital fluorescence color image 112 represents the fluorescence emission of one or more phosphors 116, 118. Therefore, preferably, the digital fluorescence color image 112 does not record wavelengths outside the emission spectrum or the emission spectra of one or more phosphors.

[0055] Both the digital white light color image 114 and the digital fluorescence color image 112 are color images. These images are recorded using at least three color bands, i.e., the primary colors of the color space. For example, the digital white light color image 114 and the digital fluorescence color image 112 may be recorded in the RGB color space using three primary colors or color bands R, G, B. Alternatively, the digital white light color image 114 and the digital fluorescence color image 112 may be recorded in different color spaces respectively, and / or may be represented by multi-spectral or hyperspectral color images. The digital white light color image 114 and the digital fluorescence color image 112 do not necessarily have to be recorded in the same color space, but this is preferred.

[0056] In a color space such as the RGB color space, each color is represented by a triplet of three integer values, where each integer value indicates the intensity of one of the primary colors R, G, B. Each numerical value represents a spatial coordinate, and each color band represents a coordinate axis. For example, the highest intensity red is indicated by the triplet [255, 0, 0]. The highest intensity green is indicated by [0, 255, 0], and the highest intensity blue is indicated by [0, 0, 255]. Therefore, the RGB color space is a three-dimensional space, and the CMYK color space will be a four-dimensional space. Color can be regarded as a point within the color space pointed to by a vector such as [0, 0, 255]. A multi-spectral or hyperspectral color space having n color bands will consequently be an n-dimensional color space accordingly, and each color is represented by n sets of color space coordinates.

[0057] The spectra recorded in the digital white light color image 114 and the spectra recorded in the digital fluorescence color image 112 are preferably complementary to each other, i.e., non-overlapping.

[0058] More specifically, the digital imaging system 102 can include a digital imaging system 102 for generating the digital fluorescence color image 112 and the digital white light color image 114. This digital imaging system 102 can include a white light color camera 110 and a fluorescence color camera 111.

[0059] The white light color camera 110 is configured to record the digital white light color image 114. In particular, the white light color camera 110 may be configured to generate a stream of the digital white light color image 114 in the form of a video stream. The white light color camera 110 is preferably configured to record digital images over the entire visible spectrum of the wavelengths shown above. The white light color camera 110 may be a CCD, CMOS, or multi-spectrum or hyperspectrum camera.

[0060] The fluorescence color camera 111 is configured to record the digital fluorescence image 112. In particular, the fluorescence camera 111 may be configured to generate a stream of the digital fluorescence color image 112 in the form of a video stream. The fluorescence color camera 111 may be configured to record the digital fluorescence color image 112 only with the fluorescence spectra of at least one phosphor 116, 118. The fluorescence camera 111 may be configured to record digital fluorescence images only in one or more narrow optical bands. These narrow bands should overlap with the fluorescence spectra of one or more phosphors 116, 118 where fluorescence is recorded. Preferably, the fluorescence spectra of the phosphor 116 and the second phosphor 118 are at least partially, preferably completely separated, whereby the fluorescence camera 111 can record light in two separate fluorescence bands spaced apart from each other.

[0061] The fluorescence color camera 111 may be a CCD, CMOS, or multi - spectral or hyperspectral camera. The white - light color camera 110 and the fluorescence color camera 111 are preferably of the same type, but this is not necessarily required.

[0062] The respective fields of view 184 of the cameras 110, 111 are preferably aligned or even coincide coaxially. Thus, the cameras 110, 111 preferably provide the same field of view 184 at the same viewing point and focal length. This results in the same representation of the object 106 within the images 112, 114 generated by the different cameras 110, 111. Both cameras 110, 111 can use the same objective lens 174.

[0063] If the coincidence of the viewing point and the field of view cannot be generated optically, it may be generated by image processing by applying a coincidence or alignment routine to the digital images 112, 114, as further explained below.

[0064] Preferably, the two cameras 110, 111 are operated synchronously. In particular, the exposure times may be synchronized. Thus, the medical observation device 100 may be configured to generate the digital white - light color image 114 and the digital fluorescence image 112 simultaneously.

[0065] Preferably, the gains of the two cameras 110, 111 are synchronized, i.e., the two cameras 110, 111 are adjusted simultaneously. Moreover, the ratio of the gain applied in camera 110 to the gain applied in camera 111 may be constant even when the gain is changed. Gamma correction and color adjustment or white balance may be switched off or may be maintained constant.

[0066] Due to any of the above features, the comparison, joint processing and / or combination of the two images 112, 114 is facilitated.

[0067] To separate the spectrum recorded in the digital white light color image 114 from the spectrum recorded in the digital fluorescence color image 112, i.e., to separate the reflection spectrum from the fluorescence spectrum, an optical color separation assembly 176 may be provided. This color separation assembly 176 can include optical elements such as a dichroic beam splitter 192 which may be dichroic. The color separation assembly 176 can further or alternatively include an optical white light filter 188 and / or an optical fluorescence filter 190.

[0068] The fluorescence filter 190 is preferably configured to transmit light in the fluorescence spectra of one or more phosphors 116, 118 and block light outside the fluorescence spectra.

[0069] The fluorescence filter 190 may be configured as a band-pass filter including one or more pass bands. Each pass band should overlap with the fluorescence emission spectra of the respective phosphors 116, 118 for which fluorescence is to be recorded. Since the fluorescence filter 190 is in the optical path between the beam splitter 192 and the fluorescence camera 111, only the wavelengths of the pass bands of the fluorescence filter 190 are transmitted to the fluorescence camera 111.

[0070] The white light filter 188 is preferably configured to block light within the fluorescence spectra of one or more phosphors 116, 118. The white light filter 188 may also be configured to block light within the fluorescence excitation spectra.

[0071] The white light filter 188 is preferably configured as a band-stop filter whose stop band corresponds to or at least includes the pass band of the fluorescence filter 190. The white light filter 188 is located in the optical path between the beam splitter 192 and the white light camera 110. Thus, the white light camera 110 records only wavelengths outside the stop band of the white light filter 188 and, therefore, also records wavelengths outside the pass band of the fluorescence filter 190.

[0072] Either the white light filter 188 or the fluorescent filter 190 may be an adjustable filter.

[0073] When the beam splitter 192 is a dichroic beam splitter, at least one of the filters 188, 190 may be omitted because in this case the optical spectrum filtering is already integrated in the dichroic beam splitter. Then, the above description of the passband and the stopband should also apply mutatis mutandis to the dichroic beam splitter 192.

[0074] The medical observation device 100 may further include an illumination assembly 178, which is preferably configured to illuminate the object 106 through the objective lens 174 through which the imaging system 102 records at least one digital image 112, 114. The illumination assembly 178 may be configured to selectively generate white light, i.e., light that is uniformly distributed across the entire visible spectrum, and fluorescence excitation light that includes only light of a wavelength that excites the fluorescence of at least one phosphor 116, 118. The illumination light generated by the illumination assembly 178 may be supplied to the objective lens 174 using the illumination beam splitter 180.

[0075] The illumination filter 179 may be provided depending on the phosphor and the excitation spectrum specific to its fluorescence. For example, when 5-ALA is used as the phosphor, the illumination filter may have a transmittance of 90% - 98% up to a wavelength of 425 nm, a transmittance of between 0.5% and 0.7% between wavelengths of 450 nm and 460 nm, a transmittance not exceeding 0.1% between wavelengths of 460 nm and 535 nm, and a substantially zero transmittance above a wavelength of 535 nm.

[0076] Instead of or in addition to the illumination filter 179, the illumination assembly 178 may include an adjustable light source that includes, for example, a number of LEDs or OLEDs of different colors.

[0077] The medical observation device 100 can further include an image processor 170. This image processor 170 can be a hardware module such as a microprocessor or a software module. The image processor 170 can be a combination of both a hardware module and a software module, for example, by using a software module configured to be executed on a specific processor such as a vector processor, a floating-point graphic processor, a parallel processor, and / or a plurality of processors. The image processor 170 can be part of a general-purpose computer 186 such as a PC.

[0078] The image processor 170 is configured to acquire a digital white light color image 114 and a digital fluorescence image 112. For example, the image processor 170 can be configured to acquire the digital white light color image 114 and the digital fluorescence image 112 from the memory 194 and / or directly from the cameras 110, 111. The memory 194 can be part of the image processor 170 or can be resident elsewhere in the medical observation device 100.

[0079] The image processor 170 is further configured to calculate a digital output color image 160 from the digital white light color image 114 and the digital fluorescence image 112. The digital output color image 160 is a color image represented in a color space. The color space of the digital output color image can be different from the color space of either the digital white light color image 114 or the digital fluorescence image 112. However, preferably, the color space of the digital output color image 160 is the same as the color space of the digital white light color image 114 and the digital fluorescence image 112.

[0080] In particular, the image processor 170 is configured to calculate a digital output color image 160 from the digital white light color image 114 and the digital fluorescence image 112 using the color conversion function 140. The color conversion function 140 may be any type of function, such as a one-dimensional or n-dimensional interpolation function. The color conversion function 140 may be stored in the memory 194.

[0081] Preferably, the color conversion function 140 is a linear conversion function. In particular, the color conversion function 140 may be a color conversion matrix 142. One dimension of the color conversion matrix 142 may be the sum of the number of color bands in the digital fluorescence color image 112 and the number of color bands in the digital white light color image 114, i.e., the sum of the dimensions of the color spaces of the images 112, 114. Another dimension of the color conversion matrix 142 may correspond to the number of color bands in the digital output color image 160, i.e., the dimension of the color space of the digital output color image 160.

[0082] If all of the images 112, 114, 160 are within the RGB color space, the dimensions of the color conversion matrix are preferably 6×3 or 3×6.

[0083] A particular color conversion matrix 142 may be selectable from a set of color conversion matrices 142a - d stored, for example, in the memory 194 within the medical observation device 100 or the image processor 170. For example, different color conversion matrices 142a - d may be stored in memory for different phosphors.

[0084] For example, the first color conversion matrix 142a represents the case where ICG is used as the phosphor 116 in the object 106, the second color conversion matrix 142b represents the case where 5-ALA is used as the phosphor 118 in the object 106, and / or the third color conversion matrix 142c can represent the case where 5-ALA and ICG are simultaneously used as the phosphors 116, 118 in the object 106. Similarly, a further color conversion matrix 142d may be used for other phosphors or for the binding of phosphors. In its simplest form, the color conversion matrix 142 separately performs the addition of intensities in each color band of the color spaces of the fluorescent color image and the white light color image.

[0085] Each different color conversion matrix 142 can represent different filter settings of the color separation assembly 176. Since different phosphors have different emission spectra, the wavelengths recorded by the white light color camera 110 and the fluorescent camera 111 are different for each phosphor. Therefore, for each phosphor, the color bands of the two cameras 110, 111 are used in different ranges, and different calibration matrices are required to adjust the relative intensities in the color bands of the images 112, 114.

[0086] The medical observation device 100 may be adjusted for different phosphors by reconfiguring the color separation assembly 176, for example, by replacing optical elements such as the filters 190 and / or 188, or the dichroic beam splitter 180, and selecting the corresponding color conversion matrix 142. The selection of the color conversion matrix 142 may be performed automatically depending on the current settings of the color separation assembly 176, or may be performed manually by the user.

[0087] The digital output color image 160 may be displayed on a display 132 integrated with the medical observation device 100. For example, the display 132 may be integrated with the eyepiece or the ocular lens 104 of the medical observation device 100.

[0088] The medical observation device 100 can include a direct optical path 134 from the object 106 through the objective lens 174 to the eyepiece lens 104. In such a case, the display may be a translucent display 132 positioned within the direct optical path 134, or may be projected into the direct optical path 134. A beam splitter 136 may be provided to split light between the optical eyepiece lens 104 and the digital imaging system 102. In one embodiment, up to 80% of the light may be directed towards the eyepiece lens 104.

[0089] Alternatively, the medical observation device 100 does not have a direct optical path 134, but can only display images from the integrated display 132. As a further alternative, the medical observation device may not have any display at all.

[0090] The medical observation device 100 can include an output interface 172 to which one or more (external) displays 182 may be connected. For this purpose, the output interface 172 can include standardized connectors and data transmission protocols such as USB, HDMI, DVI, DisplayPort, Bluetooth, etc. The external display may be a monitor, 3D goggles, eyeglasses, etc. Any combination of external displays may be connected to the output interface 172.

[0091] The computer 186 or the image processor 170 is connected to the digital imaging system 102 using one or more data transmission lines 196. The data transmission line may be wired, wireless, or partially wired and partially wireless. The computer 186 and / or the image processor 170 is not actually integrated into the medical observation device 100, but may be located physically separated from the digital imaging system 102. For this purpose, the digital imaging system 102 and the computer 186 and / or the image processor 170 may be connected to a network such as a LAN, WLAN, or WAN to which at least one display 182 is also connected.

[0092] According to a variant, the medical observation device 100 may be a stereoscope, but may include only two cameras for each stereoscopic channel. In one stereoscopic channel, a fluorescence color camera 111 is used and is configured to selectively record the white light reflectance as well, while in the other stereoscopic channel, a white light color camera 110 is used. In such an arrangement, when fluorescence is not used, a stereoscopic white light color image is provided, and when fluorescence is used, a monocular white light color image and a monocular fluorescence color image are provided. The above description and the following description are equally applicable to this configuration.

[0093] FIG. 2 shows, by reference numeral 200, a quantitative example of a first imaging spectrum 202 that may be recorded by a digital white light camera 110 and / or represented in a digital white light color image 114. The intensity I over the wavelength / color λ is shown normalized. The first imaging spectrum 202 is preferably extended over at least the visible spectrum 212.

[0094] As a mere example, the color space in which the first imaging spectrum 202 is recorded is an RGB color space having three primary colors or color bands 204, 206, and 208. One primary color 204 is blue, another primary color 206 is green, and the third primary color 208 is red. The sensitivities of the sensors of the white light color camera 110 in the different primary colors 204, 206, 208 are adjusted so that the sensitivity over the entire visible spectrum 212 is as constant as possible as a result.

[0095] If a color space other than RGB is used, the number, position, and / or width of the color bands may be different. Otherwise, there is no fundamental difference from the RGB color space.

[0096] The first imaging spectrum 202 does not include the fluorescence excitation light and the fluorescence emission spectrum of at least one phosphor 116, 118. Therefore, the first imaging spectrum 202 may include at least one cut-off band 210 that coincides with the fluorescence emission of at least one phosphor whose fluorescence is recorded by the fluorescence color camera 111. This cut-off band 210 is generated, for example, by the white light filter 188. The number, width and / or position of the cut-off band 210 depend on the number and type of phosphors observed in the object 106.

[0097] Reference numeral 220 indicates a second imaging spectrum 222 that may be recorded by the fluorescence color camera 111 and / or a second imaging spectrum 222 that may be represented in the digital fluorescence color image 112, respectively. As a mere example, the color space in which the second imaging spectrum 222 is recorded is also the RGB color space. The sensitivities of the sensors of the fluorescence color camera 111 in different primary colors 204, 206, 208 are adjusted so that the sensitivities are as constant as possible over the entire visible spectrum 212.

[0098] The spectra 202, 222 do not have to be recorded in the same color space, but this is preferred.

[0099] The second imaging spectrum 222 can include one or more pass bands 224. The number, position and / or width of the pass band depend on the number and type of phosphors used. At least one pass band 224 preferably corresponds to at least one cut-off band 210. At least one pass band is generated, for example, by the fluorescence filter 190.

[0100] The first imaging spectrum 202 and the second imaging spectrum 222 are complementary to each other. Preferably, they complement each other so as to cover the whole or most of the visible spectrum 212.

[0101] Each passband 224 of the second imaging spectrum 222 preferably overlaps with the fluorescence emission spectra 226, 228 of the phosphors 116, 118 on which fluorescence is recorded and also overlaps with one or more primary colors 204, 206, 208 of the color spectrum. For example, the fluorescence emission spectrum 226 of one phosphor 116 can overlap with all three primary colors 204, 206, 208. The sensor of the fluorescence camera 111 that records the color band 204 records only a small portion 230 of the fluorescence emission spectrum 226. The sensor of the fluorescence camera 111 that records the color band 206 records a large portion 232 of the fluorescence emission spectrum 226, while the sensor of the fluorescence camera 111 that records the color band 208 also records only a small portion 236 of the fluorescence emission spectrum 226.

[0102] In contrast, the fluorescence spectrum 228, if present in a particular case, is recorded only by the sensor of the fluorescence camera 111 that records the color band 208.

[0103] The color conversion function 140 is applied to both the digital white light color image 114 and the digital fluorescence color image 112 to obtain the digital output color image 160 whose spectrum is indicated by the reference numeral 250 in FIG. 2. Essentially, the spectrum 252 of the digital output image 160 results from the combination of the first imaging spectrum 202 and the second imaging spectrum 222.

[0104] Higher accuracy can be achieved by processing the individual spectra 202 and 222 as a single composite multi-spectral spectrum having numerical values of color bands corresponding to the sum of the color bands in the first imaging spectrum 202 and the second imaging spectrum 222. In other words, the digital fluorescence color image 112 and the digital white light color image 114 are co-processed as a single (virtual) multi-spectral image.

[0105] This will be described below with reference to FIG. 3. For simplicity, FIG. 3 shows the spectra of FIG. 2 in the RGB color space. Only a single passband 224 or a blocking band 210 is shown.

[0106] The digital white light color image 114 recorded in the first imaging spectrum 202 includes signals R1, G1, and B1, each representing the intensity I of its respective color band. Due to the blocking band 210, the signal G1 results from two separated wavelength bands. However, the sensor that records G1 cannot distinguish between these two wavelength bands.

[0107] The digital fluorescence color image 112 recorded in the second imaging spectrum 222 includes signals R2, G2, B2 in each color band.

[0108] Since the first and second imaging spectra 202, 222 are complementary to each other, each color band is divided into two signals, each signal arriving from a different camera 110, 111 and representing or equivalent to a sub-band of the color band. The color band 204 is divided into R1 and R2 respectively. The color band 206 is divided into G1 and G2 respectively, and the color band 208 is divided into B1 and B2 respectively. Preferably, there is no overlap between the various signals within the color band.

[0109] Thus, even when the first and second imaging spectra 202, 222 are recorded in the same color space using the same type of color camera, a multi-spectral image of the object 106 results, which in this case consists of six color bands R1, R2, G1, G2, B1, B2. This is schematically shown by reference numeral 300. It should be noted that this is independent of whether the fluorescence camera actually records fluorescence emission or reflectance.

[0110] In other words, at least one color band 204, 206, 208 of the color space of the digital output color image 160 is subdivided into two sub-bands R1, R2, G1, G2, B1, B2, where one of the two sub-bands is included in the digital fluorescence color image 112 and the other of the two sub-bands is included in the digital white light color image 114. Preferably, the two sub-bands within a color band do not overlap. They are preferably complementary. Most preferably, together they at least substantially complete their respective color bands. A sub-band can include or consist of two separated spectral bands. Each sub-band may itself be regarded as a color band.

[0111] The color conversion function 140 represents the subdivision of the color band into sub-bands R1, R2, G1, G2, B1, B2 determined by the cutoff band 210 and the passband 224. Since the amount of light collected by each camera 110, 111 in its sub-band is determined by the width and / or position of the sub-band, the color conversion function 140 needs to be adjusted for each different filter setting of the color separation assembly 176.

[0112] Thus, the digital white light image 114 and the digital fluorescence image 112 may be processed together as an image consisting of the combination of the color bands in the two images 112 and 114. This provides improved color resolution.

[0113] The color conversion function 140 may be applied in the form of a linear transformation using a color conversion matrix 142 to generate the digital output color image 160.

[0114] When the digital output color image 160 is represented in the RGB color space, a 6×3 or 3×6 color conversion matrix is used for the RGB signals R * , G * , B *To achieve this, it may be applied to the combined digital fluorescence image 112 and white light image 114 or their component signals or color space coordinates R2, G2, B2, R1, G1, B1. The matrix coefficients C11, C12, …, C63 may be determined experimentally.

[0115] As a result of applying the color conversion function 140, an output spectrum 302 represented by three RGB signals or color space coordinates is obtained.

[0116] The above conversion is applied to each image position or pixel.

[0117] FIG. 4 shows a schematic diagram of an imaging method that may be implemented as a computer-implemented method executed, for example, on an image processor 170.

[0118] In optional step 400, for example, using a white light color camera 110, a digital white light color image 114 is recorded. In optional step 402, for example, using a fluorescence camera 111, a digital fluorescence color image 112 is recorded. Steps 400 and 402 are optional because these images 112, 114 may be obtained from memory. As described above, these cameras 110, 111 are synchronized with respect to exposure time and locked to each other with respect to gain. That is, they are maintained at the same gain ratio. Gamma may be set to a fixed value, and preferably all automatic color adjustments are turned off.

[0119] In optional step 404, each of the images 112, 114 is demosaicked.

[0120] In optional step 406, one or both of the images 112 or 114 are aligned so that the same image features are geometrically identical with respect to size and orientation in each of the images 112, 114.

[0121] In step 408, color conversion is performed. Images 112, 114 may be linearly transformed, for example, using a color conversion matrix 142, to obtain a digital output color image 160.

[0122] In step 410, further post-processing may be performed. For example, the digital output color image 160 may be equalized, its contrast enhanced, and / or a color space conversion from RGB to sRGB etc., and / or gamma correction may be performed. In step 412, the digital output image 160 is displayed.

[0123] Some embodiments relate to a microscope that includes a system as described in connection with one or more of FIGS. 1-4. Alternatively, the microscope may be part of a system as described in connection with one or more of FIGS. 1-4, or may be connected to a system as described in connection with one or more of FIGS. 1-4.

[0124] FIG. 5 shows a schematic diagram of a system 500 configured to implement the method described herein. System 500 includes a microscope 510 and a computer system 520. Microscope 510 is configured to image and is connected to computer system 520. Computer system 520 is configured to implement at least a portion of the method described herein. Computer system 520 may be configured to execute a machine learning algorithm. Computer system 520 and microscope 510 may be separate entities, or may be integrated within a common housing. Computer system 520 may be part of the central processing system of microscope 510, and / or computer system 520 may be part of a sub-component of microscope 510, such as a sensor, actuator, camera, or illumination unit of microscope 510.

[0125] The computer system 520 may be a local computer device (e.g., a personal computer, laptop, tablet computer, or mobile phone) comprising one or more processors and one or more storage devices, or it may be a distributed computer system (e.g., a cloud computing system distributed across various locations such as local clients and / or one or more remote server farms and / or data centers, comprising one or more processors and one or more storage devices). The computer system 520 may include any circuit or combination of circuits. In one embodiment, the computer system 520 may include one or more processors, which can be of any kind. As used herein, a processor may contemplate any kind of computing circuit, such as, for example, a microprocessor of a microscope or microscope component (e.g., a camera), a microcontroller, a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a graphics processor, a digital signal processor (DSP), a multi-core processor, a field programmable gate array (FPGA), or any other kind of processor or processing circuit, but is not limited thereto. Other kinds of circuits that may be included in the computer system 520 may be, for example, custom circuits, application specific integrated circuits (ASICs), etc., such as, for example, one or more circuits (such as communication circuits) used in wireless devices such as mobile phones, tablet computers, laptop computers, two-way radios, and similar electronic systems. The computer system 520 may include one or more storage devices that may include one or more storage elements suitable for specific applications, such as main memory in the form of random access memory (RAM), one or more hard drives, and / or one or more drives for handling removable media such as compact discs (CDs), flash memory cards, digital video discs (DVDs), etc.The computer system 520 may include a display device, one or more speakers and a keyboard and / or a mouse, a trackball, a touch screen, a controller that may include a voice recognition device, or any other device that enables a user of the system to input information into the computer system 520 and receive information from the computer system 520.

[0126] Some or all of the steps may be performed by a hardware device (or using a hardware device) such as, for example, a processor, a microprocessor, a programmable computer, or an electronic circuit. In some embodiments, any one or more of the extremely important steps may be performed by such a device.

[0127] Depending on certain implementation requirements, embodiments of the present invention may be implemented in hardware or software. This implementation is executable by a non-transitory recording medium, which is a digital recording medium, etc. that stores electronically readable control signals that cooperate (or are capable of cooperating) with a programmable computer system to implement each method, and this may be, for example, a floppy disk, a DVD, a Blu-ray, a CD, a ROM, a PROM, an EPROM, an EEPROM, or a FLASH memory. Thus, the digital recording medium may be computer-readable.

[0128] Some embodiments of the present invention include a data carrier having electronically readable control signals that can cooperate with a programmable computer system so that any of the methods described herein are implemented.

[0129] Generally, embodiments of the present invention can be implemented as a computer program product comprising program code, which code is operative to implement any of the methods when the computer program product is executed on a computer. This program code may be stored, for example, on a machine-readable carrier.

[0130] Another embodiment includes a computer program stored on a machine-readable carrier for implementing any of the methods described herein.

[0131] Thus, in other words, an embodiment of the present invention is a computer program having program code for implementing any of the methods described herein when the computer program is executed on a computer.

[0132] Thus, another embodiment of the present invention is a recording medium (or data carrier or computer-readable medium) including a stored computer program for implementing any of the methods described herein when executed by a processor. The data carrier, digital recording medium or recording medium is typically tangible and / or non-transitory. Another embodiment of the present invention is an apparatus as described herein including a processor and a recording medium.

[0133] Thus, another embodiment of the present invention is a data stream or signal sequence representing a computer program for implementing any of the methods described herein. The data stream or signal sequence may be configured to be transferred, for example, via a data communication connection such as the Internet.

[0134] Another embodiment includes a processing means, for example, a computer or programmable logic device configured or adapted to implement any of the methods described herein.

[0135] Another embodiment includes a computer having an installed computer program for implementing any of the methods described herein.

[0136] Another embodiment of the invention includes an apparatus or system configured to transfer (e.g., electronically or optically) a computer program for implementing any of the methods described herein to a receiver. The receiver may be, for example, a computer, a mobile device, a storage device, etc. The apparatus or system may include, for example, a file server for transferring the computer program to the receiver.

[0137] In some embodiments, a programmable logic device (e.g., a field programmable gate array) may be used to perform some or all of the functions of the methods described herein. In some embodiments, the field programmable gate array may cooperate with a microprocessor to implement any of the methods described herein. Generally, and advantageously, the methods are implemented by any hardware device.

Description of the Reference Numerals

[0138] 100 Medical observation device 101L Stereoscopic subassembly for left channel 101R Stereoscopic subassembly for right channel 102 Digital imaging system 104 Eyepiece 106 Object 107 Biological tissue 110 White light color camera 111 Fluorescent color camera 112 Digital fluorescent color image 114 Digital white light color image 116 Phosphor 118 Second phosphor 132 Internal display 134 Direct optical path 136 Beam splitter 140 Color conversion function 142 Color conversion matrix 142a~142d Different color conversion matrices 160 Digital output color image 170 Image processor 172 Output interface 174 Objective lens 176 Color separation assembly 178 Lighting assembly 179 Lighting filter 180 Lighting beam splitter 182 Display 184 Field of view 186 Computer 188 White light filter 190 Fluorescent filter 192 Dichroic beam splitter 194 Memory 196 Data transmission line 200 Spectrum 202 First imaging spectrum 204 Primary color or color band 206 Primary color or color band 208 Primary color or color band 210 Blocking band 212 Visible spectrum or visible light range 220 Spectrum 222 Second imaging spectrum 224 Passband 226 Fluorescent emission spectrum of phosphor 228 Fluorescent emission spectrum of another phosphor 230 Part of the fluorescent emission spectrum in color band 204 232 Part of the fluorescent emission spectrum in color band 206 236 Part of the fluorescent emission spectrum in color band 208 250 Spectrum 252 Spectrum of digital output image 300 Multispectral spectrum obtained from the first and second imaging spectra 400 Recording of digital white light color images 402 Recording of digital fluorescence color images 404 Demosaicing 406 Alignment 408 Color conversion 410 Post-processing 412 Display 500 System 510 Microscope 520 Computer system λ Wavelength I Intensity Coefficients of the color conversion matrix C11, C12, … C63 Example of RGB color space R1, G1, B1, R2, G2, B2, R * , G * , B * (Intensity) signals / color space coordinates in each color band, or sub-band of the color space

Claims

1. A computer-implemented image processing method for generating a digital output color image (160) of an object (106), wherein the method comprises the following steps, namely: The steps include acquiring a digital white light color image (114) of the object (106) recorded in the first imaging spectrum (202), A step of acquiring a digital fluorescent color image (112) of the object (106) recorded in a second imaging spectrum (222), wherein the second imaging spectrum (222) overlaps with the fluorescence emission spectrum (226) of at least one phosphor (116), and unlike the first imaging spectrum (202), the second imaging spectrum (222) overlaps with the visible spectrum (212), and both the first and second imaging spectra (202, 222) overlap with the visible spectrum (212), The steps include generating the digital output color image (160) by combining the digital fluorescent color image (112) and the digital white light color image (114), A computer-implemented image processing method including [specific details omitted].

2. The first imaging spectrum (202) and the second imaging spectrum (222) are complementary to each other. The computer-based image processing method according to claim 1.

3. The aforementioned digital white light color image (114) is represented using at least three first color bands (R, G, B) in a first color space (RGB), The digital fluorescent color image (112) is represented in a second color space that includes at least three second color bands. The aforementioned digital output color image (160) is generated in a third color space that includes at least three third color bands. The first and second color bands are mapped onto the third color band of the digital output color image using a linear transformation. Each color band of the first color band and each color band of the second color band are input to the linear transformation as separate color bands. The computer-based image processing method according to claim 2.

4. The linear transformation includes a color transformation matrix having dimensions of numerical X × numerical Y, The numerical value X is the sum of the amount of the first color band and the amount of the second color band. The numerical value Y is the amount of color band in the third color space. The computer-based image processing method according to claim 3.

5. The first color space and the second color space are identical. The computer-based image processing method according to claim 3 or 4.

6. The first imaging spectrum (202) includes a first subband (R1, G1, B1) in the color bands (204, 206, 208) of the color space (RGB), The second imaging spectrum (222) includes a second subband (R2, G2, B2) in this color band, The first subband and the second subband are complementary to each other. The computer-based image processing method according to claim 5.

7. The color band of the third color space includes the first and second subbands, The computer-based image processing method according to claim 6.

8. The second imaging spectrum (222) includes the NIR wavelength, The computer-based image processing method according to claim 1.

9. The digital fluorescence color image (112) and the digital white light color image (114) are jointly processed as a digital multispectral image including at least five color bands. The computer-based image processing method according to claim 1.

10. A medical observation device (100), in particular a method (100) for operating a microscope or endoscope, wherein the method comprises the following steps, namely: The steps include: performing the computer-implemented image processing method described in claim 1; The steps include recording a digital white light color image (114) using a white light color camera (110), The steps include recording a digital fluorescent color image (112) using a fluorescent color camera (111), A method (100) including the following.

11. The white light color camera (110) and the fluorescent color camera (111) are synchronized with respect to at least one of the exposure time and gain. The method according to claim 10.

12. Image processor (170) for microscope or endoscope, The aforementioned image processor (170) A digital white light color image (114) of the object (106) recorded in the first imaging spectrum (202) is acquired. The system is configured to acquire a digital fluorescence color image (112) of the object (106) recorded in a second imaging spectrum (222), The second imaging spectrum (222) overlaps with the fluorescence emission spectrum (226) of at least one phosphor (116), and unlike the first imaging spectrum (202), both the first and second imaging spectra (202, 222) overlap with the visible spectrum (212). The image processor (170) is configured to generate a digital output color image (160) by combining the digital fluorescent color image (112) and the digital white light color image (114). Image processor (170).

13. A medical observation device (100) such as a microscope or endoscope, wherein the medical observation device (100) is The image processor (170) according to claim 12, A fluorescent color camera (111) configured to record a digital fluorescent color image (112), A white light color camera (110) configured to record a digital white light color image (114), A medical observation device (100) including the following.

14. A method for using a fluorescent color camera (111) in a medical observation device, The medical observation device (100) is for recording a portion (222) of the spectrum (250) of a digital output color image (160) generated by the medical observation device (100), and the medical observation device (100) further includes a white light color camera (110) configured to record another portion (202) of the spectrum (250) of the digital output color image (160). How to use.

15. A computer program product or computer-readable medium, wherein when the program is executed by a computer, the computer includes an instruction that causes the computer to execute the method described in claim 1.

Images